Educational History. Professional Experience

A.E. Ferster 1 Amanda E. Ferster

121 Cedar Rock Trace Athens, GA 30605

770.714.4570 [email protected]

Educational History

2013 Ph.D., in Educational Psychology

Focus: Quantitative Methods University of Georgia

1998 M.Ed., in Educational Psychology

Focus: School Psychology

Edinboro University of Pennsylvania

1997 B.A. in Psychology

Edinboro University of Pennsylvania

Professional Experience

2014-Present Assistant Director, Georgia Center for Assessment, University of Georgia, Athens, GA

Lead the Evaluation, Measurement, and Reporting & Design Division of the Georgia Center for Assessment through the management of psychometric, data management, and reporting components of large-scale assessment contracts. Serve as the Principal Investigator for contracts through development of Scope of Work(s), project budgeting, milestone monitoring, operational psychometrics, programming, and supervision of division staff.

2013-2014 Assistant Research Scientist, Georgia Center for Assessment, University of Georgia, Athens, GA

Program Manager of the Georgia Criterion-Referenced Competency Tests-Modified Assessment Program. In this role, I coordinated the activities of the test development, psychometric, production and

administrative teams; ensured the quality of psychometric and test development deliverables; collaborated with sub-contractors; and facilitated program workshops and meetings.

Program Manager of the Georgia Student Growth Model Report for Parents Program. In this role, I collaborated with the Georgia Department of Education regarding program milestones and evaluation instruments and assisted the Georgia Center for Assessment design team through data management, quality assurance, and program supervision.

A.E. Ferster 2 2012-2013 Psychometrician I, Center for Educational Testing & Evaluation,

The University of Kansas, Lawrence, KS

Served as a member of the psychometric and test development teams for the Dynamic Learning Maps Consortium. Dynamic Learning Maps is a next-generation alternate assessment system with

online operational administration slated for the 2014-2015 academic year. In this position, I recommended scoring strategies for Technology Enhanced Item Types (TEIs); developed pilot and field test plans; initiated the development of the program’s validity arguments and plan to collect evidence; collaborated with team on cognitive laboratory planning and protocol development; collaborated with the technology team to ensure program needs were met within the assessment delivery system and the implementation of the student Personal Needs and Preferences Profile (PNP) component of the Accessible Portable Item Protocol (APIP); assisted content staff in developing item-writing guidelines and the assessment content distribution; and presented assessment system progress, plans, and technical issues to state members and advisory committees.

2009-2012 Research Professional III, Georgia Center for Assessment, University of Georgia, Athens, GA

Conducted psychometric analyses for the Georgia state-wide Alternate Assessment based on Modified Achievement Standards (AA-MAS)—the GA CRCT-M (i.e., calibration, equating, differential item functioning, and classical item analyses); recommended assessment development procedures to client (i.e., established sampling methodology, psychometric operational form guidelines, and equating plans); authored chapters of the CRCT-M Standard Setting Report and the Operational Technical Manual; assisted in the instruction and

supervision of interim psychometric staff and graduate assistants, managed the reporting of the high-stakes Gwinnett Gateway Assessment program; served as an advisor to project

coordinators and content specialists during form development; generated user-interface programs to facilitate assessment activities (i.e., Visual Basic rater scanning, Visual Basic for Applications form development, and Production Facility cut score impact projection programs); and presented the technical aspects of programs to Technical Advisory Committees.

2006-2009 Assessment Specialist, Assessment Research & Development, Georgia Department of Education, Atlanta, GA

Replicated service providers’ psychometric analyses and reporting programs for quality assurance (i.e., pre-equating, scaling tables, and data management routines); served as a resource during assessment development activities (i.e., provided support to team during item/data review, standard setting, and vertical articulation); collaborated with service-providers on scan, scoring, and reporting procedures; produced user-interface analysis programs for local staff, generated electronic aggregations and performance briefs; and conducted assessment research as requested by state leadership.

A.E. Ferster 3 2004-2006 School Improvement Specialist, School Improvement,

Georgia Department of Education, Atlanta, GA

Developed assessment reporting programs, instructional publications, and training modules for local educational agencies (e.g., 20,000 copies of the Data Utilization Guide were distributed to schools with over 50 on-site training sessions); collaborated with team to develop formative assessment and agency evaluation guides; analyzed assessment data/educational indicators to prioritize the level of support offered to local education agencies; and assisted with program evaluation (e.g., evaluation of School Reform Models, Leadership Facilitators, and Performance on School Standards).

2002-2004 Research, Evaluation & Testing Specialist, Testing Division, Georgia Department of Education, Atlanta, GA

Aggregated student-level assessment data to disseminate electronic results to local systems; assisted with program evaluation (e.g., evaluation of Charter Schools and SWD Inclusion Practices), served as a resource during data reviews, and provided data utilization training to Regional Education Service Agencies.

1999-2002 Statistical Analyst II, University Planning, Institutional Research, & Continuous Improvement,

Edinboro University of Pennsylvania, Edinboro, PA

Extracted and analyzed university data requested by the Pennsylvania State System of Higher Education, Pennsylvania Department of Education, and the National Center for Education Statistics; served as a resource to faculty conducting research through design, implementation, and analysis; and evaluated Enrollment, Management, and Retention initiatives (e.g., Living and Learning Communities, Staff -Student Mentor Program, and the At-risk Remediation Program).

Grants & Contract Activity

2014 Principal Investigator, Georgia Student Growth Model Report for Parents. $255,569.

2014 Co-Principal Investigator, Georgia High School Graduation Test. $755, 162.

2014 Principal Investigator, CRCT-M No Cost Extension. $201,000. 2009 Development of the syntax to evaluate Georgia local agencies for

recognition programs. Georgia Department of Education. $4,500.

2000 Factors that impact student retention. Pennsylvania State System of Higher Education Performance and Outcome Plan Grant. $10,000.

A.E. Ferster 4

Academic Teaching Experience

Spring, 2014 Adjunct Assistant Professor, University of Georgia Applied Analysis of Variance Methods in Education

Instructed approximately 50 graduate students, prepared lecture material and statistical package lab activities and recordings, graded student work, and held office hours for students.

Student Course Evaluations: N=49, n=21. Scale: 1 (Strongly Disagree) – 5 (Strongly Agree)

Question Mean Median

The course was effectively organized 4.7 5

Assignments and activities were clearly related to course goals 4.9 5

The instructor was knowledgeable and well-prepared 4.7 5

Assignments and activities were useful for helping me learn 4.7 5 New skills and/or concepts were presented in ways I could understand 4.6 5 The instructor was open to students’ questions and comments 4.9 5

The instructor provided useful feedback on student work 4.8 5

Course work was evaluated according to clear expectations 4.7 5

This course challenged me to think and learn 4.4 5

Spring, 2010 Graduate Teaching Assistant for Structural Equation Modeling Fall, 2009 Graduate Teaching Assistant for Analysis of Variance

Spring, 2009 Graduate Teaching Assistant for Structural Equation Modeling

Assistantships, Internships & Practicum

University of Georgia, Athens, GA

1997-1999 Graduate Research Assistant, Institutional Research, Edinboro University of PA, Edinboro, PA

1998 School Psychology Practicum,

General McClane School District, Edinboro, PA

1993-1995 Psychological Statistics Tutor & Peer Academic Tutor, Office of Students with Disabilities, Edinboro, PA

A.E. Ferster 5

Publications & Technical Documents

Ferster, A.E (2013). The Criterion Referenced Competency Tests—Modified (CRCT-M) Item and Data Review Workshop Report. Athens, GA: Georgia Center for Assessment, University of Georgia

Bandalos, D.L., Davis, S., Ferster, A.E., & Samuelson, K. (2011). Validation of high stakes testing in accountability systems. In K. Geissinger and J. Boivard, (Eds.),

Contemporary Issues in High Stakes Testing. American Psychological Association. Calhoun, L., Cramer, S., Ferster, A.E., Gonyea, M. (2011). The Criterion Referenced

Competency Tests—Modified (CRCT-M) Operational Technical Report. Athens, GA: Georgia Center for Assessment, University of Georgia.

Calhoun, L., Choi, H., Cramer, S., Ferster, A.E. (2011). The Georgia

CRCT-M Modified Angoff Standard Setting Technical Report. Athens, GA: Georgia Center for Assessment, University of Georgia.

Ferster, A.E. (2010). Georgia Kindergarten Inventory of Developing Skills validity study in support of the argument: GKIDS provides educators with information regarding the level of instructional support needed by students entering first grade. Athens, GA: Georgia Center for Assessment, University of Georgia.

Cramer, S., & Ferster, A.E. (2010). Gwinnett Gateway annual technical report. Athens, GA: Georgia Center for Assessment, University of Georgia.

Ferster, A.E. (2009). Five-year proposal for investigating the consequential validity of Georgia’s Assessment System. Atlanta, GA: Georgia Department of Education.

Ferster, A.E., & Calhoun, L. (2006). The 2006-2007 Data Utilization Guide: A resource guide for Georgia Educators. Atlanta, GA: Georgia Department of Education.

Ferster, A.E., & Calhoun, L. (2005). The 2005-2006 Data Utilization Guide: A resource guide for Georgia Educators. Atlanta, GA: Georgia Department of Education.

Ferster, A.E., & Burks, K. (2001). Edinboro University’s 2000-2001 Fact Book. Edinboro, PA: Edinboro University of Pennsylvania.

Ferster, A.E., & Algarez, J. (2000). Edinboro University’s 1999-2000 Fact Book. Edinboro, PA: Edinboro University of Pennsylvania.

A.E. Ferster 6

Select Presentations

Ferster, A.E., Zhao, F., & Clark, A. (April, 2014). Understanding the academic profiles of students participating in the Alternate Assessment based on Alternate Achievement Standards: A cluster analysis. Paper presented at the 2014 Annual Meeting of the American Educational Research Association in Philadelphia, PA.

Ferster, A.E., Zhao, F., & Qin, L. (May, 2013). A program to assist non-measurement faculty with their assessment practices. Program presented at the 2013 Annual Meeting of the Association for Institutional Research in Long Beach, CA.

Ferster, A.E., & Templin, J. (April, 2013). An evaluation of item level design features via an extension of the Linear Logistic Test Model with Random Effects. Paper presented at the 2013 Annual Meeting of the National Council on Measurement in Education in San Francisco, CA.

Ferster, A.E., Shaftel, J., Sheinker, A., & Yung, S. (April, 2013). An argument based approach to the reliability of the First Contact Survey. Poster presented at the 2013 Annual Meeting of the American Educational Research Association in San Francisco, CA.

Ferster, A.E., Shaftel, J., Sheinker, A., & Whetstone, P. (November, 2012). Are the right students participating in the Alternate Assessment based on Alternate Achievement Standards? Poster presented at the 2012 Annual TASH Meeting in Long Beach, CA.

Nixon, C., Algoloz, C., Ferster, A.E., Jenkins, C., & Templin, J. (April, 2012). A diagnostic model for GKIDS performance ratings. Poster presented at the 2012 Annual Meeting of the National Council on Measurement in Education in Vancouver, BC, Canada.

Ferster, A.E. (September, 2010). Evaluating the efficacy of item modifications under the Rasch model, mixed-Rasch, and invariance procedures. In-progress research presented at the 8th Annual Society of Multivariate Experimental Psychology Graduate Student

Preconference in Atlanta, GA.

Ferster, A.E., & Kim, S.-H. (July, 2010). Compatibility of item parameter estimates. Poster presented at the 75th Annual International Meeting of the Psychometric Society in Athens, GA.

Kim, S.-H., & Ferster, A.E. (June, 2010). Use of academic assessment results to improve student academic achievement: Balanced assessment system. Paper presented at the KEDI-KAERA Educational Policy Joint Symposium in Seoul, Korea.

Ferster, A.E. (March, 2007). Dissemination & utilization of student level assessment files in Georgia. National Center for Education Statistics (NCES) Management Information Systems Conference, Atlanta, GA.

Vahlsing, J., & Ferster, A.E. (November, 2006). Got data? Georgia’s single statewide accountability system. Georgia Educational Technology Conference, Atlanta, GA.

A.E. Ferster 7 Ferster, A.E. (May, 2006). Creating a balanced assessment system, Georgia Regional Service

Agency Annual Conference. St. Simons, GA.

Ferster, A.E., & Calhoun, L. (August, 2005). The 2005-2006 Data Utilization Guide: A resource for Georgia educators. Georgia Association of Educational Leaders, Jekyll Island, GA.

Select Training Sessions

Ferster, A.E. (June, 2008). Item writing guidelines. Forsyth Counselor Assessment Kick-off, Cumming, GA.

Bandalos, D.L., & Ferster, A.E. (April, 2007). Teaching educational measurement. National Council on Measurement in Education, Chicago, IL.

Ferster, A. E., & Vahlsing, J. (November, 2006). Analyzing data with macros: Programs within the 2006-2007 Georgia Data Utilization Guide. Georgia Educational Technology Conference, Atlanta, GA.

Calhoun, L., Ferster, A.E., Fincher, M., & Komatsu, L. (September, 2005). Assessment literacy & constructing formative assessments via the On-line Assessment System (OAS). Training module presented to Regional Education Service Agency Staff. Macon, GA. Ferster, A.E., & Calhoun, L. (Spring, 2003). Managing assessment data. Georgia Department of

Education Desire2Learn online professional development course presented to local system test coordinators.

Calhoun, L., & Ferster, A.E. (Fall, 2002). Writing within the content areas. Georgia Department of Education Desire2Learn online professional development course presented to local educators.

Ferster, A.E. (August-September, 2002). Interpretation of aggregate and student level state assessment reports. Training presented to new local test coordinators at the Annual Test Coordinator’s Regional Workshop(s).

Service & Outreach Activities

American Educational Research Association (AERA) Association for Institutional Research (AIR)

American Psychological Association (APA)

National Council for Measurement in Education (NCME)

2014 AERA Rasch Special Interest Group Session Chair 2013-2014 Manuscript review: Applied Psychological Measurement 2011-2012 NCME Annual Conference Proposal review

A.E. Ferster 8 2010 Psychometric Society: 75

th

Annual Meeting Local Organizing Committee 2008 Teacher Evaluation (CLASS KEYS) Advisory Council

2005 & 2008 Development Committee for Georgia Leadership Institute for School Improvement Data Module

2005-2007 Teaching Leader, Georgia Leadership Institute for School Improvement

2006 Task Force on Disproportionality within SWD (Students classified with a disability) 2003-2004 Developed/delivered data management professional learning sessions for

GaDOE employees

2003 Assessment Dissemination Task Force

1999-2002 Sorority Advisor, Alpha Sigma Alpha, Edinboro University

2001 Strategic Study Group, Evaluation of the Graduate Assistantship Award Process, Edinboro University

1998 Treasurer, School Psychology Organization

1998 Student Representative, School Psychology Program Review

Honors & Recognition

2007-2010 Fellowship for Graduate Study, Association for Institutional Research-National Center for Education Statistics . $30,000. 2009 AIR-NCES National Summer Data Policy Institute Fellowship

2008 GaDOE Recognition for Terrific Team: Assessment Research & Development 2006 Compass Award for School Improvement: GaDOE

2005 GaDOE Recognition for Development of Data Utilization Guide 2003 Selected to participate in the National Center for Education Statistics National Assessment of Educational Progress (NAEP)

2003 GaDOE Recognition for Adequate Yearly Progress Development Team

Computing

SPSS LISREL Winsteps/Facets Captivate VBA

SAS Mplus SSI IRT Suite Desire2Learn R

IRTPRO Camtasia

Professional Development

Association for Institutional Research: Excel Macro Boot camp: May, 2013 NCME Training Session: Multidimensional Item Response Theory: April, 2013

NCME Training Session: A Generalized Linear Mixed Model Approach to IRT: April, 2012 NCME Training Session: Bayesian Networks in Educational Assessment: April, 2012 NCME Training Session: Standard Setting in the Real World: April, 2012

University of Georgia, College of Education: Statistical Analysis R Workshop: January, 2012 Institute for Interdisciplinary Research: Validation: A General Framework & Prototype: July, 2011 Institute for Interdisciplinary Research: Diagnostic Classification Models: October, 2010

A.E. Ferster 9 NCME Training Session: Introduction to Rule Space and Q-Matrix Method: April, 2009

University of Kansas Item Response Theory Advanced Statistics Camp: June, 2007 Introduction to Rasch Measurement Course, University of Illinois at Chicago: April, 2007 Data Retreat Training of Trainers: March, 2006

SREB Leadership Curriculum Training Module: March, 2004 SPSS Professional Development Courses: January-April, 2003

Intermediate Topics Survey Methodology Survey Analysis

Syntax I Syntax II SPSS Scripts

Statistical Analysis Advanced Statistical Analysis