Psychometrics, Data Analysis and Research
Alignment Studies
WCA develops alignment studies through the process of aligning state standards and assessments by capturing the information about the standards and assessments acquired during the alignment review process and generating statistical reports that reveal the degree of alignment based on three criteria: 1) Categorical Concurrence 2) Depth-of-Knowledge Consistency 3) Range-of-Knowledge Consistency
Correlation Studies
WCA provides correlation studies focused on providing information that demonstrates the relationship between two measurement instruments. This type of study provides general correlation, but it does not predict specific performance on a high-stakes measure or provide cut scores.
External Evaluation Studies
WCA provides external evaluation studies for clients including: 1) Examining the effectiveness of curriculum, instruction, and intervention when utilizing a specific instrument as an outcome measure 2) Evaluating the impact on student achievement that interventions may have when assessment or data-driven decision making is a critical component of the intervention process.
Item Calibration Studies
WCA calibration studies are performed once the items have been field tested either via paper test forms, on-line test forms or through an internal item embedding system. Item Calibration Studies Include: model fitting, test item parameter estimation and item fit measures.
Linking/Equating Studies
WCA conducts Linear Equating studies for clients. Linear Equating Studies focus on establishing proficiency cut-points on assessments that are comparable to the cut scores, for example, on a state high-stakes test. Concurrent scores from the two tests are used to establish performance on the assessment and proficiency levels on state tests.
Performance Standard Setting Studies
WCA provides standard setting services to help establish cut-points on existing or newly created measures using a variety of methodologies (e.g., Angoff, Bookmark, Alignment, Wright Maps, etc.).
Program Efficacy Research
WCA designs and conducts program efficacy research studies to help clients establish an evidence base for the product or service.
Psychometric Consultation
WCA provides Psychometric Consultation to clients, including: 1) Introductory meetings to review research requests 2) Reviews of existing research and other supporting documentation 3) Research proposal addressing client's needs 4) Assistance in responding to RFP requests.
Reliability Analysis
WCA develops reliability studies to examine the internal consistency of measures by determining how well items correlate to one another.
Research Design Methodology
WCA provides advice and consultation on research designs for study proposals and execution. This may include randomized trials, non-equivalent group designs, propensity matching designs, single group treatment designs, or case studies.
Scale Development
WCA develops and validates measurement instruments and scales for client use. We have developed measures ranging from reading skills for English Learners to statistical thinking and computational thinking measures for aspiring college students.
Statistical Analysis
WCA statistical analysis includes but is not limited to: 1) Assessment Data, 2) Survey Data, 3) Program Data, and 4) Other Outcome data (e.g., Social-Emotional Learning, STEM Self-Efficacy).
Test Validation Studies
WCA test validation services provide evidence to support the validity and/or reliability of the assessment instrument of interest.
Predictive Validity Studies
WCA perform predictive validity studies focused on the use of one measurement instrument to predict performance on another measurement instrument, for example, state tests or other high-stakes measures. This type of study takes the data provided and establishes a relationship between the two assessments. Once the relationship between the two assessments is established, the resulting information can be used to help educators. For example, the information can be used to develop cut scores that correspond to state test cut scores defining the various proficiency levels.
DIF Analysis/Measurement Invariance
WCA provides Differential Item Functioning (DIF) Analysis used to determine if test questions are fair and appropriate for assessing the knowledge of various ethnic/minority groups (or underrepresented groups). Measurement Invariance testing ensures tests and assessments operate comparably across groups, settings, or time points.
Literature Review
WCA literature review services summarize research evidence regarding a topic or question to better serve the client’s interests.
Qualitative Data Collection and Interpretation
WCA conducts one-on-one interviews with staff, customers, or focus groups to get detailed qualitative data that is then summarized and presented to clients in terms of emerging themes, topics, sentiments, and findings.
Research Team Development
WCA advises clients to develop their own internal Research team, including setting research goals, identifying staffing needs, recruiting and interviewing prospective hires, advising team on best practices.
Contact Us to learn more
about how West Coast Analytics
can customize a research strategy that directly
supports your program goals.
about how West Coast Analytics
can customize a research strategy that directly
supports your program goals.