|
Psychometrics
|
Psychometrics is the science of psychological and educational measurement: the discipline that ensures assessments, surveys, and research instruments actually measure what they’re intended to measure, consistently and fairly.
At West Coast Analytics, psychometric rigor is at the core of everything we do. We provide consultation and analysis across the full psychometric spectrum, from foundational reliability and validity work to advanced modeling, including computer adaptive testing (CAT), and large-scale technical documentation. Whether you’re developing a new instrument from scratch or evaluating the integrity of an existing one, our team brings the depth and experience your project demand.
At West Coast Analytics, psychometric rigor is at the core of everything we do. We provide consultation and analysis across the full psychometric spectrum, from foundational reliability and validity work to advanced modeling, including computer adaptive testing (CAT), and large-scale technical documentation. Whether you’re developing a new instrument from scratch or evaluating the integrity of an existing one, our team brings the depth and experience your project demand.
|
Our specific capabilities span the entire assessment lifecycle, offering the precise analytical tools you need to ensure validity, fairness, and defensibility.
From initial item development to long-term impact analysis, we deliver actionable data and clear insights tailored to your project’s goals. Explore our core assessment services to discover how we can elevate your assessment program, or contact us to discuss your unique project needs. |
Alignment Studies
WCA develops alignment studies through the process of aligning state standards and assessments by capturing the information about the standards and assessments acquired during the alignment review process and generating statistical reports that reveal the degree of alignment based on three criteria: 1) Categorical Concurrence 2) Depth-of-Knowledge Consistency 3) Range-of-Knowledge Consistency Correlation Studies WCA provides correlation studies focused on providing information that demonstrates the relationship between two measurement instruments. This type of study provides general correlation, but it does not predict specific performance on a high-stakes measure or provide cut scores. External Evaluation Studies WCA provides external evaluation studies for clients including: 1) Examining the effectiveness of curriculum, instruction, and intervention when utilizing a specific instrument as an outcome measure 2) Evaluating the impact on student achievement that interventions may have when assessment or data-driven decision making is a critical component of the intervention process. Item Calibration Studies WCA calibration studies are performed once the items have been field tested either via paper test forms, on-line test forms or through an internal item embedding system. Item Calibration Studies Include: model fitting, test item parameter estimation and item fit measures. Linking/Equating Studies WCA conducts Linear Equating studies for clients. Linear Equating Studies focus on establishing proficiency cut-points on assessments that are comparable to the cut scores, for example, on a state high-stakes test. Concurrent scores from the two tests are used to establish performance on the assessment and proficiency levels on state tests. Performance Standard Setting Studies WCA provides standard setting services to help establish cut-points on existing or newly created measures using a variety of methodologies (e.g., Angoff, Bookmark, Alignment, Wright Maps, etc.). Program Efficacy Research WCA designs and conducts program efficacy research studies to help clients establish an evidence base for the product or service. Psychometric Consultation WCA provides Psychometric Consultation to clients, including: 1) Introductory meetings to review research requests 2) Reviews of existing research and other supporting documentation 3) Research proposal addressing client's needs 4) Assistance in responding to RFP requests. Reliability Analysis WCA develops reliability studies to examine the internal consistency of measures by determining how well items correlate to one another. Research Design Methodology WCA provides advice and consultation on research designs for study proposals and execution. This may include randomized trials, non-equivalent group designs, propensity matching designs, single group treatment designs, or case studies. Scale Development WCA develops and validates measurement instruments and scales for client use. We have developed measures ranging from reading skills for English Learners to statistical thinking and computational thinking measures for aspiring college students. Statistical Analysis WCA statistical analysis includes but is not limited to: 1) Assessment Data, 2) Survey Data, 3) Program Data, and 4) Other Outcome data (e.g., Social-Emotional Learning, STEM Self-Efficacy). Test Validation Studies WCA test validation services provide evidence to support the validity and/or reliability of the assessment instrument of interest. Predictive Validity Studies WCA perform predictive validity studies focused on the use of one measurement instrument to predict performance on another measurement instrument, for example, state tests or other high-stakes measures. This type of study takes the data provided and establishes a relationship between the two assessments. Once the relationship between the two assessments is established, the resulting information can be used to help educators. For example, the information can be used to develop cut scores that correspond to state test cut scores defining the various proficiency levels. DIF Analysis/Measurement Invariance WCA provides Differential Item Functioning (DIF) Analysis used to determine if test questions are fair and appropriate for assessing the knowledge of various ethnic/minority groups (or underrepresented groups). Measurement Invariance testing ensures tests and assessments operate comparably across groups, settings, or time points. Literature Review WCA literature review services summarize research evidence regarding a topic or question to better serve the client’s interests. Qualitative Data Collection and Interpretation WCA conducts one-on-one interviews with staff, customers, or focus groups to get detailed qualitative data that is then summarized and presented to clients in terms of emerging themes, topics, sentiments, and findings. Research Team Development WCA advises clients to develop their own internal Research team, including setting research goals, identifying staffing needs, recruiting and interviewing prospective hires, advising team on best practices. |
Contact Us to learn more
about how West Coast Analytics
can customize a research strategy that directly
supports your program goals.
about how West Coast Analytics
can customize a research strategy that directly
supports your program goals.