Psychometrics.Defensible exams build confidence and certainty.

Introduction

We design exams guided by psychometric science and a vital mission: to ensure learners are competent and qualified.


The science of testing.

We use precise and proven science to create defensible and fair exams.

Psychometrics is the science of designing, planning and implementing defensible assessments. Yardstick Assessment Strategies (YAS) psychometricians bring superior technical expertise and a client-focused attitude to create processes and products that help ensure students, candidates and professionals are assessed fairly and reliably.

Measuring competence.

We verify your candidates’ test results, so you can defend them.

Psychometrics is the science of designing, planning and implementing defensible assessments. Yardstick Assessment Strategies (YAS) psychometricians bring superior technical expertise and a client-focused attitude to create processes and products that help ensure students, candidates and professionals are assessed fairly and reliably.

Our approach.

Your results are strongest when we work together.

Psychometric science is complex, but at YAS, we approach it with a spirit of openness and curiosity. Where some might guard their deep knowledge of test science, we share our expertise, experience and leadership freely with the industries and clients we serve. Working together, with a common understanding, we build an assessment that is defensible, relevant, fair and perfectly tailored to your needs.

Want to make your high stakes examinations defensible? Talk to us.

Yardstick Assessment Life Cycle.

Overview Stage 1. Defining target and creating specifications Stage 2. Item development Stage 3. Assembling exam form(s) Stage 4. Test administration Stage 5. Item and test analysis Stage 6. Standard setting

Overview

Our testing experts use industry best practices described in the Assessment Life Cycle. These rigorous methods, and the precise and proven science  behind them, produce well-designed exams that are defensible and fair. From item development through to exam delivery and analysis, our experts reach out to you as partners, ensuring you understand the process and feel supported and engaged through its every step.

Stage 1. Defining target and creating specifications

Whether conducting a job analysis, building a competency profile, or defining a curriculum, YAS consults subject matter experts, practitioners and published materials to identify the skills and knowledge required for mastery of a subject area. Based on this analysis, we develop an examination blueprint, which identifies how each competency should be weighted in your exam.

Specialized services:

  • Surveys and consultation
  • Competency weighting
  • Blueprint development

Stage 2. Item development

Having the right number and type of questions is essential for accurately measuring qualifications. Item development is careful work, requiring meticulous review and editing. From training your subject matter experts on writing best practices and evaluating your draft items, to project managing your item development workflow, our psychometricians are available to help each step of the way.

Specialized services:

  • Workshops and guides
  • Professional item development
  • Translation services

Stage 3. Assembling exam form(s)

YAS draws questions from the item bank to fit the unique constraints of your exam, including your blueprint, total number and types of items, number of case scenarios, and so on. Using specialized software with optimization technology, YAS can automate this process.

Specialized services:

  • Automated Test Assembly (ATA)
  • Facilitation of validation process
  • Practice test development

Stage 4. Test administration

In Stage 4, candidates finally have the opportunity to demonstrate what they know and can do. Our psychometricians work with our exam administration team to ensure that the conditions for administration and handling of sensitive information is secure and consistent with the stakes, or seriousness of your exam.

Specialized services:

  • Paper to computer-based transition
  • Collusion detection
  • Customized candidate results reporting

Stage 5. Item and test analysis

At this stage, we review exam results to ensure that both the test, and each item that comprises it, works as they should. YAS can evaluate the overall reliability of your exam as well as identify items that are too easy, too hard, or not sufficiently clear. Based on post-administration reports, you can decide whether to retain, revise or remove questions for future assessments.

Specialized services:

  • Classical Test Theory (CTT) item analysis
  • Item Response Theory (IRT) item analysis
  • Differential Item Functioning (DIF) analysis

Stage 6. Standard setting

The passing score, or “cut score” serves as a dividing line between candidates that are judged competent, meeting a certain level of knowledge and skill, and not competent. Having an accurate passing score is of the utmost importance for candidate fairness and examination defensibility.

Specialized services:

  • Consultation and training of standard setting methods
  • Facilitation of standard setting panel
  • Automated Angoff estimation

Sharing our knowledge

Assessment Life Cycle Whitepapers

The Yardstick Assessment Strategies (YAS) White Paper library is a fantastic resource for organizations wanting to learn more about psychometrics and how they relate to high stakes assessment. Our goal at YAS is to demystify psychometric processes and work collaboratively with our clients.

To gain access to our white paper downloads please fill out the form. Once your details have been submitted, you will see a download link underneath the whitepaper descriptions below.

[contact-form-7 404 "Not Found"]