Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Since the first tests were developed 2000 years ago for entry into civil service of Imperial China, test security has been a concern.  The reason is quite straightforward: most threats to test security are also threats to validity, and the decisions we make with test scores could therefore be invalid, or at least suboptimal.  It is […] The post How do I develop a Test Security Plan? appeared first...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • The standard error of measurement is one of the core concepts in psychometrics.  One of the primary assumptions of any assessment is that it is accurately and consistently measuring whatever it is we want to measure.  We therefore need to demonstrate that it is doing so.  There are a number of ways of quantifying this, […] The post The Standard Error of Measurement appeared first on Online Testing...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • The standard error of the mean is one of the three main standard errors in psychometrics and psychology.  Its purpose is to help conceptualize the error in estimating the mean of some population based on a sample.  The SEM is a well-known concept from the general field of statistics, used in an untold number of […] The post The Standard Error of the Mean appeared first on Online Testing, Education...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • One of my graduate school mentors once said in class that there are three standard errors that everyone in the assessment or I/I Psych field needs to know: mean, error, and estimate.  They are quite distinct in concept and application, but easily confused by someone with minimal training.  I’ve personally seen the standard error of […] The post The Story of the Three Standard Errors appeared first...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • One of the best aspects of my position is the opportunity to travel the world and talk with many experts about psychometrics and educational assessment.  In December 2017, I was lucky enough to travel to Monterrey, Mexico, with the dual purpose of a conference and a Psychometrics Seminar.  It was an exciting week that taught […] The post 2017 Psychometrics Seminar and CIIE Conference appeared firs...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Validity, in its modern conceptualization, refers to evidence that supports our intended interpretations of test scores (see Chapter 1 of APA/AERA/NCME Standards for full treatment).  Validity threats are issues that issues that hinder the interpretations and use of scores.  The word “interpretation” is key because test scores can be interpreted in different ways, including ways […] The post What ...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Assessment Systems Ranks No. 807 on the 2017 Inc. 5000 America’s Fastest-Growing Private Companies with Three-Year Sales Growth of 559% MINNEAPOLIS, November 10, 2017 – Inc. magazine ranked Assessment Systems NO. 807 on its 36th annual Inc. 5000, the most prestigious ranking of the nation’s fastest-growing private companies. Assessment Systems also claims the honor of #13 Top […] The post Assessme...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • One of the core concepts in psychometrics is item difficulty.  This refers to the probability that examinees will get the item correct for educational/cognitive assessments or respond in the keyed direction with psychological/survey assessments (more on that later).  Difficulty is important for evaluating the characteristics of an item and whether it should continue to be part of […] The post What...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • It’s October 30, 2017, and collusion is all over the news today… but I want to talk about a different kind of collusion.  That is, non-independent test taking.  In the field of psychometric forensics, examinee collusion refers to cases where an examinee takes a test with some sort of external help in obtaining the correct […] The post Examinee Collusion: Primary vs Secondary appeared first on Onli...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • In the past decade, terms like machine learning, artificial intelligence, and data mining are becoming greater buzzwords as computing power, APIs, and the massively increased availability of data enable new technologies like self-driving cars. However, we’ve been using methodologies like machine learning in psychometrics for decades. So much of the hype is just hype. So, what […] The post Data Min...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • An emerging sector in the field of psychometrics is the area devoted to analyzing test data to find cheaters and other illicit or invalid testing behavior.  We lack a generally agreed-upon and marketable term for that sort of work, and I’d like to suggest that we use Psychometric Forensics. While research on this topic is more […] The post Can we call it Psychometric Forensics? appeared first on O...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Last week, I had the opportunity to attend the 2017 Conference on Test Security (COTS), hosted by the University of Wisconsin-Madison.  If your organization has any concerns about test security (that is, you have any sort of real stakes tied to your test!), I recommend that you attend COTS.  It has a great mix of […] The post 2017 Conference on Test Security appeared first on Online Testing, Educa...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • The post 2017 IACAT Conference… WOW! appeared first on Online Testing, Educational Assessment, Computerized Adaptive Testing | Assessment Systems.

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • The British statistician George Box is credited with the quote, “All models are wrong but some are useful.”  As psychometricians, it is important that we never forget this perspective.  We cannot be so haughty as to think that our models actually represent the true underlying phenomena and any data that does not fit nicely is just […] The post All Psychometric Models Are Wrong appeared first on On...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Computerized adaptive testing (CAT) is an incredibly important innovation in the world of assessment.  It’s a psychometric paradigm that applies machine learning principles to personalize millions and millions of assessments, from K12 education to university admissions to professional certification to employment screening to medical surveys.  While invented in the 1970s, primarily at as part of […...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Cognitive diagnostic models are an area of psychometric research that has seen substantial growth in the past decade, though the mathematics behind them, dating back to MacReady and Dayton (1977).  The reason that they have been receiving more attention is that in many assessment situations, a simple overall score does not serve our purposes and […] The post What are cognitive diagnostic models? a...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • I recently received a email from a researcher that wanted to implement item response theory, but was not sure where to start.  It occurred to me that there are plenty of resources out there which describe IRT but few, if any, that provide guidance for how someone new to the topic could apply IRT.  That is, plenty […] The post How do I implement item response theory? appeared first on Online Testin...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Why online essay marking? Essay questions and other extended constructed response (ECR) items remain a mainstay of educational assessment.  From a purely psychometric perspective, they are usually not beneficial – that is, from an item response theory paradigm, the amount of information added per minute of testing time will be less than other item types […] The post 6 Reasons for Online Essay Mark...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Guttman errors are a concept derived from the Guttman Scaling approach to evaluating assessments.  There are a number of ways that they can be used.  Meijer (1994) suggests an evaluation of Guttman errors as a way to flag aberrant response data, such as cheating or low motivation.  He quantified this with two different indices, G […] The post Guttman Errors: Additional Insight into Examinees appea...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post

What is a rubric?

  • What is a rubric? It’s a rule for converting unstructured responses on an assessment into structured data that we can use psychometrically. Why do we need rubrics? Measurement is a quantitative endeavor.  In psychometrics, we are trying to measure things like knowledge, achievement, aptitude, or skills.  So we need a way to convert qualitative data […] The post What is a rubric? appeared first on ...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Test security is an increasingly important topic. There are several causes, including globalization, technological enhancements, and the move to a gig-based economy driven by credentials. Any organization that sponsors assessments that have any stakes tied to them must be concerned with security, as the greater the stakes, the greater the incentive to cheat. And any […] The post Identifying and De...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Item banking refers to the purposeful creation of a database of items intending to measure a predetermined set of constructs. The term item refers to what many call questions; though their content need not be restricted as such and can include problems to solve or situations to evaluate in addition to straightforward questions. The art […] The post What is Item Banking? How can it improve my asse...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Today I read an article in The Industrial-Organizational Psychologist (the colloquial journal published by the Society for Industrial Organizational Psychology) that really resonated with me. Has Industrial-Organizational Psychology Lost Its Way? -Deniz S. Ones, Robert B. Kaiser, Tomas Chamorro-Premuzic, Cicek Svensson Why?  Because I think a lot of the points they are making are also true […] The...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post

Item Writing Tips

  • With so many things to consider, it’s no wonder psychometricians often recommend the retirement of poor performing items. Here are some of the most common issues we see, along with our tried and true methods for designing good, psychometrically sound items: Issue Recommendation Key is invalid due to multiple correct answers. Consider each answer option […] The post Item Writing Tips appeared first...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • I just returned from the 2017 Innovations in Testing conference in Scottsdale, AZ, organized by the Association of Test Publishers.  This is one of my favorite conferences because it contains a compelling blend of ingredients – quality psychometrics, innovative technology, and the business of assessment – and the 2017 edition definitely did not disappoint. This year I was […] The post ASC Drives T...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post
  • Few people realize that deep in the heart of The Hobbit, Tolkien placed an allegory that deftly demonstrates the psychometric concepts of Difficulty and Discrimination. For those not familiar with the story, Bilbo and his companions attempt to liberate treasure from an evil dragon. On the way, they are captured and imprisoned deep underground, then Bilbo is separated from his […] The post The Psyc...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post

New blog articles detected.

  • New version of CITAS released

    The post New version of CITAS released appeared first on Online Testing, Educational Assessment, Computerized Adaptive Testing | Assessment Systems.

  • How do I conduct a modified-Angoff study?

    There are a number of acceptable methodologies in the psyychometric literature for standard setting studies, also known as cutscores or passing points.  Examples include Angoff, modified-Angoff, Bookmark, Contrasting Groups, and Borderline.  The modified-Angoff approach is by far the most commonly used, yet it remains a black box to many professionals in the testing industry, especially non-psycho...

  • Understanding FastTest’s Annual Certification/ Recertification Report

    Background of the Certification/Recertification Report The National Commission for Certifying Agencies (NCCA) is a group that accredits certification programs.  Basically, many of the professional associations that had certifications (e.g., Certified Professional Widgetmaker) banded together to form a super-association, which then established an accreditation arm to ensure that certifications were...

  • What is Scaling?

    I often hear this question, especially regarding the scaled scoring functionality found in software like FastTest and Xcalibre.  The following is adapted from lecture notes I wrote while teaching a course in Measurement and Assessment at the University of Cincinnati. Scaling: Sort of a Tale of Two Cities Scaling at the test level really has […] The post What is Scaling? appeared first on Online Te...

  • What is item response theory?

    Item response theory (IRT) represents an important innovation in the field of psychometrics. While now 50 years old – assuming the “birth” is the classic Lord and Novick (1969) text – it is still underutilized and remains a mystery to many practitioners.  So what is item response theory, and why was it invented? Classical test […] The post What is item response theory? appeared first on Online Tes...

  • Top 3 K-12 Assessment Trends

    Technavio recently released a market analysis on K-12 Assessment Trends.  They concluded that there are three big trends currently impacting the testing world: Emphasis on cognitive testing and assessment Increase in number of standardized test-optional institutions Rising penetration of cloud computing The second of the 3 K-12 Assessment Trends is not on assessment itself (or psychometrics, the [...

  • ASC Presents at 2016 Conference on Test Security

    ASC attended the 2016 Conference on Test Security (COTS), held October 18-20 in Cedar Rapids IA, graciously hosted by Pearson.  The conference brings together thought leaders on all aspects of test security, including statistical detection of test fraud, management of test centers, candidate agreements, investigations, and legal implications.  ASC was lucky enough to win three […] The post ASC Pre...

  • The 3 best approaches for IRT equating

    If you are delivering high stakes tests in linear forms – or piloting a bank for CAT/LOFT – you are faced with the issue of how to equate the forms together.  That is, how can we defensibly translate a score on Form A to a score on Form B?  While the concept is simple, the […] The post The 3 best approaches for IRT equating appeared first on Online Testing, Educational Assessment, Computerized Ada...

Assessment Systems Corporation
Assessment Systems Corporation
Blog Post

Out-Market Your Competitors?

Get complete competitive insights on over 2.2 million companies to drive your marketing strategy.

Create Free Account Log in

By signing up, you agree to the Terms of Service and Privacy Policy.

Out-Market Your Competitors

Get complete competitive insights on over 2.2 million companies to drive your marketing strategy.

Create Free Account

Already a user?  Log in

By signing up, you agree to the Terms of Service and Privacy Policy.