Our systems are now restored following recent technical disruption, and we’re working hard to catch up on publishing. We apologise for the inconvenience caused. Find out more

Recommended product

Popular links

Popular links


Subscores

Subscores

Subscores

A Practical Guide to Their Production and Consumption
Shelby Haberman
Sandip Sinharay, Educational Testing Service, New Jersey
Richard A. Feinberg, National Board of Medical Examiners, Pennsylvania
Howard Wainer
February 2024
Available
Paperback
9781009413664

    This authoritative guide directs consumers and users of test scores on when and how to provide subscores and how to make informed decisions based on them. The book is designed to be accessible to practitioners and score users with varying levels of technical expertise, from executives of testing organizations and students who take tests to graduate students in educational measurement, psychometricians, and test developers. The theoretical background required to evaluate subscores and improve them are provided alongside examples of tests with subscores to illustrate their use and misuse. The first chapter covers the history of tests, subtests, scores, and subscores. Later chapters go into subscore reporting, evaluating and improving the quality of subscores, and alternatives to subscores when they are not appropriate. This thorough introduction to the existing research and best practices will be useful to graduate students, researchers, and practitioners.

    • Applications are demonstrated through a single unifying example of a test with subscores and through numerous other illustrations
    • Written by the foremost experts on the topic
    • Allows readers to apply results through discussions of methodology and software in R and Fortran

    Reviews & endorsements

    'The authors cogently and compellingly warn potential sub-score users of the adage, 'buyer beware.' In economic terms, demand is seductive; supply is low quality; and the price of improved quality unexpectedly high.' Arthur E. Wise, Education author, advocate, and policymaker

    'This compact volume provides both contemporary theory and sage advice about subscores for test developers, integrating seminal ideas and essential results from more than three dozen publications on the subject published by the authors over the past twenty-five years. It is an essential reference for practitioners and an ideal text for classes in test development.' David Thissen, Professor Emeritus, The University of North Carolina at Chapel Hill

    'This book is a masterful treatise on the subject of subtests, essential reading for all psychometricians, both practicing and aspiring. The figures are abundant and lucidly explained, as are the necessary equations. The text is learned and sophisticated, with occasional flashes of wit, and is enriched by numerous real-world examples.' Malcolm James Ree, Ph.D., Past chair of the ASVAB Technical Committee

    'Subscores: A Practical Guide for Their Production and Consumption provides a comprehensive overview of the often-misunderstood characteristics of subscores. It fills an important gap in responsible testing with a much-needed explication of subscore meaning and use in an accessible form for both expert and non-expert stakeholders in the assessment world. Its value makes one hope it is not Wainer's last contribution to the field.' Donald E. Melnick, M.D., MACP, Past President, National Board of Medical Examiners

    'This volume is sure to become a landmark in the study of subscores in educational tests. Based on two decades of research, it offers a coherent, comprehensive and eminently readable treatment of all aspects of the subject. Test developers, psychometricians, practitioners and - especially - users will find much wisdom and practical advice on generating, evaluating and employing subscores in a broad range of contexts.' Henry Braun, Boisi Professor of Education and Public Policy, Boston College

    'Anyone with basic psychometric training who needs to get up to speed on subscores quickly would benefit immensely from this book.' Michael C. Edwards, psychometrika

    'I recommend that anyone who is involved in test design and score reporting should obtain a copy of this book and digest the main messages. The motives driving the desire for subscores will not go away. It is important that those in the testing industry have ways of dealing with the continuing desire for subscores.' Mark Reckase, Journal of Educational and Behavioral Statistics

    See more reviews

    Product details

    February 2024
    Paperback
    9781009413664
    194 pages
    228 × 149 × 11 mm
    0.29kg
    Available

    Table of Contents

    • 1. Introduction
    • 2. How are subscores reported?
    • 3. When and how should subscores be reported?
    • 4. A survey to explore the conditions under which subscores have added value
    • 5. What to do when subscores do not have added value. Augmentation, no subscore reporting, and some other options
    • 6. Coda: Lessons learned, conclusions, and recommendations
    • Appendix
    • Glossary
    • References
    • Index.
      Authors
    • Shelby Haberman

      Shelby Haberman is a statistician with substantial experience in educational testing. He currently works as an independent consultant. Previously he taught at the University of Chicago, Hebrew University, and Northwestern University and was later employed by the Educational Testing Service. He is a fellow of the Institute of Mathematical Statistics, the American Statistical Association, and the American Academy for the Advancement of Science and was the 2019 recipient of the NCME Award for Career Contributions to Educational Measurement. Haberman is the author of 'The Analysis of Frequency Data,' 'Analysis of Qualitative Data,' and 'Advanced Statistics.'

    • Sandip Sinharay , Educational Testing Service, New Jersey

      Sandip Sinharay is a distinguished presidential appointee in the Research & Development division at the Educational Testing Service in Princeton, New Jersey. He is the current editor of 'Psychometrika,' and a past editor of the 'Journal of Educational Measurement' (2020–2022) and 'Journal of Educational and Behavioral Statistics' (2010–2014). He has received six awards from the National Council on Measurement in Education. He received the ETS Scientist award in 2008 and the ETS Presidential award twice. Sinharay has co-edited two published volumes and authored or co-authored more than 100 articles in peer-reviewed journals and edited books.

    • Richard A. Feinberg , National Board of Medical Examiners, Pennsylvania

      Richard A. Feinberg has taught at the Graduate School of Education of the University of Pennsylvania and the Philadelphia College of Osteopathic Medicine. He is currently a Principal Psychometrician at the National Board of Medical Examiners where he oversees examination development, scoring, reporting, and operational research for various subspecialty medical boards, the United States Medical Licensing Examination, and the North American Veterinary Licensing Examination. Feinberg has published numerous articles across a broad range of statistical applications in the educational and psychological literature.

    • Howard Wainer

      Howard Wainer is an independent statistician and author with experience in educational testing and data visualization. He has taught at The University of Chicago, Princeton University, and the Wharton School of the University of Pennsylvania. He was employed by the Educational Testing Service from 1980 until 2001 and was the Distinguished Research Scientist at the National Board of Medical Examiners from 2001 until 2016. Wainer is a fellow of the American Statistical Association and American Educational Research Association, and the author or editor of 25 previous books.