Our systems are now restored following recent technical disruption, and we’re working hard to catch up on publishing. We apologise for the inconvenience caused. Find out more

Recommended product

Popular links

Popular links


The Evaluation Game

The Evaluation Game

The Evaluation Game

How Publication Metrics Shape Scholarly Communication
Emanuel Kulczycki, Adam Mickiewicz University, Poland
April 2023
Paperback
9781009351195
$39.99
USD
Paperback
USD
Hardback

    Scientific research is communicated, organized, financed, governed, and evaluated through the process of publication. The result of this process is a highly competitive academic environment that rewards researchers for high volume publication, preferably in high-impact journals, leading to the popularised expression 'publish or perish'. Universities and other scientific institutions are under similar pressure, with their aggregated research output being under constant scrutiny. This innovative text provides a detailed introduction to the origin and development of the scholarly metrics used to measure academic productivity, and the effect they have upon the quality and diversity of scientific research. With its careful attention to both the positive and negative outcomes of research evaluation and their distinct expressions around the globe, The Evaluation Game guides the way to a more grounded understanding of metrics, and the diverse academic cultures they give rise to.

    • Provides a comprehensive account of the transformations in scholarly communication generated by research evaluation systems, and proposes a fundamental rethinking of the values that drive academia
    • Presents the first historical account of research evaluation systems in the East, tracing them back to their roots in the modernization of Russia
    • Discusses the two distinct trajectories of modernisation and metricization in academia, the socialist and capitalist, allowing readers to understand why researchers in different regions react differently to research evaluation

    Reviews & endorsements

    'Research evaluation has taken very different forms under different bureaucracies and political systems. Kulczycki makes a unique contribution by explaining some 'untold histories of research evaluation' from Eastern Europe and comparing metric-based evaluation models under socialist and neoliberal regimes.' Ismael Rafols, Centre for Science and Technology Studies (CWTS), Leiden

    'Emanuel Kulczycki is uniquely positioned to provide this highly insightful critique of the relationship between academia and the state in research evaluation systems. In this book, evaluation is not merely an event of which researchers are the sole object or beneficiary but a process that is inextricably tied to issues of trust, communication, discipline diversity and the power of the state. Only by reconciling these relationships can we move to more responsible research evaluation and address academic resistance.' Gemma Derrick, Centre for Higher Education Transformations, University of Bristol

    'The author uses the metaphor in the title to emphasize the competitive environment in which scientific research takes place. He shows the extent to which research evaluation originates (also) from the government. In this context, he points out a remarkable difference between the West (USA and Western Europe) and the former Eastern Bloc. In the West, researchers have more confidence in colleagues, via peer review, while in the former East Bloc, there is a historic distrust in authorities (experts), and hence a preference for bibliometric indicators. The book draws attention to power relations in science and as such is a useful read, not only for information scientists but also for sociologists and political scientists who want to take a glonacal (global-national-local) perspective.' Ronald Rousseau, KU Leuven and University of Antwerp

    '… an excellent overview of the operation of state, academic institution and publisher-led systems of research publication evaluation.' Huw Morris, Educational Review

    '… a valuable and exciting contribution.' Alessia Lo Porto Lefébure, Questions de communication

    See more reviews

    Product details

    No date available
    Adobe eBook Reader
    9781009351225
    0 pages

    Table of Contents

    • Introduction
    • 1. Evaluation as power
    • 2. Economization and metricization
    • 3. Untold histories of research evaluation
    • 4. The diversity of evaluative powers
    • 5. Players and the stakes
    • 6. Playing the evaluation game
    • Conclusions
    • Acknowledgements
    • References
    • Index.
      Author
    • Emanuel Kulczycki , Adam Mickiewicz University, Poland

      Emanuel Kulczycki is Associate Professor at Adam Mickiewicz University, Poznań, and Head of the Scholarly Communication Research Group. From 2018 to 2020, he was the chair of the European Network for Research Evaluation in the Social Sciences and the Humanities, and in 2019 he co-founded the Helsinki Initiative on Multilingualism in Scholarly Communication. He has been a policy advisor for the Ministry of Science and Higher Education in Poland since 2013. He co-edited the Handbook on Research Assessment in the Social Sciences (2022, Edward Elgar Publishing).