Joint post by Paola Masuzzo, Lonni Besançon, and Jon Tennant.
As children, we are taught “Don’t judge a book by its cover”. Yet, when it comes to evaluation of scholarly research, this is often exactly what we do. In 1997, an article was published entitled “Why the impact factor of journals should not be used for evaluating research”. Yet, twenty years later, this metric is still pervasively used for research assessment, and closely tied to the quality of articles and their authors, as has been recently reported for North America and across parts of Europe.
We do not understand this. There is no theoretical, ethical, or empirical basis for this system of evaluation. The three of us are early career researchers, and we are deeply concerned. It should not be up to us to compensate for the lack of leadership and responsibility demonstrated by senior academics, who should be doing research evaluation with the same rigour they perform their research.
Why can the supposed intellectual elite of this planet not get past this? “What is the alternative?”, we hear you cry oh clichéd professor. Great advances in science were made before this system was even considered and it is therefore irrational to believe that this is the only way to expand knowledge. Apathy is unacceptable in the face of mounting evidence of the problems this causes, including increasing questionable research practices and retractions, and a mental health crisis within the publish or perish paradigm.
Science is not a competition but an iterative and collaborative process. We need to fix the research evaluation system, now, and make it compatible with the way we perform and value research. This includes the adoption of a humane-oriented model that supports slow, robust, and inclusive participatory research, and values a diversity of research outputs and processes. If we do this, we can create a healthier research culture for everyone, and look back on this time in our history with pride.