Meta-research
Meta-research is a recent field of research that investigates research practices with the ultimate goal of finding evidence-based improvements.[1] It is also known as "research on research" as it uses research methods to study how research is done and where improvements can be made. It covers all fields of scientific research (including health and medical research) and has been described as "taking a bird’s eye view of science".[1] It aims to improve scientific practice as summed up by John Ioannidis, "Science is the best thing that has happened to human beings [...] but we can do it better".
History
Meta-research has grown as a reaction to the replication crisis and concerns about waste in research.[2]
In health and medical research concerns have been raised about waste due to publication bias, inadequate research reporting, and poor study design, such as inadequate blinding. It is estimated that 85% of the worldwide research budget in health and medical research is currently wasted.[3] The 85% figure is supported by multiple empirical studies in a range of fields that have attempted to reproduce published peer reviewed research and failed on 75% to 90% of occasions.[4]
Many high-profile scientific publishers are interested in meta-research and improving the quality of their publications. Many of the concerns about waste in health and medical research were described in the 2014 Lancet special issue on 'Research: increasing value, reducing waste'. There is an ongoing special section in Nature on "Challenges in irreproducible research" with 12 editorials. Science has had an editorial [5] and a policy forum [6] on the problems with reproducibility. PLOS ONE launched a Reproducibility Initiative in 2012. Biomed Central introduced a minimum standards of reporting checklist to four titles in 2015.
In the media there have been articles on the flaws in science in The Economist and The Atlantic.
The first international conference in the broad area of meta-research was the Research Waste/EQUATOR conference in Edinburgh in 2015; the first international conference on peer review was the Peer Review Congress in 1989.[7] The first journal specifically targeting meta-research was Research Integrity and Peer Review launched in 2016. The journal's opening editorial called for, "research that will increase our understanding and suggest potential solutions to issues related to peer review, study reporting, and research and publication ethics".[8]
Meta-research centres
- Meta-Research Innovation Center at Stanford (METRICS) (co-directors John Ioannidis and Steven N. Goodman)
- Center for Open Science
- Projet MiRoR Methods in Research on Research
- Centre for Journalology
- European Network for Knowledge Impact
See also
References
- 1 2 Ioannidis, John P. A.; Fanelli, Daniele; Dunne, Debbie Drake; Goodman, Steven N. (2015). "Meta-research: Evaluation and Improvement of Research Methods and Practices". PLOS Biology. 13 (10): e1002264. doi:10.1371/journal.pbio.1002264. ISSN 1545-7885.
- ↑ "Researching the researchers". Nature Genetics. 46 (5): 417–417. 2014. doi:10.1038/ng.2972. ISSN 1061-4036.
- ↑ Chalmers, Iain; Glasziou, Paul (2009). "Avoidable waste in the production and reporting of research evidence". The Lancet. 374 (9683): 86–89. doi:10.1016/S0140-6736(09)60329-9. ISSN 0140-6736.
- ↑ Begley, C. G.; Ioannidis, J. P. A. (2014). "Reproducibility in Science: Improving the Standard for Basic and Preclinical Research". Circulation Research. 116 (1): 116–126. doi:10.1161/CIRCRESAHA.114.303819. ISSN 0009-7330.
- ↑ Buck, S. (2015). "Solving reproducibility". Science. 348 (6242): 1403–1403. doi:10.1126/science.aac8041. ISSN 0036-8075.
- ↑ Alberts, B.; Cicerone, R. J.; Fienberg, S. E.; Kamb, A.; McNutt, M.; Nerem, R. M.; Schekman, R.; Shiffrin, R.; Stodden, V.; Suresh, S.; Zuber, M. T.; Pope, B. K.; Jamieson, K. H. (2015). "Self-correction in science at work". Science. 348 (6242): 1420–1422. doi:10.1126/science.aab3847. ISSN 0036-8075.
- ↑ Rennie, Drummond (1990). "Editorial Peer Review in Biomedical Publication". JAMA. 263 (10): 1317. doi:10.1001/jama.1990.03440100011001. ISSN 0098-7484.
- ↑ Harriman, Stephanie L.; Kowalczuk, Maria K.; Simera, Iveta; Wager, Elizabeth (2016). "A new forum for research on research integrity and peer review". Research Integrity and Peer Review. 1 (1). doi:10.1186/s41073-016-0010-y. ISSN 2058-8615.