Paper details
Possible Pitfalls of Quantitative Metrics
Author
Pavel Mika, Library of the ASCR, v. v. i., Czech Republic
Documents to download
Full text Foto přednášejícího / Picture Presentation
Abstract
Quantitative methods for evaluation of research outputs represent objective system based on robust data which is used on different levels of research institutions.
This post will present critical view on practical use of bibliometric methods. There will be listed difficulties and limitation which cause lower value of information got by metrics and which increase a risk of misinterpretation. Discussion about possible solution will be provided and general recommendation will be suggested for accurate use of bibliometry.
There will be described issue of research area scheming which is necessary for objective use if citation indicators. But which schema use and how does this influence the results could be quite difficult question.
Bibliometric indicators itself include quite wide range of circumstances, which are important to take into consideration (e. g. size dependent and independent indicators, average distortion, minimum threshold of documents). Use of whole or fractional counting could be an interesting question. Presented issues will be illustrated by practical examples.
The main aim of this post is not a depreciation of using of bibliometry for research evaluation but on the contrary it should propose robust and resistant solutions.
Author's professional CV
Pavel Mika graduated from the Institute of Information Studies and Librarianship at Charles University in Prague. He has worked at the Library of the Academy of Sciences of the Czech Republic since 2014.
He is focused on creation of bibliometric analysis and on general problematics of the research evaluation in terms of bibliometrics and scientometrics.
He actively participated in evaluation of Czech Academy of Sciences institutions and in the project IPN Metodika (creation of a new evaluation methodology).
