Informacja

Drogi użytkowniku, aplikacja do prawidłowego działania wymaga obsługi JavaScript. Proszę włącz obsługę JavaScript w Twojej przeglądarce.

Tytuł pozycji:

On the agreement between bibliometrics and peer review: Evidence from the Italian research assessment exercises.

Tytuł:
On the agreement between bibliometrics and peer review: Evidence from the Italian research assessment exercises.
Autorzy:
Baccini A; Department of Economics and Statistics, University of Siena, Siena, Italy.
Barabesi L; Department of Economics and Statistics, University of Siena, Siena, Italy.
De Nicolao G; Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy.
Źródło:
PloS one [PLoS One] 2020 Nov 18; Vol. 15 (11), pp. e0242520. Date of Electronic Publication: 2020 Nov 18 (Print Publication: 2020).
Typ publikacji:
Journal Article; Research Support, Non-U.S. Gov't
Język:
English
Imprint Name(s):
Original Publication: San Francisco, CA : Public Library of Science
MeSH Terms:
Peer Review/*trends
Bibliometrics ; Humans ; Italy ; Peer Review, Research/standards ; Peer Review, Research/trends ; Publishing/standards
References:
Psychol Bull. 1968 Oct;70(4):213-20. (PMID: 19673146)
Educ Psychol Meas. 2019 Jun;79(3):558-576. (PMID: 31105323)
Biometrics. 1977 Mar;33(1):159-74. (PMID: 843571)
Entry Date(s):
Date Created: 20201118 Date Completed: 20210104 Latest Revision: 20210104
Update Code:
20240105
PubMed Central ID:
PMC7673579
DOI:
10.1371/journal.pone.0242520
PMID:
33206715
Czasopismo naukowe
This paper analyzes the concordance between bibliometrics and peer review. It draws evidence from the data of two experiments of the Italian governmental agency for research evaluation. The experiments were performed by the agency for validating the adoption in the Italian research assessment exercises of a dual system of evaluation, where some outputs were evaluated by bibliometrics and others by peer review. The two experiments were based on stratified random samples of journal articles. Each article was scored by bibliometrics and by peer review. The degree of concordance between the two evaluations is then computed. The correct setting of the experiments is defined by developing the design-based estimation of the Cohen's kappa coefficient and some testing procedures for assessing the homogeneity of missing proportions between strata. The results of both experiments show that for each research areas of science, technology, engineering and mathematics the degree of agreement between bibliometrics and peer review is-at most-weak at an individual article level. Thus, the outcome of the experiments does not validate the use of the dual system of evaluation in the Italian research assessments. More in general, the very weak concordance indicates that metrics should not replace peer review at the level of individual article. Hence, the use of the dual system in a research assessment might worsen the quality of information compared to the adoption of peer review only or bibliometrics only.
Competing Interests: NO authors have competing interests.
Zaloguj się, aby uzyskać dostęp do pełnego tekstu.

Ta witryna wykorzystuje pliki cookies do przechowywania informacji na Twoim komputerze. Pliki cookies stosujemy w celu świadczenia usług na najwyższym poziomie, w tym w sposób dostosowany do indywidualnych potrzeb. Korzystanie z witryny bez zmiany ustawień dotyczących cookies oznacza, że będą one zamieszczane w Twoim komputerze. W każdym momencie możesz dokonać zmiany ustawień dotyczących cookies