seminarios bibliometricos 2017 · +2.500 nuevos títulos en diciembre 2017 y posible ampliación...
TRANSCRIPT
SEMINARIOS BIBLIOMETRICOS 2017
La Bibliometria su historia, su buen uso, su futuro
Sebastien Vellay, Country Manager Miguel Garcia, Solution Specialist Rachel Mangan, Training Manager
Historia
Bibliometrics overview
3
HISTORIA
Source: http://jongose.ninja
4
¿QUE ES LA BIBLIOMETRIA?
5
¿PORQUE UTILIZAR BIBLIOMETRIA?
6
•
•
•
¿PORQUE UTILIZAR BIBLIOMETRIA?
—
¿QUE MIDEN LAS CITAS DE VERDAD?
8
MEJORES PRACTICAS: PEER REVIEW INFORMADA
9
MÉTRICAS DE CITAS SON SOLO UNA PIEZA DEL PUZZLE DE PERFORMANCE DE LA INVESTIGACIÓN. •
•
•
–
–
–
–
–
•–
–
Ejemplos de indicadores bibliometricos
11
NÚMERO DE PUBLICACIONES Y DE CITAS
12
% DOCUMENTOS CITADOS
La porcentaje de documentos que han recibido pelo menos una
cita en un grupo de publicaciones.
Citation Frequency Distribution
41,691 de 123,565
publicaciones nunca han sido citadas (34.5%).
% Documentos citados = 65.5%
13
EL ÍNDICE H
Un investigador tiene un H-index de X, si tiene al menos X
publicaciones que tengan recibido al menos X citas.
• Creado por el físico J. Hirsch en 2005
+ Combina productividad (número de documentos) y impacto número de citas) + Se puede aplicar a cualquier nivel de agregación + Tiene mejores resultados para grandes cantidades de publicaciones de grande impacto LIMITACIONES - Muy dependiente del tiempo - Ignora la edad - No considera diferencias de áreas
14
LIMITES DE H-INDEX
15
CITATION IMPACT (AVERAGE CITATIONS)
Un pilar de las mejores practicas:
NO confiar en un solo indicador pero utilizar una combinación
16
DIFFERENCES IN AVERAGE CITATION RATES
Citation Impact can
vary significantly
across different
disciplines and time
periods.
Cannot be compared
without some form of
normalization to allow
for the differences in
fields and time
17
DIFFERENCES IN AVERAGE CITATION RATES
18 EXAMPLES OF DIFFERENCES IN CITING BEHAVIOUR PER CATEGORIES
19
THE INFLUENCE OF CONTEXT IN METRICS
Research communities have radically different “Citation behaviours” and patterns.
It is therefore essential to contextualize citation metrics
20
JOURNAL RANKING INDICATORS
Some commonly used journal ranking indicators available via the
Journal Citation Reports
- Journal Impact Factor
- 5 year Journal Impact Factor
- Immediacy index
- Eigenfactor score
21
JOURNAL IMPACT FACTOR REFLECTS A JOURNAL’S OVERALL PERFORMANCE
22
JOURNAL IMPACT FACTOR REFLECTS A JOURNAL’S OVERALL PERFORMANCE
To contextualise the Journal Impact Factor, we calculate normalised metrics, based on percentiles distribution of Impact Factors of journals in the same category. QUARTILES ARE MOST COMMONLY USED
23
JOURNAL IMPACT FACTOR REFLECTS A JOURNAL’S OVERALL PERFORMANCE
24
SELF CITATIONS AT JOURNAL LEVEL – REV BRAS FARMACOGN: Regional coverage Expansion
– First Journal Impact Factor in 2009 was 3.462
Journal was suppressed from 2010 & 2011 JCR
25
26
NORMALIZATION IN PRACTICE
27
IS high or low?
0
25 20
high
0
1000
low
CONTEXT IS EVERYTHING INDICTORS MUST BE PUT INTO CONTEXT TO BE USEFUL: CATEGORY, JOURNAL, PEERS, GLOBAL ‣ NORMALIZED INDICATORS — for relative performance comparisons ‣ PERCENTILES — where does it fall in the range of values? ‣ BENCHMARKS — how does it compare with a group or globally?
NORMALIZATION IN PRACTICE
28
28
Percentile is a value above which a certain proportion of
the observations fall
Percentiles allow the classification of publications
into meaningful citation impact classes
The smaller the percentile number, the higher the
number of citations
Document Type: Article
15/4.31 =3.48
Average of citations received by an article published in 2006 in the Transformations in Business & Economics journal
Indicator of performance of this
Article in the Transformations in
Business & Economics journal:
If>1, performs higher than average
If<1, performs lower than average
World Average = 1
(When actual number of citations =
expexted number of citations)
CONTEXTUALIZACIÓN A NIVEL DE PAPER
29
BIBLIOMETRIC INDICATORS
Journal Ranking Indicators
Performance in field & journal
Scientific Excellence
Productivity
and
Impact
Scientific
Collaborations
• Journal Impact Factor
•Journal Impact Factor
without self citations
•Journal Impact Factor
for 5 years
•Quartile in Category
•Immediacy Index
•Eigenfactor Score
• Cited & Citing
Relations of a Journal
with other Journals
• International
Collaborations
• National
Collaborations
• Industry
Collaborations
•
•Category Normalized
Citation Impact
•Journal Normalized
Citation Impact
•% Documents in 1%
• % Documents in 10%
• Average Percentiles
•Hot Papers
• Highly Cited Papers
• Research Fronts
• Baselines
• # of documents
• # of OA documents
• # of funded documents
• # of citations
•% of Documents cited
•2nd generation citations
•Citation per document
•H-index
•Impact Relative to
Country
•Impact Relative to Area
•Impact Relative to
World
• What can and what should be measured? • What are appropriate measures for the purpose? • Each indicator answers 1 question, not ALL questions.
30
SPECIAL CASES
Negative Citations Arts & Humanities Mutual Citations Multi-authored Papers
o
31
EMERGING SOURCES CITATION INDEX: COVERAGE THROUGHOUT THE WORLD
5200 journals already selected and in WoS 2500 European Journals 40% in Social Sciences
34% of ESCI journals are Open Access
+2.500 nuevos títulos en Diciembre 2017 y posible ampliación con 10 años de archivos
32
Productivity
And Impact Normalization Top Performance
Scientific
Collaborations
Web of Science
Documents
Times Cited
Citation Impact
% of documents cited
H Index
Average percentile
Category Normalized
Citation Impact
Category Expected
Citations
Hot Papers
Journal Normalized
Citation Impact
Journal Expected
Citations
% Documents in Top
1%
% Documents in Top
10%
Highly Cited Papers
% Industry
Collaborations
% International
Collaborations
Journal Ranking Indicators
Journal Impact Factor
Impact Factor w/o
Self Cites
5 year Impact Factor
Immediacy Index
Eigenfactor
Collaborations with
Organizations
Collaborations with
Countries
Collaborations with
Authors
• What can and what should be measured?
• What are appropriate measures for the purpose?
RESPONSIBLE USE OF BIBLIOMETRIC INDICATORS: A BASKET OF INDICATORS. NO MAGIC RECIPE FITS ALL
33
-Bibliometrics are not evaluative by nature – however they are used as a Science Policy tool.
Currently, a lack of systematic:
•Bibliometrics education & training for research management & research evaluation
•Training programs focused more on academic objectives
•Development of problem-solving skills based on standardized techniques
•Professionalization of Bibliometrics science for librarians, archivists, professionals
“It is a matter of common knowledge that
there is a lack of bibliometric expertise
and education on the one hand, and an
increasing demand on the other” –
J. Gorraiz, 2011”
RESPONSIBLE USE OF BIBLIOMETRIC INDICATORS: BRIDGING THE GAP BETWEEN THEORY AND PRACTICE
34
And, above all, present the results openly and honestly
David Pendlebury (2008): “Using Bibliometrics in Evaluating Research”
Ten Rules in Using Publication and Citation Analysis
1. Consider whether available data can address the question
2. Choose publication types, field definitions, and years of data
3. Decide on whole or fractional counting
4. Judge whether data require editing to remove “artifacts”
5. Compare like with like
6. Use relative measures, not just absolute counts
7. Obtain multiple measures
8. Recognize the skewed nature of citation data
9. Confirm that the data collected are relevant to the question
10. Ask whether the results are reasonable
RESPONSIBLE USE OF BIBLIOMETRIC INDICATORS: BRIDGING THE GAP BETWEEN THEORY AND PRACTICE
35
http://wokinfo.com/media/mtrp/UsingBibliometricsinEval_WP.pdf
RESPONSIBLE USE OF BIBLIOMETRIC INDICATORS: BRIDGING THE GAP BETWEEN THEORY AND PRACTICE
36
CAN I TRUST YOUR DATA?
Statistics are as valid as the data behind them
37
AT THE HEART OF OUR SOLUTIONS: THE WEB OF SCIENCE CORE COLLECTION
Consistent indexing for complete analysis
Cover-to-cover indexing
All author names
All author addresses (affiliations)
Funding Agencies & Grant Numbers (Funding text)
Subject Area Classification
Open Access
38
Journal Publishing Standards
Editorial Content International
Focus Citation Analysis
Does this journal
target an
international
audience or
specifically a
regional audience?
Is international
representation
among authors and
board members at
an appropriate level
for such a journal?
Total citations
Recent citation
activity
Author and editorial
board members’
citations in the
literature
Integration of the
journal into the
literature over time
Peer review
Ethical publishing practices
Meets technical requirements (XML / PDF)
English-language bibliographic information
Timeliness of publication*
* Evaluated after selection
International editorial conventions
Scholarly
community
recommendation
or demonstrated
interest
Will this journal
enrich WoS with
novel content?
How does this
journal compare with
covered journals of
similar scope?
Is this subject
already well
covered?
Green = ESCI Requirements
Black = SCIE/SSCI/AHCI Requirements
WEB OF SCIENCE CORE COLLECTION SELECTION PROCESS
39
>1 Billion cited references
All authors and bibliographic information
All affiliations and addresses
All funding sources (2008) manually
captured
AT THE HEART OF OUR SOLUTIONS: THE WEB OF SCIENCE CORE COLLECTION
40
ANALYSIS SOURCE
CONTINUOUS DISAMBIGUATION EFFORT
41
DIFFERENT LEVELS OF METADATA – OPEN ACCESS JOURNALS
OPEN ACCESS TITLES IN WOS CORE COLLECTION (2,900+ TITLES)
15.8 14.6
12.7
10.4 8.7
7.5 6.1
5.1 3.5
2.4 2.0 1.4
0
2
4
6
8
10
12
14
16
18
2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2004
% of Growth in OA WoS Core Collection publications