Evaluation of the Scientific Production in Portuguese Medical Schools
38
Evaluation of the Scientific Production in Portuguese Medical Schools 2006/2007 Class 5
description
Evaluation of the Scientific Production in Portuguese Medical Schools. 2006/2007 Class 5. Introduction. Scientifical and technological dynamics understanding;. interest for scientific production quantitative indicators. helps. Political engeneering;. Decision making on this area. - PowerPoint PPT Presentation
Transcript of Evaluation of the Scientific Production in Portuguese Medical Schools
Evaluation of the Scientific Production in
Portuguese Medical Schools
2006/2007 Class 5
Introduction
SANTOS,Raimundo - Revista Digital de Biblioteconomia e Ciência da Informação, Campinas, v. 1, n. 1, p. 22-38, jul./dez. 2003 – ISSN: 1678-765X
increases
interest for scientific production quantitative indicators helps
• Scientifical and technological dynamics understanding;
• Political engeneering;
• Decision making on this area.
Quantitative scientific production measured by
number of articles published
in scientifical journals
Scientific production has been increasing in the last years:
Graph - Annual evolution of the portuguese scientific publications´ number on Science Citation Index (red line-totals; blue line_ with foreign’s co-authorship; space between the two lines- without foreign’s co-authorship). Source: ISI – Web of Knowledge
COIMBRA JR., Carlos E. A. Scientific production in public health and the international literature bases. Cad. Saúde Pública. 1999, vol. 15, no. 4, pp. 883-888. http://scientific.thomson.com/free/essays/selectionofmaterial/journalselection/
Indexed journals
• report investigation results
• look up for bibliographic information
ISI web of Science
ALLOW TO ALLOWS ACCESS TO
• title
• author
• journal´s impact factor
•Citation data
EVALUATING JOURNALS
Many factors are taken into account:
Qualitative Quantitative
journal's basic publishing standards
• editorial content• authorship’s
internacional diversity
• citation data
Interrelated
All factors determine strengths and weaknesses of the journal
J. M. CAMPANARIO, L. GONZÁLEZ: Journal self-citations -Scientometrics 69 (2006)
IMPACT FACTOR
bibliometric product
more used
Internacional scope and diffusing of
academic journalsfundamental indicator
became widespread
It’s use
Aims
Research Selection
Develop an objective methodology
for scientifical
articles
In order to make it:
REPRODUCTIBLE
-Author’s position;
-Number;
-Citation´s Number;
-Impact factor;
-Journals.
LISBON
COIMBRA
compare
Methods Two medical schools
http://scientific.thomson.com/pt/produtos/WoK/wok/
FMUC FMUL
Reasons: the oldest universities and the ones
which have simultaneously hospital and faculty.
Data base:
ISI web of knowledge
• Gives access to the leader of database of quote (Web of Science);
• gathers the searched results promoting its analysis (Analyze tool);
• available index, records, virtual documents and electronic journals.
• FlowchartStart
Choose the medical school
Adress= Coimbra? no
2710 publications
Is a Fac Med Lisbon’s publication?
no
yes
805 publications
Is a Fac Med Coimbra’s publication?
no
yes
Publications’ inclusion
Publications’ exclusion
Choose the publication
year
Collect publication information
SPSS data inclusion
Data statistic treatment
End
Adress= Lisbon or Lisboa?
Publication’s year = 2005?yes
no
yes
Choose the database
Choose the queries
Article prodution
Web site prodution
yesno
http://scientific.thomson.com/pt/produtos/WoK/wok/
Inicial queriesLisbon* medical school Lisboa* medical school
Lisbon* school of medicine Faculty of medicine of Lisboa*
Faculty medicine Lisboa*Faculdade de medicina de
Lisboa*
Medical school, Lisbon*Medical school, Lisboa*
Faculty of medicine, Lisboa* School of medicine, Lisboa*
* - Coimbra
FINAL QUERY : Lisboa* or Lisbon* 2005
• Exclusion criterias:
- Articles not published in faculties:
- Articles with none contribution of faculty members;
• Inclusion criterias:
- Articles with contribution of faculty members;
- Articles from:
Lisbon Coimbra
Santa Maria’s Hospital Univ Coimbra Ctr Neurosci & Cell Biol Coimbra
Lisbon fac. Med. Dermatol Clin Coimbra, Portugal
Med sch Hosp Univ Coimbra
Int. Mol. Med Univ Coimbra, Fac Med
Fac Med Univ Hosp Coimbra
Ctr. Quim & Bioquim Fac Med, Coimbra
• Information from the articles: - Author author; Other authors; Institution 1st author; Author’s position; 1st author’s filiation 1 and 2; Institution’s 1st author filiation; Author’s total number.
- Journal Citation´s number specific for the article; Index; Publication review or journal; Page; Volume;
Data Base creation
Statistical Analysis
Lables
Graphs
SPSS
-Statistical calculations;
- Results interpretation and presentation
• Data base creation
Coimbra’s results
Table 1 – Coimbra’s 1st Author’s Institution Filiation
Filiation
Table 2 – Coimbra’s 1st Author’s Institution Filiation
NValid 97
Missing 0
Frequenc
y Percent
Valid Percent
Cumulative Percent
ValidCtr Neurociencias
1 1,0 1,01,0
Ctr Neurosci
2 2,1 2,13,1
Ctr Neurosci & Cell Biol
15 15,5 15,518,6
Dermatol Clin
1 1,0 1,019,6
Fac Med
63 64,9 64,984,5
Hosp Pediat Coimbra
1 1,0 1,085,6
Inst Biochem
6 6,2 6,291,8
Inst Pharmacol & Expt
Therapeut 1 1,0 1,092,8
Serv Dermatol
2 2,1 2,194,8
Serv Med 1
1 1,0 1,095,9
Serv Med 2
1 1,0 1,096,9
Univ Coimbra
3 3,1 3,1100,0
Total 97 100,0 100,0
Graph 1 – Coimbra’s 1st Author’s Institution Filiation
Bars show counts
0 20 40 60
Count
Ctr Neurociencias
Ctr Neurosci
Ctr Neurosci & Cell Biol
Dermatol Clin
Fac Med
Hosp Pediat Coimbra
Inst Biochem
Inst Pharmacol & Expt Therapeut
Serv Dermatol
Serv Med 1
Serv Med 2
Univ Coimbra
Table 3 – Coimbra’s 1st Author’s first filiation
Table 4 – Coimbra’s 1st Author’s first filiation
N Valid 97
Missing 0
Frequency Percent Valid Percent
Cumulative Percent
Valid Allgemeines Krankenhaus Wien1 1,0 1,0
1,0
Assoc Biomed Res & Innovat
Light & Image 1 1,0 1,02,1
Case Western Reserve Univ Inst
Patho 4 4,1 4,16,2
Case Western Reserve Univ Inst
Pathol 1 1,0 1,07,2
Charite Univ Hosp Dept
Rheumatol & Clin Immunol
1 1,0 1,08,2
CNTM
1 1,0 1,09,3
Ctr Addict & Mental Hlth
1 1,0 1,010,3
Delegat Coimbra Natl Inst Legal
Med 1 1,0 1,011,3
Dept Biol Univ Aveiro
2 2,1 2,113,4
Dept Expt Med Sci
1 1,0 1,014,4
Dept Ophthalmol Univ Coimbra
1 1,0 1,015,5
Dept Urol & Renal Transplantat
Univ Coimbra 5 5,2 5,220,6
Dept Zool Univ Coimbra
2 2,1 2,122,7
Fac Farm Coimbra
9 9,3 9,332,0
Fac Med Coimbra
22 22,7 22,754,6
Fac Med Dijon
1 1,0 1,055,7
Fac Med Univ Lisbon
1 1,0 1,056,7
Fac Sci & Technol Coimbra
2 2,1 2,158,8
Galderma R&D Inc
1 1,0 1,059,8
Hosp Pediat Coimbra
1 1,0 1,060,8
Inst Nacl Med Legal
1 1,0 1,061,9
Ist Super Sanita
1 1,0 1,062,9
Janssen Cilag GmbH
1 1,0 1,063,9
Johns Hopkins Univ
1 1,0 1,064,9
Karolinska Inst
1 1,0 1,066,0
Louisiana State Univ Dept Biol Sci
1 1,0 1,067,0
Lund Univ
1 1,0 1,068,0
Mario Negri Inst Pharmacol Res
1 1,0 1,069,1
NIA
1 1,0 1,070,1
Oporto Inst Mol & Cell Biol
1 1,0 1,071,1
Queen Elizabeth Hosp
1 1,0 1,072,2
Rheumatism Fdn Hosp
1 1,0 1,073,2
Tohoku Univ Sch Med
1 1,0 1,074,2
UEX Fac Med
1 1,0 1,075,3
Univ Cambridge Dept Pharmacol
4 4,1 4,179,4
Univ Coimbra
5 5,2 5,284,5
Univ Coimbra Dept Cardiol
1 1,0 1,085,6
Univ Coimbra Dept Dermatol
1 1,0 1,086,6
Univ Coimbra Dept Endocrinol
1 1,0 1,087,6
Univ Coimbra Dept Orthopaed
2 2,1 2,189,7
Univ Coimbra Dept Radiol
1 1,0 1,090,7
Univ Coimbra Dept Surg 3
1 1,0 1,091,8
Univ Coimbra Dept Zool
2 2,1 2,193,8
Univ Coimbra Serv Nefrol
1 1,0 1,094,8
Univ Fed Sao Paulo
1 1,0 1,095,9
Univ Minho Dept Biol
1 1,0 1,096,9
Univ Oxford Dept Human Anat &
Genet 1 1,0 1,097,9
Univ Utrecht Med Ctr
1 1,0 1,099,0
Univ Washington Dept
Anesthesiol 1 1,0 1,0100,0
Total 97 100,0 100,0
Graph 2 – Coimbra’s 1st Author’s first filiation
Bars show counts
0 5 10 15 20
Count
Allgemeines Krankenhaus Wien
Case Western Reserve Univ Inst Pathol
Ctr Addict & Mental Hlth
Dept Expt Med Sci
Dept Zool Univ Coimbra
Fac Med Dijon
Galderma R&D Inc
Ist Super Sanita
Karolinska Inst
Mario Negri Inst Pharmacol Res
Queen Elizabeth Hosp
UEX Fac Med
Univ Coimbra Dept Cardiol
Univ Coimbra Dept Orthopaed
Univ Coimbra Dept Zool
Univ Minho Dept Biol
Univ Washington Dept Anesthesiol
Filiation2
Statistics
Table 5 – Coimbra’s 1st Author’s second filiation
Table 6 – Coimbra’s 1st Author’s second filiation
Filiation2
N Valid 97
Missing 0
Frequenc
y PercentValid
PercentCumulative
Percent
Valid -79 81,4 81,4
81,4
Bloomberg Sch Publ Hlth1 1,0 1,0
82,5
Ctr Neurosci & Cell Biol7 7,2 7,2
89,7
Grp Bromatol1 1,0 1,0
90,7
INSERM1 1,0 1,0
91,8
Inst Biochem4 4,1 4,1
95,9
Inst Pharmacol & Expt Therapeut 1 1,0 1,0
96,9
Inst Pharmacol & Neurosci 1 1,0 1,0
97,9
Mol Struct Grp1 1,0 1,0
99,0
Wallenberg Neurosci Ctr1 1,0 1,0
100,0
Total 97 100,0 100,0
Graph 3 – Coimbra’s 1st Author’s second filiation
Bars show counts
0 25 50 75
Count
-
Bloomberg Sch Publ Hlth
Ctr Neurosci & Cell Biol
Ctr Neurosci & Cell Biol Coimbra
Grp Bromatol
INSERM
Inst Biochem
Inst Pharmacol & Expt Therapeut
Inst Pharmacol & Neurosci
Mol Struct Grp
Wallenberg Neurosci Ctr
Filia
tion2
Statistics
Impactfactor916
3.016622.47100
2.182385.466
11.632274.5121.577004.04800
ValidMissing
N
MeanMedianStd. DeviationMinimumMaximumSum
2575
Percentiles
Impactfactor
1 1,0 1,1 1,11 1,0 1,1 2,22 2,1 2,2 4,41 1,0 1,1 5,51 1,0 1,1 6,67 7,2 7,7 14,31 1,0 1,1 15,41 1,0 1,1 16,51 1,0 1,1 17,62 2,1 2,2 19,81 1,0 1,1 20,91 1,0 1,1 22,03 3,1 3,3 25,31 1,0 1,1 26,41 1,0 1,1 27,51 1,0 1,1 28,61 1,0 1,1 29,71 1,0 1,1 30,81 1,0 1,1 31,91 1,0 1,1 33,03 3,1 3,3 36,31 1,0 1,1 37,41 1,0 1,1 38,51 1,0 1,1 39,61 1,0 1,1 40,71 1,0 1,1 41,81 1,0 1,1 42,91 1,0 1,1 44,02 2,1 2,2 46,21 1,0 1,1 47,31 1,0 1,1 48,41 1,0 1,1 49,51 1,0 1,1 50,51 1,0 1,1 51,63 3,1 3,3 54,91 1,0 1,1 56,01 1,0 1,1 57,12 2,1 2,2 59,33 3,1 3,3 62,61 1,0 1,1 63,71 1,0 1,1 64,81 1,0 1,1 65,92 2,1 2,2 68,11 1,0 1,1 69,21 1,0 1,1 70,31 1,0 1,1 71,41 1,0 1,1 72,51 1,0 1,1 73,61 1,0 1,1 74,72 2,1 2,2 76,91 1,0 1,1 78,05 5,2 5,5 83,51 1,0 1,1 84,62 2,1 2,2 86,81 1,0 1,1 87,91 1,0 1,1 89,01 1,0 1,1 90,11 1,0 1,1 91,21 1,0 1,1 92,33 3,1 3,3 95,61 1,0 1,1 96,71 1,0 1,1 97,81 1,0 1,1 98,91 1,0 1,1 100,0
91 93,8 100,06 6,2
97 100,0
.466
.490
.591
.634
.646
.799
.821
.9421.0561.2191.4011.4981.5771.6101.6641.6871.7641.7731.7901.7971.8021.8111.8231.8541.8571.8881.9041.9952.1922.2272.2512.2962.4712.4772.5272.8302.8422.9452.9943.0883.2273.2743.4103.5083.6373.7673.7863.8183.8794.0484.2244.6044.9044.9715.2885.5055.8546.0206.9567.5067.5357.5779.88511.632Total
Valid
noneMissingTotal
Frequency Percent Valid PercentCumulative
Percent
Table 7 – Coimbra’s impact factor
Table 8 – Coimbra’s impact factor
Graph 4 –Coimbra’s journal impact factor
Statistics
Citationnumber970
2,006,357
036
408,50
5,00
ValidMissing
N
MedianStd. DeviationMinimumMaximumSum
2575
Percentiles
Citationnumber
24 24,7 24,7 24,721 21,6 21,6 46,415 15,5 15,5 61,93 3,1 3,1 64,97 7,2 7,2 72,25 5,2 5,2 77,33 3,1 3,1 80,44 4,1 4,1 84,51 1,0 1,0 85,62 2,1 2,1 87,61 1,0 1,0 88,71 1,0 1,0 89,71 1,0 1,0 90,71 1,0 1,0 91,81 1,0 1,0 92,83 3,1 3,1 95,91 1,0 1,0 96,91 1,0 1,0 97,91 1,0 1,0 99,01 1,0 1,0 100,0
97 100,0 100,0
012345678910111215171819222736Total
ValidFrequency Percent Valid Percent
CumulativePercent
Table 9 – Coimbra’s article citation´s number
Table 10 – Coimbra’s article citation´s number
Graph 5 – Coimbra’s article citation´s number
6 2 2 7 4 3 4 1 3 1 1 3 4 2 5 2 3 5 1 3 3 1 1 4 3 1 2 1 1 1 1 1 3 1 3 1 1 1 2 1 1 1
123456791012
1 2 3 4 5 6 7 8 9 10 11 14 15 16 20
Table 11 – Coimbra’s relative position of Institution Author
Lisbon’s results
Table 12 – Lisbon’s 1st Author’s Institution Filiation
N Valid 108
Missing 0
Filiation Statistics
Table 13 – Lisbon’s 1st Author’s Institution Filiation
Frequenc
y PercentValid
PercentCumulative
Percent
Valid Ctr Quim & Bioquim1 ,9 ,9
,9
Fac Med65 60,2 60,2
61,1
Hosp Santa Maria30 27,8 27,8
88,9
Inst Mol Med1 ,9 ,9
89,8
Med Sch2 1,9 1,9
91,7
Univ Clin Dermatol1 ,9 ,9
92,6
Univ Lisbon8 7,4 7,4
100,0
Total 108 100,0 100,0
Filiation
Bars show counts
0 20 40 60
Count
Ctr Quim & Bioquim
Fac Med
Hosp Santa Maria
Inst Mol Med
Med Sch
Univ Clin Dermatol
Univ Lisbon
Graph 6 – Lisbon’s 1st Author’s Institution Filiation
Table 14 – Lisbon’s 1st Author’s first filiation
N Valid 108
Missing 0
Filiation1
Statistics
Table 15 – Lisbon’s 1st Author’s first filiation
Filiation1
Frequency Percent
Valid Percent
Cumulative Percent
Valid - 1 ,9 ,9 ,9
Aarhus Univ Hosp 1 ,9 ,9 1,9
Campo Grande 1 ,9 ,9 2,8
Ctr Quim & Bioquim 1 ,9 ,9 3,7
Dept Quim & Bioquim 1 ,9 ,9 4,6
Dermatopathol Gemeinschaftspraxis 1 ,9 ,9 5,6
Fac Med 49 45,4 45,4 50,9
Free Univ Brussels 1 ,9 ,9 51,9
Hosp Santa Maria 21 19,4 19,4 71,3
Innsbruck Med Univ 1 ,9 ,9 72,2
Inst Genet Med Jacinto Magalhaes 1 ,9 ,9 73,1
Inst Higiene & Med Trop 2 1,9 1,9 75,0
Inst Med Genet Jacinto Magalhaes 1 ,9 ,9 75,9
Inst Tecnol Quim & Biol 1 ,9 ,9 76,9
Maternidade Dr Alfredo da Costa 1 ,9 ,9 77,8
Rush Univ Ctr Med 1 ,9 ,9 78,7
St Pierre Univ Hosp 1 ,9 ,9 79,6
Univ Bonn 1 ,9 ,9 80,6
Univ Cambridge 1 ,9 ,9 81,5
Univ Cantabria CSIC 1 ,9 ,9 82,4
Univ Edinburgh Coll Med & Vet Med 1 ,9 ,9 83,3
Univ Edinburgh Inst Cell & Mol Biol 1 ,9 ,9 84,3
Univ Lisbon 8 7,4 7,4 91,7
Univ Nova Lisboa 4 3,7 3,7 95,4
Univ Paris 11 1 ,9 ,9 96,3
Univ Roma La Sapienza 1 ,9 ,9 97,2
Univ Texas 1 ,9 ,9 98,1
Vanderbilt Univ 1 ,9 ,9 99,1
Vrije Univ Amsterdam, Ctr Med 1 ,9 ,9 100,0
Total 108 100,0 100,0
Bars show counts
10 20 30 40 50
Count
-
Ctr Quim & Bioquim
Fac Med
Innsbruck Med Univ
Inst Med Genet Jacinto Magalhaes
Rush Univ Ctr Med
Univ Cambridge
Univ Edinburgh Inst Cell & Mol Biol
Univ Paris 11
Vanderbilt Univ
Graph 7 – Lisbon’s 1st Author’s first filiation
N Valid 108
Missing 0
Table 16 – Lisbon’s 1st Author’s second filiation
Filiation2
Statistics
Table 17 – Lisbon’s 1st Author’s second filiation
Filiation2
Frequency Percent Valid PercentCumulative
Percent
Valid -104 96,3 96,3
96,3
IMM2 1,9 1,9
98,1
Inst Higiene & Med Trop1 ,9 ,9
99,1
Inst Invest Cientif Bento Rocha Cabral 1 ,9 ,9
100,0
Total 108 100,0 100,0
Bars show counts
0 25 50 75 100
Count
-
IMM
Inst Higiene & Med Trop
Inst Invest Cientif Bento Rocha Cabral
Graph 8 – Lisbon’s 1st Author’s second filiation
Statistics
Impactfactor9810
3.345232.63800
2.200714.430
11.810327.8331.888003.94625
ValidMissing
N
MeanMedianStd. DeviationMinimumMaximumSum
2575
Percentiles
Impactfactor
1 ,9 1,0 1,01 ,9 1,0 2,02 1,9 2,0 4,11 ,9 1,0 5,11 ,9 1,0 6,13 2,8 3,1 9,21 ,9 1,0 10,21 ,9 1,0 11,21 ,9 1,0 12,21 ,9 1,0 13,31 ,9 1,0 14,32 1,9 2,0 16,33 2,8 3,1 19,41 ,9 1,0 20,41 ,9 1,0 21,45 4,6 5,1 26,51 ,9 1,0 27,61 ,9 1,0 28,61 ,9 1,0 29,61 ,9 1,0 30,61 ,9 1,0 31,64 3,7 4,1 35,71 ,9 1,0 36,73 2,8 3,1 39,83 2,8 3,1 42,91 ,9 1,0 43,91 ,9 1,0 44,91 ,9 1,0 45,91 ,9 1,0 46,91 ,9 1,0 48,02 1,9 2,0 50,01 ,9 1,0 51,01 ,9 1,0 52,01 ,9 1,0 53,11 ,9 1,0 54,11 ,9 1,0 55,11 ,9 1,0 56,12 1,9 2,0 58,21 ,9 1,0 59,22 1,9 2,0 61,21 ,9 1,0 62,21 ,9 1,0 63,31 ,9 1,0 64,35 4,6 5,1 69,41 ,9 1,0 70,41 ,9 1,0 71,41 ,9 1,0 72,41 ,9 1,0 73,51 ,9 1,0 74,51 ,9 1,0 75,51 ,9 1,0 76,51 ,9 1,0 77,61 ,9 1,0 78,61 ,9 1,0 79,61 ,9 1,0 80,61 ,9 1,0 81,62 1,9 2,0 83,71 ,9 1,0 84,71 ,9 1,0 85,71 ,9 1,0 86,73 2,8 3,1 89,81 ,9 1,0 90,81 ,9 1,0 91,81 ,9 1,0 92,91 ,9 1,0 93,91 ,9 1,0 94,91 ,9 1,0 95,91 ,9 1,0 96,91 ,9 1,0 98,02 1,9 2,0 100,0
98 90,7 100,010 9,3
108 100,0
.430
.681
.6991.1181.1471.2261.2881.2951.3081.4711.6381.6901.7181.7621.8261.8881.8982.0562.1172.1382.1882.2442.2962.3192.3232.3662.3722.5442.5842.6082.6362.6402.6782.7112.8302.9623.0133.0473.0563.1223.2273.4343.5103.5373.5613.6693.7863.8503.8713.8794.1484.3794.6044.6574.7024.8765.0655.2345.8355.8545.8556.0206.1456.5206.5436.9567.7649.05210.17411.810Total
Valid
noneMissingTotal
Frequency Percent Valid PercentCumulative
Percent
Table 18 - Impact factor
Table 19 – Impact factor
2.000 4.000 6.000 8.000 10.000
Impactfactor
0
5
10
15
20
Graph 9 – Journal impact factor
Statistics
Citationnumber108
02,00
5,0000
32356,00
4,00
ValidMissing
N
MedianStd. DeviationMinimumMaximumSum
2575
Percentiles
Citationnumber
32 29,6 29,6 29,619 17,6 17,6 47,219 17,6 17,6 64,86 5,6 5,6 70,46 5,6 5,6 75,96 5,6 5,6 81,54 3,7 3,7 85,25 4,6 4,6 89,81 ,9 ,9 90,73 2,8 2,8 93,51 ,9 ,9 94,41 ,9 ,9 95,41 ,9 ,9 96,31 ,9 ,9 97,21 ,9 ,9 98,11 ,9 ,9 99,11 ,9 ,9 100,0
108 100,0 100,0
0123456791012131415212232Total
ValidFrequency Percent Valid Percent
CumulativePercent
Table 20 – Article citation´s number
Table 21 – Article citation´s number
Graph 10 – Article citation´s number
7 9 13 10 9 6 9 1 2 1 1 1 3 1 1 1 1 3 1 1 1 1 1 1 1 1 1 1 2 2 1 2 2 3 1 1 1 2 1 1
123456781720
1 2 3 4 5 6 7 8 9 10 11 12 13 17 35 59
Table 22 – Relative position of Institution Author
Articles which 1st author belongs to facultyCoimbra:34
Lisboa:68
Lisboa:108
Coimbra:97Number of articles
Discussion and conclusion
Impact factor medium Coimbra: 3.02
Lisboa: 3.35
Impact factor sum up Coimbra:274.5
Lisboa:327.8
Citations number sum upCoimbra:408
Lisboa:356
References
SANTOS,Raimundo - Revista Digital de Biblioteconomia e Ciência da Informação, Campinas, v. 1, n. 1, p. 22-38, jul./dez. 2003 – ISSN: 1678-765X
COIMBRA JR., Carlos E. A. Scientific production in public health and the international literature bases. Cad. Saúde Pública. 1999, vol. 15, no. 4, pp. 883-888.
http://scientific.thomson.com/free/essays/selectionofmaterial/journalselection/
J. M. CAMPANARIO, L. GONZÁLEZ: Journal self-citations -Scientometrics 69 (2006)
http://scientific.thomson.com/pt/produtos/WoK/wok/
