Bioterrorism Research

TOPICAL THEME FOR TODAY–BIOTERRORISM

2

TOPICAL THEME FORTODAY-BIOTERRORISM• The topic of bioterrorism comprises a variety of

topics and approaches, and is timely.

• Notable among the highly cited papers are reportson the genome sequences or the specificbiochemical actions of the pathogens underlyinganthrax, smallpox, plague, and other scourgeswhose causative agents have the potential to beweaponized.

3

TOPICAL THEME FORTODAY-BIOTERRORISM (cont.)• Additional topics include the technology of

bio-sensors and other means of detection, alongwith the development of vaccines and othercounter-measures.

• Other papers assess the public-health andenvironmental aftermath of the 9/11 attacks, oroffer more general discussions of preparednessand emergency management.

4

HOW DID WE DEFINE THE TOPIC?• Searched titles, abstracts,

and keywords across Webof Science-– Science Citation Index

Expanded– Social Science Citation

Index– Arts and Humanities

Citation Index– Conference Proceedings

Citation Index- science– Conference Proceedings

Citation Index- socialscience/humanities

agroterror* bio defen*

bio* containm* Biodefen*

biochemicalweapon* biological war*

chem* attack Counterterroris*

emergencypreparedness

homelandsecurit*

nerve agent* germ war*

bio* attack* anthrax*

bioterror* Biothreat*

5

YOU NEED TO KNOW…• What are the hot topics related to bioterrorism?

• Who are the key researchers?

• Which countries and institutions are most active inthis topic? Which are most highly cited?

• Which US government organizations are focusingmore on bioterrorism research?

• Who’s collaborating in this area?

• What journals focus on the topic?

• What funding agencies most frequently fund thisresearch?

6

ABOUT THIS DATASET- BIOTERRORISM

7

ABOUT THIS DATASET-BIOTERRORISM (CONT.)• 15,290 journal articles in 239 journal categories

(1981-2008)

• 2,485 conference proceedings papers

• 63% of papers were cited

• 138,789 total citations received, for an average of9.08 cites/paper– 76% of the materials are articles and reviews, and they

have an average citation rate of 11.46

8

ABOUT THIS DATASET-BIOTERRORISM (CONT.)• 176 of the papers (1.5% of the set) are in the top

1% of their field. Almost 800 are in the top 10%of their field.

• The research appeared in over 3,000 journals.

• Research from 142 countries

9

RESEARCH ON BIOTERRORISM HASINCREASED, PARTICULARLY IN THE PAST 5YEARS

10

TOP SUBJECT CATEGORIESJOURNAL CATEGORY PAPERS

PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH 1,145

MICROBIOLOGY 1,060

BIOCHEMISTRY & MOLECULAR BIOLOGY 1,040

IMMUNOLOGY 958

MEDICINE, GENERAL & INTERNAL 889

CHEMISTRY, ANALYTICAL 885

CHEMISTRY, MULTIDISCIPLINARY 839

INFECTIOUS DISEASES 794

BIOTECHNOLOGY & APPLIED MICROBIOLOGY 776

MULTIDISCIPLINARY SCIENCES 769

11

DRILL DOWN TO SPECIFIC TOPIC:ANTHRAX

12

MOST HIGHLY CITED PAPER-LAST 10 YEARSGenome sequence of Yersinia pestis, the causativeagent of plague. Nature 2001 (article)

Average citationsspecific to journal, year,and document type

Percentile rank specific to fieldand year. The closer to zero,the more highly cited.

Citations received per year

13

ROLE-UP METRICS INTO SUMMARY FIGURESE.G. ALL US NAVY RESEARCH

Productivity # papers 156

Total influence # citations 2,343H-index 26

Efficiency Avg. citation rate 15.02

Percent of papers cited 82.05

H-index: This statistic reflects the number of papers(N) in a given dataset having N or more citations.26 of US Navy's 156 papers were cited at least26 times each.

14

ROLE-UP METRICS INTO SUMMARY FIGURESE.G. ALL US NAVY RESEARCH (CONT.)

C-index (journal performance ratio): equals thesum of all actual citations divided by the sum of all theexpected citations, producing a ratio of actual toexpected for a group of papers.

Relative Impact/Bench-marking

C-index 1.20

Average percentile 40.61

% papers in top 10% of their field 38

% papers in top 1% of their field 4.23

Special-ization Disciplinarity index 0.04

15

ROLE-UP METRICS INTO SUMMARY FIGURESE.G. ALL US NAVY RESEARCH (CONT.)Average percentile: average of the percentilemeasurements for the papers in this set.

•Indicates performed overall, with each paper’s citationcount having been normalized for its field of study andyear.

Relative Impact/Bench-marking

C-index 1.20

Average percentile 40.61

% papers in top 10% of their field 38

% papers in top 1% of their field 4.23

Special-ization Disciplinarity index 0.04

16

WHICH COUNTRIES ARE MOST ACTIVE?

47% of papers have only US authors

Bioterrorism research:Papers per country, 1999-2008

17

COMPARE COUNTRIES WITHCITATION METRICS

TotalPapers

TotalCites

Avg.Citesper

PaperH

Index

C Index(Journal

PerformanceRatio)

Avg.Percentil

e

USA 6,764 67,816 10.03 91 1.03 49.89

China 207 1,223 5.91 15 1.17 59.09

India 216 1,144 5.30 17 0.80 63.49

Germany 473 4,199 8.88 33 1.00 51.89

Allbioterrorism

papers12,316 96,710 7.85 94 1.01 53.98

These metrics normalizefor field, age, and sizedifferences.

18

COMPARE COUNTRIES WITHCITATION METRICS (CONT.)

TotalPapers

TotalCites

Avg.Citesper

PaperH

Index

C Index(Journal

PerformanceRatio)

Avg.Percentil

e

USA 6,764 67,816 10.03 91 1.03 49.89

China 207 1,223 5.91 15 1.17 59.09

India 216 1,144 5.30 17 0.80 63.49

Germany 473 4,199 8.88 33 1.00 51.89

Allbioterrorism

papers12,316 96,710 7.85 94 1.01 53.98

These metrics normalizefor field, age, and sizedifferences.

USA

China

19

COMPARE COUNTRIES WITHCITATION METRICS (CONT.)

TotalPapers

TotalCites

Avg.Citesper

PaperH

Index

C Index(Journal

PerformanceRatio)

Avg.Percentil

e

USA 6,764 67,816 10.03 91 1.03 49.89

China 207 1,223 5.91 15 1.17 59.09

India 216 1,144 5.30 17 0.80 63.49

Germany 473 4,199 8.88 33 1.00 51.89

Allbioterrorism

papers12,316 96,710 7.85 94 1.01 53.98

These metrics normalizefor field, age, and sizedifferences.

India

Germany

20

COMPARE COUNTRIES WITHCITATION METRICS (CONT.)

TotalPapers

TotalCites

Avg.Citesper

PaperH

Index

C Index(Journal

PerformanceRatio)

Avg.Percentil

e

USA 6,764 67,816 10.03 91 1.03 49.89

China 207 1,223 5.91 15 1.17 59.09

India 216 1,144 5.30 17 0.80 63.49

Germany 473 4,199 8.88 33 1.00 51.89

Allbioterrorism

papers12,316 96,710 7.85 94 1.01 53.98

These metrics normalizefor field, age, and sizedifferences.

World

21

WHO’S COLLABORATINGCoauthored

Papers(1999-2003) Country Country

31 England USA

25 France USA

23 Canada USA

19 Germany USA

13 Russia USA

11 Australia USA

11 Italy USA

10 India USA

9 Israel USA

7 France Italy

7 Japan USA

7 Netherlands USA

6 Australia England

CoauthoredPapers

(2004-2008) Country Country

102 Canada USA

59 England USA

50 Germany USA

32 Australia USA

30 France USA

29 Peoples RChina USA

26 Israel USA

23 France Germany

23 Japan USA

20 England Germany

20 Sweden USA

19 Italy USA

19 Switzerland USA

22

HIGH IMPACT INSTITUTIONS

Organization Papers

1 US Army 581

2Ctrs. Disease Control &Prevent 373

3 Harvard University 222

4 Johns Hopkins Univ 179

5 US Navy 155

6 NIAID 125

7 University of Pittsburgh 110

8 Texas A&M Univ 104

9 University Maryland 99

10 University Michigan 99

Most prolificOrganization Cites

1 US Army 9,621

2Ctrs. Disease Control &Prevent 6,912

3 Johns Hopkins University 5,006

4 Harvard University 4,859

5 NIAID 2,692

6 Inst Pasteur 2,404

7 US Navy 2,342

8 Def Sci & Technol Lab 2,190

9 University Michigan 2,027

10 New York City Dept Health 1,826

Most highly cited

23

WHICH INSTITUTIONS COLLABORATENumber ofcoauthored

papers (1999-2008)

35 Ctrs Dis Control & Prevent Emory Univ

30 US Army Uniformed Serv Univ Hlth Sci

21 Ctrs Dis Control & Prevent New York City Dept Hlth

20 Battelle Mem Inst US Army

20 Geocenters Inc US Army

20 NCI US Army

20 New Mexico State Univ Univ Calif Riverside

18 Harvard Univ Massachusetts Gen Hosp

17 Uniformed Serv Univ Hlth Sci Walter Reed Army Inst Res

16 Ctrs Dis Control & Prevent US Army

939 total citations26.54 avg cites/paper

24

WHO ARE THE INFLUENTIAL AUTHORSON THIS TOPIC?

Arthur Friedlander, M.D.

Senior Scientist, United States Army Medical Research Institute forInfectious Diseases (USAMRIID), Frederick, MD

25

WHO ARE THE INFLUENTIAL AUTHORSON THIS TOPIC? (CONT.)

Arthur Friedlander, M.D.

Senior Scientist, United States Army Medical Research Institute forInfectious Diseases (USAMRIID), Frederick, MD

http://www.usmedicine.com/article.cfm?articleID=1784&issueID=114

26

AM FRIEDLANDER

Productivity # papers 42

Totalinfluence

# citations 2,788

Self-citingpapers

29

H-index 21

Efficiency Avg. citationrate

66.38

Percent ofpapers cited

88.10

Relative Impact/Bench-marking

C-index 2.42

Averagepercentile

14.68

% papers in top10% of their field

57

% papers in top1% of their field

17

Special-ization Disciplinarity index 0.13

27

COMPARE RESEARCHERS,INSTITUTIONS, ETC.

TotalPapers

TotalCites

Avg.Citesper

Paper

HInde

x

C Index(Journal

PerformanceRatio)

Avg.Percentil

eFriedlander, AM

US Army, MedicalResearch Institute forInfectious Diseases

42 2,788 66.38 21 2.42 14.68

All US Army(bioterrorism research)

582 9,625 16.54 43 1.34 46.10

Quinn, CPCtrs for Disease Control

32 978 30.56 14 2.12 27.13

All of CDC(bioterrorism research)

373 6,912 18.53 38 1.13 42.18

All bioterrorismpapers

12,316 96,710 7.85 94 1.01 53.98

These metrics normalize forfield, age, and size differences.

28

WHICH JOURNALS FOCUS ON THIS TOPIC?

Papers Journal Cites2007 impact

factor

282BIOSECURITY AND BIOTERRORISM‐BIODEFENSE STRATEGY PRACTICE AND SCIENCE 534 1.88

243 CHEMICAL & ENGINEERING NEWS 65 0.38

219 SCIENCE 2,562 26.37

184 STUDIES IN CONFLICT & TERRORISM 85

180 NATURE 3,385 28.75

179ABSTRACTS OF PAPERS OF THE AMERICANCHEMICAL SOCIETY 6

29

WHICH FUNDING AGENCIES ARE SUPPORTINGRESEARCH ON BIOTERRORISM TOPICS?

Funding bodyNumberof papers(2008)

NIH 57

NIAID 13

US Army 13

US Dept Energy 12

NSF 12

30

TODAY WE FOCUSED ON ATOPICAL ANALYSIS• However, these metrics and types of analysis are

often used for performance assessment activities:– Analyze your intramural or extramural research

Which programs are producing world class research?

Which researchers are standing out from the rest?

How does our research compare with our peerinstitutions?

Did our investments in new staff or research facilitiespay off?

31

EVALUATE RESEARCH OUTCOMES:TRACK, MEASURE, RANKIntegrate citation metrics into strategic planning andperformance review

Use objective measures of R&D for internal reviews,funding acquisition

32

EVALUATE RESEARCH OUTCOMES:TRACK, MEASURE, RANKUse objective measures of R&D for internal reviews,funding acquisition

33

EVALUATE RESEARCH OUTCOMES:TRACK, MEASURE, RANKPromote research accomplishments