Top Banner
Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El Hage, Ph.D., Chief Good Clinical Practices Branch II, DSI FDA October 2001
57

Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Dec 14, 2015

Download

Documents

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Scientific Misconduct-The “F” word-

Stan W. WoollenAssociate Director for Bioresearch Monitoring

Office for the Good Clinical Practices

and

Antoine El Hage, Ph.D., Chief

Good Clinical Practices Branch II, DSI

FDA

October 2001

Page 2: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Questions for the Session

• "FDA Misconduct Focus Areas: What are They and Does the Data Reinforcethe Agency Concerns?”– Falsification, yes

• "How can Industry/QA Vigilance

 Minimize Scientific Misconduct?”– QA Role=Prevention, detection, correction

Page 3: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

What is Misconduct?FDA’s Focus

• Recognizing Research Misconduct– Research misconduct means Falsification of

data in proposing, designing, performing, recording, supervising or reviewing research, or in reporting research results.

– Falsification includes acts of omission and commission.

Page 4: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Types of Falsification• Acts of omission

– consciously not revealing all data

(e.g. reportable adverse events, concomitant meds., etc)

• Acts of commission– consciously altering data or Fabricating data

(e.g. lab values, BP readings, bogus specimens)

• Data is interpreted broadly– individual facts, statistics, tissue samples, items

of information, statements made by individuals

Page 5: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

What is Misconduct?FDA’s Focus

• Deliberate or repeated noncompliance with the regulations can be considered misconduct, but is secondary to falsification of data.

• Research misconduct does not include honest error or honest differences of opinion.

Page 6: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Consequences of Fraud

• If fraud takes place in a clinical trial, it places all subjects in that trial at possible safety risk

• Fraud jeopardizes the reliability of submitted and/or published data and undermines the Agency’s mission to protect and promote the public health

Page 7: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Consequences of Fraud

• Though Fraud is encountered on a relatively rare basis, its impact is broad.

– Seriously noncompliant CIs are often used by

multiple sponsors on multiple trials

– Small number of investigators can have a broad impact on many applications by many sponsors

Page 8: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Applications and Sponsors Associated with Violative CIs

CI Applications Sponsors

A 91 47

B 49 25

C 43 21

D 21 17

E 12 6

F 6 6

G 92 48

Page 9: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Falsification -A chronic problem-

• Tony’s Tales 1990-2001 – What types of data were falsified

– How was data falsified

– Why was data falsified

– Who did it

– How was it detected

• QA- tips for preventing, detecting correcting

Page 10: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Types of Data Falsified

• EKGs

• Blood Pressure Data

• Physical and lab examinations

• Biological Specimens

• Subject Identities

• Drug Compliance Records

• You name it

Page 11: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

EKGs -a common problem• Circa 1990

– Kept stock files of EKGs etc.

– Made identical/duplicate prints of x-rays with different names

– Obtained blank copies of lab reports. Used a different numbering system than numbering system used by the lab

• Multiple copy records:

– No originals of a particular lab report - all were photocopies

• Dr. S

– Faked subjects: used names obtained from the obituary column

– CRF completed after subjects died

– Had unopened cartons of the investigational drug

Page 12: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

EKGs a common problem• - 1998

– Dates were misrepresented on EKGs to coincide with protocol required visits (5)

– Used 5 year old EKG tracings

– Dates were changed in 5 records to match the washout periods required by the protocol

– Five subjects received prohibited medication while on the study

– Five subjects did not sign consent forms before entering the study

– Seven subjects EKGs were not done at Visit 1 per protocol

– 4 subjects had discrepancies between progress notes and what was reported in the CRFs

Page 13: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

How is Data Falsified

• EKGs– Continuous strip run on one patient

then torn in half and represented as coming from two subjects

– Preprinted subject identifying information altered or obliterated on existing EKGs

– Dr. Xerox will see you now

Page 14: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

How is Data Falsified

• Blood Pressure Data

– Blood pressure measurements and

times changed in source documents to

match CFR and vice versa

Page 15: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Blood pressure data questioned during in-house review

Baseline F. Visit Mean ⎠ Baseline F. Visit Mean ⎠

SupineSys. BP 180 161 -19 178 171 - 7

Dias. BP 114 100 - 14 112 109 - 3

Stand.Sys. BP 178 159 -19 176 169 - 7

Dias. BP 114 100 - 14 113 110 - 3

94 subjects Data Listing

Page 16: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Mind if we inspect?

Sponsor’s answer- It was concluded that inconsistencies in the

source documentation would make it difficult to trace or verify some of the key information. As a result of our findings, we recommend that the agency’s planned visit to the study sites for June 1997 be cancelled.

NDA Withdrawn

Page 17: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

What we see in the submissionSubject # Week Date Reading Systolic Diastolic

31 4 10/30/92 1 185 95

2 185 95

3 180 90

4 180 90

Average 182.50 92.50

8 11/27/92 1 190 95

2 180 90

3 180 90

4 175 90

Average 181.25 91.25

Page 18: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

What we find on site

Reading Week 4 Week 8 Week 4 * Week 8 *10/30/92 11/27/92 10/30/92 11/27/92

First 195/99 198/95 185/95 190/95

Second 185/95 180/100 185/95 180/90

Third 198/103 180/98 180/90 180/90

Fourth 195/95 195/105 180/90 175/90

Average 193.2/85 185/99.5 182.5/92.5 181.25/ 113.75

Original Case Report Form * Handwritten changes by G. Mon 11/18/93 - Changes are to reflect the medical chart (No source data)

Page 19: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

The explanation

• How about the BP readings?– You cannot find them in “books”

– They are “rare” but real, and they occur in this country

• Our population is different from the U.S. population and that is why you see consistent BP readings over time (6 months)

Page 20: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

How is Data Falsified

• Physical and/or Lab Exams

– Documented only by checked blocks in CRF

signed by study coordinator and co-signed by

PI. No corroborating source documents.

– Bogus lab results reported

Page 21: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Clinical Fraud Cases

Subject # Parameter Actual Value Reported Inclusion

T03419 Uric Acid 10.8 6.8 #7.5mg/dlT05139 “ 8.1 6.2 “T03311 “ 13.6 8.6/8.2 #9.0mg/dlT02965 “ 10.1 8.0 “T03304 Hemoglobin 7.6 8.3 $8.0mg/dlT01767 “ 7.7 9.7 “T02944 “ 8.1 10.4 “T02958 “ 7.9 8.0 “T01619 Platelets “clumped” 140,000 $50,000mm3

T01767 Creatinine 2.8 2.3 #2.5mg/dlT05566 CD4 225 195 <200mm3

T02937 SGOT 241 141 #5x upperSGPT 205 159 Limit

T02944 WBC 800 1300 <1,500mm3

Neutrophils 44 800 <750mm3

Fabricated Data

Page 22: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

How is Data Falsified

• Biological Specimens

– Samples purported to come from a

large number of individual subjects

actually derived from only a few

different subjects.

Page 23: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

The “F” Case

• Robert Fiddes, MD

– Guilty - Conspiracy to commit an offense against the United States

– Guilty - Making false statements in matter within jurisdiction of the FDA (18 USC 1001)

• Sentenced - 15 months in jail (see newspaper)

• Fined - $800,000

• Deported

Page 24: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

New York TimesMay 17, 1999

RESEARCH FOR HIRE: SECOND OF TWO ARTICLES

A Doctor's Drug Studies Turn Into

Fraud

By KURT EICHENWALD and GINA KOLATA

Page 25: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

NY Times AllegationFabrication the undetectable crime?

• “Another study on an antibiotic required that patients have a certain type of bacteria growing in their ear. No problem for Fiddes. He bought the bacteria from a commercial supplier and shipped them to testing labs, saying they had come from his patients' ears.”

Page 26: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

NY Times Allegation

• The FDA investigators asked (Fiddes), what evidence of fraud is there in the records reviewed by monitors and the government? What could the watchdogs have seen that would have allowed them to detect his fraud?

Page 27: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

NY Times Allegation

• “Nothing, Fiddes replied. Had it not been for a disgruntled former employee, he would have still been in business.”

Page 28: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Bogus specimensA new era in detection?

• Chronic Bronchitis Study – 84 subjects enrolled, required to produce positive

sputum samples to qualify for study– Monitor reported that sputum samples were not

collected per the protocol (i.e. in presence of the investigator)

– FDA inspected and sponsor audited to validate data. No direct evidence of a problem with specimen integrity

Page 29: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Clinical Fraud Casesdetecting the undetectable

• Sponsor performed DNA analysis on sputum and serum samples to put concerns to rest.

• Analysis showed 35 of 84 sets of subject serum and sputum samples did not match

• 26 sputum samples were found to be derived from only 3 subjects

Page 30: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

How is Data Falsified

• Subject Identities

– Same subject enrolled more than once under

two different names and subject numbers

– Nonexistent subjects created

Page 31: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Clinical Fraud Cases

Dr. P

– Fabricated laboratory data and eye exams - all subjects

– Created data for subjects by using available results from different subjects

– Recycled subjects (3x) and invented data (EKG tracings, duplicate lab results)

– Used 2 year old EKG tracings

– Disqualified (Hearing)

Page 32: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Clinical Fraud Cases

• Dr. K. - 1987– 85 cases submitted - ONLY 15 were real subjects

– Faked approximately 70 subjects records

– Never used test article - used marketed products

– Did not obtain informed consent

• Disqualified

• Sentenced - 400 hours of community service

• Fined - $30,000

Page 33: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

How is Data Falsified

• Drug Compliance Records

– Returned study drug dumped, 100%

compliance in taking test medication

recorded in CRF

Page 34: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Why is Data Falsified? We might be cynical, but we weren’t born that way

Reasons why records not available:

• “They were destroyed in a hurricane”

• “They were lost in a boating accident”(burglary, robbery or vandalism)

• “They were lost in the mail”

• “The mover threw them out”

• “My father-in-law threw them out”

Page 35: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Why is Data Falsified? We might be cynical but we weren’t born that way

• I destroyed the records. You were not informed by the sponsor!!?

• I did not know that the medical charts and CRFs (data) must correspond.

• I do not remember why I changed the dates (visits)

• I care for my subjects, used the “best available local therapy”

• I do not see a problem with re-entering a subject 5 or 6 times (considering them as six different subjects)

Page 36: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Why is Data Falsified• Reasons are not always known or

clear, and often can only be inferred– To qualify ineligible subjects to enroll

or continue on the study

– To please the bosses by filling in the blanks and making the source documents match the CRF

– For fun and profit

Page 37: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Why is Data Falsified?

• “Edged into it” - rarely primary intent

• Not enough time or loss of interest

• Staff turnover

• Not enough subjects

• For “good of subject”

• Pressure to publish

• Power & prestige

• Money

Page 38: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Who Does It??• Anyone at investigator’s site who has access

to data – Principal Investigator

– Study coordinator

– Research Subjects

– Study Nurse

– ?????????

Page 39: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

NY Times AllegationTHENURSEDIDIT Maneuver

The last refuge of a scoundrel

• "Dr. Fiddes replied that they were going to blame the study nurse for all of the problems, and he was going to say he had no knowledge of what was going on."

Page 40: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

The Blame GameWho gets the blame?

n (parties blamed) = 23n (cases) = 20

39%

17%9%

9%

9%

9%4% 4%

Page 41: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

QA’s Role in Dealing with Misconduct

• Prevention– Identify and eliminate/minimize risk factors for

misconduct

• Detection– Monitor and recognize signs of fraud

• Correction– Promptly investigate and report fraud

Page 42: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Tips for Preventing Fraud

• Make sure all study staff have the necessary resources and support needed to accomplish their tasks

• Don’t place needless requirements or unreasonable demands on the site

• Monitor sites closely and pay attention to complaints from site personnel

• Minimize the use of enrollment incentives

Page 43: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Approaches in Detecting Fraud (Rules?)• Tip/nose/experience/gut feeling• Understand the protocol or plan• Parameters that determine eligibility

(inclusion/exclusion criteria)

• Accept no copies - originals• Identify all source/supporting documents• Look for mistakes/changes/inconsistencies• Frequency of changes - identify who made them• Determine & document if changes are justified• Challenge suspicious data• Ask for all information (data) pertinent to the study

(CRF, AB, CPF, MV-MR, X-R, EKG, DIA, etc.)

Page 44: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Tips for Detecting Serious Misconduct

• Get Technical-Read x-rays, EKGs, lab results, don’t just inventory

• Fill in the Blanks-Question missing dates, times, information,offer to retrieve records yourself

• Don’t be intimidated-tell the emperor he has no clothes

Page 45: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Tips for Detecting Serious Misconduct

• Don’t shoot the messenger-believe the monitor, put the burden of proof on the CI

• Be suspicious of blame shifting-tell CI he/she is totally responsible for the conduct of the study

• Expect Fraud-Start from the assumption the records are bogus and the study is a fraud, and work back

Page 46: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Tips for Detecting Serious Misconduct

• Cultivate Whistleblowers-establish rapport with study staff, be approachable and available, listen to grievances, observe working conditions

Page 47: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Who Complains?---Everybody!FY 2000

n = 118

14%

11%

9%8%

19%

9%

3%

3%

8%5%

2% 2%

8%

Page 48: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

What Are They Complaining About? Everything!!

• Failure to follow the protocol (70)

• Falsification (67)

• Informed Consent Issues (55)

• Failure to report adverse events (40)

• Qualifications of persons performing physicals (27)

• Inadequate Records (25)

• Failure to get IRB approval, report changes in research (20)

• Failure to follow FDA regulations (13)

• Charging for the test article (9)

• Drug accountability (7)

• No active IND (7)

• Violations of GLP regs (7)

• Misleading advertisements (5)

• Blinding (3)

• No 1572 (2)

• Monitoring practices (2)

• IRB shopping (1)

Page 49: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Clinical Investigator Inspections*FY 1999

n= 306

52%

44%

3%0.3%

*All inspections, domestic & foreign

Page 50: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Complaints Inspected and Their Classifications

26%(n= 27)

n= 105

26%26%

52%

n= 27

Page 51: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Correcting MisconductHow You can help

FDA Wants You to Recognize and Report Research Misconduct

Page 52: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

FDA Believes Sponsors should Promptly Report...

• Any information they have that any person involved in human subject trials committed research misconduct

• Whenever the sponsor discovers misconduct

• Not just for clinical investigators and not just when a clinical investigator is terminated

Page 53: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Correcting Misconduct

• Reporting Research Misconduct– Name of the person(s) – Contact information – Specific identity of the affected research

• IND/IDE #, protocol, study title, and study dates

– As much information regarding the research misconduct as is available to the sponsor.

Page 54: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Where to Report Misconduct

Drugs– Division of Scientific Investigations

(HFD-45), Office of Medical Policy, Center for Drug Evaluation and Research, FDA, 7520 Standish Place, Room 103, Rockville, Maryland 20855-2773, (301) 594-0020, fax (301) 594-1204.

Page 55: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Where to Report Misconduct

Biological Products• Office of Compliance and Biologics

Quality, Division of Inspections and Surveillance, Center for Biologics Evaluation and Research, (HFM-650), FDA, 1401 Rockville Pike, Room 400S, Rockville, Maryland 20852-1448, (301) 827-6221, fax (301) 443-6748.

Page 56: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Where to Report Misconduct

Medical Devices– Office of Compliance, Division of

Bioresearch Monitoring, (HFZ-310), Center for Devices and Radiological Health, FDA, 2098 Gaither, Room 130, Rockville, Maryland 20850, (301) 594-4718, fax (301) 594-4731.

Page 57: Scientific Misconduct -The “F” word- Stan W. Woollen Associate Director for Bioresearch Monitoring Office for the Good Clinical Practices and Antoine El.

Tips for Dealing with Serious Misconduct

Be Prepared- have a system in place to capture, document and deal with complaints of misconduct in a timely fashion. Follow your SOPs!!!!