Top Banner
Improving CDISC SDTM Data Quality & Compliance Right from the Beginning Bharat Chaudhary, Cytel Padamsimh Balekundri, Cytel Session CD08 – PhUSE 2015, Vienna
41

Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Jul 09, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Improving CDISC SDTM Data Quality & Compliance

Right from the Beginning

Bharat Chaudhary, CytelPadamsimh Balekundri, Cytel

Session CD08 – PhUSE 2015, Vienna

Page 2: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Agenda

• Background

• Overview: SDTM Development

• The Problem: In SDTM Development

• Our Solution: Set of Utilities

• Summary

2PhUSE 2015: CD08

Page 3: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Background

• SDTM (Study Data Tabulation Model)

• Beneficial for clinical data reviewers & analysts as it brings standardization in presenting the data

• Complexity of standards - Risk of compliance issue – Rework

• Validation tools & Techniques - Limitations

• Scope for Improvement – Ideas

3PhUSE 2015: CD08

Page 4: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Overview: SDTM Development

aCRFSDTM

Specification SDTM Programdevelopment

SDTM datasets

OpenCDISCValidator

CDMS Data SDTM

independentvalidation

4PhUSE 2015: CD08

Page 5: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

REWORK

The Problem: In SDTM development

aCRFSDTM

Specification SDTM Programdevelopment

SDTM datasets

OpenCDISCValidator

CDMS Data SDTM

independentvalidation

5PhUSE 2015: CD08

Page 6: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution

aCRFSDTM

Specification SDTM Programdevelopment

SDTMdatasets

OpenCDISCValidator

CDMS Data SDTM

independentvalidation

6PhUSE 2015: CD08

What can be done?

REWORK

12

3

Page 7: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

PhUSE 2015: CD08 7

Steps to go throughRework Area

Solution

Utility

With & Without

Page 8: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

PhUSE 2015: CD08 8

Solution 1

Page 9: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1

aCRFSDTM

Specification SDTM Programdevelopment

SDTMdatasets

OpenCDISCValidator

CDMS Data SDTM

independentvalidation

ü We might miss the basics while creating the SDTM spec (specification)

ü End up creating multiple versions of spec

9PhUSE 2015: CD08

Rework Area

Page 10: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1

SDTM Spec Checker

ü Identify compliance issues at spec level, even before programming

ü Minimize the number of spec versions, which saves time & efforts

(SSC)

10PhUSE 2015: CD08

Solution

Page 11: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1

SingleWindowView

Technology: MS ExcelInputs: SDTM SpecExecution Time: < 1 Min

(SSC)Framework

11PhUSE 2015: CD08

UtilitySDTM IG

Standards

ImportedMetadata

from SDTM spec

Result

COMPARE

Page 12: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1

1. SDTM Mapping specification open/active

(SSC)Execution Step

12PhUSE 2015: CD08

2. SDTM Spec Checker

Utility

Page 13: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1(SSC)

13PhUSE 2015: CD08

Utility

Page 14: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1(SSC)

14PhUSE 2015: CD08

Utility

Page 15: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1(SSC)

15PhUSE 2015: CD08

Utility

Page 16: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1(SSC)Final Report

16PhUSE 2015: CD08

Utility

Page 17: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1(SSC)Final Report

17PhUSE 2015: CD08

Utility

Page 18: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 1

18PhUSE 2015: CD08

Average time taken to review the SDTM Specification with 10 domains.

3-4Hrs

<20Min

(SSC)

With & Without

Page 19: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

PhUSE 2015: CD08 19

Solution 2

Page 20: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2

aCRFSDTM

Specification SDTM Programdevelopment

SDTM datasets

OpenCDISCValidator

CDMS Data SDTM

independentvalidation

ü SDTM compliance & Data consistency errors are not identified

ü End up doing multiple validation cycles

20PhUSE 2015: CD08

Rework Area

Page 21: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2

SDTM Dataset Checker

ü Identify data quality and SDTM compliance issues at development stage

ü Minimize the number of validation cycle, which saves time & efforts

(SDC)

21PhUSE 2015: CD08

Solution

Page 22: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2Framework

Technology: SAS MacroInputs: SDTM SAS DatasetExecution Time: < 5 Min

(SDC)

SDC Utility

22PhUSE 2015: CD08

SDTM datasets

Utility

Page 23: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Framework

ü Having inbuilt checks

ü First these checks will apply on the Domain

Master Macro

23PhUSE 2015: CD08

Utility

Page 24: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Framework

ü It’s a reference file

ü Having metadata of commonly used CDISC SDTM IG versions

CDISC Master file

24PhUSE 2015: CD08

Utility

Page 25: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Framework

ü Having Checks in this excel fileü User can add any number of custom checks

SDTM Checks file

25PhUSE 2015: CD08

Utility

Page 26: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Framework

ü User-defined checks

ü If user wants to add any complex algorithm

Study Specific macro

26PhUSE 2015: CD08

Utility

Page 27: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Execution Step

§ To apply on all domains in sdtm library :

%sdtm_chk (sdtm_v=3.1.2, lib= sdtm);

§ To apply on specific domain (i.e. LB) :

%sdtm_chk (sdtm_v=3.1.2, lib= sdtm, check=lb );

27PhUSE 2015: CD08

Utility

Page 28: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Final Report

ü Easy navigation & filtering can be applied for better understanding of issues

28PhUSE 2015: CD08

Utility

Page 29: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Real Life Example

§ Date of early visit > Date of later visit

§ Duplicate records

29PhUSE 2015: CD08

§ Unexpected Results

Utility

Page 30: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2(SDC)Real Life Example

§ Non missing –-ORRES & –-ORRESU but --STRESC is blank

§ Incorrect order of variables, USUBJID before DOMAIN

30PhUSE 2015: CD08

Utility

Page 31: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 2

31PhUSE 2015: CD08

Average time taken to review the SDTM SAS Dataset with 1 domain.

2-3Hrs

<25Min

(SDC)

With & Without

Page 32: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

PhUSE 2015: CD08 32

Solution 3

Page 33: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 3

aCRFSDTM

Specification SDTM Programdevelopment

SDTM datasets

OpenCDISCValidator

CDMS Data SDTM

independentvalidation

ü Repeat runs of OpenCDISC validator for same study

ü Possibility of missing to identify new issues each time we run the validator

33PhUSE 2015: CD08

Rework Area

Page 34: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 3

ü It saves time on multiple report reviews for the same study, by

(OCR)

• Importing and aligning comments from previous/first report

• Identifying new errors/warnings

34PhUSE 2015: CD08

OpenCDISC Report Reviewer

Solution

Page 35: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 3Framework

Technology: MSExcel-VBAMacroInputs: ReviewedOpenCDISCReportExecution Time: < 2 min

(OCR)

Reviewed Report OCR Utility New Summarized Report

Importing Comments

35PhUSE 2015: CD08

Utility

Page 36: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 3(OCR)Execution Step

ü First reviewed OpenCDISC Report

36PhUSE 2015: CD08

ü New reportUtility

Page 37: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 3(OCR)Execution Step

ü Utility will import comments from previous report and align them with new report

37PhUSE 2015: CD08

ü Filter out ‘New Errors’ and address it, Instead of reviewing entire report

Utility

Page 38: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 3(OCR)

ü The OCR utility also generates the summary report

38PhUSE 2015: CD08

Final Report

Utility

Page 39: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Solution 3

39PhUSE 2015: CD08

Average time taken to review new errors in OpenCDISC Reports.

2-3Hrs

<2Min

(OCR)

With & Without

Page 40: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

SSC

REWORK

aCRFSDTM

Specification SDTM Programdevelopment

SDTM datasets

OpenCDISCValidator

CDMS Data SDTM

independentvalidation

Summary

SDC

OCR

40PhUSE 2015: CD08

Page 41: Improving CDISC SDTM Data Quality & Compliance Right from the … · 2017-10-08 · Background • SDTM (Study Data Tabulation Model) • Beneficial for clinical data reviewers &

Questions ?

PhUSE 2015: CD08 41

Thank you !!

[email protected]@cytel.com