Regulatory Challenges in Bioassay Practices Tim Schofield Managing Director & Head of Non- Clinical Services Arlenda, Inc. tim.schofield.arlenda.com Presented at the 35 th Annual Midwest Biopharmaceutical Statistics May 22, 2012, Ball State University, Muncie, Indiana
Regulatory Challenges in Bioassay Practices. Tim Schofield Managing Director & Head of Non-Clinical Services Arlenda, Inc. tim.schofield.arlenda.com Presented at the 35 th Annual Midwest Biopharmaceutical Statistics May 22, 2012, Ball State University, Muncie, Indiana. Outline. - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Regulatory Challenges in Bioassay Practices
Tim SchofieldManaging Director & Head of Non-Clinical Services
Arlenda, Inc.
tim.schofield.arlenda.com
Presented at the 35th Annual Midwest Biopharmaceutical Statistics
May 22, 2012, Ball State University, Muncie, Indiana
Outline
What is a bioassay?
Bioassay guidelines
Regional differences in bioassay practices
US viewpoint on bioassay practices
QbD for analytical methods
What is a bioassay?ICH definition and requirements
Bioassay (Biological Assay) – ICH Q6B (paraphrased) Definition: The measure of the biological activity using a suitably
quantitative biological assay (also called potency assay or bioassay), based on the attribute of the product which is linked to the relevant biological properties.
A valid biological assay to measure activity should be provided by the manufacturer. Examples of procedures used to measure biological activity include:
• Animal-based biological assays, which measure an organism's biological response to the product
• Cell culture-based biological assays, which measure biochemical or physiological response at the cellular level
• Biochemical assays, which measure biological activities such as enzymatic reaction rates or biological responses induced by immunological interactions
Potency definition Specific ability or capacity of the product, as indicated by
appropriate laboratory tests or by adequately controlled clinical data obtained through the administration of the product in the manner intended, to effect a given result. [21 CFR §600.3 (s)]
Tests for potency Tests for potency shall consist of either in vitro or in vivo tests, or
both, which have been specifically designed for each product so as to indicate its potency in a manner adequate to satisfy the interpretation of potency given by the definition in § 600.3 (s) of this chapter. [21 CFR § 610.10]
What is a bioassay?FDA requirements
Measurement of activity rather than mass Specific to the mechanism of action
Usually reported as relative potency to a reference standard
Highly variable 10% to 50% RSD (versus 1% to 2% RSD for chromatographic assays)
Biology rather than chemistry
Resource intensive Time as well as materials
Usually performed on samples in a complex matrix Therapeutic proteins purified from cell culture
Vaccines produced in living systems
What is a bioassay?Distinguishing properties
Bioassay guidelines
Originally USP <111> and EP 5.3 <111> was split into two chapters, USP <1032> Design and
Development of Biological Assays and USP <1034> Analysis of Biological Assays
<1033> Biological Assay Validation added to the suite
“Roadmap” chapter (to include glossary)
6
Bioassay guidelines (cont.)
All but chapter <111> are above 1000 and therefore “informational” Not intended as enforceable (as chapters below 1000)
However, the chapters provide a set of guiding principles which might be considered by regulators in their reviews
Chapter <111> is left to support monographs which reference it USP is working towards addressing product-specific references
to prepare it for further revision
7
Regional differences in bioassay practices
Assessing “linearity” and similarity “Linearity” is the goodness-of-fit to the processing model
Similarity is the equivalence of the bioassay model parameters
• Parallelism in parallel line analysis
• Equivalence of asymptotes and Hill coefficient in 4 parameter logistic regression
• Equivalence of intercepts in slope ratio analysis
Parallel line/curve versus slope ratio analysis For some vaccines the US requires parallel line analysis while the EU requires slope
ratio analysis
Design and performance characteristics are different for the two approaches
Clinical specifications versus process consistency Growing expectation in the US that potency specifications should be supported by
clinical studies
Regional differences in bioassay practicesAssessing “linearity” and similarity
Significance testing versus equivalence testing
Laboratory A
-1.2
-0.8
-0.4
0
0.4
0.8
0.5 1 1.5 2 2.5
Log10 Concentration
Log1
0 R
espo
nse
Standard DataTest DataStandard LineTest Line
Laboratory B
-1.2
-0.8
-0.4
0
0.4
0.8
0.5 1 1.5 2 2.5
Log10 ConcentrationLo
g10
Res
pons
e
Standard DataTest DataStandard LineTest Line
p = 0.02 (p < 0.05, i.e., significantly different)
Conclude nonparallel!
Penalized for good assay performance
p = 0.08 (p > 0.05, i.e., not significantly different)
Conclude parallel!
Rewarded for poor assay performance
Paradox: significance tests reward poor work and penalize good work The greater the precision in the data,
the more likely you will fail the significance test
Solution – use an equivalence test Determine an acceptable range in a
metric related to “linearity” or similarity (LAL,UAL)
Demonstrate (TOST) that there’s acceptable similarity
• CI includes 0 = no evidence of a difference
• CI within (LAL,UAL) = similar
a: no evidence of a differencein slopes; however, possibly outsideacceptance limit (not similar)
b: no evidence of a difference in slopes; but inside acceptance limit (similar)
c: a difference in slopes; however, within acceptance limit (similar)
a b c
0
a b c
LALLAL
Note: Rewarded for good work
N=6 N=8N=4
10
Regional differences in bioassay practicesAssessing “linearity” and similarity (cont.)
UAL
Hurdles to an equivalence approach European regulation adheres to EP 5.3 The revision of EP 5.3 does not allow for other approaches Some points of view
• “Statistical significance is scientifically important”• The significance approach can be moderated by an examination of the results
• Use of historical variability
• Moderation of significance level
• May lead to subjectivity
• “Calibration” to the equivalence approach• Engineer significance approach to duplicate equivalence approach
• More straight forward to apply equivalence approach
Establishment of an equivalence margin
11
Regional differences in bioassay practicesAssessing “linearity” and similarity (cont.)
Approaches for assigning an equivalence margin – operational approaches Approach 1 – based on “process capability” of the bioassay
• Addresses only the producer’s risk• There is no penalty for a poorly designed bioassay
Approach 2 – based on “process capability” using a tolerance interval on the confidence interval
• Penalizes poor assay runs
12
Regional differences in bioassay practicesAssessing “linearity” and similarity (cont.)
Diffe
renc
e of
Slo
pes
Approach 1
Diffe
renc
e of
Slo
pes
Approach 2 -
-
Approaches for assigning an equivalence margin – quality approaches Approach 3 – based on discrimination between “good” and “bad”
behavior• Protects both producer’s and consumer’s risk
• However, how do you define/generate “bad” behavior
• Some sensitivity to clinical correspondence to “bad” behavior Approach 4 – ad hoc limits
• Based on product or assay knowledge
• Should consider potential impact to product quality
13
Regional differences in bioassay practicesAssessing “linearity” and similarity (cont.)
► There are currently regional differences in the accepted processing of some vaccines (flu)
– EU requires slope ratio while North America requires parallel line analysis
► In slope ratio analysis variability of RP is impacted by increased variability of influential regression points Slope is influenced by extreme
points
► Simulation results True relative potency equal to
• Little impact on relative potency determination with increase in assay %RSD
• Dramatic increase in RP %RSD for slope ratio assay• Assay design should be adapted to parallel line
approach (geometric doses)
Regional differences in bioassay practicesBioassay design and data processing (cont.)
US viewpoint on bioassay practicesValidation of assay format
Some US regulators believe that bioassay validation should be a verification of the procedure for obtaining a “reportable value” Groupings in time have different variability characteristics than the sum
of the variance components
Emphasis on product release ignores other uses
Some merit to this if the validation is not designed to address the issue of short term versus long term variability
• Replicate the bioassay under the same set of ruggedness conditions
2.8
3
3.2
3.4
3.6
3.8
4
4.2
0 3 6 9 12 15 18 21 24Time (Month)
Regression
0
50
100
150
200
1 10 100 1000
Res
pons
e
Concentration
Dilutional Linearity Risk of truncation error and range
Retest rules have the potential to lead to truncation bias in the reportable value
• e.g., retest when a measurement is outside the “quantifiable range” of the bioassay
Potential solutions
• Assign a value to the low/high result (e.g., ½ the LLOQ in clinical assays)
• Demonstrate a range which supports low/high potency samples (without retest)
• Retest the series using an adjusted dilution scheme
Managing variabilityBeyond random and systematic variability (cont.)
16
Test
Avg
Retest
Lot 1
Lot 5
Lot 2
Lot 3
Lot 4
US viewpoint on bioassay practicesBioassay characterization
USP allows for “Use of validation results for bioassay characterization” Use of variance components to
adapt bioassay format
• Numbers of runs (assays) and replicates to efficiently manage bioassay variability
• Identify potentially significant sources of variability
• Update technique or training
• Replicate over significant factors
% 1e100yVariabilit ormatF knˆ
kˆ 2
Replicate2Run
Format variability for different combinations of number of runs (k) and number of minimal sets within run (n)