Multiplicity problem in clinical trials and some statistical approaches by Statswork

NOV 16, 2019

Research paper

Multiplicity Problem in Clinical Trials and Some of its Statistical Approaches Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

INTRODUCTION

01 The multiplicity issue should be considered at the beginning stage i.e. starting from the design, analysis and interpretation of the study.

Researchers often face multiple testing problems in clinical trial that have an impact on type I and type II error rates resulting in invalid inference.

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

MULTIPLICITY

Inflation of type I error rate from a multiple testing problem is commonly referred as multiplicity.

02 If there exists the problem of multiplicity, then it should be adjusted in the testing problem.

01 Type I error is simply the error rate when rejecting the null hypothesis when it is true and it is referred as significance level of the trial.

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

NEED TO CONSIDER MULTIPLE TESTING ADJUSTMENTS Suppose a set of hypotheses are tested within the same study simultaneously, then the probability of rejecting at least one null hypothesis (i.e) type I error rate is increased, thereby results in a high risk of finding false positive. (For example) • Consider a study of five independent null hypotheses, and each are tested simultaneously at 5% level of significance, and the result from the test is that the overall type I error rate is 23%. However, probability of atleast one significant result will be calculated using 1−(1−α)k where k is the number of tests. • In such situation, adjustments in multiple testing problem is needed otherwise it yield invalid result that 23% chance to get atleast one significant result when the null hypothesis is actually true but we assume that the error rate is maintained at 5% level. • Also, the false positive findings depends on the sample size of the study. • Thus, multiplicity adjustment should be necessary in designing, analysing the data and interpreting the results. Research paper by Li et al (2017) discusses about various multiplicity

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

STATISTICAL APPROACHES FOR MULTIPLICITY Non - Parametric Procedures

Non - Hierarchical Hypotheses

Parametric Procedures

Statistical Approaches for Multiplicity

Simple Procedures Hierarchical Hypotheses Gate-keeping Procedures

1. Bonferroni Procedure 2. Simes Procedure 3. Holm Step-Down Procedure 4. Hochberg Step-Up Procedure 5. Hommel Procedure

1. Dunnet Procedure

1. Fixed - Sequence Procedure 2. Fallback Procedure

1. Serial Gate-keeping Procedures 2. Parallel Gate-keeping Procedure 3. Other Extensions of Gatekeeping Procedures

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

MULTIPLICITY PROCEDURES Gatekeeping Procedure Used in situation when there are multiple endpoints and are grouped into different families. Dunnett or stepdown Dunnett procedure Used if there is a prior evidence about the test is more significant. Fixed Sequence Procedure Stepwise multiple testing procedure that is constructed using a pre-specified sequence of hypotheses. Disadvantage of this procedure is that • Power will be maximized as long as previous hypotheses are rejected, but minimized if a previous hypothesis is not rejected. • Ordering of multiple hypotheses based on the clinical importance is subjective in nature.

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

FALLBACK PROCEDURE

It is similar to a fixed sequence test, in which hypotheses are tested in an a priority order at the full alpha level.

01 02

Full alpha of 0.05 is split for endpoints in a pre-specified order and the hypotheses in late order can still be tested (but with different alpha levels) if the previous hypothesis is not rejected.

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

CONCLUSIONS

Multiplicity problem is not uncommon in the clinical trials if we have one or more treatment in the study.

More appropriate statistical method is necessary to deal with the multiplicity problem which reduces the false positive findings under the assumed null hypothesis.

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

Statswork Lab @ Statswork.com www.statswork.com

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics

PHONE NUMBER UK

: +44-1143520021

INDIA

: +91-4448137070

EMAIL ADDRESS info@statswork.com

GET IN TOUCH WITH US

Freelancer Consultant Guest Blog Editor CONTACT hr@workfoster.com

Research Planing | Data Collection | Semantic Annotation | Consumer & Retail Analytics | Econometrics