Top Banner
Clinical Trials in Psychiatry Second Edition Brian S. Everitt Institute of Psychiatry, King’s College London, UK Simon Wessely Institute of Psychiatry, King’s College London, UK
25

Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Oct 08, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Clinical Trials inPsychiatrySecond Edition

Brian S. Everitt

Institute of Psychiatry, King’s College London, UK

Simon Wessely

Institute of Psychiatry, King’s College London, UK

Page 2: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

This page intentionally left blank

Page 3: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Clinical Trials inPsychiatry

Second Edition

Page 4: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

This page intentionally left blank

Page 5: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Clinical Trials inPsychiatrySecond Edition

Brian S. Everitt

Institute of Psychiatry, King’s College London, UK

Simon Wessely

Institute of Psychiatry, King’s College London, UK

Page 6: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Copyright © 2008 John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester,West Sussex PO19 8SQ, England

Telephone �+44� 1243 779777

Email (for orders and customer service enquiries): [email protected] our Home Page on www.wiley.com

All Rights Reserved. No part of this publication may be reproduced, stored in a retrieval system or transmittedin any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, exceptunder the terms of the Copyright, Designs and Patents Act 1988 or under the terms of a licence issued by theCopyright Licensing Agency Ltd, 90 Tottenham Court Road, London W1T 4LP, UK, without the permissionin writing of the Publisher. Requests to the Publisher should be addressed to the Permissions Department,John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ, England, oremailed to [email protected], or faxed to (+44) 1243 770620.

Designations used by companies to distinguish their products are often claimed as trademarks. All brand namesand product names used in this book are trade names, service marks, trademarks or registered trademarks oftheir respective owners. The Publisher is not associated with any product or vendor mentioned in thisbook.

This publication is designed to provide accurate and authoritative information in regard to the subject mattercovered. It is sold on the understanding that the Publisher is not engaged in rendering professional services.If professional advice or other expert assistance is required, the services of a competent professional should besought.

Other Wiley Editorial Offices

John Wiley & Sons Inc., 111 River Street, Hoboken, NJ 07030, USA

Jossey-Bass, 989 Market Street, San Francisco, CA 94103-1741, USA

Wiley-VCH Verlag GmbH, Boschstr. 12, D-69469 Weinheim, Germany

John Wiley & Sons Australia Ltd, 33 Park Road, Milton, Queensland 4064, Australia

John Wiley & Sons (Asia) Pte Ltd, 2 Clementi Loop #02-01, Jin Xing Distripark, Singapore 129809

John Wiley & Sons Canada Ltd, 6045 Freemont Blvd, Mississauga, Ontario, L5R 4J3

Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may notbe available in electronic books.

Library of Congress Cataloging in Publication Data

Everitt, Brian.Clinical trials in psychiatry / Brian S. Everitt, Simon Wessely. — 2nd ed.

p. ; cm.Includes bibliographical references and index.ISBN 978-0-470-51302-6 (cloth : alk. paper)1. Mental illness. 2. Psychiatry—Research—Methodology. 3. Clinical trials.I. Wessely, Simon. II. Title.[DNLM: 1. Psychiatry—methods. 2. Randomized Controlled Trials—methods.3. Research Design. WM 20 E93C 2008]RC454.E866 2008616.89′10724—dc22

2008041616

British Library Cataloguing in Publication Data

A catalogue record for this book is available from the British Library

ISBN 978-0-470-51302-6

Typeset in 10.5/13pt Times by Integra Software Services Pvt. Ltd, Pondicherry, IndiaPrinted and bound in Great Britain by Antony Rowe Ltd, Chippenham, WiltshireThis book is printed on acid-free paper responsibly manufactured from sustainable forestryin which at least two trees are planted for each one used for paper production.

Page 7: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Contents

Preface to the first edition ix

Preface to the second edition xi

1 Treatments, good, bad or worthless – and how do we tell? 11.1 Treatments worthless – and worse 11.2 A brief history of treating the mentally ill 51.3 Summary 11

2 The randomized clinical trial 132.1 Introduction 132.2 The clinical trial 172.3 Ethical issues in clinical trials 292.4 Informed consent 332.5 Compliance 362.6 Summary 40

3 Design issues in clinical trials 433.1 Introduction 433.2 Clinical trial designs 443.3 Methods of randomization 563.4 Methods of masking treatments 623.5 The size of a clinical trial 633.6 Interim analysis 663.7 Summary 70

4 Special problems of trials in psychiatry 714.1 Introduction 714.2 Explanatory versus pragmatic trials 724.3 Complex interventions 794.4 Outcome measures in psychiatry 814.5 Summary 87

Page 8: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

vi CONTENTS

5 Some statistical issues in the analysis of psychiatrictrials 895.1 Introduction 895.2 P-values and confidence intervals 905.3 Using baseline data 915.4 Longitudinal data 975.5 Missing values and dropouts in longitudinal data 1035.6 Multiple outcome measures 1085.7 Intention-to-treat 1095.8 Economic evaluation of trials 1125.9 Number needed to treat 1165.10 Summary 116

6 Analysing data from a psychiatric trial: an example 1196.1 Introduction 1196.2 Beating the Blues 1196.3 Analysis of the post-treatment BDI scores 1236.4 Graphical displays and summary measure analysis of longitudinal

data 1286.5 Random effects models for the BtB data 1356.6 The dropout problem in the BtB data 1426.7 Summary 144

7 Systematic reviews and meta-analysis 1457.1 Introduction 1457.2 Study selection 1487.3 Publication bias 1517.4 The statistics of meta-analysis 1537.5 Some examples of meta-analysis of psychiatric trials 1557.6 Summary 160

8 RCTs in psychiatry: threats, challenges and the future 1638.1 Introduction 1638.2 Can randomized clinical trials in psychiatry be justified? 1648.3 Are randomized clinical trials really necessary? 1698.4 Conflicts of interest 1708.5 Scandals, trials and tribulations 1718.6 The future of psychiatric trials 1738.7 Defending the clinical trial 1788.8 Summary 179

Appendix A Issues in the management of clinical trials – ‘howto do it’ 181

A.1 Introduction 181A.2 Clinical trial protocols 182A.3 Getting the costs right 185A.4 Collecting and managing the data 186A.5 Writing the patient information sheet 188A.6 Getting informed consent 189

Page 9: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

CONTENTS vii

A.7 Maintaining recruitment 190A.8 Doing the follow-up 191A.9 Useful web sites 191

Appendix B Writing a trial report 195B.1 Introduction 195

Appendix C Useful software for clinical trials 201C.1 Introduction 201C.2 Data management 201C.3 Design 202C.4 Analysis 202

Bibliography 205

Index 223

Page 10: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

This page intentionally left blank

Page 11: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Preface to the first edition

Estimates of the annual cost of mental health problems to the United Kingdom rangefrom £7bn to £32bn; mental health accounts for a quarter of all GP consultations.Given these figures it is not surprising that the search for effective treatments inpsychiatry continues apace. From new drug therapies for schizophrenia to the useof cognitive behaviour therapy in managing depression, psychiatric research workersremain committed to discovering the best means of overcoming the misery that ismental illness. But for progress to be maintained and hopefully accelerated, competingtreatments need to be assessed and compared in the most rigorous manner available.Such rigour is provided by the randomized clinical trial, which as implemented inpsychiatry is the subject of this book. We hope the material included will be usefulfor trainee psychiatrists who are very likely to be involved in clinical trials at sometime in their careers, for psychiatrists currently applying clinical trial methodologyand for other researchers in mental health who need to assess the implications of theresults from psychiatric trials for patient care.

We would like to thank the following people who have provided ideas, suggestions,criticisms and often all three, during the preparation of this book: Anders Skrondal,Catherine Gilvarry, Clive Adams, Sir Iain Chalmers, Barbara Farrell, Matthew Hotopfand Mike Slade.

Finally thanks are due to Harriet Meteyard for much help during the writing of thebook, particularly with references.

B.S. Everitt and S. WesselyLondon, March 2003

Page 12: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

This page intentionally left blank

Page 13: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

Preface to the second edition

In this second edition we have extended the discussion of efficacy and efficiency trials,given a brief account of N-of-1 trials, commented on recent clinic trial ‘disasters’ andsaid a little about both the registration of trials and the possible conflicts of interestwhen undertaking industry-sponsored trials. We have also updated the referencesin many sections. But our main aim has been again to provide a relatively conciseaccount of clinical trials in psychiatry for both people contemplating undertaking aclinical trial, and those seeking to interpret results from such a trial. As bureaucracythreatens to make the former more difficult, we hope this book will at least simplifythe latter.

B.S. Everitt and S. WesselyLondon, May 2006

Page 14: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

This page intentionally left blank

Page 15: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

1Treatments, good, bad orworthless – and how do we tell?

1.1 Treatments worthless – and worse

All who drink of this remedy recover in a short time, except those whom it does not help, whoall die. Therefore, it is obvious that it fails only in incurable cases.

This aphorism is generally attributed to Galen (AD 130–200), a Greek physician,who was destined to dominate medicine for many centuries and who wrote withsuch conviction and dogmatism that few doctors dared to criticize him. He was aprodigious writer and in one of his many books he gives an account of his ownparents, describing his father as amiable, just and benevolent, and his mother asthoroughly objectionable, a woman who was always shouting at her husband anddisplaying her evil temper by biting her serving-maids. His father had a dream thathis son was destined one day to become a great physician and this encouraged him tosend Galen to Pergamon and to Smyrna for a preliminary grounding in philosophy,and then on to Alexandria to specialize in medicine.

The veneration of dogma proclaimed by Galen and other authoritative peoplelargely stifled any interest in experimentation or proper scientific exploration inmedicine until well into the seventeenth century. Even the few who did attempt toincrease their knowledge by close observation or simple experiment often interpretedtheir findings in the light of the currently accepted dogma. When, for example,Andreas Vesalius, a sixteenth-century Belgian physician, first dissected a humanheart and did not find ‘pores’, said by Galen to perforate the septum separating theventricular chambers, the Belgian assumed the openings were invisible to the eye. Itwas only several years after his initial investigation that Vesalius had the confidenceto declare that ‘pores’ did not exist.

Clinical Trials in Psychiatry: Second Edition By Brian S. Everitt and Simon Wessely© 2008 John Wiley & Sons, Ltd

Page 16: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

2 CH01 TREATMENTS, GOOD, BAD OR WORTHLESS

Similarly the announcement of the discovery of the circulation of the blood byan English physician, William Harvey, in 1628, met with violent opposition, sinceit contradicted Galen’s view that blood flowed to and fro in a tide-like move-ment within arteries and veins. Even when it was admitted rather grudgingly thatHarvey was probably correct, a defender of the established view wrote that if thenew findings did not agree with Galen, the discrepancy should be attributed tothe fact that nature had changed; one should not admit that the master had beenwrong!

For the medieval physician, choice of treatment depended largely on the resultsof observing one or two patients or on reports from colleagues, again usually basedon very limited numbers of observations. But since patients rather inconvenientlyvary in their responses to treatment, this was often the recipe for the developmentof treatments that were disastrously ineffective when applied more generally. Eachproposed treatment (however absurd) might be taken up by enthusiasts only to bedropped when another (often equally absurd) became fashionable. Even the oathtaken by Western physicians since the time of Hippocrates, in which they swearto protect their patients ‘from whatever is deleterious and mischievous’, has notmanaged to stop many assaultive therapies being given or to lessen the persis-tence of barbarous practices like copious blood-letting. Even the most powerfulmembers of society were vulnerable to the ill-informed, if well-intentioned physi-cian. At eight o’clock on Monday morning of 2 February 1685, for example, KingCharles II of England was being shaved in his bedroom. With a sudden cry hefell backward and had a violent convulsion. He became unconscious, rallied onceor twice and, after a few days, died. Doctor Scarburgh, one of the 12 or 14physicians called to treat the stricken king, recorded the efforts made to cure thepatient.

As the first step in treatment the king was bled to the extent of a pint from a vein in his rightarm. Next his shoulder was cut into and the incised area was ‘cupped’ to suck out an additional8 ounces of blood. After this, the drugging began. An emetic and purgative were adminis-tered, and soon after a second purgative. This was followed by an enema containing antimony,sacred bitters, rock salt, mallow leaves, violets, beetroot, camomile flowers, fennel seed, linseed,cinnamon, cardamom seed, saffron, cochineal and aloes. The enema was repeated in two hoursand a purgative given. The king’s head was shaved and a blister raised on his scalp. A sneezingpowder of hellebore root was administered and also a powder of cowslip flowers ‘to strengthenhis brain’. The cathartics were repeated at frequent intervals and interspersed with a soothingdrink composed of barley water, liquorice and sweet almond. Likewise white wine, absinthe andanise were given, as also were extracts of thistle leaves, mint, rue and angelica. For external treat-ment a plaster of Burgundy pitch and pigeon dung was applied to the king’s feet. The bleedingand purging continued, and to the medicaments were added melon seeds, manna, slippery elm,black cherry water, an extract of flowers of lime, lily of the valley, peony, lavender and dissolvedpearls. Later came gentian root, nutmeg, quinine and cloves. The king’s condition did not

Page 17: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

1.1 TREATMENTS WORTHLESS – AND WORSE 3

improve, indeed it grew worse, and in the emergency 40 drops of extract of human skullwere administered to allay convulsions. A rallying dose of Raleigh’s antidote was forced downthe king’s throat; this antidote contained an enormous number of herbs and animal extracts.Finally bezoar stone was given. ‘Then’, said Scarburgh, ‘Alas! After an ill-fated night his serenemajesty’s strength seemed exhausted to such a degree that the whole assembly of physicianslost all hope and became despondent; still so as not to appear to fail in doing their duty in anydetail, they brought into play the most active cordial.’

As a sort of grand summary to this pharmaceutical debauch, a mixture of Raleigh’santidote, pearl julep and ammonia was forced down the throat of the dying king.

Occasionally serendipitous observations led to more suitable treatments beingdiscovered. An example is provided by the Renaissance surgeon, Ambroise Pare,when treating wounds suffered by soldiers during the battle to capture the castle ofVillaine in 1537. Pare intended to apply the standard treatment of pouring boiled oilover the wound but ran out of oil. He then substituted a digestive made of egg yolks,oil of roses, and turpentine. The superiority of the new treatment became evident theday after the battle:

I raised myself very early to visit them, when beyond my hope I found those to whom I appliedthe digestive medicament feeling but little pain, their wounds neither swollen nor inflamed, andhaving slept through the night. The others to whom I had applied the boiling oil were feverishwith much pain and swelling about their wounds. Then I determined never again to burn thusso cruelly by arquebusses.

By the late seventeenth and early eighteenth century, some scientists and physiciansbegan to adopt a more sceptical attitude to the pronouncements of authoritativefigures, and medicine began a slow march from dogmatic, even mystical, certaintyto proper scientific uncertainty. One of the most notable examples illustrating thischange is provided by James Lind’s investigation into the treatment of scurvy.

Scurvy is a disease characterized by debility, blood changes, spongy gums andhaemorrhages in the tissues of the body. The symptoms come on gradually with failureof strength and mental depression. Then follow sallow complexion, sunken eyes,tender gums and muscular pains. These symptoms may continue for weeks, graduallyworsening. Teeth fall out and haemorrhages, often massive, penetrate muscles andother tissues. The last stages of scurvy are marked by profound exhaustion, faintingand complications such as diarrhoea and pulmonary or kidney troubles, any of whichmay bring about death. In 1932 it was discovered that the cause of scurvy is deficiencyof vitamin C and, even in desperate cases, recovery may be anticipated when thedeficient vitamin is supplied, by injection or orally.

But 300 years ago physicians knew only that scurvy was common, was often fatal,and was a severe problem for mariners, causing more deaths in wartime than did theenemy. It is, for example, recorded that in 1740 Lord Anson took six ships on a world

Page 18: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

4 CH01 TREATMENTS, GOOD, BAD OR WORTHLESS

cruise and lost some 1200 of his men to the disease. There was some speculation thatscurvy and diet were connected but it was Lind who first investigated the relationshipin a proper scientific fashion.

James Lind was a Scottish physician who took his MD degree at Edinburgh in1748 and was physician at the Haslar hospital for men of the Royal Navy, Gosport,Hampshire, England from 1758 until his death. In his book, A Treatise on the Scurvy,published in 1754, he gives the following description of his landmark study:

On the 20th May 1747, I took twelve patients in the scurvy, on board the Salisbury at sea.Their cases were as similar as I could have them. They all in general had putrid gums, the spotsand lassitude, with weakness of their knees. They lay together in one place, being a properapartment for the sick in the fore-hold; and had one diet in common to all, viz. water-gruelsweetened with sugar in the morning; fresh mutton broth often times for dinner; at other timespuddings, boiled biscuit with sugar etc. And for supper, barley and raisins, rice and currants,sago and wine, or the like. Two of these were ordered each a quart of cider a day. Two otherstook twenty-five gutts of elixir vitriol three times a day, upon an empty stomach; using a garglestrongly acidulated with it for their mouths. Two others took two spoonfuls of vinegar threetimes a day, upon an empty stomach: having their gruels and their other food well acidulatedwith it, as also the gargle for their mouths. Two of the worst patients, with the tendons in theham rigid (a symptom none of the rest had) were put under a course of sea-water. Of this theydrank half a pint every day, and sometimes more or less as it operated, by way of a gentle physic.Two others had each two oranges and one lemon given them every day. These they eat withgreediness, at different times, upon an empty stomach. They continued but six days under thiscourse, having consumed the quantity that could be spared. The two remaining patients, tookthe bigness of a nutmeg three times a day of an electuary recommended by a hospital-surgeon,made of garlic, mustard-feed, rad. raphan, balsam of Peru, and gum myrr; using for commondrink barley water well acidulated with tamarinds; by a decoction of which, with the addition ofcremor tartar, they were greatly purged three or four times during the course. The consequencewas, that the most sudden and visible good effects were perceived from the use of the orangesand lemons; one of those who had taken them, being at the end of six days fit for duty. Thespots were not indeed at that time quite off his body, nor his gums sound; but without any othermedicine, than a gargle of elixir vitriol, he became quite healthy before we came into Plymouth,which was on the 16th June. The other was the best recovered of any in his condition; and beingnow deemed pretty well, was appointed nurse to the rest of the sick.

In spite of the relative clear-cut nature of his findings, Lind still advised that thebest treatment for scurvy involved placing stricken patients in ‘pure dry air’. Nodoubt the reluctance to accept oranges and lemons as treatment for the disease hadsomething to do with their expense compared to the ‘dry air’ treatment. In fact itwas a further 40 years before Gilbert Blane, Commissioner of the Board of the Careof Sick and Wounded Seamen, succeeded in persuading the Admiralty to make theuse of lemon juice compulsory in the British Navy. But once again the question ofcost quickly became an issue with limes, which were cheaper, being substituted forlemons. Economy thus condemned the British sailor to be referred to for the next200 years as ‘limeys’.

Page 19: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

1.2 A BRIEF HISTORY OF TREATING THE MENTALLY ILL 5

The characteristics of Lind’s investigation which make it so notable for the timeare its comparison of different treatments and the similarity of the patients at thecommencement of the study, i.e., they were all at a similar stage of the illness andwere all on a similar diet. As we shall see in the next chapter these characteristicsare much like those demanded in a modern clinical trial.

But Lind’s systematic approach to treatment evaluation was, in the eighteenthcentury, the exception rather than the rule, and personal observation was still highlyregarded by most clinicians as the most appropriate way of providing suitable proce-dures for alleviating the suffering of their patients. The result was the continuationof such ‘treatments’ as blood-letting, purging, complicated diets and even starva-tion. It was not until the beginning of the ninteenth century that a few courageousphysicians acknowledged that personal observations on a small number of patients,however acutely made, are unlikely to tell the whole story, and pronounced that mosttreatments then in use were essentially worthless. Pierre-Charles-Alexander Louis,for example, became famous for rejecting the established doctrine of blood-letting asa medical treatment. Through observation he showed that slightly more people whowere bled died than people who were not. Clinicians were increasingly forced toadmit that the cupboard of specific remedies was virtually bare, and so concentratedtheir efforts on accurate diagnosis and prognosis rather than treatment. During thenext 100 years or so some progress was made in identifying effective treatmentsfor particular conditions, for example, the heart drug digoxin from the foxglove andaspirin from the bark of the willow tree. But the real therapeutic revolution hasoccurred in the last 75 years or so and has seen the introduction of effective treatmentsfor a vast range of diseases. The reasons behind this revolution involve a complexmixture of progress in pharmacology and medical technology well described in LeFanu (1999). But as more and more potential treatments were developed, the needgrew for some scientifically acceptable form of procedure by which their advan-tages and disadvantages could be assessed. Fortunately this need was met in the1930s/1940s by the introduction of the controlled clinical trial, the story of whichwe take up in Chapter 2. Here we move on to say a little more about treatmentsspecific to that branch of medicine with which this book is largely concerned, namelypsychiatry.

1.2 A brief history of treating the mentally ill

The mentally ill have always been with us – to be feared, marvelled at, laughed at, pitied ortortured, but all too seldom cured. (Alexander and Selesnick, 1966)

In his dictionary of psychology, the late Professor Stuart Sutherland definespsychiatry as ‘the medical speciality that deals with mental disorders’. An almost

Page 20: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

6 CH01 TREATMENTS, GOOD, BAD OR WORTHLESS

equally brief definition appears in Campbell’s Psychiatric Dictionary, namely, ‘themedical speciality concerned with the study, diagnosis, treatment and preventionof behaviour disorders’. In terms of either definition it would appear that psychi-atry has a long history; Pythagoreans, for example, employed a form of musictherapy with emotionally ill patients (see Gordon, 1949), and Aretaeus (AD 50–130)observed mentally ill patients and did careful follow-up studies on them. As aresult, he established that manic and depressive states often occur in the sameindividual and that lucid intervals generally exist between manic and depressiveperiods.

But a thousand years on such a seemingly enlightened approach to the mentally illhad been largely abandoned in favour of viewing the insane as wild beasts who shouldbe kept constantly in fetters. Indeed according to Foucalt (1961), ‘madness borrowedits face from the mask of the beast’. In early medieval times beating, incarceration andrestraint were the ‘treatments’ endured by the majority of the mentally ill. Insanitywas almost universally regarded as a spiritual trial which one had to undergo as apunishment for vice, a test of faith, or a method of purging sin – a form of purgatoryon earth – which could be dealt with only by spiritual remedies such as exorcismor being locked up in a church overnight. Gradually other approaches to treatmentwere introduced although most were equally harsh; bleeding, vomiting and purgingfor mentally ill patients were common, as were more whimsical forms of treatmentsuch as whirling or spinning a madman round on a pivot. These treatments were inaddition to the continued use of manacles and chains for restraint. Apart from theirharshness, what these treatments also had in common was that they were almostuniversally ineffective.

It was not until the seventeenth century that the tide of opinion seems to haveturned against rough treatment. For example, on 18 July 1646 the Court of Governorsof Bethlem Hospital ordered ‘that no officer or servant shall give any blows or illlanguage to any of the mad folks on pain of loosing his place’ and at the same hospitalin 1677 the governors propounded a rule that ‘No Officer or Servant shall beat orabuse any Lunatik, nor offer any force to them, but upon absolute, Necessity, forthe better governing of them’ (see Russell, 1997). As a substitute for coercion, someinstitutes housing the insane began to offer kindness, attention to health, cleanlinessand comfort. Reformers such as John Monro pioneered the introduction of ‘moraltreatment’, which stressed the value of occupation to combat the dangers of idleness,and the need for patients to be dealt with tenderly and with affection. Such anapproach was now considered to be more likely to restore reason than harshness orseverity.

But although there was an increasing desire for caring to replace constraint indealing with the mentally disturbed, drugs such as corium, digitalis, antimony andchloral were still used to quieten disruptive patients, replacing physical fetters withpharmacological ones. And despite the best efforts of the advocates of the moral

Page 21: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

1.2 A BRIEF HISTORY OF TREATING THE MENTALLY ILL 7

treatment approach, asylums housing the insane often remained depressing anddegrading places until well into the twentieth century, as is illustrated by the followingaccount of a visit by a newly appointed psychiatrist in 1953 to the chronic ward of amental hospital in Cambridge in the United Kingdom (given in Le Fanu,1999):

I was taken in by someone who had a key to unlock the door and lock it behind you. Thecrashing of keys in the lock was an essential part of asylum life then just as it is today in jail.This led into a big bare room, overcrowded with people, with scrubbed floors, bare woodentables, benches screwed to the floor, people milling around in shapeless clothing. There wasa smell in the air of urine, paraldehyde, floor polish, boiled cabbage and carbolic soap – theasylum smell. Some wards were full of tousled, apathetic people just sitting in a row becausefor twenty years the nurses had been saying ‘sit down, shut up’. Others were noisy. At the backof the ward were the padded cells, in which would be one or two patients, smeared with faeces,shouting obscenities at anybody who came near. A scene of human degradation.

Sadly many early twentieth-century treatments for the mentally ill patient appear inretrospect equally as harsh as those used centuries earlier and, in the main, almostequally ineffective in producing a cure. One positive change from earlier times,however, was that now some clinicians began to take the first small steps to evaluatingtreatments scientifically by making qualitative and quantitative observations andmeasurements. Empiricism was, at last, about to play a role in psychiatric practice.Both the harshness of treatment and the attempt at a more scientific approach toevaluation can be illustrated in the context of the theory relating focal infectionto mental disorders proposed by Dr Henry A. Cotton in the 1920s. According toDr Cotton:

The so called functional psychoses we believe today to be due to a combination of manyfactors, but the most constant one is the intra-cerebral, bio-chemical cellular disturbance arisingfrom circulating toxins originating in chronic foci of infection, situated anywhere in the body,associated probably with secondary disturbance of the endocrin system. Instead of consideringthe psychosis as a disease entity, it should be considered as a symptom, and often a terminalsymptom of a long continued masked infection, the toxaemia of which acts directly on the brain.

Dr Cotton identified infection of the teeth and tonsils as the most important focito be considered, but the stomach and, in female patients, the cervix could also besources of infection responsible, according to Dr Cotton’s theory, for the mentalcondition of the patient. The logical treatment for the mentally ill resulting fromDr Cotton’s theory was surgical elimination of the chronically infected tissue, allinfected teeth and tonsils certainly and, for many patients, colectomies. Additionallyfemale patients might require enucleation of the cervix, or in some cases completeremoval of fallopian tubes and ovaries. Such treatment was, according to Dr Cotton,enormously successful; out of 1400 patients treated, only 42 needing to remain inhospital.

Page 22: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

8 CH01 TREATMENTS, GOOD, BAD OR WORTHLESS

The focal infection theory of functional psychoses was not universally accepted,neither were the striking results said to have been obtained by the removal of theseinfections. So in 1922 Drs Kopeloff and Cheney of the New York State PsychiatricInstitute undertook a study to investigate Dr Cotton’s proposed treatment in the spiritof, in their own words: ‘an approach free from prejudice and without preconceivedideas as to the possible results’.

To achieve this laudable if somewhat pious aim, Kopeloff and Cheney plannedtheir study in the form of an experiment. All the patients were divided into twogroups as nearly identical as possible. All members of one group received operativetreatment for foci of infection in teeth and tonsils, while members of the other groupreceived no such treatment and consequently could be regarded as controls. No doubtKopeloff and Cheney’s study would have been hard pressed to have gained ethicalapproval today, but despite its ethical and probable scientific limitations it did produceresults (summarized here in Table 1.1) that cast grave doubts over removal of focalinfections as a treatment for some types of mental illness and, indirectly at least,drove a nail into the coffin of Dr Cotton’s theory as to the cause of these conditions.

Dr Cotton’s suggested treatment for patients with functional psychoses was severe,but not more so than other ‘physical therapies’, which became popular in the 1930sand 1940s. Insulin coma, for example, required patients to be given large doses ofinsulin, which, by lowering the blood sugar, induced a comatose state from whichthey would be rescued by a large dose of glucose (if they were among the luckyones – some patients died). According to Sargent and Slater (1944), ‘reliable statisticsare mostly in favour of the treatment’, although this claim needs to consideredalongside their recommendation as to how to select patients for treatment: ‘It is rarelyindeed that facilities will exist for the treatment by a full course of insulin of allschizophrenics coming under observation, and it is therefore important not to wastethe treatment on patients not very likely to respond while denying it to the favourablecases.’

Table 1.1 Results from Kopeloff and Cheney’s study

Dementia praecox Manic depressive

Controls Operated Controls Operated

Number of cases 15 17 15 9Recovered − − 5 4Improved 5 5 8 1Total benefited 5 5 13 5Unimproved 10 12 2 4Left hospital 3 5 6 3

Reproduced from Kopeloff, N., Kirby, H.G. (1923) American Journal of Psychiatry, 3, 149–97 withpermission from The American Psychiatric Association

Page 23: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

1.2 A BRIEF HISTORY OF TREATING THE MENTALLY ILL 9

Perhaps the most severe of the physical therapies was a lobotomy, where thebrain was cut with a knife. The operation was pioneered by Egas Moniz, a Lisbonneurologist, and later taken up enthusiastically by psychiatrists such as WilliamSargent of St Thomas’s Hospital in the United Kingdom. Evaluation of the effective-ness of the therapy was largely anecdotal, and even an enthusiast such as Sargentknew that the operation was often performed at a price:

It is probable that the highest powers of the intellect are affected detrimentally, and if the patientshows little sign of this in his day-to-day behaviour it may be because the daily routine ofexistence makes little call on his best powers. We recognize too that temperamental qualitiesalso are not unaffected, that the reduction in self-criticism may lead to tactless and inconsideratebehaviour, and that the more immediate translation of thought and feeling into action can showitself in errors of judgement. The damage, once done, is irreparable. (Sargent and Slater, 1944)

Both insulin therapy and lobotomies were slowly phased out as treatments for thementally ill, but another of the physical therapies introduced in the mid-twentiethcentury, electric shock (ECT) remains in use to this day largely because it has beenfound to be effective in a number of studies (see next chapter). This treatment,introduced by Cerletti and Bini in the late 1930s, consists of producing convulsionsin a patient by means of passing an electric current through two electrodes placedon the forehead. The idea that such convulsions might help the mentally ill patientwas not new; as long ago as 1798, for example, Weickhardt had recommended thegiving of camphor to the point of producing vertigo and epileptic fits.

ECT was (and is) used primarily in the treatment of patients with severe depres-sion. Early claims for its effectiveness bordered on the miraculous. Batt (1943), forexample, reported a recovery rate of 87 per cent. Fitzgerald (1943) was only slightlyless optimistic, suggesting the figure was 78 per cent. In neither report, however, wasthere any attempt to gather data on recovery rates in concurrent controls. Despitethis, other psychiatrists accepted the quoted recovery rates as an indication of theeffectiveness of ECT. Typical is the following quotation from Napier (1944):

‘It is a remarkable advance that a type of case in which the outlook was formerly so problematicalcan now be offered with some confidence the prospect of restoration in a matter of weeks.’

Some researchers attempted to evaluate ECT by comparing their results with thosefrom historical controls (see Chapter 2) or from concurrent patients who for onereason or another had not been offered the treatment of choice (ECT). But suchstudies largely only illustrated the weaknesses of such an approach. That by Karagulla(1950), for example, compared results for six groups of patients. Two groups, menand women, had been treated at the Royal Edinburgh Hospital for Mental and NervousDisorders in the years 1900–39 (before the advent of ECT). The other four groupshad been treated in the years 1940–48, two (men and women) by ECT and two others(men and women) not using ECT. It requires little imagination to suppose that the

Page 24: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

10 CH01 TREATMENTS, GOOD, BAD OR WORTHLESS

historical controls seen during the period 1900–39 are of little use in evaluating ECT;any difference between the recovery rates for the periods 1900–39 and 1940–48 infavour of the latter could be explained by many other factors than treatment with ECT.The differences between the ECT groups and the concurrent controls are also virtuallyimpossible to assess since the decision to use ECT on a patient was a subjectiveone by the clinicians involved. There is no way of knowing whether the treatedand untreated groups are comparable. (More comments and criticisms of historicalcontrol studies will be found in the next chapter.) A scientifically acceptable studyof the benefits or otherwise of ECT had to wait until 1965 as we shall recount inChapter 2.

At the end of the 1940s and the beginning of the 1950s, the physical treatmentsintroduced into psychiatry 30 years earlier still formed the core of most psychia-trists’ treatment armoury. But matters were about to change; in the 1950s severalentirely new types of drugs were to be introduced in psychiatric practice. In themain the discovery of these drugs was not based on a scientific knowledge of brainchemicals, rather their discovery was for the most part serendipity, resulting fromacute observations made by clinicians such as Henri Laborit (the effects of theantihistamine promethazine, from which developed chlorpromazine), and John Cadewho first described the value of lithium in manic depression by observing its effecton a number of patients. The tricyclic antidepressants and the selective serotoninreuptake inhibitors or SSRIs, which had fewer side effects in treating depression werealso discovered in the 1950s. Finally, almost by accident, Leo Sternback in 1957identified the benzodiazepines for treating mild anxiety.

The need to establish whether or not these newly discovered compounds wereeffective in treating mentally disturbed patients greatly increased most psychiatrists’appreciation of the need for acceptable procedures for evaluating treatments. Andafter 1960 the increasing need to satisfy regulatory authorities (prior to 1960 onlythe United States had such a body overseeing the introduction of new drugs intogeneral use, but the thalidomide tragedy changed the situation dramatically) meantthat the controlled clinical trial, the subject of Chapter 2, increasingly became viewedas the ‘gold standard’ for evaluating competing therapies. A quotation from oneof the psychiatric champions of this approach, Michael Shepherd (1959), remainsalmost the perfect model for the modern scientific view that psychiatrists should havein the evaluation of psychotropic drug therapies, in particular, and in the evaluationof psychiatric treatments in general:

The clinician is compelled to hold the balance between the scales of laboratory data on the onehand and stochastic theory on the other. Though his experience and judgement are essential itwill be necessary for him to adopt a more experimental role in the future if he is to co-operatefully with the pharmacologist and the statistician whose techniques he should understand if fullweight is to be given to observations made in the clinical setting.

Page 25: Clinical Trials in Psychiatry€¦ · 3 Design issues in clinical trials 43 3.1 Introduction 43 3.2 Clinical trial designs 44 3.3 Methods of randomization 56 3.4 Methods of masking

1.3 SUMMARY 11

1.3 Summary

In the last 50–60 years, medicine has made giant strides in finding effective treatmentsfor a range of conditions. In the 1940s, for example, death in childhood from polio,diphtheria and whooping cough were commonplace but is now thankfully rare (atleast in most of Europe and the United States). And the treatment of the mentallyill has also made great progress. Drug treatment of schizophrenia, depression andanxiety disorders have been found to be effective and have done much to alleviatethe misery of these conditions. Drug treatment of mental illness works by altering insome way the chemistry of the body. Chlorpromazine, for example, has been shownto interfere with the action of the neurotransmitter dopamine. But the modern viewof mental illness, that it has both psychological and physical dimensions, implies thateffective treatment must aim to ease the suffering of the mind as well as correctingpossible abnormalities of chemistry. And so, in the 1970s, behavioural psychotherapybegan to be used to treat particular disorders. More recently cognitive therapy hasbeen introduced. This provides a simple, straightforward treatment regimen whichlasts weeks rather than years, and above all permits the patients to make sense of,and thus hopefully control, their psychological problems.

A cornerstone of the improvements in treatment in medicine in general and psychi-atry in particular has been the introduction of an acceptable scientific approach totreatment evaluation, i.e., the clinical trial. Such trials are also the cornerstone ofthe modern evidence-based medicine movement (see Sackett et al., 1996). Initiallyclinical trials in psychiatry largely involved the evaluation of drug treatments, as weshall see in Chapter 2. More recently, however, psychological therapies have alsobeen subjected to the rigours of the clinical trial, although there has been a growingawareness that the logistical problems of such trials differ from those of the averagedrug trial. The reasons why the clinical trial approach is so essential in the evaluationof competing therapies are taken up in Chapter 2.