My interest in this topic, and I think I also can speak for other activist PWP, is motivated by my 13 years with PD. . Time is not neutral for a person with a degenerative disease, so a failure of a clinical trial that not only drains resources to redo the study correctly, but sets back the whole program years if it is not discontinued altogether.

Our goal in the Pipeline Project is to alert the sponsors and the regulators about potential errors that they can, and from our growing experience in advising sponsors and regulators, they often do make in their assumptions and design choices. Shedding more light on the previously totally proprietary interactions betwen sponsors and FDA, where the critical choices are made, will improve communication about the options for design and especially on issues about what is in the best interest of patients (such as the necessity of placebo controls).

During my time as a patient advocate, we have done our work effectively. I began my advocacy career working on the enactment of the Udall Act for PD Research in 1997 and the NIH PD research agenda in 1999-2000, during this time the scientific research for PD in the Federal government increased from about $50m to $250 but has decreased more recently in a negative Federal budget environment. In 2000 I was patient representative on the DBS advisory Panel at FDA, and subsequently have collaborated with FDA staff to establish, recruit and train Patient consultants to FDA to provide our unique experience as participants in studies and demonstrations (I have participated in nearly 20). Thankfully for our cause, we are blessed with many resourceful comrades in our search for better treatments, including entertainment celebrities, like Michael J Fox, Muhamad Ali, and business leaders like Andy Grove, who have made enormous contributions to fill in many of the gaps in development of therapies.

The problem is in spite of all the accomplishments that we can claim individually or collectively, DBS is the only real breakthrough in PD treatment in the past 40 years Other advances in dopamine replacement therapies have added up to give people more relief from symptoms, but a growing list of failed clinical trials has dampened our hopes for the promised cures.

As our knowledge of genetics and cell functioning, etc. grows the understanding of what we dont know also grows, which puts us further from the goal in the eyes of science than we were at the turn of the century

The most important scientific problem that the PD community faces now is the failure of clinical trials for treatments that we know from 1st hand experience work for some people. As Andy Grove has taught us, we do not want to walk away from the golden nuggets available from failed studies. We have been reading research literature on placebo response and the artificial bias that can result form random assignment to the powerful effects of placebo brain surgery in a clinical trial. We have identified an alternative design based on research on human response to treatments and controlled experiments which is not always the same as animal response to the same situation. This design addresses the short comings of the gold standard design, usually insisted on by FDA.

The "comment" presented below appears on the Alzheimer's Research Forum. It outlines the rationale for our observations. A more detailed presentation with a range of methodological issues important for design of PD studies is being prepared.
-------------------------------------

Comment by Perry D Cohen, PhD:

Don’t Jeopardize New Therapies with Sham Surgery Control – Placebo Responses May Be Part of Therapies.

I was the patient representative on the FDA advisory panel that reviewed deep brain stimulation (DBS) in March of 2000, and later I participated in the Medicare National Coverage decision for DBS on behalf of the requester (not Medtronics but an individual person with Parkinson's). From these engagements, I recall this treatment was shown to be very effective (upwards of 85 percent have 50 percent improvement in motor symptoms). Such dramatic and lasting improvements would need to be expected to offer a treatment that makes it worthwhile to take the risk of brain surgery. After a delay of more than 4 years from the initial advisory group, DBS has been available to patients, as a near breakthrough option once first-line treatment fails. Indeed it is the only major new therapy for PD in the 40 years since levodopa was discovered. Now the recent study published in JAMA continues to show efficacy and also shows that its adverse side effects for important functions like cognition are greater for DBS than with standard drug therapy. The DBS experience can be instructive for other surgical treatments for PD

The question I want to raise regards the Ceregene 120 study, a gene therapy application of the nerve growth factor neurturin, NTN. The phase 2 study "failed to meet primary endpoints" in comparison to a sham surgery placebo control. Similar to experiences with other surgically installed treatments, such as GDNF infusion pump and implantation of spheramine, a cell-based therapy using retinal dopaminergic cells, this latest placebo-controlled trial did not replicate the gains from the phase 1 open-label study. The results of all of these studies are clouded from methodological issues such as differences in dosing between phase 1 and phase 2, dislodgement of pump connections, and differences in the use of other PD medications during the studies that may have affected the results. Even so, the fact remains that some study participants have experienced dramatic improvements lasting as long as 6 years and counting, and some have reduced their PD medications to near zero, being almost symptom free after decades of increasing disability. A brain autopsy of one GDNF patient showed nerve growth in the side of the brain in which the treatment was administered during the trial. For all of these treatments, data point to improvements well beyond reasonable estimates of placebo effects.

Clearly placebo effects are very strong. Research on placebo response for a range of medical conditions including PD attribute these real physiological effects to expectations of benefit and conditioning established in the social context of administering a treatment. The greater the risk and notoriety of the intervention, and the more certain and authoritative the source, produces a greater placebo effect. Maximum placebo effects, as would be expected, are found from brain surgery as well as from the safest form of sham brain surgery, where the brain is not penetrated but the patient goes through the same process including lengthy anesthesia. DBS patients report vast improvements in symptoms even before the stimulators are turned on. Clinical brain researchers (including more than 90 percent of the Parkinson's Study Group) agree that sham brain surgery is necessary to prove that improvements are attributable to the treatment beyond the placebo. On the other hand, an online survey of activist PD patients found that only 37 percent would participate in a sham surgery study. Closing this gap raises practical as well as ethical issues.

DBS was approved without sham surgery as a placebo control. So why aren't DBS' gains in motor scores attributed in part to a learned placebo response? Shouldn't the placebo effects that last multiple years be counted as part of the treatment, as they effectively are with DBS, and not written off as bias? The recent JAMA publication improved the evidence of efficacy for DBS by randomization to best medical treatment versus surgery. Why isn't random assignment to best medical practice a sufficient comparison for other surgical interventions?

Sham surgery is not a sugar pill; it is a powerful intervention, although you would probably be charged with fraud if you tried to sell it. Placebo studies on the experience of pain in fact demonstrate that the "bias" from patient hopes and expectations, a central element of all healing, is opposite of what has been assumed by science in experimental settings. That is, treatment effects are reduced and placebo effects are increased. That is so because random assignment dilutes positive effect of patients’ expectation that they will improve from the on-going uncertainty about whether they are on the real thing, and conversely it elevates the placebo group’s expectation that they may be on the real thing. This biases the results toward type II errors (false negative), which are more important to patients with serious illness than are type I errors (false positive) that are the target of statistical models. The pain studies suggest that the placebo mechanism may be necessary to trigger the therapeutic effects of treatment. Elaborate deception to control this effect could be undermining its evaluation.

Sure, we need to control bias. But variability and bias can come from many sources, including importantly the selection of participants and the variability of raters on subjective scales such as UPDRS. For example, are all study participants diagnosed correctly? And do they represent homogeneous types of patients? Depression medication trials, which also fail at high rates, have taught us that clearer distinction between treatment and placebo results from higher-quality central rating of subjective measurement scales. Multiple ratings of key measures reduce noise in data when averaged. Patients who have participated in PD clinical trials know that UPDRS "off" may describe different behavior on different days, and are not totally determined by the time since the last dose. Better understanding of these factors from the patient perspective is necessary to control this source of variability in the data.

Alternatively, where the sources of variability are unbiased, the problem can be fixed by increasing sample size to account for random fluctuations in the calculations of confidence of the result. This not only costs more, but it also may bump up against practical limitations including recruitment and FDA statisticians.

New directions for the 21st century

As science progresses, we need to re-examine our assumptions about the standards for evidence in the assessment of safety and effectiveness. The gold standard of the randomized, prospective, double-blind placebo-controlled study cannot be applied as a one-size-fits-all to conditions on the cutting edge of medical science.

Medical miracles of the 20th century mostly pertain to acute conditions, where linear assumptions of statistical models for hypothesis testing more closely approximate the relatively short-term interventions. As we deal with longer-term degenerative processes involving dynamic interaction and feedback to our conscious brain processes, assumptions from the experimental model become questionable. This is true even where all orthodoxies of statistics are followed and statistical significance is achieved.

Recent FDA law offers greater flexibility to align methods to the parameters of the specific case. Such alternative methods need to be qualified and used. Examples include Bayesian statistics for application to dose-finding tasks, or mathematical models of disease progression as historical controls. Crossover designs can detect differences in symptomatic benefits, and delayed start designs have shown promise to detect neuro-protection.

FDA law requires well-controlled randomized studies, not placebos. New policies put more emphasis on life cycle monitoring of treatments in real practice settings, and provide reimbursement coverage for access to new treatments while evidence of long-term safety and efficacy are established with greater certainty. Following patients more closely for a number of years to see the lasting effects can establish whether the treatment effects are purely placebo, at the same time that long-term safety is tracked.

Continuing failure of studies based on faulty assumptions about human behavior is not a viable option. A better understanding of placebo responses in the design of clinical trials points to new approaches in collaboration with patient advocates and communications to FDA.

Perry D Cohen, PhD directs the Parkinson Pipeline Project: http://www.pdpipeline.org/aboutus/community.htm