Flexibility in Design, Outcomes and Analysis in “Evidence- Based” Drug Prevention Research: The Case of the Midwestern Prevention Project
Journal Title: Journal of Addiction & Prevention - Year 2014, Vol 2, Issue 1
Abstract
Flexibility in study designs, definitions, outcomes and analytic models increases the chance that the results reported in an empirical study are untrue. Such flexibility in methodological and analytic practices has been observed in evaluations of a number of drug prevention programs that appear on lists of evidenced-based programs. The current paper examines the evidence base pertaining to one of the most well-established drug prevention programs, namely the Midwestern Prevention Project (MPP; also known as Project STAR). Specifically, it examines the results reported from the quasiexperimental evaluation of the MPP that was conducted in Kansas City and the experimental replication conducted in Indianapolis, Indiana, and the data analysis practices used in producing these findings. It shows there is considerable analytical flexibility evident in the published accounts from these two evaluations studies, notably in the samples used in the data analyses and the manner in which outcome variables were measured. The implications of this for the MPP’s status as an evidenced-based drug prevention program are discussed, along with the means by which flexibility in analytic procedures in drug prevention research could be reduced. The seemingly widespread existence of such analytic flexibility within the field suggests that confirmation bias is part of the general culture of drug prevention research. This impedes the development of a sound scientific base within the discipline and might even lead it to degenerate into a pseudoscience.
Authors and Affiliations
Dennis M. Gorman
Keywords
Related Articles
- EP ID EP202548
- DOI 10.13188/2330-2178.1000009
- Views 139
- Downloads 0
“Bouncing-Back” and Relaxation were the Most Valued Skills Acquired by 369 Students During a School-Based Resiliency Program
Background: Drug and alcohol use during adolescence continues to be concerning, and evidence suggests this can be reduced with resiliency training. Here we provide results from a qualitative inquiry into the possible eff...
Waiting Time Increases Risk of Attrition in Gambling Disorder Treatment
Attrition is a well known problem in psychotherapeutic treatment. Patients with addiction have high attrition rates, and it is therefore important to identify factors that can improve completion rates in addiction. Here,...
Diagnostic Performance of the Rutgers Alcohol Problem Index (RAPI) in Detecting DSM-5 Alcohol Use Disorders among College Students
Background and objectives: The DSM-5 Alcohol Use Disorder criteria (AUD) have been modified to reflect a single diagnosis, which may alter how AUDs are detected within our screening measures. The Rutgers Alcohol Problem...
A Factor Analysis of PTSD with Latino Samples with Substance Use Disorders
Objective: The Post - Traumatic Stress Disorder (PTSD) factor structure is not a generally agreed upon concept. It has remained controversial and its’ efficacy regarding different trauma presentations is still in questio...
The Case for Placement Criteria for Adolescent Substance Use Disorders
Adolescent substance use (MTF, 2012) and substance use disorders (SUD) continue to be major public health concerns. However, SUD has unfortunately received only little resources compared to other high prevalence mental d...