Evaluation of Propensity Score Based Methods in Sentinel Study Settings Using Simulation Experiments

Project Title Evaluation of Propensity Score Based Methods in Sentinel Study Settings Using Simulation Experiments
Date Posted
Thursday, June 15, 2017
Status
In progress
Description

The Mini-Sentinel pilot developed several pre-programmed analytic modules for medical product safety assessments including a propensity score matching (PSM) module that has been converted to a routine querying tool for the FDA’s active postmarket risk identification and analysis (ARIA) system.

This project will inform appropriate use of the PSM tool within the ARIA system for a one-time (non-sequential) data analysis via rigorous demonstration of relative performance under numerous simulated circumstances similar to real-world safety analyses. With the introduction of the ARIA framework, FDA re-assessed the relevance and potential utility of the four existing analytic modules and related methods, and re-prioritized methods evaluation work. As a result, this workgroup focused on the evaluation of PS-based methods only, which includes regression and weighting methods but not the self-controlled risk interval module.

The project also assesses other related PS methods that could expand the functionality of the existing PSM tool by adding PS stratification, regression, and inverse-probability weighting methods. The goal of this project is to describe the statistical and epidemiological performance of these PS-based methods under conditions likely to be encountered by the ARIA system so that end-users will be able to optimize the tools’ use. The findings from this effort will also guide future tool development and enhancement work. The infrastructure for simulation experiments built by this workgroup is re-usable and can be used in future assessments of the performance of other modules and methods.

Workgroup Leader(s)

Bruce Fireman MA; Kaiser Permanente Northern California, Oakland, CA

Susan Gruber PhD, MPH, MS; Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, MA

Workgroup Members

Laura Amsden MSW, MPH; Bruce Fireman MA; Kaiser Permanente Northern California, Oakland, CA

Jessica Franklin PhD; Joshua Gagne PharmD, ScD; Sebastian Schneeweiss MD, ScD; Shirley Wang PhD, ScM; Richie Wyss PhD; Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA

Katherine Freitas; Susan Gruber PhD; Judith Maro PhD, MS; Catherine Rogers MPH; Darren Toh ScD; Zilu Zhang MS; Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, MA

Christian Hampp PhD; Mark Levenson PhD; Michael Nguyen MD; Yueqin Zhao PhD, MS; Center for Drug Evaluation and Research, FDA, Silver Spring, MD

Rima Izem PhD; Office of Biostatistics, Center for Drug Evaluation and Research, FDA, Silver Spring, MD

Jennifer Nelson PhD; Robert Wellman MS; Kaiser Permanente Washington Health Research Institute, Seattle, WA

Related Links