-Author name in bold denotes the presenting author
-Asterisk * with author name denotes a Non-ASH member
Clinically Relevant Abstract denotes an abstract that is clinically relevant.

PhD Trainee denotes that this is a recommended PHD Trainee Session.

Ticketed Session denotes that this is a ticketed session.

265 Crowdsourcing a High-Risk Classifier for Multiple Myeloma Patients

Myeloma: Biology and Pathophysiology, excluding Therapy
Program: Oral and Poster Abstracts
Type: Oral
Session: 651. Myeloma: Biology and Pathophysiology, excluding Therapy: Mechanisms of Resistance and Prognosis
Saturday, December 9, 2017: 4:00 PM
Bldg B, Lvl 2, B211-B212 (Georgia World Congress Center)

Andrew P Dervan1*, Michael Mason, PhD2*, Fadi Towfic, PhD1*, Michael Amatangelo, PhD1*, Daniel Auclair, PhD3*, Douglas Bassett, PhD4*, Hongyue Dai, PhD5*, William S. Dalton, PhD, MD5*, Samuel Danziger, PhD4*, Erin Flynt1*, Hartmut Goldschmidt, MD 6, Justin Guinney, PhD2*, Dirk Hose, MD7, Konstantimos Mavrommatis, PhD1*, Gareth J. Morgan, MD, PhD8, Nikhil Munshi, MD9, Alexander Ratushny4*, Dan Rozelle, PhD10*, Mehmet Kemal Samur, PhD11, Frank Schmitz, MD, PhD4*, Kenneth H Shain, MD, PhD 12, Matthew Trotter, PhD13*, Brian A Walker, PhD8, Brian S. White, PhD2*, Thomas Yu, BS2* and Anjan Thakurta, PhD1*

1Celgene Corporation, Summit, NJ
2Sage Bionetworks, Seattle, WA
3Multiple Myeloma Research Foundation, Norwalk, CT
4Celgene Corporation, Seattle, WA
5M2Gen, Tampa, FL
6University Hospital Heidelberg and German Cancer Research Center, Heidelberg, Germany
7Department of Internal Medicine V, University Hospital Heidelberg, Heidelberg, Germany
8Myeloma Institute, University of Arkansas for Medical Sciences, Little Rock, AR
9J. Lipper Cancer Center for Multiple Myeloma, Dana Farber Cancer Institute, Boston, MA
10Rancho Biosciences, Boston
11Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA
12Department of Malignant Hematology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, FL
13Celgene Institute for Translational Research Europe (CITRE), Seville, Spain


Multiple myeloma (MM) is a cancer of the plasma cells, and its clinical course depends on a complex interplay of clinical traits and molecular characteristics of the tumor. While current therapeutic combinations work well for a majority of patients, a subset of MM patients still rapidly progress or die within 18 months after diagnosis. Thus, there is an urgent need for a precise risk stratification model to identify these patients to allow selection of alternative therapeutic approaches. Current risk stratification practice is based on plasma cell cytogenetics and clinical stage at presentation, and, to a lesser degree, myeloma cell gene expression. The Myeloma Genome Project (MGP), an industry-academia collaborative project aims to develop highly accurate, clinically-implementable prognostic tests for MM patients. As part of the broader MGP effort, The MM DREAM (Dialogue for Reverse Engineering Assessments and Methods) challenge was conceived as an innovative approach to accelerate the development and evaluation of risk models in newly diagnosed MM. We collected large and diverse datasets from multiple collaborative groups and recruited a community of computational biologists, statisticians and leading experts in MM to build and test models (including the DREAM community of 20,000 solvers).


We assembled nine datasets comprised of 3,077 subjects with whole exome profiling (N = 1,273), gene expression profiling (N = 2,431), and clinical and cytogenetic data. Four data sets are publicly available and were provided for model training/development, while 5 data sets are previously unpublished and blinded to participants for model validation. Unpublished data were generously provided by an array of public, private and non-profit contributors including the University of Arkansas for Medical Sciences and Dana Farber Cancer Institute on behalf of the MGP, the Multiple Myeloma Research Foundation’s Personalized Medicine Initiative (www.themmrf.org), Moffitt Cancer Center and M2Gen, and the University of Heidelberg. The Challenge goal was to accurately predict which newly diagnosed MM patients would progress (or die) within 18 months of diagnosis. We challenged the community to identify high-risk patients using DNA-based, RNA-based, or a combination of RNA, DNA, cytogenetic and demographic features. As an additional incentive, $150,000 in prizes will be awarded to top performing teams. By the first month of the competition, 290 teams from around the world had signed up for the challenge. We compare competitors’ performance against state of the art classifiers based on gene expression (e.g. UAMS-70, EMC-92), patient characteristics (e.g. International Staging System stage combined with age), and cytogenetics. These were used as a benchmark upon which winning models needed to improve. The challenge was hosted on Sage Bionetworks’ Synapse platform, which enabled development, submission and evaluation of models using an automated framework. A Docker framework was used to ensure portability and to allow secure use of unpublished validation data. Participants were evaluated on their ability to predict high risk patients using a variety of metrics including integrated AUC, AUC and precision-recall AUC.

Results / Discussion

Based on implementation of several published benchmark models on a preliminary set of validation data, the top performing published DNA-based model was based on mutation burden (Miller et al., AUC = 0.70, iAUC = 0.71), the top performing published RNA-based model was the UAMS-17 (Shaughnessy et al., AUC = 0.52), and the top performing clinical based model was a combination of age and ISS (AUC = 0.69, iAUC=0.68). The unique combination of over 3,000 patients’ worth of molecular and clinical data allowed precise model generation while the collection of multiple distinct (unpublished) validation cohorts prevented model over fitting. Top performing teams identified novel prognostic feature sets for high risk MM, establishing new benchmarks for the field, and final results from the top performing models will be presented. Such novel models will be integrated with the broader efforts within MGP for validation and clinical test development. The results of this effort demonstrate that data sharing coupled with the power of crowdsourcing can contribute to the development of robust and clinically-implementable models for risk-stratification of patients with MM.

Disclosures: Dervan: Celgene Corporation: Employment, Equity Ownership; Twinstrand Biosciences: Equity Ownership. Towfic: Celgene Corporation: Employment, Equity Ownership; Immuneering Corporation: Equity Ownership. Amatangelo: Celgene Corporation: Employment. Bassett: Celgene Corporation: Employment. Dalton: M2Gen: Employment. Danziger: Celgene Corporation: Employment. Flynt: Celgene Corporation: Employment. Goldschmidt: Chugai: Consultancy, Honoraria, Research Funding, Speakers Bureau; Novartis: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Morphosys: Research Funding; Celgene: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Janssen: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Millenium: Research Funding, Speakers Bureau; Bristol-Myers Squibb: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Amgen: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Takeda: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Research Funding, Speakers Bureau; Onyx: Membership on an entity's Board of Directors or advisory committees, Speakers Bureau. Hose: Takeda: Membership on an entity's Board of Directors or advisory committees; Sanofi: Research Funding; EngMab: Research Funding. Mavrommatis: Celgene Corporation: Employment. Morgan: Takeda: Consultancy, Honoraria; Bristol Myers: Consultancy, Honoraria; Celgene: Consultancy, Honoraria, Research Funding. Ratushny: Celgene Corporation: Employment. Rozelle: Rancho Biosciences: Employment. Schmitz: Celgene Corporation: Employment. Trotter: Celgene Corporation: Equity Ownership; Celgene Institute for Translational Research Europe: Employment. Thakurta: Celgene Corporation: Employment, Equity Ownership.

Previous Abstract | Next Abstract >>
*signifies non-member of ASH