-Author name in bold denotes the presenting author
-Asterisk * with author name denotes a Non-ASH member
Clinically Relevant Abstract denotes an abstract that is clinically relevant.

PhD Trainee denotes that this is a recommended PHD Trainee Session.

Ticketed Session denotes that this is a ticketed session.

2269 Explainable End-to-End Supervised Learning Identifies Myelodysplastic Neoplasms in Bone Marrow Smears

Program: Oral and Poster Abstracts
Session: 803. Emerging Tools, Techniques and Artificial Intelligence in Hematology: Poster I
Hematology Disease Topics & Pathways:
Research, MDS, artificial intelligence (AI), adult, Translational Research, Chronic Myeloid Malignancies, Diseases, Myeloid Malignancies, Technology and Procedures, Study Population, Human, machine learning
Saturday, December 9, 2023, 5:30 PM-7:30 PM

Jan-Niklas Eckardt1,2*, Tim Schmittmann3*, Freya Schulze, MD2*, Sebastian Riechert, MSc1,3*, Martin M. K. Schneider, MD2*, Lukas Reichel, MD2*, Miriam Eva Helena Gediga, MD2*, Katja Sockel, MD2*, Anas Shekh Sulaiman, MD2*, Ekaterina Balaian, MD4*, Christoph Röllig, MD, MSc5*, Frank P. Kroschinsky, MD, MBA2, Anne Marie Asemissen, MD6*, Uwe Platzbecker, MD7, Christian Pohlkamp, MD8*, Torsten Haferlach, MD, PhD8, Karsten Wendt, PhD3*, Martin Bornhäuser, MD9,10* and Jan Moritz Middeke, MD2,11*

1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
2Department of Internal Medicine I, University Hospital Carl Gustav Carus, Technical University Dresden, Dresden, Germany
3Institute of Software and Multimedia Technology, Technical University Dresden, Dresden, Germany
4Department of Medicine I, University Hospital TU Dresden, Dresden, Germany
5Department of Internal Medicine I, University Hospital Dresden, Dresden, Germany
6Department of Hematology, Oncology and Bone Marrow Transplantation with Section of Pneumology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
7Department of Hematology, Cellular Therapy, Hemostaseology and Infectious Diseases, University Medical Center Leipzig, Leipzig, Germany
8MLL Munich Leukemia Laboratory, Munich, Germany
9National Center for Tumor Diseases (NCT/UCC) Dresden, Technical University Dresden, Dresden, Germany
10Department of Internal Medicine 1, University Hospital Carl Gustav Carus, Technical University Dresden, Dresden, Germany
11Else-Kröner-Fresenius-Center for Digital Health, Technical University Dresden, Dresden, Germany

Myelodysplastic neoplasms (MDS) encompass clonal myeloid malignancies that are characterized by ineffective hematopoiesis, cytopenia, myelodysplasia, and recurrent genetic events. Apart from genetic abnormalities and the assessment of peripheral blood for cytopenia, cytomorphologic evaluation of bone marrow morphology is key in initial diagnosis and response assessment as well as to detect disease transformation to acute myeloid leukemia (AML). However, the identification of aberrant morphologies in bone marrow cells is challenging and prone to inter-observer variability even for seasoned morphologists resulting in discrepancies between local site and central review. After the introduction of deep learning (DL) models for computer vision tasks, a wide variety of applications in imaging diagnostics has been addressed using convolutional neural networks including the assessment of bone marrow cell types and prediction of hematological malignancies.

Bone marrow smear (BMS) images of manually selected regions of interest (ROI) from 483 MDS patients treated at the University Hospital Dresden were captured at 40-fold magnification with a resolution of 2560*1920 pixels and pre-processed. In parallel, BMS images from two control cohorts were taken: (i) 1226 AML patients registered in the German Study Alliance Leukemia (SAL) registry, and (ii) 236 healthy bone marrow donors. In addition, an external validation cohort of 50 MDS patients was obtained from the Munich Leukemia Laboratory (MLL). Image-level labels were provided denoting the corresponding diagnosis: “MDS”, “AML” and “healthy donor”. To balance different sample sizes between the datasets, simple image augmentation techniques such as random sized cropping, color shifting, and linear transformations were used. Training and testing were performed with 5-fold cross-validation, i.e. multiple train-test-splits of 80:20. Importantly, cell-level labels, e.g. specifically annotated cell types or features like distinct dysplastic morphologies were not used to train our model as we intended to abstract visual information exclusively through our neural networks instead of using expert-guided feature engineering.

Six different recently introduced convolutional neural network (CNN) architectures were compared (ResNet-34/50/101/152, ResNeXt-50/101, ShuffleNet V2, DenseNet-121/169/201, Wide ResNet-50/101, and SqueezeNet 1.1). To evaluate individual model performance, we used accuracy, recall (=sensitivity), precision (=positive predictive value), and area-under-the-curve (AUC) of both the receiver-operating-characteristic (ROC) and precision-recall-curve (PRC). Binary classification tasks showed high accuracy of 0.956 and 0.981 for distinguishing MDS from healthy donors and AML, respectively (Table I). Results were validated in the external MDS cohort reaching an accuracy of 0.916 for MDS vs. donors and 0.968 for MDS vs. AML (Table I).

For explainability, we used occlusion sensitivity mapping which iteratively blocks image areas from being evaluated by the CNNs, measures consecutive drops in prediction performance, and thus identifies image areas of high importance (highlighted in green). By reviewing images, we found the CNNs to target nuclei not only of dysplastic cells but rather of all available cells in a ROI (Figure 1).

Using supervised end-to-end deep learning, we developed a software framework to distinguish between MDS, AML, and healthy controls with very high accuracy. Importantly, models do not require laborious feature engineering, i.e. manually drafted, cell-level labels alleviating the need for time-consuming and cost-ineffective manual labeling and thereby bypassing a key bottleneck for current standards of computer vision in microscopy.

Disclosures: Sockel: Gilead: Consultancy, Honoraria; BMS/Celgene: Consultancy, Honoraria; Novartis: Consultancy, Honoraria; Active Biotech: Research Funding; GSK: Consultancy, Honoraria; SOBI: Consultancy, Honoraria; Blueprint: Consultancy, Honoraria. Röllig: AbbVie: Consultancy, Honoraria, Research Funding; Astellas: Consultancy, Honoraria; BMS: Consultancy, Honoraria; Janssen: Consultancy, Honoraria; Novartis: Consultancy, Honoraria, Research Funding; Pfizer: Consultancy, Honoraria, Research Funding; Servier: Consultancy, Honoraria. Platzbecker: Celgene: Honoraria; Silence Therapeutics: Consultancy, Honoraria, Research Funding; Takeda: Consultancy, Honoraria, Research Funding; Syros: Consultancy, Honoraria, Research Funding; Bristol Myers Squibb: Consultancy, Honoraria, Membership on an entity's Board of Directors or advisory committees, Other: travel support; medical writing support, Research Funding; Novartis: Consultancy, Honoraria, Research Funding; Curis: Consultancy, Research Funding; Geron: Consultancy, Research Funding; AbbVie: Consultancy; Amgen: Consultancy, Research Funding; Janssen Biotech: Consultancy, Research Funding; Servier: Consultancy, Honoraria, Research Funding; Merck: Research Funding; Jazz: Consultancy, Honoraria, Research Funding; MDS Foundation: Membership on an entity's Board of Directors or advisory committees; Fibrogen: Research Funding; Roche: Research Funding; BeiGene: Research Funding; BMS: Research Funding. Pohlkamp: MLL Munich Leukemia Laboratory: Current Employment. Haferlach: MLL Munich Leukemia Laboratory: Current Employment, Other: Equity Ownership. Middeke: Novartis Oncology: Research Funding.

*signifies non-member of ASH