-Author name in bold denotes the presenting author
-Asterisk * with author name denotes a Non-ASH member
Clinically Relevant Abstract denotes an abstract that is clinically relevant.

PhD Trainee denotes that this is a recommended PHD Trainee Session.

Ticketed Session denotes that this is a ticketed session.

3714 Patients’ Perception of Usability and Utility of a Digital Health Tool for Electronic Patient-Reported Outcomes Monitoring in Real-Life Hematology Practice: Evidence from the Gimema-Alliance Platform

Program: Oral and Poster Abstracts
Session: 902. Health Services and Quality Improvement - Lymphoid Malignancies: Poster II
Hematology Disease Topics & Pathways:
Research, Clinical Practice (Health Services and Quality), Clinical Research, patient-reported outcomes, real-world evidence
Sunday, December 10, 2023, 6:00 PM-8:00 PM

Fabio Efficace, PhD1*, Mario Luppi, MD2*, Leonardo Potenza, MD, PhD3*, Francesco Sparano1*, Giovanni Caocci, MD4, Francesca Fazio5*, Massimo Breccia5*, Maria Teresa Petrucci5*, Andrea Patriarca, MD6*, Thomas Baldi1*, Michelina Santopietro, MD7*, Roberta Battistini7*, Agostino Tafuri, MD8, Gloria Margiotta Casaluci, MD6*, Elisabetta Colaci2*, Davide Giusti2*, Valeria Pioli2*, Paolo De Fabritiis, MD9*, Nicolina Rita Ardu9*, Pasquale Niscola, MD9*, Olga Mulas, MD4*, Claudio Fozza, MD10*, Sergio Siragusa11*, Salvatrice Mancuso11*, Paola Boggione6*, Lorenzo De Paoli6*, Anna Paola Leporace8*, Maria Paola Bianchi8*, Ida Carmosino, MD5*, Claudio Cartoni5*, Alice Di Rocco5*, Isabella Capodanno, MD12*, Massimo Pini13*, Alessandra Romano, MD14*, Paola Fazi, MD1* and Marco Vignetti, MD1*

1Italian Group for Adult Hematologic Diseases (GIMEMA), Data Center and Health Outcomes Research Unit, Rome, Italy
2Hematology Unit and Chair, Azienda Ospedaliera Universitaria di Modena, Department of Medical and Surgical Sciences, University of Modena and Reggio Emilia, Modena, Italy
3Hematology Unit and Chair, Department of Medical and Surgical Sciences, Azienda Ospedaliera Universitaria di Modena, University of Modena and Reggio Emilia, Modena, Italy
4Department of Medical Sciences and Public Health, University of Cagliari, Businco Hospital, Cagliari, Italy
5Hematology, Department of Translational and Precision Medicine, Azienda Ospedaliera Policlinico Umberto I, Sapienza University of Rome, Rome, Italy
6Division of Hematology, Department of Translational Medicine, University of Eastern Piedmont, Novara, Italy
7Hematology and Hematopoietic Stem Cells Transplant Unit, AO San Camillo-Forlanini, Rome, Italy
8Azienda Ospedaliera Sant'Andrea, Rome, Italy
9Hematology Unit, Sant'Eugenio Hospital, Rome, Italy
10Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy
11Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties, University of Palermo, Palermo, Italy
12Hematology Unit, Azienda Unità Sanitaria Locale-IRCCS, Reggio Emilia, Italy
13Hematology and Thrombotic Diseases, San Giovanni Bosco Hospital, Turin, Italy
14Division of Hematology, Azienda Policlinico-S. Marco, University of Catania, Catania, Italy

Background

Digital health tools are increasingly being used in oncology practice to better monitor patients’ health status. They may include electronic-patient-reported outcome (ePRO) monitoring systems, with automated alerts triggered to the physician depending on specific conditions (e.g., when patients report clinically relevant problems). Although implementation of these tools in real-life practice may offer valuable benefits, it is important to assess their usability and utility from the users’ standpoint.

Objective

The aim of this study was to evaluate the patients’ perception of usability and utility of a digital health tool for ePRO monitoring of patients with hematologic malignancies in real-life practice.

Methods

In December 2020, the GIMEMA Group developed a digital health platform for adult patients with hematologic malignancies (GIMEMA-ALLIANCE platform) with the goal of facilitating patient-centered care. The platform was open to enrollment until December 2022 and involved 26 hospitals. After providing written informed consent, patients received a personal password to access the secure patient portal and complete ePRO questionnaires assessing health-related quality of life (HRQoL) and symptoms (EORTC QLQ-C30 and selected items from the EORTC Item Library). Real-time graphical presentation of PRO results is displayed for both patients and physicians. The platform allows hematologists to receive real-time alerts in the presence of clinically important problems and symptoms. For the purpose of this study, a dedicated section in the patient portal was developed to evaluate the usability and utility of the platform. In this section, patients had the possibility to complete the System Usability Scale (SUS). The SUS is a 10-item widely used questionnaire to evaluate users’ perceived system satisfaction. Its score ranges from 0 to 100 and a score ≥70 is considered a threshold for an acceptable usability. Analyses were performed overall and by age group category, based on the median age of the patient population. Patients also completed an ad-hoc survey consisting of 6 items covering aspects on the utility of the platform, for example in favoring shared decision-making or improving the communication with the treating hematologist. Only patients who have completed the ePRO questionnaires at least twice, i.e. those who had the possibility to sufficiently test its functionalities, were considered eligible for completing the survey on usability and utility of the platform.

Results

Out of the 362 eligible patients, a total of 161 (44%) completed the survey. No difference in age and sex was found between patients who completed or not the survey. The median age of patients who completed the survey was 59 years (IQR: 51 - 67) and 53 (34%) were women. The most prevalent diagnosis was multiple myeloma (n=40, 25%). At the time of survey completion, 69% of the patients were receiving a treatment for their disease. The mean SUS score of the overall population was 80.8 (SD 15.5) and the majority of patients (n=131, 81%) gave a rating ≥70 (the prespecified threshold for the acceptable usability). The mean SUS score for the younger and the older groups was 80.5 (SD 14.9) and 81.4 (SD 16), respectively. Eighty-eight percent of patients agreed or strongly agreed that the platform was easy to use, 83% felt very confident in using the platform, and 72% found the various functionalities offered by the platform well integrated (Figure 1). Positive feedbacks on the utility of the platform were also collected. For example, 71% of patients considered the ePRO questionnaires useful for their health conditions and 63% would recommend its use to other patients. However, amongst the patients who had visits at the clinic (n=127), only 39% reported that their doctor discussed ePRO results with them, and this may explain the lower agreement for some items (Figure 2). For example, 38% of the patients strongly agreed/agreed that the platform helped them to improve the communication with their doctor, while 44% neither agreed or disagreed and 18% strongly disagreed/disagreed.

Conclusion

This study showed a good usability and utility of the GIMEMA-ALLIANCE platform from the patients’ perspective, and this was true for younger and older patients. Future areas of improvement should include actions to facilitate physicians in discussing ePRO results during the clinical encounter with their patients.

Disclosures: Efficace: Syros: Consultancy; AbbVie: Consultancy; Incyte: Consultancy. Luppi: Gilead Sci: Membership on an entity's Board of Directors or advisory committees, Other: Travel Grant; MSD: Membership on an entity's Board of Directors or advisory committees; Novartis: Membership on an entity's Board of Directors or advisory committees; Daiichi-Sankyo: Membership on an entity's Board of Directors or advisory committees; Sanofi: Membership on an entity's Board of Directors or advisory committees; Jazz Pharma: Membership on an entity's Board of Directors or advisory committees; Abbvie: Membership on an entity's Board of Directors or advisory committees; Grifols: Membership on an entity's Board of Directors or advisory committees. Fazio: Sanofi: Honoraria; Janssen: Honoraria; Beigene: Honoraria; GSK: Membership on an entity's Board of Directors or advisory committees. Breccia: AOP: Honoraria; BMS: Honoraria; Pfizer: Honoraria; Incyte: Honoraria; AbbVie: Honoraria; Novartis: Honoraria. Petrucci: Celgene-BMS: Honoraria, Membership on an entity's Board of Directors or advisory committees, Other: Support for attending meetings and/or travel; Janssen-Cilag: Honoraria, Membership on an entity's Board of Directors or advisory committees, Other: Support for attending meetings and/or travel; GSK: Honoraria, Membership on an entity's Board of Directors or advisory committees; Takeda: Honoraria, Membership on an entity's Board of Directors or advisory committees, Other: Support for attending meetings and/or travel; Roche: Membership on an entity's Board of Directors or advisory committees; Oncopeptides: Membership on an entity's Board of Directors or advisory committees; Pfizer: Membership on an entity's Board of Directors or advisory committees; Menarini: Membership on an entity's Board of Directors or advisory committees; Sanofi: Honoraria, Membership on an entity's Board of Directors or advisory committees, Other: Support for attending meetings and/or travel; Amgen: Honoraria, Membership on an entity's Board of Directors or advisory committees, Other: Support for attending meetings and/or travel. Patriarca: Sobi: Consultancy, Speakers Bureau; Alexion: Consultancy; Sanofi: Consultancy, Research Funding, Speakers Bureau; Pfizer: Consultancy, Speakers Bureau; Takeda: Consultancy, Research Funding, Speakers Bureau; Novartis: Consultancy, Research Funding, Speakers Bureau; Incyte: Consultancy, Research Funding, Speakers Bureau. Fozza: BMS: Research Funding; Amgen: Research Funding; Sanofi: Research Funding. Di Rocco: Takeda: Speakers Bureau; Abbvie: Honoraria; Janssen: Honoraria; Gilead: Honoraria, Speakers Bureau; Roche: Honoraria, Speakers Bureau; Novartis: Speakers Bureau; Incyte: Speakers Bureau. Vignetti: Dephaforum: Honoraria; Uvet: Honoraria; AbbVie: Honoraria; Novartis: Speakers Bureau; ER Congressi: Honoraria; IQVIA: Honoraria.

*signifies non-member of ASH