Skip to Main Content (Press Enter)

Logo UNISR
  • ×
  • Home
  • People
  • Outputs
  • Organizations
  • Expertise & Skills
  • Equipment

UNIFIND
Logo UNISR

|

UNIFIND

unisr.it
  • ×
  • Home
  • People
  • Outputs
  • Organizations
  • Expertise & Skills
  • Equipment
  1. Outputs

Testing ChatGPT ability to answer laypeople questions about cardiac arrest and cardiopulmonary resuscitation

Academic Article
Publication Date:
2024
Short description:
Testing ChatGPT ability to answer laypeople questions about cardiac arrest and cardiopulmonary resuscitation / Scquizzato, T., Semeraro, F., Swindell, P., Simpson, R., Angelini, M., Gazzato, A., Sajjad, U., Bignami, E.G., Landoni, G., Keeble, T.R., Mion, M.. - In: RESUSCITATION. - ISSN 0300-9572. - 194:(2024). [10.1016/j.resuscitation.2023.110077]
abstract:
Introduction: Cardiac arrest leaves witnesses, survivors, and their relatives with a multitude of questions. When a young or a public figure is affected, interest around cardiac arrest and cardiopulmonary resuscitation (CPR) increases. ChatGPT allows everyone to obtain human-like responses on any topic. Due to the risks of accessing incorrect information, we assessed ChatGPT accuracy in answering laypeople questions about cardiac arrest and CPR. Methods: We co-produced a list of 40 questions with members of Sudden Cardiac Arrest UK covering all aspects of cardiac arrest and CPR. Answers provided by ChatGPT to each question were evaluated by professionals for their accuracy, by professionals and laypeople for their relevance, clarity, comprehensiveness, and overall value on a scale from 1 (poor) to 5 (excellent), and for readability. Results: ChatGPT answers received an overall positive evaluation (4.3 ± 0.7) by 14 professionals and 16 laypeople. Also, clarity (4.4 ± 0.6), relevance (4.3 ± 0.6), accuracy (4.0 ± 0.6), and comprehensiveness (4.2 ± 0.7) of answers was rated high. Professionals, however, rated overall value (4.0 ± 0.5 vs 4.6 ± 0.7; p = 0.02) and comprehensiveness (3.9 ± 0.6 vs 4.5 ± 0.7; p = 0.02) lower compared to laypeople. CPR-related answers consistently received a lower score across all parameters by professionals and laypeople. Readability was 'difficult' (median Flesch reading ease score of 34 [IQR 26-42]). Conclusions: ChatGPT provided largely accurate, relevant, and comprehensive answers to questions about cardiac arrest commonly asked by survivors, their relatives, and lay rescuers, except CPR-related answers that received the lowest scores. Large language model will play a significant role in the future and healthcare-related content generated should be monitored.
Iris type:
1.1 Articolo in rivista
List of contributors:
Scquizzato, Tommaso; Semeraro, Federico; Swindell, Paul; Simpson, Rupert; Angelini, Matteo; Gazzato, Arianna; Sajjad, Uzma; Bignami, Elena G; Landoni, Giovanni; Keeble, Thomas R; Mion, Marco
Authors of the University:
LANDONI GIOVANNI
Handle:
https://iris.unisr.it/handle/20.500.11768/155336
Published in:
RESUSCITATION
Journal
  • Overview

Overview

URL

https://www.resuscitationjournal.com/article/S0300-9572(23)00813-4/fulltext
  • Use of cookies

Powered by VIVO | Designed by Cineca | 26.11.0.0