Is ChatGPT knowledgeable of acute coronary syndromes and pertinent European Society of Cardiology Guidelines?
Select Content Type
Clinical Guidelines
Authored By
Gurbuz DC, Varis E
Authored On
Interests
Cardiology
Emergency Medicine
Speciality
Cardiology
Emergency Medicine
Book Detail
volume
72
ISSN
2724-5772
No. of pages
5
Publication Date
Actions
Download in App
Event Data
{"article_title":"Is ChatGPT knowledgeable of acute coronary syndromes and pertinent European Society of Cardiology Guidelines?","author":"\"Gurbuz, Dogac C , Varis, Eser\"","journal_title":"Minerva cardiology and angiology","issn":"2724-5772 ; Electronic","isbn":"","publication_date":"20240601","volume":"72","issue":"3","first_page":"299","page_count":"5","accession_number":"38391252","doi":"10.23736\/S2724-5683.24.06517-7","publisher":"Minerva medica","doctype":"Letter","subjects":"Cardiology","interest_area":["Cardiology"," Emergency Medicine"],"abstract":"Advancements in artificial intelligence are being seen in multiple fields, including medicine, and this trend is likely to continue going forward. To analyze the accuracy and reproducibility of ChatGPT answers about acute coronary syndromes (ACS).","url":"https:\/\/search.ebscohost.com\/login.aspx?direct=true&db=mdl&AN=38391252&authtype=shib&custid=ns346513","isPdfLink":true,"isSAML":false,"additionalInfo":{"Authored_By":"Gurbuz DC, Varis E","Journal_Info":"Publisher: Minerva medica Country of Publication: Italy NLM ID: 101776555 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 2724-5772 (Electronic) Linking ISSN: 27245683 NLM ISO Abbreviation: Minerva Cardiol Angiol Subsets: MEDLINE","Publication_Type":"Journal Article","Published_Date":"2024-06-01","Source":"Minerva cardiology and angiology [Minerva Cardiol Angiol] 2024 Jun; Vol. 72 (3), pp. 299-303. Date of Electronic Publication: 2024 Feb 23.","Languages":"English","Electronic_ISSN":"2724-5772","MeSH_Terms":"Acute Coronary Syndrome*\/therapy , Cardiology*\/standards , Practice Guidelines as Topic*\/standards, Humans ; Reproducibility of Results ; Europe ; Societies, Medical ; Surveys and Questionnaires ; Artificial Intelligence","Subjects":"Humans, Reproducibility of Results, Europe, Societies, Medical, Surveys and Questionnaires, Artificial Intelligence, Acute Coronary Syndrome therapy, Cardiology standards, Practice Guidelines as Topic standards","Title_Abbreviations":"Minerva cardiology and angiology","Volume":"72"},"header":{"DbId":"mdl","DbLabel":"MEDLINE Ultimate","An":"38391252","RelevancyScore":"924","PubType":"Academic Journal","PubTypeId":"academicJournal","PreciseRelevancyScore":"924.313354492188"},"plink":"https:\/\/search.ebscohost.com\/login.aspx?direct=true&site=eds-live&db=mdl&AN=38391252&authtype=shib&custid=ns346513&group=main&profile=eds","upload_link":"https:\/\/search.ebscohost.com\/login.aspx?direct=true&site=eds-live&db=mdl&AN=38391252&authtype=shib&custid=ns346513&group=main&profile=eds"}
["Gurbuz DC, Varis E","Publisher: Minerva medica Country of Publication: Italy NLM ID: 101776555 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 2724-5772 (Electronic) Linking ISSN: 27245683 NLM ISO Abbreviation: Minerva Cardiol Angiol Subsets: MEDLINE","Journal Article","2024-06-01","Minerva cardiology and angiology [Minerva Cardiol Angiol] 2024 Jun; Vol. 72 (3), pp. 299-303. Date of Electronic Publication: 2024 Feb 23.","English","2724-5772","Acute Coronary Syndrome*\/therapy , Cardiology*\/standards , Practice Guidelines as Topic*\/standards, Humans ; Reproducibility of Results ; Europe ; Societies, Medical ; Surveys and Questionnaires ; Artificial Intelligence","Humans, Reproducibility of Results, Europe, Societies, Medical, Surveys and Questionnaires, Artificial Intelligence, Acute Coronary Syndrome therapy, Cardiology standards, Practice Guidelines as Topic standards","Minerva cardiology and angiology","72"]
Description
Background: Advancements in artificial intelligence are being seen in multiple fields, including medicine, and this trend is likely to continue going forward. To analyze the accuracy and reproducibility of ChatGPT answers about acute coronary syndromes (ACS).<br />Methods: The questions asked to ChatGPT were prepared in two categories. A list of frequently asked questions (FAQs) created from inquiries asked by the public and while preparing the scientific question list, 2023 European Society of Cardiology (ESC) Guidelines for the management of ACS and ESC Clinical Practice Guidelines were used. Accuracy and reproducibility of ChatGPT responses about ACS were evaluated by two cardiologists with ten years of experience using Global Quality Score (GQS).<br />Results: Eventually, 72 FAQs related to ACS met the study inclusion criteria. In total, 65 (90.3%) ChatGPT answers scored GQS 5, which indicated highest accuracy and proficiency. None of the ChatGPT responses to FAQs about ACS scored GQS 1. In addition, highest accuracy and reliability of ChatGPT answers was obtained for the prevention and lifestyle section with GQS 5 for 19 (95%) answers, and GQS 4 for 1 (5%) answer. In contrast, accuracy and proficiency of ChatGPT answers were lowest for the treatment and management section. Moreover, 68 (88.3%) ChatGPT responses for guideline based questions scored GQS 5. Reproducibility of ChatGPT answers was 94.4% for FAQs and 90.9% for ESC guidelines questions.<br />Conclusions: This study shows for the first time that ChatGPT can give accurate and sufficient responses to more than 90% of FAQs about ACS. In addition, proficiency and correctness of ChatGPT answers about questions depending on ESC guidelines was also substantial.
