Israel Medical Association Journal

Artificial Intelligence (AI), particularly large language models (LLMs) like OpenAI's ChatGPT, has shown potential in various medical fields, including pediatrics. We evaluated the utility and integration of LLMs in pediatric medicine. We conducted a search in PubMed using specific keywords related to LLMs and pediatric care. Studies were included if they assessed LLMs in pediatric settings, were published in English, peer-reviewed, and reported measurable outcomes. Sixteen studies spanning pediatric sub-specialties such as ophthalmology, cardiology, otology, and emergency medicine were analyzed. The findings indicate that LLMs provide valuable diagnostic support and information management. However, their performance varied, with limitations in complex clinical scenarios and decision-making. Despite excelling in tasks requiring data summarization and basic information delivery, the effectiveness of the models in nuanced clinical decision-making was restricted. LLMs, including ChatGPT, show promise in enhancing pediatric medical care but exhibit inconsistent performance in complex clinical situations. This finding underscores the importance of continuous human oversight. Future integration of LLMs into clinical practice should be approached with caution to ensure they supplement, rather than supplant, expert medical judgment.

Background: Advancements in artificial intelligence (AI) and natural language processing (NLP) have led to the development of language models such as ChatGPT. These models have the potential to transform healthcare and medical research. However, understanding their applications and limitations is essential.

Objectives: To present a view of ChatGPT research and to critically assess ChatGPT's role in medical writing and clinical environments.

Methods: We performed a literature review via the PubMed search engine from 20 November 2022, to 23 April 2023. The search terms included ChatGPT, OpenAI, and large language models. We included studies that focused on ChatGPT, explored its use or implications in medicine, and were original research articles. The selected studies were analyzed considering study design, NLP tasks, main findings, and limitations.

Results: Our study included 27 articles that examined ChatGPT's performance in various tasks and medical fields. These studies covered knowledge assessment, writing, and analysis tasks. While ChatGPT was found to be useful in tasks such as generating research ideas, aiding clinical reasoning, and streamlining workflows, limitations were also identified. These limitations included inaccuracies, inconsistencies, fictitious information, and limited knowledge, highlighting the need for further improvements.

Conclusions: The review underscores ChatGPT's potential in various medical applications. Yet, it also points to limitations that require careful human oversight and responsible use to improve patient care, education, and decision-making.

Large language models have revolutionized natural language processing. The emergence phenomenon is observed in these models and has the potential to revolutionize data processing and management. In this review, we discuss the concept of emergence in artificial intelligence, give detailed examples, and elaborate on the risks and limitations of large language models. The review exposes physicians to large language models, their advantages, and the inherent opportunities. We also describe the limitations and dangers, as these models are expected to impact medicine soon.