Israel Medical Association Journal

Background: Completing internal medicine specialty training in Israel involves passing the Israel National Internal Medicine Exam (Shlav Aleph), a challenging multiple-choice test. multiple-choice test. Chat generative pre-trained transformer (ChatGPT) 3.5, a language model, is increasingly used for exam preparation.

Objectives: To assess the ability of ChatGPT 3.5 to pass the Israel National Internal Medicine Exam in Hebrew.

Methods: Using the 2023 Shlav Aleph exam questions, ChatGPT received prompts in Hebrew. Textual questions were analyzed after the appeal, comparing its answers to the official key.

Results: ChatGPT 3.5 correctly answered 36.6% of the 133 analyzed questions, with consistent performance across topics, except for challenges in nephrology and biostatistics.

Conclusions: While ChatGPT 3.5 has excelled in English medical exams, its performance in the Hebrew Shlav Aleph was suboptimal. Factors include limited training data in Hebrew, translation complexities, and unique language structures. Further investigation is essential for its effective adaptation to Hebrew medical exam preparation.

Background: Nasal obstruction is one of the most common complaints in the practice of rhinology.

Objective: To adapt the Nasal Obstruction Scale Evaluation (NOSE) questionnaire to Hebrew (H-NOSE) and to assess its sensitivity and specificity.

Methods: Candidates for surgical intervention due to isolated nasal obstruction and healthy volunteers (controls) were included in the validation. The English NOSE questionnaire was translated into Hebrew and re-translated for translation validity. Patients completed the H-NOSE questionnaire before and after surgery for nasal obstruction. The same questionnaire was completed by the controls. Test–retest reliability was performed within 2 weeks. Psychometric properties (reliability, reproducibility, validity, and responsiveness) were assessed by a test–retest procedure, internal consistency, correlation to the Hebrew Sino-Nasal Outcome Tool 22 (He-SNOT-22), and response sensitivity.

Results: In total, 179 patients with nasal obstruction and 74 controls completed the questionnaire. Cronbach's alpha score was 0.93 for internal consistency. The receiver operating characteristic curve demonstrated high sensitivity and specificity (< 90%) and area under the curve was 0.97. We found no significant difference in test–retest reliability. The difference between the pre- and postoperative questionnaire scores was highly significant (13.9 ± 4.0 vs. 3.2 ± 4.1, respectively, P < 0.001).

Conclusions: The H-NOSE questionnaire demonstrated reliable internal consistency, sensitivity, specificity, and reliability. The Hebrew version differentiated between patients and heathy controls and was easy to administer. This instrument is useful for Hebrew speaking patients who undergo surgery for nasal obstruction.

Background: Patient protection requires the provision of informed consent for participation in medical research. The MacArthur Competence Assessment Tool for Clinical Research (MacCAT-CR) is frequently used for screening the capacity of research subjects to consent to participate in research.

Objectives: To evaluate the utility of the Hebrew translation of the MacCAT-CR for the assessment of capacity of patients with chronic schizophrenia to provide informed consent to participate in clinical trials.

Methods: We evaluated the translated MacCAT-CR by comparing the capacity of patients with chronic schizophrenia to provide informed consent to participate in clinical trials. The following standardized neurocognitive assessment tools were used: Addenbrooke’s Cognitive Examination (ACE) and Frontal Assessment Battery (FAB), as well as the attending doctor’s assessment.

Results: Twenty-one patients participated. Mean MacCAT-CR score was12 ¡À 10.57 (range 0¨C32), mean FAB score was 9.9 ¡À 4.77 (range 1¨C18), mean ACE was 59.14 ¡À 16.6 (range 27¨C86) and mean doctor’s assessment was 5.24 ¡À 1.18 (range 3¨C7).

Conclusions: The Hebrew-version of the MacCAT-CR helped identify patients with the capacity to provide informed consent for participation in research. Patients with FAB scores ¡Ý 12 tended to score higher on the Hebrew-version of the MacCAT-CR, thus confirming the utility of the Hebrew version of the MacCAT-CR. During the screening process for clinical trials it may be practical to administer the concise FAB questionnaire, and then administer the MacCAT-CR only to those who scored ¡Ý 12 on the FAB.

Background: The Pittsburgh Sleep Quality Index is a standardized self-administered questionnaire for the assessment of subjective sleep quality. It has been translated into several languages and is widely used in clinical research studies.

Objectives: To assess the reliability and validity of the Pittsburgh Sleep Quality Index Hebrew translation in a sleep clinic sample and in comparison with the Technion Mini Sleep Questionnaire.

Methods: The PSQI[1] was translated into Hebrew based on standard guidelines. The final Hebrew version (PSQI-H) was administered to 450 patients from two sleep clinics and to 61 healthy adults from the community as a non-clinical control sample. The MSQ[2] was administered to 130 patients in one sleep clinic.

Results: For the PSQI-H[3], Cronbach's-alpha scores for sleep clinic and non-clinical samples were 0.70 and 0.52 respectively and 0.72 combined. Clinical sample scores were significantly higher than the non-clinical group, indicating lower sleep quality for the former. Significant correlations were found between the MSQ subscores and PSQI-H component scores for common underlying constructs.

Conclusions: The PSQI-H differentiated between clinical and non-clinical samples and showed adequate reliability and good validity. It may be used as a standardized tool for the assessment of subjective sleep quality in clinical research studies conducted in the Hebrew-speaking population.