id,title,description,date_created,date_modified,date_published,original_publication_date,publication_doi,provider,is_published,reviews_state,version,is_latest_version,preprint_doi,license,tags_list,tags_data,contributors_list,contributors_data,first_author,subjects_list,subjects_data,download_url,has_coi,conflict_of_interest_statement,has_data_links,has_prereg_links,prereg_links,prereg_link_info,last_updated
fd8w5_v1,Simple Prompting Enhances ChatGPT’s Diagnostic Accuracy in Psychiatric Cases,"Despite the centrality of the diagnostic assessment in psychiatry, the diagnostic agreement among mental health practitioners often varies from poor to moderate. The potential of Large Language Models (LLMs; such as ChatGPT), among other approaches, has been studied to be used as standardized tools to support clinicians’ decision-making. The current work investigates the diagnostic accuracy of ChatGPT 3.5 across different case presentation styles (i.e., vignette and outline) and prompting techniques. A total of 46 psychiatric cases with an accompanying diagnosis were used. Two trained clinical psychologists evaluated the accuracy of the generated diagnosis against the reference diagnosis. A robust statistical approach was then used to investigate the effect of case format and prompt type on the average diagnostic accuracy. The results showed a moderate agreement between the ratings of the two clinical psychologists (kappa = 0.687). Moreover, a statistically significant main effect of prompting technique on ChatGPT diagnostic accuracy emerged (p = 0.009). The highest accuracy was achieved when ChatGPT 3.5 was simply instructed to provide and justify a single diagnosis for each case as compared to when it was asked to provide a diagnosis likelihood (p < 0.001) or when it was asked to act as a clinical psychologist (p < 0.001). The results of the current work reinforce the potential to use ChatGPT as a supporting tool for the diagnostic step in psychiatry and provide a general indication in order to ensure good performance when using it.",2024-09-11T11:08:13.263715,2024-09-11T14:50:20.932619,2024-09-11T14:50:00.265663,,,newaddictionsx,1,accepted,1,1,https://doi.org/10.31219/osf.io/fd8w5,CC-By Attribution 4.0 International,ChatGPT; clinical diagnosis; clinical psychology; diagnostic reliability; large language models; psychiatric diagnosis,"[""ChatGPT"", ""clinical diagnosis"", ""clinical psychology"", ""diagnostic reliability"", ""large language models"", ""psychiatric diagnosis""]",Seraphina Fong; Alessandro Carollo; Martina Dal Maso; Giovanni Martinotti; Debora Luciani; Yasser Saeed Khan; Luca Pellegrini; Ornella Corazza; Gianluca Esposito,"[{""id"": ""hzy3r"", ""name"": ""Seraphina Fong"", ""index"": 0, ""orcid"": ""0000-0002-8256-746X"", ""bibliographic"": true}, {""id"": ""76j29"", ""name"": ""Alessandro Carollo"", ""index"": 1, ""orcid"": ""0000-0002-2737-0218"", ""bibliographic"": true}, {""id"": ""w6esc"", ""name"": ""Martina Dal Maso"", ""index"": 2, ""orcid"": null, ""bibliographic"": true}, {""id"": ""ugawh"", ""name"": ""Giovanni Martinotti"", ""index"": 3, ""orcid"": null, ""bibliographic"": true}, {""id"": ""ux7nv"", ""name"": ""Debora Luciani"", ""index"": 4, ""orcid"": null, ""bibliographic"": true}, {""id"": ""razxg"", ""name"": ""Yasser Saeed Khan"", ""index"": 5, ""orcid"": null, ""bibliographic"": true}, {""id"": ""d6phm"", ""name"": ""Luca Pellegrini"", ""index"": 6, ""orcid"": null, ""bibliographic"": true}, {""id"": ""g3e6u"", ""name"": ""Ornella Corazza"", ""index"": 7, ""orcid"": null, ""bibliographic"": true}, {""id"": ""35h7k"", ""name"": ""Gianluca Esposito"", ""index"": 8, ""orcid"": ""0000-0002-9442-0254"", ""bibliographic"": true}]",Seraphina Fong,Mental Disorders; Other Psychiatry and Psychology; Clinical Psychology; Psychiatry and Psychology; Medicine and Health Sciences; Social and Behavioral Sciences; Psychology,"[{""id"": ""584240d954be81056ceca85b"", ""text"": ""Mental Disorders""}, {""id"": ""584240d954be81056ceca928"", ""text"": ""Other Psychiatry and Psychology""}, {""id"": ""584240d954be81056ceca93d"", ""text"": ""Clinical Psychology""}, {""id"": ""584240d954be81056cecaa2b"", ""text"": ""Psychiatry and Psychology""}, {""id"": ""584240da54be81056cecaaaa"", ""text"": ""Medicine and Health Sciences""}, {""id"": ""584240da54be81056cecac48"", ""text"": ""Social and Behavioral Sciences""}, {""id"": ""584240da54be81056cecac68"", ""text"": ""Psychology""}]",https://osf.io/download/66e17a70b4e35b0d2c45a5e3,0,,no,not_applicable,[],,2025-04-09T21:06:22.707544
5hyjx_v1,Dynamic Topic Modeling of Kratom Use and Experiences: Insights on 13 years of Reddit Discussions,"Traditionally used in Southeast Asia for common ailments, kratom (Mitragyna speciosa) is increasingly being adopted in other regions for the self-treatment of pain, mental health issues such as anxiety, depression, and dependence or managing the withdrawal symptoms linked to stimulants/sedatives or other substances in absence of clinical supervision. To gain better insight into the experiences and the motivations underlying kratom use, previous studies have analyzed material shared among users on social media. However, these investigations often employed manual labeling and categorizations, which are time-consuming and do not allow the investigation of large samples. The present work utilized a natural language processing approach (BERTopic) to extract prominent topics of discussion from kratom-related Reddit posts made between 2010 to 2023 (n = 188,139 posts). Dynamic Topic Modeling was also implemented to analyze how discussions about these topics evolved over time. From the results, users discussed topics including usage for substance use disorder recovery (e.g., suboxone), drug testing, consumption methods, logistic issues (e.g., bringing kratom on flights, receiving kratom via mail), tapering off the use of kratom, and providing support to others who are in the process of quitting kratom. The current study supports the need of clinical trials as well as new ecological insights into experiences of kratom users, while supporting the implementation of new policies to regulate its usage.",2024-08-16T14:24:54.262470,2024-08-19T15:40:41.311049,2024-08-19T15:40:23.301353,,,newaddictionsx,1,accepted,1,1,https://doi.org/10.31219/osf.io/5hyjx,CC-By Attribution 4.0 International,BERTopic; addiction science; kratom; natural language processing; reddit; topic modeling,"[""BERTopic"", ""addiction science"", ""kratom"", ""natural language processing"", ""reddit"", ""topic modeling""]",Seraphina Fong; Alessandro Carollo; Elisabeth Prevete; Ornella Corazza; Gianluca Esposito,"[{""id"": ""hzy3r"", ""name"": ""Seraphina Fong"", ""index"": 0, ""orcid"": ""0000-0002-8256-746X"", ""bibliographic"": true}, {""id"": ""76j29"", ""name"": ""Alessandro Carollo"", ""index"": 1, ""orcid"": ""0000-0002-2737-0218"", ""bibliographic"": true}, {""id"": ""evu6m"", ""name"": ""Elisabeth Prevete"", ""index"": 2, ""orcid"": null, ""bibliographic"": true}, {""id"": ""f84tx"", ""name"": ""Ornella Corazza"", ""index"": 3, ""orcid"": ""0000-0001-7371-319X"", ""bibliographic"": true}, {""id"": ""35h7k"", ""name"": ""Gianluca Esposito"", ""index"": 4, ""orcid"": ""0000-0002-9442-0254"", ""bibliographic"": true}]",Seraphina Fong,Linguistics; Substance Abuse and Addiction; Pain Management; Medicine and Health Sciences; Mental and Social Health; Social and Behavioral Sciences; Computational Linguistics; Psychology,"[{""id"": ""584240d954be81056ceca960"", ""text"": ""Linguistics""}, {""id"": ""584240d954be81056ceca980"", ""text"": ""Substance Abuse and Addiction""}, {""id"": ""584240d954be81056ceca988"", ""text"": ""Pain Management""}, {""id"": ""584240da54be81056cecaaaa"", ""text"": ""Medicine and Health Sciences""}, {""id"": ""584240da54be81056cecac2d"", ""text"": ""Mental and Social Health""}, {""id"": ""584240da54be81056cecac48"", ""text"": ""Social and Behavioral Sciences""}, {""id"": ""584240da54be81056cecac4f"", ""text"": ""Computational Linguistics""}, {""id"": ""584240da54be81056cecac68"", ""text"": ""Psychology""}]",https://osf.io/download/66bf61425f510217b72d3b6f,0,,available,not_applicable,[],,2025-04-09T21:06:21.781360