UMIN-CTR Clinical Trial
| Unique ID issued by UMIN | UMIN000054461 |
|---|---|
| Receipt number | R000062206 |
| Scientific Title | Accuracy and reliability of data extraction for systematic reviews using large language models: A protocol for a prospective study |
| Date of disclosure of the study information | 2024/05/23 |
| Last modified on | 2024/05/23 14:54:52 |
* This page includes information on clinical trials registered in UMIN clinical trial registed system.
* We don't aim to advertise certain products or treatments
Basic information
Public title
Accuracy and reliability of data extraction for systematic reviews using large language models: A protocol for a prospective study
Acronym
Accuracy and reliability of data extraction for systematic reviews using large language models: A protocol for a prospective study
Scientific Title
Accuracy and reliability of data extraction for systematic reviews using large language models: A protocol for a prospective study
Scientific Title:Acronym
Accuracy and reliability of data extraction for systematic reviews using large language models: A protocol for a prospective study
Region
| Japan |
Condition
Condition
Sepsis
Classification by specialty
| Emergency medicine | Intensive care medicine |
Classification by malignancy
Others
Genomic information
NO
Objectives
Narrative objectives1
To evaluate the accuracy and reliability of the extracted data from selected literature in the systematic review process in J-SSCG 2024 using three LLMs (GPT-4 Turbo, Claude 3, and Gemini 1.5 Pro).
Basic objectives2
Others
Basic objectives -Others
accuracy and reliability
Trial characteristics_1
Trial characteristics_2
Developmental phase
Assessment
Primary outcomes
To evaluate the accuracy and reliability of three large language models and optimize their command prompts to enhance accuracy.
Key secondary outcomes
Detailed characteristics of errors
Time to complete each task
Following the primary analysis, we will optimize the original command with integration of prompt engineering techniques in the secondary analysis.
Base
Study type
Others,meta-analysis etc
Study design
Basic design
Randomization
Randomization unit
Blinding
Control
Stratification
Dynamic allocation
Institution consideration
Blocking
Concealment
Intervention
No. of arms
Purpose of intervention
Type of intervention
Interventions/Control_1
Interventions/Control_2
Interventions/Control_3
Interventions/Control_4
Interventions/Control_5
Interventions/Control_6
Interventions/Control_7
Interventions/Control_8
Interventions/Control_9
Interventions/Control_10
Eligibility
Age-lower limit
| Not applicable |
Age-upper limit
| Not applicable |
Gender
Male and Female
Key inclusion criteria
Not applicable
Key exclusion criteria
Not applicable
Target sample size
Research contact person
Name of lead principal investigator
| 1st name | Takehiko |
| Middle name | |
| Last name | Oami |
Organization
Chiba University Graduate School of Medicine
Division name
Department of Emergency and Critical Care Medicine
Zip code
260-8677
Address
1-8-1 Inohana, Chuo, Chiba
TEL
0432227171
seveneleven711thanks39@msn.com
Public contact
Name of contact person
| 1st name | Takehiko |
| Middle name | |
| Last name | Oami |
Organization
Chiba University Graduate School of Medicine
Division name
Department of Emergency and Critical Care Medicine
Zip code
260-8677
Address
1-8-1 Inohana, Chuo, Chiba
TEL
0432227171
Homepage URL
seveneleven711thanks39@msn.com
Sponsor or person
Institute
Chiba University Graduate School of Medicine
Institute
Department
Personal name
Takehiko Oami
Funding Source
Organization
Chiba University Graduate School of Medicine
Organization
Division
Category of Funding Organization
Other
Nationality of Funding Organization
Other related organizations
Co-sponsor
Name of secondary funder(s)
IRB Contact (For public release)
Organization
Chiba University Hospital
Address
1-8-1 Inohana, Chuo, Chiba 260-8677, Japan
Tel
0432227171
seveneleven711thanks39@msn.com
Secondary IDs
Secondary IDs
NO
Study ID_1
Org. issuing International ID_1
Study ID_2
Org. issuing International ID_2
IND to MHLW
Institutions
Institutions
千葉大学大学院医学研究院 救急集中治療医学
Other administrative information
Date of disclosure of the study information
| 2024 | Year | 05 | Month | 23 | Day |
Related information
URL releasing protocol
Publication of results
Unpublished
Result
URL related to results and publications
Number of participants that the trial has enrolled
Results
Results date posted
Results Delayed
Results Delay Reason
Date of the first journal publication of results
Baseline Characteristics
Participant flow
Adverse events
Outcome measures
Plan to share IPD
IPD sharing Plan description
Progress
Recruitment status
Enrolling by invitation
Date of protocol fixation
| 2024 | Year | 05 | Month | 22 | Day |
Date of IRB
| 2024 | Year | 05 | Month | 22 | Day |
Anticipated trial start date
| 2024 | Year | 05 | Month | 23 | Day |
Last follow-up date
| 2024 | Year | 12 | Month | 31 | Day |
Date of closure to data entry
Date trial data considered complete
Date analysis concluded
Other
Other related information
https://medrxiv.org/cgi/content/short/2024.05.22.24307740v1
Management information
Registered date
| 2024 | Year | 05 | Month | 22 | Day |
Last modified on
| 2024 | Year | 05 | Month | 23 | Day |
Link to view the page
Value
https://center6.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000062206
