UMIN-CTR Clinical Trial

Unique ID issued by UMIN UMIN000054783
Receipt number R000062604
Scientific Title Comparison of large language models for citation screening
Date of disclosure of the study information 2024/06/26
Last modified on 2024/11/13 14:13:55

* This page includes information on clinical trials registered in UMIN clinical trial registed system.
* We don't aim to advertise certain products or treatments


Basic information

Public title

Comparison of large language models for citation screening

Acronym

Comparison of large language models for citation screening

Scientific Title

Comparison of large language models for citation screening

Scientific Title:Acronym

Comparison of large language models for citation screening

Region

Japan


Condition

Condition

Sepsis

Classification by specialty

Emergency medicine Intensive care medicine

Classification by malignancy

Others

Genomic information

NO


Objectives

Narrative objectives1

To evaluate the accuracy of three leading LLMs - GPT-4, Gemini 1.5 Pro, and Claude 3.5 for literature screening.

Basic objectives2

Others

Basic objectives -Others

To evaluate the time required for the process and cost of three leading LLMs - GPT-4, Gemini 1.5 Pro, and Claude 3.5 for literature screening.

Trial characteristics_1


Trial characteristics_2


Developmental phase



Assessment

Primary outcomes

Accuracy,

Key secondary outcomes

Time required for citation screening, and cost


Base

Study type

Observational


Study design

Basic design


Randomization


Randomization unit


Blinding


Control


Stratification


Dynamic allocation


Institution consideration


Blocking


Concealment



Intervention

No. of arms


Purpose of intervention


Type of intervention


Interventions/Control_1


Interventions/Control_2


Interventions/Control_3


Interventions/Control_4


Interventions/Control_5


Interventions/Control_6


Interventions/Control_7


Interventions/Control_8


Interventions/Control_9


Interventions/Control_10



Eligibility

Age-lower limit

18 years-old <=

Age-upper limit

100 years-old >=

Gender

Male and Female

Key inclusion criteria

Sepsis

Key exclusion criteria

Not applicable

Target sample size

41


Research contact person

Name of lead principal investigator

1st name Takehiko
Middle name
Last name Oami

Organization

Chiba University Graduate School of Medicine

Division name

Department of Emergency and Critical Care Medicine

Zip code

30329

Address

1-8-1 Inohana, Chuo, Chiba 260-8677, Japan

TEL

0432227171

Email

seveneleven711thanks39@msn.com


Public contact

Name of contact person

1st name Takehiko
Middle name
Last name Oami

Organization

Chiba University Graduate School of Medicine

Division name

Department of Emergency and Critical Care Medicine

Zip code

30329

Address

1-8-1 Inohana, Chuo, Chiba 260-8677, Japan

TEL

0432227171

Homepage URL


Email

seveneleven711thanks39@msn.com


Sponsor or person

Institute

Chiba University Graduate School of Medicine

Institute

Department

Personal name

Takehiko Oami


Funding Source

Organization

None

Organization

Division

Category of Funding Organization

Other

Nationality of Funding Organization



Other related organizations

Co-sponsor


Name of secondary funder(s)



IRB Contact (For public release)

Organization

Department of Emergency and Critical Care Medicine, Chiba University Graduate School of Medicine

Address

1-8-1 Inohana, Chuo, Chiba 260-8677, Japan

Tel

0432227171

Email

seveneleven711thanks39@msn.com


Secondary IDs

Secondary IDs

NO

Study ID_1


Org. issuing International ID_1


Study ID_2


Org. issuing International ID_2


IND to MHLW



Institutions

Institutions



Other administrative information

Date of disclosure of the study information

2024 Year 06 Month 26 Day


Related information

URL releasing protocol


Publication of results

Unpublished


Result

URL related to results and publications


Number of participants that the trial has enrolled


Results


Results date posted


Results Delayed


Results Delay Reason


Date of the first journal publication of results


Baseline Characteristics


Participant flow


Adverse events


Outcome measures


Plan to share IPD


IPD sharing Plan description



Progress

Recruitment status

Enrolling by invitation

Date of protocol fixation

2024 Year 06 Month 26 Day

Date of IRB

2024 Year 06 Month 26 Day

Anticipated trial start date

2024 Year 06 Month 26 Day

Last follow-up date

2024 Year 12 Month 31 Day

Date of closure to data entry


Date trial data considered complete


Date analysis concluded



Other

Other related information

https://medrxiv.org/cgi/content/short/2024.06.26.24309513v1


Management information

Registered date

2024 Year 06 Month 26 Day

Last modified on

2024 Year 11 Month 13 Day



Link to view the page

Value
https://center6.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000062604