UMIN-ICDS Clinical Trial

Unique ID issued by UMIN UMIN000063691
Receipt number R000072814
Scientific Title Automated Structuring of Diagnostic Imaging Reports: Risk Management Using Large Language Models
Date of disclosure of the study information 2026/11/19
Last modified on 2026/11/19 13:17:05

* This page includes information on clinical trials registered in UMIN clinical trial registed system.
* We don't aim to advertise certain products or treatments


Basic information

Public title

Automated Structuring of Diagnostic Imaging Reports: Risk Management Using Large Language Models

Acronym

Automated Structuring of Diagnostic Imaging Reports: Risk Management Using Large Language Models

Scientific Title

Automated Structuring of Diagnostic Imaging Reports: Risk Management Using Large Language Models

Scientific Title:Acronym

Automated Structuring of Diagnostic Imaging Reports: Risk Management Using Large Language Models

Region

Japan


Condition

Condition

All conditions undergoing diagnostic imaging

Classification by specialty

Radiology

Classification by malignancy

Others

Genomic information

NO


Objectives

Narrative objectives1

The objective of this study is to optimize closed large language models (LLMs) through prompt engineering and related techniques to evaluate the feasibility of a medical safety support system based on diagnostic imaging reports. Specifically, we aim to verify: 1) the inference speed and accuracy of automated structuring of free-text diagnostic imaging reports; 2) the accuracy of automated detection models for high-risk cases requiring follow-up, such as emergency conditions and incidental findings; and 3) the usefulness of a risk management system that cross-references radiology reports with electronic health records (HIS) to track clinical follow-up actions and detect unaddressed cases.

Basic objectives2

Others

Basic objectives -Others

Evaluation of structuring accuracy of diagnostic imaging reports and feasibility of a risk case detection system

Trial characteristics_1


Trial characteristics_2


Developmental phase

Not applicable


Assessment

Primary outcomes

Technical accuracy of automated structuring and high-risk case extraction from diagnostic imaging reports (accuracy, precision, recall, F1 score, sensitivity, and specificity compared with ground truth labeled by board-certified radiologists) (at the time of data analysis)

Key secondary outcomes



Base

Study type

Observational


Study design

Basic design


Randomization


Randomization unit


Blinding


Control


Stratification


Dynamic allocation


Institution consideration


Blocking


Concealment



Intervention

No. of arms


Purpose of intervention


Type of intervention


Interventions/Control_1


Interventions/Control_2


Interventions/Control_3


Interventions/Control_4


Interventions/Control_5


Interventions/Control_6


Interventions/Control_7


Interventions/Control_8


Interventions/Control_9


Interventions/Control_10



Eligibility

Age-lower limit


Not applicable

Age-upper limit


Not applicable

Gender

Male and Female

Key inclusion criteria

Finalized diagnostic imaging reports interpreted by board-certified radiologists for patients who underwent CT, MRI, X-ray (X-P), or radioisotope (RI) examinations at St. Marianna University Hospital between January 1, 2020, and December 31, 2024.

Key exclusion criteria

Diagnostic imaging reports of patients who opted out (declined participation) of the use of their data for this study.

Target sample size

10000


Research contact person

Name of lead principal investigator

1st name Yasuyuki
Middle name
Last name Kobayashi

Organization

St. Marianna University School of Medicine

Division name

Department of Radiology

Zip code

216-8511

Address

2-16-1 Sugao, Miyamae-ku, Kawasaki, Kanagawa 216-8511, Japan

TEL

044-977-8111

Email

yasukoba@marianna-u.ac.jp


Public contact

Name of contact person

1st name Yasuyuki
Middle name
Last name Kobayashi

Organization

St. Marianna University School of Medicine

Division name

Department of Advanced Biomedical Imaging Informatics

Zip code

216-8511

Address

2-16-1 Sugao, Miyamae-ku, Kawasaki, Kanagawa 216-8511, Japan

TEL

044-977-8111

Homepage URL


Email

yasukoba@marianna-u.ac.jp


Sponsor or person

Institute

St. Marianna University School of Medicine

Institute

Department

Personal name



Funding Source

Organization

St. Marianna University School of Medicine

Organization

Division

Category of Funding Organization

Other

Nationality of Funding Organization



Other related organizations

Co-sponsor


Name of secondary funder(s)



IRB Contact (For public release)

Organization

St. Marianna University School of Medicine

Address

2-16-1 Sugao, Miyamae-ku, Kawasaki, Kanagawa 216-8511, Japan

Tel

044-977-8111

Email

yasukoba@marianna-u.ac.jp


Secondary IDs

Secondary IDs

NO

Study ID_1


Org. issuing International ID_1


Study ID_2


Org. issuing International ID_2


IND to MHLW



Institutions

Institutions



Other administrative information

Date of disclosure of the study information

2026 Year 11 Month 19 Day


Related information

URL releasing protocol


Publication of results

Unpublished


Result

URL related to results and publications


Number of participants that the trial has enrolled


Results


Results date posted


Results Delayed


Results Delay Reason


Date of the first journal publication of results


Baseline Characteristics


Participant flow


Adverse events


Outcome measures


Plan to share IPD


IPD sharing Plan description



Progress

Recruitment status

Preinitiation

Date of protocol fixation

2026 Year 04 Month 10 Day

Date of IRB


Anticipated trial start date

2026 Year 12 Month 01 Day

Last follow-up date

2028 Year 03 Month 31 Day

Date of closure to data entry


Date trial data considered complete


Date analysis concluded



Other

Other related information

This is a single-center, retrospective observational study. We will collect and analyze existing data from approximately 10,000 finalized diagnostic imaging reports interpreted by board-certified radiologists (covering CT, MRI, X-ray [X-P], and radioisotope [RI] examinations) and corresponding electronic health records (clinical notes, order histories, and laboratory test results) for patients examined at St. Marianna University Hospital between January 1, 2020, and December 31, 2024. A unique study ID will be assigned to each patient for longitudinal analysis, and data stratified by modality and anatomical region will be divided into training and independent validation datasets. Using lightweight large language models (LLMs) operating in an on-premises closed environment, we will perform automated report structuring and high-risk case extraction, evaluating technical accuracy and clinical utility against ground truth labeled by board-certified radiologists and actual clinical follow-up actions recorded in electronic health records.


Management information

Registered date

2026 Year 11 Month 19 Day

Last modified on

2026 Year 11 Month 19 Day



Link to view the page

Value
https://center6.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000072814