AI multimodal large language model on CAR-T pre-leukapheresis evaluation to predict monitoring needs post infusion for early dismissal planning

Abstract

Abstract Introduction: CAR-T therapy has transformed cancer therapy. with its first Food and Drug Administration (FDA) approved product in August 2017. Given the expanding indications and growing experience, particularly with management of immediate toxicities requiring specialized expertise such as Cytokine Release Syndrome (CRS) and Immune Effector Cell-Associated Neurotoxicity syndrome (ICANS), FDA recently removed the Risk Evaluation and Mitigation Strategies (REMS) for CD19 and BCMA targeting CAR-T on June 26th2025. In particular, given that CRS and ICANS typically occur in the first 2 weeks post CAR-T infusion, the minimum required stay near CAR-T treatment center is reduced from one month to 2 weeks. While this could reduce treatment burden for patients (pts) who need to travel away from home to receive CAR-T, there is a need to update the transition of care from CAR-T center to pts' local oncology practice. Pts carry in their rate of recovery and have varying supportive care needs in the second half of the month post CAR-T infusion. To assist with care transition and planning, we examine the use of AI multimodal large language model (LLM) to predict patients' supportive care needs 2 weeks after CAR-T infusion based on the clinical data at the time of CAR-T evaluation, prior to leukapheresis. This timepoint was selected to also maximize travel, lodging and caregiver planning for pts and family as well. Methodology: Pts who were treated with FDA-approved CAR-T at Mayo Clinic Rochester between December 2022 and June 2025 were examined. Based on experiences with referral practices in the Midwest region, we defined patients with high monitoring needs as those who between day 14-30 post CAR-T had either hospital admission due to recurrent CRS or ICANS or required transfusion of more than 1 blood product per week (red blood cell or platelets). Others were classified as low monitoring needs. Clinical notes, labs, vital signs and electrocardiogram at the time of CAR-T evaluation were abstracted and summarized by Gemini LLM for association with patients with high versus low monitoring needs post CAR-T. Model was developed and tested for predicted needs and concordance with actual outcome of these pts. Results: Among the 362 pts who received FDA approved CAR-T in the timeframe, 84 pts had high monitoring needs. An additional 84 pts with low monitoring needs were randomly selected from 278 pts. These were divided into a training cohort and test cohort of 84 pts each, with 42 pts with high and 42 pts with low monitoring needs. Demographics of the two cohorts displayed no statistical difference. LLM analysis of the clinical data at the time of CAR-T eval identified 5 categories associated with risk for high monitoring needs: 1) Disease status (clinical notes about bulky, progressive disease or CNS involvement); 2) inflammatory and tumor burden markers (CRP, LDH); 3) hematologic status (platelet, plt; neutrophil count ANC); 4) renal function; 5) performance status. Using common clinical lab parameter convention (platelets <100, ANC< 1, CrCl< 30ml/min), and prioritizing for not missing pts with high monitoring needs, LLM model was defined to predict patients for high monitoring needs if high risk feature was identified in category 1 or any category combinations; whereas patients with no high risk feature or only 1 category that is not disease status was predicted as low monitoring needs. In this model, the sensitivity was 85.7%, specificity 23.8%, F1 score 65.5%. Applying this model to test cohort 2, the sensitivity was 83.3%, specificity 28.6%, and F1 score 65.4%. Discussion: We demonstrate proof-of-concept that LLM can be used to analyze clinical data at the time of evaluation for CAR-T eligibility to predict for supportive care needs post treatment. Not surprisingly, features identified by LLM to be associated with high monitoring needs are those previously reported by us and others at the time of CAR-T evaluation and or pre-lymphodepletion to be associated with risk for cytopenia, infection, hospitalization and non-relapse mortality. Based on the summary output generated by LLM, additional opportunities for classification methods were identified to improve specificity and balanced accuracy of the LLM model. This is a promising tool for further development to assist clinicians and patients to plan their treatment journey.