In a retrospective multi-center cohort study, Mamandipoor et al. investigated the prediction of blood lactate values in critically ill patients to assess mortality risk. Elevated serum lactate levels upon initial testing are known predictors of poor outcomes in critical care settings. The study aimed to determine if machine learning models could accurately predict subsequent changes in serum lactate levels, providing valuable information for clinicians to adjust patient care accordingly. The researchers utilized the MIMIC-III and eICU-CRD datasets for internal validation and further validated their findings on an external eICU cohort within the MIMIC-III dataset. Three distinct subgroups were established based on initial lactate levels: normal (<2 mmol/L), mild (2-4 mmol/L), and severe (>4 mmol/L). Outcomes were defined by changes in serum lactate levels between these groups, with additional sensitivity analyses considering a >10% change threshold and evaluating the impact of time intervals between subsequent measurements on predictive performance. The results demonstrated that LSTM models successfully predicted deterioration in serum lactate values among MIMIC-III patients, achieving an area under the curve (AUC) of 0.77 for the normal group, 0.77 for the mild group, and 0.85 for the severe group. While slightly lower performance was observed during external validation, the LSTM models still showed promising discrimination capabilities. Overall, this research suggests that machine learning models can effectively forecast changes in serum lactate levels among critically ill patients, potentially aiding clinicians in early intervention strategies and optimizing patient care decisions. Further clinical studies are warranted to explore how implementing a clinical decision support tool based on these predictive models could positively influence patient outcomes and clinical decision-making processes.
SummaryResearchers studied how to predict blood lactate values in very sick patients. High lactate levels can show that a patient may not get better. They used computer models to guess if a patient's lactate levels would change. Patients were split into three groups based on their initial lactate levels: normal, mild, and severe. The computer models did well at guessing changes in lactate levels for different groups.
Definitions
- Retrospective: Looking back at things that have already happened.
- Cohort study: A type of research where a group of people is studied over time.
- Predicting: Guessing what might happen in the future.
- Machine learning: Computers learning from data to make decisions without being explicitly programmed.
- Serum lactate: A substance in the blood that can show how sick someone is.
- Deterioration: Getting worse or declining.
- Discrimination capabilities: Ability to distinguish between different things accurately.
Introduction
In critical care settings, elevated serum lactate levels have been identified as a strong predictor of poor outcomes in critically ill patients. However, traditional methods for monitoring and predicting changes in lactate levels may not be sufficient to effectively guide clinical decision-making. In recent years, machine learning models have shown promise in accurately forecasting changes in various biomarkers, including serum lactate levels. In their retrospective multi-center cohort study, Mamandipoor et al. aimed to investigate the predictive capabilities of machine learning models for changes in serum lactate values among critically ill patients.
Methodology
The researchers utilized two large datasets - MIMIC-III and eICU-CRD - for internal validation and an external eICU cohort within the MIMIC-III dataset for further validation. The study included adult patients who had at least two consecutive measurements of serum lactate levels during their ICU stay. Three distinct subgroups were established based on initial lactate levels: normal (<2 mmol/L), mild (2-4 mmol/L), and severe (>4 mmol/L). Outcomes were defined by changes in serum lactate levels between these groups, with additional sensitivity analyses considering a >10% change threshold and evaluating the impact of time intervals between subsequent measurements on predictive performance.
Data Collection and Pre-processing
The researchers extracted data from electronic health records (EHRs) using structured query language (SQL) queries. They also performed data cleaning and pre-processing steps such as removing outliers, imputing missing values, and normalizing continuous variables.
Machine Learning Models Used
The study utilized long short-term memory (LSTM) models due to their ability to capture temporal dependencies in sequential data such as EHRs. LSTM is a type of recurrent neural network that has shown promising results in predicting medical outcomes. The researchers also used logistic regression and random forest models for comparison.
Results
The results showed that the LSTM models successfully predicted deterioration in serum lactate values among MIMIC-III patients, achieving an area under the curve (AUC) of 0.77 for the normal group, 0.77 for the mild group, and 0.85 for the severe group. While slightly lower performance was observed during external validation, with AUCs of 0.71, 0.72, and 0.79 respectively, the LSTM models still showed promising discrimination capabilities.
Sensitivity Analyses
The sensitivity analyses revealed that using a >10% change threshold improved predictive performance for all three subgroups compared to using absolute changes in lactate levels as outcomes. Additionally, shorter time intervals between subsequent measurements were associated with better predictive performance.
Discussion
Overall, this study suggests that machine learning models can effectively forecast changes in serum lactate levels among critically ill patients. These findings have important implications for clinical decision-making and patient care strategies in critical care settings.
One potential application of these predictive models is in early intervention strategies to prevent further deterioration in critically ill patients' conditions. By accurately predicting changes in serum lactate levels, clinicians can proactively adjust treatment plans or initiate interventions to improve patient outcomes.
Moreover, implementing a clinical decision support tool based on these predictive models could potentially optimize patient care decisions by providing real-time predictions of changes in serum lactate levels during a patient's ICU stay.
However, further studies are needed to validate these findings and explore how incorporating these predictive models into clinical practice could positively impact patient outcomes and healthcare delivery processes.
Conclusion
In conclusion, Mamandipoor et al.'s retrospective multi-center cohort study demonstrates that machine learning models can accurately predict changes in serum lactate levels among critically ill patients. These findings have important implications for clinical decision-making and patient care strategies in critical care settings. Further research is warranted to validate these results and explore the potential benefits of implementing predictive models in clinical practice.
Purpose. Elevations in initially obtained serum lactate levels are strong predictors of mortality in critically ill patients. Identifying patients whose serum lactate levels are more likely to increase can alert physicians to intensify care and guide them in the frequency of tending the blood test. We investigate whether machine learning models can predict subsequent serum lactate changes. Methods. We investigated serum lactate change prediction using the MIMIC-III and eICU-CRD datasets in internal as well as external validation of the eICU cohort on the MIMIC-III cohort. Three subgroups were defined based on the initial lactate levels: i) normal group (<2 mmol/L), ii) mild group (2-4 mmol/L), and iii) severe group (>4 mmol/L). Outcomes were defined based on increase or decrease of serum lactate levels between the groups. We also performed sensitivity analysis by defining the outcome as lactate change of >10% and furthermore investigated the influence of the time interval between subsequent lactate measurements on predictive performance. Results. The LSTM models were able to predict deterioration of serum lactate values of MIMIC-III patients with an AUC of 0.77 (95% CI 0.762-0.771) for the normal group, 0.77 (95% CI 0.768-0.772) for the mild group, and 0.85 (95% CI 0.840-0.851) for the severe group, with a slightly lower performance in the external validation. Conclusion. The LSTM demonstrated good discrimination of patients who had deterioration in serum lactate levels. Clinical studies are needed to evaluate whether utilization of a clinical decision support tool based on these results could positively impact decision-making and patient outcomes.