Information

Click on a row to explore the results for that model. When you wish to explore a different model, then select the new result row and the tabs will be updated.

Demo Video

Seek COVER: Development and validation of a personalized risk calculator for COVID-19 outcomes in an international network

Development Status: Under Review

This shiny application contains the results of the internal and external validations of the models developed to predict risk of hospitalisation within 30 days of intitial presentation to a healthcare professional with symptoms.

During manuscript development and the subsequent review period, these results are considered under embargo and should not be disclosed without explicit permission and consent from the authors.

Abstract Importance COVID-19 is causing high mortality worldwide. Developing models to quantify the risk of poor outcomes in infected patients could help develop strategies to shield the most vulnerable during de-confinement.

Objective To develop and externally validate COVID-19 Estimated Risk (COVER) scores that quantify a patient’s risk of hospital admission (COVER-H), requiring intensive services (COVER-I), or fatality (COVER-F) in the 30-days following COVID-19 diagnosis.

Design Multinational, distributed network cohorts.

Setting We analyzed a federated network of electronic medical records and administrative claims data from 14 data sources and 6 countries, mapped to a common data model.

Participants Model development used a patient population consisting of >2 million patients with a general practice (GP), emergency room (ER), or outpatient (OP) visit with diagnosed influenza or flu-like symptoms any time prior to 2020. The model was validated on patients with a GP, ER, or OP visit in 2020 with a confirmed or suspected COVID-19 diagnosis across five databases from South Korea, Spain and the United States.

Outcomes Age, sex, historical conditions, and drug use prior to index date were considered as candidate predictors. Outcomes included i) hospitalization with pneumonia, ii) hospitalization with pneumonia requiring intensive services or death, and iii) death in the 30 days after index date.

Results Overall, 44,507 COVID-19 patients were included for model validation, after initial model development and validation using 6,869,127 patients with influenza or flu-like symptoms. We identified 7 predictors (history of cancer, chronic obstructive pulmonary disease, diabetes, heart disease, hypertension, hyperlipidemia, and kidney disease) which combined with age and sex could discriminate which patients would experience any of our three outcomes. The models achieved high performance in influenza. When transported to COVID-19 cohorts, the AUC ranges were, COVER-H: 0.69-0.81, COVER-I: 0.73-0.91, and COVER-F: 0.72-0.90. Calibration was overall acceptable, with overestimated risk in the most elderly and highest risk strata.,,

Conclusions and relevance A 9-predictor model performs well for COVID-19 patients for predicting hospitalization, intensive services and fatality. The models could aid in providing reassurance for low risk patients and shield high risk patients from COVID-19 during de-confinement to reduce the virus’ impact on morbidity and mortality.

Useful Links

A preprint of this research is available here: Below are links for study-related artifacts that have been made available as part of this study: link

Protocol: link

Packages

  • OHDSI model development: link
  • OHDSI full model validation: link
  • OHDSI simple model validation: link

The Observational Health Data Sciences and Informatics (OHDSI) international community is hosting a COVID-19 virtual study-a-thon this week (March 26-29) to inform healthcare decision-making in response to the current global pandemic. The preliminary research results on this web-based application are from a retrospective, real-world, observational study in support of this activity and will subsequently be submitted to a peer-reviewed, scientific journal.

Use this tool to calculate the risk of COVID outcomes:


Predicted Risk (%)

Description

This calculator presents the results of a prediction study that developed 3 prediction models.

The three models predicted: requiring hospital admission (COVER-H), requiring intensive services (COVER-I), or fatality (COVER-F) in the month following COVID-19 diagnosis

Disclaimer

Should not be considered Medical Advice. By using the app, you acknowledge that the content does not constitute medical advice and does not create a Healthcare Professional - Patient relationship and does not constitute medical opinion or advice. Access to general information is provided for research and educational purposes only. Content is not recommended or endorsed by any doctor or healthcare provider. The information provided is not a substitute for medical or professional care, and you should not use the information in place of an appointment or the advice of your physician or other healthcare provider. You are liable or responsible for any action taken through use of information in this site.

Data Information

The following databases were used in this study:

Database Name Country Type Years
OptumDoD Optum® De-Identified Clinformatic Data Mart Database – Date of Death (DOD)     USA     Claims     2000-2019
AU_ePBRN     Australian Electronic Practice Based Research Network Australia     Linked EHR (GP + Hospital) 2012-2019
AUSOM     Ajou University School of Medicine Database Korea     EHR     1999-2018
CCAE     IBM MarketScan® Commercial Database     USA     Claims 2000-2019
CUIMC     Columbia University Irving Medical Center Data Warehouse USA     EMR 1990-2020
VA     Department of Veterans Affairs USA     EMR 2009-2010, 2014-2020
HIRA     Health Insurance and Review Assessment Korea     Claims     2013-2020
IPCI     Integrated Primary Care Information Netherlands     GP     2006-2020
JMDC     Japan Medical Data Center     Japan     Claims     2000-2019
MDCD     IBM MarketScan® Multi-State Medicaid Database     USA     Claims 2006-2019
MDCR     IBM MarketScan® Medicare Supplemental Database     USA     Claims 2000-2019
optumEhr     Optum® de-identified Electronic Health Record Dataset     USA EHR     2006-2019
SIDIAP     The Information System for Research in Primary Care (SIDIAP) Spain     GP     2006-2020
TRDW     Tufts Researrch Data Warehouse USA     EHR     2006-2020

All databases obtained IRB approval or used deidentified data that was considered exempt from IRB approval.

Filters

Model Settings: help

Population Settings: help

Covariate Settings: help

Binary

Loading...

Measurements

Loading...

Covariates

Model Table