Abstract
The Kidney Donor Risk Index (KDRI) is widely used to rank the quality of deceased donor kidneys and is integrated into the US kidney allograft allocation system. However, the KDRI has modest predictive accuracy for allograft survival, and recent revisions to the KDRI, which removed donor race and hepatitis C virus, also revealed model calibration problems. This study aimed to evaluate novel approaches for predicting post-transplant allograft survival.
Retrospective cohort study using Organ Procurement and Transplantation Network data (05/01/07 - 12/31/2021).
1) Donor demographic and clinical variables (established predictors), 2) longitudinal laboratory data from the donor's terminal hospitalization, such as serum creatinine (new predictors), and 3) recipient clinical variables (new predictors).
75,867 adult kidney recipients at US centers.
The primary outcome was time to all-cause allograft failure over three years. A secondary outcome was delayed graft function, defined as dialysis in the first post-transplant week.
We implemented and compared machine learning statistical models versus traditional modeling approaches (i.e., proportional hazards for the primary outcome and logistic regression of the secondary outcome) that incorporated various combinations of predictors. The performance metrics used to assess discrimination were the integrated (time-dependent) area under the curve (iAUC) for allograft survival and the AUC for delayed graft function. To assess calibration, we calculated Brier scores and visually compared the predicted outcomes with the observed ones. Predictive performance was assessed in a 20% testing data split.
Neither machine learning models nor the addition of longitudinal laboratory data from the donor hospitalization to traditional models improved discrimination. For the primary outcome, the final model (named the 'Kidney Allograft Survival Index') used a proportional hazards modelling approach. Adding recipient variables improved model discrimination (iAUC 0.68) and achieved excellent calibration for the overall cohort and subgroups. The final model for delayed allograft function used logistic regression, included recipient variables and had an AUC of 0.75 with acceptable calibration.
No external validation.
Improving the discrimination and calibration of kidney allograft survival prediction models is achievable by including recipient characteristics. These enhanced models have potential to improve the system of kidney allocation.