Mitigating algorithmic unfairness arising from forgetfulness of medical records in clinical artificial intelligence

Abstract

Abstract Protecting patients’ right to be forgotten (RtbF) in the digital era underscores algorithms to delete health records from deployed artificial intelligence (AI) models upon requests, a paradigm also known as machine unlearning. Such forgetfulness, however, will alter AI models’ views of subpopulations and could yield discriminating clinical decisions that undermine healthcare equality and endanger patient trust, a common phenomenon confirmed by our thorough investigations. This observation reveals an ethical dilemma in clinical AI: protecting the RtbF of certain patients will compromise the delivery of equitable decisions and, thus, is against the AI fairness principle, necessitating a safeguarding approach. To this end, we propose a fair unlearning strategy to effectively remove medical records from trained models while mitigating decision biases to improve algorithmic equality. This strategy avoids negative interventions between potentially conflicting objectives by enforcing their gradient orthogonality. We perform extensive evaluations on real-world, multi-hospital datasets of rapid COVID-19 screening, in-hospital mortality and shock predictions. Compared with state-of-the-art approaches, our method can teach models to more effectively forget patient records with better predictive performance while, more importantly, mitigating demographic unfairness across subpopulations of ethnicities and sites (hospitals), accommodating the first generalised solution for the dilemma of RtbF and fairness.