Machine learning derived retinal pigment score from ophthalmic imaging shows ethnicity is not biology
Abstract
AbstractFew metrics exist to describe phenotypic diversity within ophthalmic imaging datasets, with researchers often using ethnicity as a surrogate marker for biological variability. We derived a continuous, measured metric, the retinal pigment score (RPS), that quantifies the degree of pigmentation from a colour fundus photograph of the eye. RPS was validated using two large epidemiological studies with demographic and genetic data (UK Biobank and EPIC-Norfolk Study) and reproduced in a Tanzanian, an Australian, and a Chinese dataset. A genome-wide association study (GWAS) of RPS from UK Biobank identified 20 loci with known associations with skin, iris and hair pigmentation, of which eight were replicated in the EPIC-Norfolk cohort. There was a strong association between RPS and ethnicity, however, there was substantial overlap between each ethnicity and the respective distributions of RPS scores. RPS decouples traditional demographic variables from clinical imaging characteristics. RPS may serve as a useful metric to quantify the diversity of the training, validation, and testing datasets used in the development of AI algorithms to ensure adequate inclusion and explainability of the model performance, critical in evaluating all currently deployed AI models. The code to derive RPS is publicly available at: https://github.com/uw-biomedical-ml/retinal-pigmentation-score.
Article Details
Authors (92)
Anand E. Rajesh
Abraham Olvera-Barrios
Alasdair N. Warwick
Yue Wu
Genomic Analysis Laboratory, Salk Institute for Biological Studies, La Jolla, CA, USA.
Kelsey V. Stuart
Mahantesh I. Biradar
Chuin Ying Ung
Anthony P. Khawaja
Robert Luben
Paul J. Foster
Charles R. Cleland
William U. Makupa
Alastair K. Denniston
Matthew J. Burton
Andrew Bastawrous
Pearse A. Keane
Mark A. Chia
Angus W. Turner
Cecilia S. Lee
Adnan Tufail
Aaron Y. Lee
Catherine Egan
Naomi Allen
Tariq Aslam
Denize Atan
Konstantinos Balaskas
Sarah Barman
Jenny Barrett
Paul Bishop
Graeme Black
Tasanee Braithwaite
Roxana Carare
Usha Chakravarthy
Michelle Chan
Sharon Chua
Alexander Day
Parul Desai
Baljean Dhillon
Andrew Dick
Alexander Doney
Sarah Ennis
John Gallacher
David Ted Garway-Heath
Jane Gibson
Jeremy Guggenheim
Chris Hammond
Alison Hardcastle
Simon Harding
Ruth Hogg
Pirro Hysi
Gerassimos Lascaratos
Thomas Littlejohns
Andrew Lotery
Phil Luthert
Tom MacGillivray
Sarah Mackie
Savita Madhusudhan
Bernadette McGuinness
Gareth McKay
Martin McKibbin
Tony Moore
James Morgan
Eoin O’Sullivan
Richard Oram
Chris Owen
Praveen Patel
Euan Paterson
Tunde Peto
Axel Petzold
Nikolas Pontikos
Jugnoo Rahi
Alicja Rudnicka
Naveed Sattar
School of Cardiovascular and Metabolic Health, University of Glasgow, Glasgow, United Kingdom
Jay Self
Panagiotis Sergouniotis
Sobha Sivaprasad
David Steel
Irene Stratton
Nicholas Strouthidis
Cathie Sudlow
Zihan Sun
Robyn Tapp
Dhanes Thomas
Emanuele Trucco
Ananth Viswanathan
Veronique Vitart
Mike Weedon
Katie Williams
Cathy Williams
Jayne Woodside
Max Yates
Yalin Zheng