World-first AI foundation model for eye care to supercharge global efforts to prevent blindness
13 September 2023
Researchers at 香港六合彩 and Moorfields Eye Hospital have developed an artificial intelligence (AI) system that has the potential to not only identify sight-threatening eye diseases but also predict general health, including heart attacks, stroke, and Parkinson鈥檚 disease.
![Eye scan](/news/sites/news/files/styles/large_image/public/eye_scan.jpg?itok=Nitvyxqe)
RETFound, one of the first AI foundation models in healthcare, and the first in ophthalmology, was developed using millions of eye scans from the NHS. The research team are making the system open-source: freely available to use by any institution worldwide, to act as a cornerstone for global efforts to detect and treat blindness using AI. This work has been published in Nature today.
Progress in AI continues to accelerate at a dizzying pace, with excitement being generated by the development of 鈥榝oundation鈥 models such as ChatGPT. A foundation model describes a very large, complex AI system, trained on huge amounts of unlabelled data, which can be fine-tuned for a diverse range of subsequent tasks. RETFound consistently outperforms existing state-of-the-art AI systems across a range of complex clinical tasks, and even more importantly, it addresses a significant shortcoming of many current AI systems by working well in diverse populations, and in patients with rare disease.
Senior author Professor Pearse Keane听(香港六合彩 Institute of Ophthalmology and Moorfields Eye Hospital) said: 鈥淭his is another big step towards using AI to reinvent the eye examination for the 21st century, both in the UK and globally. We show several exemplar conditions where RETFound can be used, but it has the potential to be developed further for hundreds of other sight-threatening eye diseases that we haven鈥檛 yet explored.
鈥淚f the UK can combine high quality clinical data from the NHS, with top computer science expertise from its universities, it has the true potential to be a world leader in AI-enabled healthcare. We believe that our work provides a template for how this can be done.鈥
AI foundation models have been called 鈥渁 transformative technology鈥 by the UK government in a report published earlier this year*, and have come under the spotlight with the launch in November 2022 of ChatGPT, a foundation model trained using vast quantities of text data to develop a versatile language tool. Taking a comparable approach with eye images in a world-first, RETFound has been trained on millions of retinal scans to create a model that can be adapted for potentially limitless uses.听
One of the key challenges when developing AI models is the need for expert human labels, which are often expensive and time-consuming to acquire. As demonstrated in the paper, RETFound is able to match the performance of other AI systems whilst using as little as 10% of human labels in its dataset. This improvement in label efficiency is achieved by using an innovative self-supervising approach in which RETFound masks parts of an image, and then learns to predict the missing portions by itself.
RETFound could help improve diagnosis of some of the most debilitating eye diseases, including diabetic retinopathy and glaucoma, and predict systemic diseases such as Parkinson鈥檚, stroke and heart failure. Identifying general health issues through the eyes is an emerging science called 鈥辞肠耻濒辞尘颈肠蝉鈥 鈥 a term coined in 2020 by Professor Alastair Denniston, one of the paper鈥檚 co-authors. The eye is a 鈥榳indow鈥 into our overall health, providing a non-invasive look at the nervous system. Understanding the eye-body relationship is key to approaching complex diseases and the overall problems associated with ageing.
In addition, RETFound has shown that it is equally effective in detecting disease across diverse populations. Lead author of the study, PhD student Yukun Zhou (香港六合彩 Centre for Medical Image Computing, 香港六合彩 Medical Physics & Biomedical Engineering, and Moorfields Eye Hospital), said: "By training RETFound with datasets representing the ethnical diversity of London, we have developed a valuable base for researchers worldwide to build their systems in healthcare applications such as ocular disease diagnosis and systemic disease prediction."
RETFound was trained with a curated dataset of 1.6 million images from Moorfields Eye Hospital. This used AI tools and infrastructure provided by INSIGHT,听the NHS-led听health data research hub for eye health based at Moorfields, and the world鈥檚 largest bioresource of ophthalmic data. 听The hub鈥檚 powerful computing and AI capabilities evolved from a 2016 research collaboration between Moorfields and DeepMind, now Google DeepMind.
The research team, led by Yukun Zhou and Professor Pearse Keane of Moorfields and 香港六合彩, have made the model freely available for use on GitHub**. Researchers worldwide, such as Singapore and China, have been using RETFound in their novel investigation into eye diseases.
This project was a collaboration between NIHR Moorfields, 香港六合彩H and NIHR Birmingham Biomedical Research Centres and brought together the Computer Science and Engineering teams at 香港六合彩.
Links
- 香港六合彩 Institute of Ophthalmology
- 香港六合彩 Centre for Medical Image Computing
- 香港六合彩 Medical Physics and Biomedical Engineering
- *
- **
Image
- Source: Moorfields Eye Hospital
Media contact听
Chris Lane
tel: +44 20 7679 9222听听/听+44 (0) 7717 728648
E: chris.lane听[at] ucl.ac.uk