Joseph Alderman

Artificial intelligence as a medical device is increasingly being applied to healthcare for diagnosis, risk stratification and resource allocation. However, a growing body of evidence has highlighted the risk of algorithmic bias, which may perpetuate existing health inequity. This problem arises in part because of systemic inequalities in dataset curation, unequal opportunity to participate in research and inequalities of access. This study aims to explore existing standards, frameworks and best practices for ensuring adequate data diversity in health datasets. Exploring the body of existing literature and expert views is an important step towards the development of consensus-based guidelines. The study comprises two parts: a systematic review of existing standards, frameworks and best practices for healthcare datasets; and a survey and thematic analysis of stakeholder views of bias, health equity and best practices for artificial intelligence as a medical device. We found that the need for dataset diversity was well described in literature, and experts generally favored the development of a robust set of guidelines, but there were mixed views about how these could be implemented practically. The outputs of this study will be used to inform the development of standards for transparency of data diversity in health datasets (the STANDING Together initiative).

Without careful dissection of the ways in which biases can be encoded into artificial intelligence (AI) health technologies, there is a risk of perpetuating existing health inequalities at scale. One major source of bias is the data that underpins such technologies. The STANDING Together recommendations aim to encourage transparency regarding limitations of health datasets and proactive evaluation of their effect across population groups. Draft recommendation items were informed by a systematic review and stakeholder survey. The recommendations were developed using a Delphi approach, supplemented by a public consultation and international interview study. Overall, more than 350 representatives from 58 countries provided input into this initiative. 194 Delphi participants from 25 countries voted and provided comments on 32 candidate items across three electronic survey rounds and one in-person consensus meeting. The 29 STANDING Together consensus recommendations are presented here in two parts. Recommendations for Documentation of Health Datasets provide guidance for dataset curators to enable transparency around data composition and limitations. Recommendations for Use of Health Datasets aim to enable identification and mitigation of algorithmic biases that might exacerbate health inequalities. These recommendations are intended to prompt proactive inquiry rather than acting as a checklist. We hope to raise awareness that no dataset is free of limitations, so transparent communication of data limitations should be perceived as valuable, and absence of this information as a limitation. We hope that adoption of the STANDING Together recommendations by stakeholders across the AI health technology lifecycle will enable everyone in society to benefit from technologies which are safe and effective.

Artificial intelligence (AI) in healthcare describes algorithm-based computational techniques which manage and analyse large datasets to make inferences and predictions. There are many potential applications of AI in the care of older people, from clinical decision support systems that can support identification of delirium from clinical records to wearable devices that can predict the risk of a fall. We held four meetings of older people, clinicians and AI researchers. Three priority areas were identified for AI application in the care of older people. These included: monitoring and early diagnosis of disease, stratified care and care coordination between healthcare providers. However, the meetings also highlighted concerns that AI may exacerbate health inequity for older people through bias within AI models, lack of external validation amongst older people, infringements on privacy and autonomy, insufficient transparency of AI models and lack of safeguarding for errors. Creating effective interventions for older people requires a person-centred approach to account for the needs of older people, as well as sufficient clinical and technological governance to meet standards of generalisability, transparency and effectiveness. Education of clinicians and patients is also needed to ensure appropriate use of AI technologies, with investment in technological infrastructure required to ensure equity of access.