unintended consequences Balanced News

Use of AI to fight COVID-19 risks harming 'disadvantaged groups', experts warn

social issue

Rapid deployment of artificial intelligence and machine learning to tackle coronavirus must still go through ethical checks and balances, or we risk harming already disadvantaged communities in the rush to defeat the disease. googletag.cmd.push(function() { googletag.display('div-gpt-ad-1450190541376-1'); }); This is according to researchers at the University of Cambridge's Leverhulme Centre for the Future of Intelligence (CFI) in two articles, published today in the British Medical Journal, cautioning against blinkered use of AI for data-gathering and medical decision-making as we fight to regain some normalcy in 2021. "Relaxing ethical requirements in a crisis could have unintended harmful consequences that last well beyond the life of the pandemic," said Dr. Stephen Cave, Director of CFI and lead author of one of the articles. "The sudden introduction of complex and opaque AI, automating judgments once made by humans and sucking in personal information, could undermine the health of disadvantaged groups as well as long-term public trust in technology." In a further paper, co-authored by CFI's Dr. Alexa Hagerty, researchers highlight potential consequences arising from the AI now making clinical choices at scale—predicting deterioration rates of patients who might need ventilation, for example—if it does so based on biased data. Datasets used to "train" and refine machine-learning algorithms are inevitably skewed against groups that access health services less frequently, such as minority ethnic communities and those of "lower socioeconomic status". "COVID-19 has already had a disproportionate impact on vulnerable communities. We know these systems can discriminate, and any algorithmic bias in treating the disease could land a further brutal punch," Hagerty said. In December, protests ensued when Stanford Medical Centre's algorithm prioritized home-workers for vaccination over those on the COVID wards. "Algorithms are now used at a local,...
medicalxpress.com     Mar 15, 2021