UCSF Health and the UCSF Division of Clinical Informatics and Digital Transformation, with a $5 million gift from Ken and Kathy Hao, aim to ensure the effectiveness and safety of artificial intelligence used in clinical care by building a platform that continuously reports on whether a tool is appropriate. achieve the intended results or if it needs improvement.
The platform will flag a tool if it is potentially dangerous or has the risk of exacerbating health disparities, prompting immediate action where needed, researchers said.
WHY IS IT IMPORTANT?
Called the AI Impact Monitoring Platform in Clinical Care, USCF Health and DoC-IT will design IMPACC to report on the effectiveness of artificial intelligence in clinical decision making and patient care , as well as potential risks to patient health and exacerbation of health disparities.
Once they develop IMPACC, UCSF Health will test its use with a suite of AI tools currently used for clinical care, according to a release from the researchers.
Julia Adler-Milstein, head of UCSF DoC-IT, and Dr. Sara Murray, director of medical AI at UCSF Health, will lead a collaborative effort to improve patient care at UCSF while advancing science about how to evaluate the AI tools they talk about in real-world usage.
“By building IMPACC, we will take a major step forward in the way we analyze the performance of AI in healthcare,” Murray said in a statement.
“As we deploy new AI technologies, this new, scalable platform will provide our health systems with direct and actionable insights into ongoing performance, ensuring not only the effectiveness of these new tools but also the system-wide safety and benefits to patients.”
The platform will also be used to guide healthcare leaders in making decisions to expand or discontinue the use of certain AI tools, researchers said. We reached out to UCSF to ask whether IMPACC, once tested and ready for use, would be available to other health systems. We will update the story with any response.
BIGGER TREND
The healthcare sector lacks established protocols for continuous AI monitoring, researchers point out, so health systems need a way to identify any performance issues during their real world in real time with longitudinal monitoring and specific criteria for escalation and human intervention.
The risk that adverse outcomes for patients and healthcare providers may go undetected in AI healthcare operations going awry is a concern for healthcare organizations. health care providers, doctors, patients, lawmakers and many others.
Dr Sonya Makhni, medical director of the Mayo Clinic Platform and senior consultant to the hospital’s Department of Internal Medicine, said: “There are many legitimate concerns about what appears to be a newly built normal. around this powerful and rapidly changing technology.” speak Healthcare IT news this early year.
Although the Mayo Clinic Platform has developed a risk classification system to qualify AI before it is used, health systems using AI algorithms “should utilize the development lifecycle AI as a framework to understand where bias may be present,” she advises thinking healthcare leaders. through the safe use of AI.
“It is the responsibility of both the solution developer and the end user to build an AI solution that is risk-aware to the best of their ability.”
ON PROFILE
“This philanthropic gift is transformative in many ways,” Adler-Milstein said in a statement. “It comes at a critical time as the healthcare industry integrates AI into clinical practice more widely.”
“This is the first collaboration between UCSF and UCSF Health on AI surveillance,” added Suresh Gunasekaran, president and CEO of UCSF Health.
“Together, we are uniquely positioned to create the first performance modeling platform across health systems in the United States, which will provide real-time visibility into the performance of AI tools and clinical impact.”
Andrea Fox is a senior editor at Healthcare IT News.
Email: [email protected]
Healthcare IT News is a publication of HIMSS Media.
