Deploy AI in healthcare with caution; build guardrails first, says Manipal CEO
While there are valid concerns around data protection in the use of artificial intelligence (AI) in healthcare, we must be careful in how we deploy AI, said Dilip Jose, CEO, Manipal Hospitals, on Thursday.
Speaking at ET's AI Conclave and Awards 2025, he said that healthcare is emotionally sensitive, morally complex, and context-heavy, making it critical for hospital chains to be mindful about where AI is embedded.
“In healthcare, we can’t be 99% accurate. The 1% error could mean a lost life. We can’t afford hallucinations in clinical settings,” he said. AI should be integrated into clinical workflows as a force multiplier rather than deployed as a standalone efficiency tool, he added.
In the same panel, Laina Emmanuel, cofounder of BrainSight AI, said AI is opening up possibilities to solve longstanding clinical problems. “There are so many unsolved clinical problems which, for the lack of computational infrastructure, were not addressed earlier. Today, with cloud infrastructure, we can run complex brain-mapping workflows and make them accessible to doctors and hospitals across the country,” she said.
She further added that informed consent must remain central to healthcare AI. “We had to take informed consent from every patient and ensure they understood how their data would be used. That is something other industries can learn from,” she said. Their team follows a risk-based approach and builds guardrails before deploying any solution in hospitals, she further added.
Speaking at ET's AI Conclave and Awards 2025, he said that healthcare is emotionally sensitive, morally complex, and context-heavy, making it critical for hospital chains to be mindful about where AI is embedded.
“In healthcare, we can’t be 99% accurate. The 1% error could mean a lost life. We can’t afford hallucinations in clinical settings,” he said. AI should be integrated into clinical workflows as a force multiplier rather than deployed as a standalone efficiency tool, he added.
In the same panel, Laina Emmanuel, cofounder of BrainSight AI, said AI is opening up possibilities to solve longstanding clinical problems. “There are so many unsolved clinical problems which, for the lack of computational infrastructure, were not addressed earlier. Today, with cloud infrastructure, we can run complex brain-mapping workflows and make them accessible to doctors and hospitals across the country,” she said.
She further added that informed consent must remain central to healthcare AI. “We had to take informed consent from every patient and ensure they understood how their data would be used. That is something other industries can learn from,” she said. Their team follows a risk-based approach and builds guardrails before deploying any solution in hospitals, she further added.
Next Story