JUNE 26 — Artificial intelligence is already helping doctors make healthcare decisions. The bigger question is: who is making sure these systems remain safe after they enter our hospitals?

From medical imaging and cancer treatment to hospital workflows, AI is rapidly becoming part of modern healthcare. It can help doctors analyse scans faster, improve efficiency, and support clinical decision-making. Around the world, healthcare providers are investing heavily in these technologies.

Malaysia is no exception. As hospitals embrace digital transformation, AI-powered tools are expected to become increasingly common in clinical practice. For patients, this could mean faster diagnoses, shorter waiting times, and improved access to specialist expertise. These are exciting developments.

But there is a catch. Unlike conventional medical equipment, AI systems do not always remain unchanged after they are introduced. Their performance may be influenced by software updates, new datasets, changing patient populations, and evolving clinical practices.

A CT scanner generally performs consistently once it has been tested and commissioned. AI systems are different. A system that performs well today may not necessarily perform the same way tomorrow.

This matters more than many people realise. Imagine an AI tool developed and trained using patient data from Europe or North America. It may perform well in those settings, but can we automatically assume it will work equally well for patients in Kuala Lumpur, Kota Bharu, Kuching, or rural Sabah?

The author argues that while artificial intelligence can transform healthcare, its long-term safety and reliability depend on continuous oversight, with medical physicists playing a critical role in ensuring patient trust. — Pexels pic
The author argues that while artificial intelligence can transform healthcare, its long-term safety and reliability depend on continuous oversight, with medical physicists playing a critical role in ensuring patient trust. — Pexels pic

Patient demographics, disease patterns, healthcare infrastructure, and clinical workflows can differ significantly. What works well in one healthcare environment may require additional validation in another.

That is why AI safety cannot stop at regulatory approval. Many people assume that once a medical device is approved, the job is done. However, AI requires continuous oversight. Hospitals need to ensure that these systems remain accurate, reliable, and fair throughout their use.

This is where a little-known group of healthcare professionals becomes increasingly important. Most Malaysians have never met a medical physicist. Yet their work affects countless patients every day.

Medical physicists help ensure that technologies such as CT scanners, MRI systems, radiotherapy equipment, and nuclear medicine devices operate safely and accurately. They play a crucial role in quality assurance, performance evaluation, risk management, and patient safety.

Traditionally, their focus has been on machines. In the age of AI, their responsibilities are expanding beyond machines to algorithms.

If a hospital introduces an AI system to help analyse medical images, someone must ask difficult questions. Was the system properly tested in the local environment? Does it perform equally well for different patient groups? Has its performance changed after a software update? Is patient data adequately protected?

These are not merely technical concerns. They are questions of safety, fairness, accountability, and public trust. Medical physicists already possess many of the skills needed to address these challenges. Their expertise in validation, quality assurance, risk assessment, and clinical technology places them in a unique position to support the safe adoption of AI in healthcare.

Their future roles may include monitoring AI performance, identifying potential biases, supporting cybersecurity efforts, and participating in hospital AI governance committees.

This does not mean AI should be feared. On the contrary, AI has enormous potential to improve healthcare delivery and patient outcomes.

However, powerful technologies require responsible oversight. As Malaysia continues its journey towards a more digital healthcare system, success will depend not only on how quickly AI is adopted, but also on how well it is governed.

The true measure of healthcare AI will not be how intelligent it appears. It will be whether patients can trust it.

Building that trust requires more than advanced technology. It requires skilled professionals working behind the scenes to ensure that innovation remains safe, effective, and centred on patient welfare.

In the years ahead, these hidden experts may become some of the most important guardians of trustworthy healthcare in Malaysia.

* The author is Mohd Fadhullah Bin Abd Halim, a PhD student at the Universiti Malaya who specialises in the study of AI-enabled medical device governance.

** This is the personal opinion of the writer or publication and does not necessarily represent the views of Malay Mail.