Not so fast AI Doctor, the FDA would like to check how good you really are at healthcare

I see you're using adaptive algorithms. Step this way for some regulation please

The US Food and Drug Administration has proposed a framework on how it might regulate medical devices that rely on AI and machine learning algorithms.

The report published this week outlines two types of algorithms for the purposes of regulation: “locked algorithms” and “adaptive algorithms.”

Locked algorithms provide the same result each time they’re fed the same input. The answers are normally based on things like look-up tables, decision trees, or classifiers. An adaptive algorithm, however, will “change its behavior using a defined learning process.” The outputs may change for a given set of inputs as the learning process is tweaked with new data.

Sound familiar? It essentially describes modern deep learning systems that require supervised training to learn how to perform a specific task. It’s these types of algorithms that are more of a pain in the neck for the FDA to deal with. At the moment most devices that use AI or machine learning and have FDA approval rely on the use of locked algorithms.

There has been an explosion in using deep learning and neural networks to pick up patterns in medical data for diagnosis. So it’s no surprise that the FDA has to eventually come up with strict guidelines on how to deal with these sorts of systems.

The framework states that medical devices that rely on adaptive algorithms will have to be approved before they can be commercialized. The FDA will be looking at how the changes affect the devices’ performance and the impact it has its effectiveness. A balance has to be struck between allowing software to continuously change if it improves over time and the safety of a patient.

For example, a manufacturer might retrain a neural network that analyses mammograms for tumors with a new, larger dataset to increase its accuracy. Or, maybe, the same dataset is used but the developer decides to include more information from different sources, such as images of the outer skin of the breasts. In these scenarios, the algorithm would have to be resubmitted for FDA approval before it could be used commercially.


US watchdog OKs robo-doc AI that spies eye disease all on its own


The same requirement is also needed if the system expands beyond what it was originally intended for. If a manufacturer decides that its device that studies retinal scans for diabetic retinopathy can also measure if a patient has high blood pressure or not, it’ll have to contact FDA officials to check if the device can be used for that purpose.

Obtaining FDA approval can be a difficult and long process. “The traditional paradigm of medical device regulation was not designed for adaptive AI or ML technologies, which have the potential to adapt and optimize device performance in real – time to continuously improve healthcare for patients,” the report said.

“The highly iterative, autonomous, and adaptive nature of these tools requires a new, total product lifecycle (TPLC) regulatory approach that facilitates a rapid cycle of product improvement and allows these devices to continually improve while providing effective safeguards.”

The guidelines in the report aren't set in stone, however. At the moment the framework is a proposal and the FDA is looking for feedback before any policies are implemented. ®

Other stories you might like

  • AI tool finds hundreds of genes related to human motor neuron disease

    Breakthrough could lead to development of drugs to target illness

    A machine-learning algorithm has helped scientists find 690 human genes associated with a higher risk of developing motor neuron disease, according to research published in Cell this week.

    Neuronal cells in the central nervous system and brain break down and die in people with motor neuron disease, like amyotrophic lateral sclerosis (ALS) more commonly known as Lou Gehrig's disease, named after the baseball player who developed it. They lose control over their bodies, and as the disease progresses patients become completely paralyzed. There is currently no verified cure for ALS.

    Motor neuron disease typically affects people in old age and its causes are unknown. Johnathan Cooper-Knock, a clinical lecturer at the University of Sheffield in England and leader of Project MinE, an ambitious effort to perform whole genome sequencing of ALS, believes that understanding how genes affect cellular function could help scientists develop new drugs to treat the disease.

    Continue reading
  • Need to prioritize security bug patches? Don't forget to scan Twitter as well as use CVSS scores

    Exploit, vulnerability discussion online can offer useful signals

    Organizations looking to minimize exposure to exploitable software should scan Twitter for mentions of security bugs as well as use the Common Vulnerability Scoring System or CVSS, Kenna Security argues.

    Better still is prioritizing the repair of vulnerabilities for which exploit code is available, if that information is known.

    CVSS is a framework for rating the severity of software vulnerabilities (identified using CVE, or Common Vulnerability Enumeration, numbers), on a scale from 1 (least severe) to 10 (most severe). It's overseen by, a US-based, non-profit computer security organization.

    Continue reading
  • Sniff those Ukrainian emails a little more carefully, advises Uncle Sam in wake of Belarusian digital vandalism

    NotPetya started over there, don't forget

    US companies should be on the lookout for security nasties from Ukrainian partners following the digital graffiti and malware attack launched against Ukraine by Belarus, the CISA has warned.

    In a statement issued on Tuesday, the Cybersecurity and Infrastructure Security Agency said it "strongly urges leaders and network defenders to be on alert for malicious cyber activity," having issued a checklist [PDF] of recommended actions to take.

    "If working with Ukrainian organizations, take extra care to monitor, inspect, and isolate traffic from those organizations; closely review access controls for that traffic," added CISA, which also advised reviewing backups and disaster recovery drills.

    Continue reading

Biting the hand that feeds IT © 1998–2022