US FDA Opinions Vary On AI’s Black Box Issues. Will Uncertainty Follow?

Chief Medical Officer Hilary Marston says a black box model could be a problem for reviewers, after CDER and CBER officials said unexplainable AI models could be acceptable but transparency is important.

Transparency is important with an AI black box, the FDA said. (Shutterstock)

Some US Food and Drug Administration officials may be willing to consider artificial intelligence models that are not fully explainable, but Chief Medical Officer Hilary Marston seems concerned about their use in applications, further illustrating the agency’s ongoing challenge regulating the emerging technology.

Key Takeaways
  • FDA CMO Hilary Marston said an AI black box could be problematic because reviewers like to redo analyses in applications.

AI models sometimes produce the expected output, but their creators cannot fully explain how the model reached the answer or...

Read the full article – start your free trial today!

Join thousands of industry professionals who rely on Pink Sheet for daily insights

  • Start your 7-day free trial
  • Explore trusted news, analysis, and insights
  • Access comprehensive global coverage
  • Enjoy instant access – no credit card required

More from AI

Report Shows Extent Of AI Use In EU Medicines Regulation During 2024

 

The AI observatory, created by the European medicines regulatory network to track the evolving use of artificial intelligence in medicines development and regulation, has issued its first annual report.

Beijing City Releases AI Action Plan Including Drug Regulation

 
• By 

Amid the wait for an action plan to apply AI tools to drug regulation at the national level in China, capital city Beijing has released its own vision of scenarios for the technology in the healthcare sector.

ANDA User Fees: Complex Generics, Transparency, Communications Are Early Negotiation Targets

 
• By 

Teva seeks a dedicated development program and first-cycle approval metrics for complex generics. Role of artificial intelligence in the generic drug review process is a talking point for both agency and industry at reauthorization kickoff meeting.

Kris Joshi Named Norstella CEO, Prioritizes AI Innovation

 
• By 

Joshi joins the parent company of Citeline, home of the Pink Sheet, to focus on AI, business harmonization and long-term growth.

More from Pathways & Standards

Senate Bill Would Boost Oversight Of US FDA User Fee Program Following Trump Reorganization

 

Senate appropriators also put FDA on notice regarding recent meetings and compliance with the Federal Advisory Committees Act, signal positive news on rare pediatric diseases, and offer hints of other agency areas they have close eyes on.

Slowdown: US FDA’s 2025 Novel Approvals Are On Below-Average Pace

 

US FDA's 25 novel approvals in 2025 fell short of the agency's five-year average count, driven by a drop in drugs center approvals; 45 user fee goals remain in second half of year.

New US FDA Biologics License Pathway Could Be Missing Link To Reduce Animal Testing

 

Akin to the 505(b)(2) NDA, a new biologic pathway could reduce the need for animal testing, FDA toxicologist says. Expanded use of generally accepted scientific knowledge (GASK), which few sponsors have attempted despite a 2023 draft guidance, would also help.