Legal GenAI must have human oversight

Generative AI (GenAI) is increasingly integrated into corporate workflows, with advocates predicting sweeping transformation across industries. Yet Zeidler Group, a LegalTech-focused law firm, warns that the technology’s power comes with clear limits. In law and compliance, regulators demand human accountability — something AI cannot replace.

The financial services industry offers a sharp example. Regulators such as the Securities and Exchange Commission in the US require human sign-off on decisions, which makes automation alone unworkable. Zeidler points to two crucial elements for making GenAI effective in this space: identifying a specific pain point and embedding expert knowledge throughout development.

Evidence suggests this is not always happening. A recent MIT NANDA Program study found that 95% of GenAI projects generate no return, largely because they are launched without a clear purpose. Zeidler argues that while GenAI can accelerate processes, success comes only when tools are designed for narrowly defined legal and compliance challenges. Without such focus, AI becomes “a solution in search of a problem.”

Equally important is expert oversight. Legal GenAI cannot simply be left to run on autopilot. While it works well for straightforward functions such as summarising documents or analysing data at scale, it falls short in regulated areas where human judgment is legally required. In sectors like asset management compliance, responsibility cannot be delegated to machines.

Some proposals suggest AI should oversee other AI agents, but Zeidler considers this unworkable. Oversight is not a technical issue but a legal one, rooted in decades of regulation and case law. Replacing human accountability with AI would require tearing down long-established legal frameworks in the US, UK, and Europe.

For Zeidler, the future of Legal GenAI lies not in replacing people, but in empowering them. Like the internet in its early years, GenAI holds transformative promise, but only when paired with human expertise. Efficiency and scale may come from AI, but accountability and responsibility remain firmly human.

Read the full story here.

Read the daily FinTech news
Copyright © 2025 FinTech Global

Enjoying the stories?

Subscribe to our daily FinTech newsletter and get the latest industry news & research

Investors

The following investor(s) were tagged in this article.