Why public regulatory data is only the tip of the iceberg

Why public regulatory data is only the tip of the iceberg

A common objection in compliance circles goes like this: why pay for regulatory intelligence when the regulator publishes everything online for free? It is a reasonable question. Regulations, enforcement notices, consultation papers and speeches are all publicly available, and placing them behind a login does not make them proprietary.

According to Corlytics, yet treating published documents as the whole picture misses most of the work. What firms see is only the visible layer: new rules, enforcement actions against firms, consultations inviting industry feedback and speeches hinting at supervisory priorities.

On their own, these are raw materials. The difficulty lies not in getting hold of them but in interpreting them accurately, consistently and at scale.

Beneath the surface sits a substantial and largely unseen infrastructure. Content must be gathered daily from hundreds of regulatory, supervisory, legislative and enforcement sources across many jurisdictions, each with its own formats, structures, languages and publishing conventions. Collecting it reliably is merely the starting point.

Every document then has to be followed through its lifecycle. Rules move from draft to consultation, through amendment, to final publication. Guidance shifts, and requirements are repealed and replaced. Without disciplined version control, organisations risk relying on outdated obligations or being unable to prove which version applied when a decision was taken.

This is a real-world issue. In its 2021 review of data collection, the Bank of England found that firms struggled to locate the latest reporting instructions and all related documents. Participants described understanding those instructions as ‘one of the biggest sources of avoidable cost’. Although the review focused on regulatory reporting, it shows how much effort remains once information has been published.

Context matters too. Metadata classifies content by jurisdiction, regulator, topic, sector, obligation, risk area and affected business function. Entity resolution connects references to organisations, legislation, products and market participants, recognising when different names or abbreviations point to the same body or rule.

Taxonomies provide a consistent structure, so users are not dependent on the wording of individual documents.

Technology carries much of this load, but human subject matter experts remain essential. They validate classifications, settle ambiguities, monitor quality and fix errors, while AI models are continually trained, tested and refined for accuracy, relevance and explainability.

The FCA captured this balance in its account of a machine executable regulatory reporting TechSprint, describing the potential for “removing ambiguity – but not judgement”. Covering only a small subset of reporting rules, the exercise showed what automation could achieve while acknowledging that firms would still need to exercise judgement.

Crucially, this capability compounds. Each new document, link, classification and validation strengthens the intelligence layer. Historical data explains how requirements evolved, and expert corrections sharpen future classifications.

That is why replication is far harder than it looks. A document downloads in seconds, but a trusted RegTech intelligence layer demands years of investment in acquisition, content management, expertise, taxonomy design, quality control and AI development. The public document is only the starting point.

Read the full Corlytics post here. 

Read the daily FinTech news

Copyright © 2026 FinTech Global

Enjoying the stories?

Subscribe to our daily FinTech newsletter and get the latest industry news & research

Investors

The following investor(s) were tagged in this article.