Lightning IQ Blog

Say Hello to Lightning IQ 2.0

Written by Danny Pidutti | Aug 6, 2026, 4:02:59 PM

The engine that made petabyte-scale processing real now puts that power in more hands, with an interface built for the people who actually need the answers.

When we introduced Lightning IQ, we set out to prove a single point: that you could bring eDiscovery-level visibility to petabytes of unstructured data in hours instead of weeks. We proved it, not in the lab, but in the real world, where it counts. Lightning IQ scans tens of billions of files across petabytes, and it does it in production every day.
 
But raw horsepower was only ever the foundation.
 
The hard truth about enterprise data is that the people who most need answers — the legal teams, the governance leads, AI practitioners, the security analysts, the IT owners staring down a data center refresh - are rarely the same people who can drive a processing engine. Speed that only a few specialists can unlock isn't speed. It's another bottleneck in your workflow.
 
LIQ 1.0 is incredibly fast, accurate, and scalable, delivering repeatable results, and while you don’t need a PhD to push the buttons, knowing which buttons to push was still a challenge.   

A platform anyone can use.

We spent hundreds of hours in the field with prospects, customers, and end users, learning how they use LIQ to address their use cases. We took those learnings and incorporated them into Lightning IQ 2.0, our most significant release yet. The result is a platform almost anyone can use. Key additions include:

  • Templating. Configure a job once, and you can share it with team members and reuse it across different data sets. It's great for capturing and templating your domain expertise.

  • Build complex searches visually. The new query builder lets anyone construct a precise, powerful query without knowing the name of every metadata field or a single line of Lucene.

  • See your data from every angle. Redesigned analytics and reporting surfaces search hits, document categories, aging, geography, duplicates, and storage cost in visualizations built for the business. Think board-level ready reports; our compliance officers and storage administrators love them.

  • Act, don't just observe. Remediate directly from your results; you want to delete the 2 million files you shouldn’t have, deduplicate to save storage space, consolidate customer data to a single location,….? No problem, LIQ will find it and then help you do something about it.

With LIQ 2.0, far more people inside an organization can now put Lightning IQ to work on the sprawling, nuanced problems that never quite fit a single tool. One platform, one interface, across data center refresh, remediation, governance, investigations, breach response, and legal review.

The same engine, forged in the real world.

None of this softens the horsepower; in fact, we spent a bunch of time here too. Underneath the new experience is the fastest data processing engine we have ever shipped, battle-tested in the harshest environments: real global data centers, at true petabyte scale, on live production data. In one such environment, a customer had an urgent document processing job that would have taken legacy tools one to two weeks to finish, they couldn’t wait that long, so they used LIQ, it finished in ninety minutes.
 
That is the difference between a benchmark and a proof. And 2.0 makes that proof usable by your whole team.

Where we are headed.

There is a reason this matters more now than ever. As organizations invest in AI, the constraint is not only compute and storage — arguably more important is the quality of the data you feed them. Thirty to seventy percent of enterprise data is redundant, obsolete, or trivial, and every gigabyte of it makes those AI investments less efficient. The natural next home for Lightning IQ is upstream: clearing the noise so only the right data flows into whatever comes next. It is where much of our roadmap now points, and it is a problem we were built to solve.

Scan everything. Move nothing. Act with confidence.  We built 1.0 to make the impossible real. We built 2.0 to make it usable by everyone who has been waiting for answers.

Fast changes everything.