Skip to content
Search icon

The world's fastest data scanning platform

Fast changes
everything.

Scan, classify and map petabytes of unstructured data — in place, in hours. Across SAN, NAS, S3 and Azure. No data movement. No blind spots. No mystery.

45+ PBscanned per day
100 Brecords / day
In-placezero data movement
< 25 minto deploy
Throughput · live Scanning
PB / HOUR
1284500000
items scanned · this session
286K items / sec
1TB per minute
1PB per hour

Proven at scale

Dell Isilon · production run

5.13 billion items. 3.75 petabytes. 5 hours.

0
items indexed
0K
items / second
PB 0
data scanned
0hrs
total run time
Config 4 Scanners 4 IPs 4 Data Stores 6 Regex Parsers 2 Regex Packs

No other software comes close. What takes legacy scanners weeks, Lightning IQ finishes before lunch.

See it live

Watch petabytes resolve
in real time.

app.lightningiq.io/scans/e01-raw-2
Screenshot 2026-02-17 153340

Completion at a glance

A single gauge tracks every scan to 100% — overall progress plus an elapsed timer down to the millisecond.

Every microservice, monitored

Scan, router, metadata, unpack, processing and datastore each report live — so you always know exactly where the work is.

Files pipeline by size

A flow map shows data moving from scanned to routed to unpacked to processed, surfacing duplicates and filtered volume as it goes.

Rich, exportable results

Directory rates, archive counts, duplicate clusters and sizes — a complete metadata map, ready for legal, compliance and remediation workflows.

The Lightning IQ difference

Eight reasons the impossible
is suddenly possible.

A revolutionary design that maps and indexes petabytes of metadata and full-text in hours — not months.

01

Lightning-fast data scanning

Scan and index petabytes of unstructured data in hours — full-text included. Terabytes a minute, petabytes an hour. No other software comes close.

02

Modern architecture

Distributed, event-driven, asynchronous and stateless micro-services — a platform built from the ground up for rapid innovation.

$ liq deploy --iac
› provisioning compute…
› starting services…
✓ live in 24m 51s
03

Automated deployment

Fully automated, on-prem or in the cloud. No error-prone configuration — one click and you're live in under 25 minutes.

↕ vertical   ↔ horizontal
04

Dynamic scaling

Scale up and down — horizontally and vertically — as needed. No drive too small, no network cluster too big for Lightning IQ.

healthservicesinfra
05

Continuous monitoring

System health, service performance and infrastructure, watched continuously — with instant notifications the moment anything looks off.

06

Resilient & fault tolerant

Category-defining availability with self-healing design — reliable, predictable performance at petabyte scale, where you need it most.

OCRNLPPIIAI
07

Pluggable & extensible

Specialized file processors run independently — endless combinations and expansion of scope. Data never rests. Neither does Lightning IQ.

AI readinessCybersecurityPII / PHI
08

Built for today & the future

From AI readiness to cybersecurity assessments to PII identification — purpose-built for the rapidly evolving petabyte challenges of every modern organization.

Modern architecture

A distributed pipeline,
engineered for a petabyte world.

Distributed, event-driven, asynchronous and stateless micro-services move every file through a specialized processing pipeline — the same six stages you watch resolve in the live console.

Scan
enumerate in place
Router
route & balance
Metadata
size · owner · age
Unpack
pst · zip · tar · rar
Processing
text · regex · dedup
Datastore
indexed & queryable
Event-driven — every stage fires asynchronouslyStateless — compute spins up only during a scanHashed & deduplicated — every file, once
Pluggable specialized file processors
Text extraction Full-text indexing Search / RegEx / Lucene Deduplication Encrypt / Decrypt Monitor / Alert AI connectors Your processor
The image depicts a vast digital landscape composed of swirling binary code cascading down like waterfalls representing the immense scale of data in a petabyte In the foreground a towering stack of hard drives each labeled with increasing capacities

Built for today and the future.

Lightning IQ was purpose-built to tackle the rapidly evolving petabyte-sized data challenges found in every organization.  From AI readiness to cyber security assessments to PII identification - only Lightning IQ can give you real-time insights into your petabyte world.    
 
Fast changes everything.

Frequently Asked Questions

Can you REALLY scan petabytes in hours?

Yes - and we'd love to show you in a personal demo.

Do your scans include full-text?
We apply highly optimized indexing and search algorithms that dramatically reduce the disk space requirements for indexes and makes searching spectacularly fast.
What you are saying is unbelievable.

Yeah - we get that a lot.

Can you scan Azure or other Microsoft storage?

Yes.

Can you scan AWS and Google Cloud storage?

Yes.

How about Dell, NetApp clusters?

Yes.

Can this software be managed and used by a single operator?
Yes, the software can be installed, deployed and run by a single user.  
 
You can create scans, modify settings, control scan speeds, define scan locations and review scan results without needing to code or have an IT developer..
Do you offer custom development services?
Yes, if you want to scan or analyze a data type outside of our current list of supported files, we do provide development services in addition to standard licensing fees. 

Join the Lightning IQ data revolution