Customer story · Data center refresh
28 Petabytes. 53 Billion Files. One Clear Path Forward.
How Epiq mapped 28 petabytes and 53 billion files, in place, to modernize its data center refresh and take on AI-scale work with confidence.
53B
files scanned in place
28 PB
global data estate
90 min
for a 13.6 TB project
The challenge
You Can’t Refresh What You Can’t See
A data center refresh forces one question: what do we actually have? For Epiq the honest answer was tens of billions of files across petabytes, much of it undocumented, duplicated, or aging in place.
Storage prices were rising several times a year and AI was compressing decision timelines. Legacy scripts crawled for weeks to return a single answer.
Epiq needed to see the whole estate, every file, in place, then act on it.
“
Data refresh is where we started with Lightning IQ, and it changed how we approach it. Seeing across our entire footprint, every file, in place, before we move or buy anything takes the guesswork out of a refresh.
The scale
Intelligence at the scale of the estate
-
53 billion files across 28 petabytes, scanned where they live, agentless, no data movement
-
A single cluster of 15.7 billion files and 7,160 TB, including one directory holding tens of millions of files
-
Every file described: metadata, categories, aging by year, duplicate identification
-
Disaster-recovery mirrors mean every cleanup counts twice
Data chaos
Data intelligence
“
Lightning IQ gets through our entire data estate, tens of billions of files across petabytes, in place, without moving the data or running up our costs. Work that used to take weeks now takes days.
Proof of speed
50 million files. 2 million needles. 90 minutes.
When an additional data volume needed to be assessed quickly for compliance, Lightning IQ scanned 9.5 TB—roughly 13.6 TB unpacked—and reduced approximately 50.3 million files to 2.1 million unique review hits in about 90 minutes.
The alternative was estimated at several weeks.
Unique review hits
2.1M
Elapsed
90 min
Scan beam sweep · 9.5 TB in, 13.6 TB unpacked, 50.3M files assessed
Input
9.5 TB → 13.6 TB
50.3M files
Output
2.1M unique hits
scoped for review
Time
90 min
versus weeks
Impact
$1M+ saved
financial impact
“
A large, unknown data volume is a constant challenge for ops teams. In this example, Lightning IQ narrowed roughly 50 million files to the 2.1 million we needed to review in about 90 minutes. The alternative would have taken weeks. That speed changes what we can take on.
The results
What changed
-
Full visibility across a 28 PB, 53 billion-file estate, in place
-
Weeks compressed to hours: 13.6 TB in about 90 minutes versus one to two weeks
-
More confident refresh decisions, with Disaster Recovery mirrors doubling every cleanup
Fast changes everything.
The right data. Right now.
Hours not Months
Scan. Classify. Act.
Until Lightning IQ, nothing could interrogate a petabyte of unstructured content fast enough to impact data center refresh timelines and budgets. Lightning IQ changes the game.
100B records · 25–45+ PB / day
Terabytes per minute. Petabytes per hour. NFS, SMB, S3, on-prem and cloud — agentless, in place.
PII · PHI · IP · ROT
Full-text and metadata classification with HIPAA, GDPR and SOX support. Exposed credentials and malware indicators surfaced in the same pass.
Retain, re-tier, retire
Decisions in days, not months — with a client-ready report per stakeholder.
See your estate before you buy another petabyte
Find out where your refresh stands in under five minutes.