Data Remediation Lightning IQ 2.0

Data remediation at petabyte scale.

Unlock the full potential of your data with Lightning IQ 2.0 - the platform that doesn’t just remediate your data, it transforms it.

Version 1.0 let you see your data. 2.0 lets you act on it - move, copy, and delete straight from scan results, in place, with the cost of inaction priced in dollars.

Request a demo See the 2.0 workflow

LIGHTNING IQ 2.0 / SCAN CONSOLE SCANNING

100B

records scanned per day

45+ PB

indexed in 24 hours

70%

storage volume reduction

$1M+

saved per petabyte of ROT

Fast changes everything

Scan. Classify. Act.

Whether you’re tackling ROT, dark data, or sensitive PII, Lightning IQ delivers immediate visibility and action-ready insights across all of your storage. In 2.0 the loop closes: findings flow straight into remediation without leaving the platform.

Scan

Agentless, in-place scanning across NFS, Azure Blob, and AWS S3. Every file fully characterized - text, language, MIME, full A/C/M timestamps, custom hashes.

Classify

Reusable, uploadable search patterns tag every file by policy - PII, PHI, sensitivity, retention schedule - with duplicate detection running inline.

Act

Move, copy, or delete in bulk directly from scan results. One decision file drives action across millions of files, with per-action throughput reported.

Unprecedented speed

Terabytes per minute. Petabytes per hour.

Lightning IQ is the only solution that can scan, classify, and remediate petabytes of unstructured data in hours - not weeks. Agentless, in place, no data movement required.

Metadata index rate 1 TB / minute

Full-text extraction 1 PB / hour

Daily scan ceiling 100B records · 45+ PB

Scale up and down, horizontally and vertically, as needed. No drive too small, no network cluster too big.

SCAN SESSION / LIVE ACTIVE

2,417,908

files characterized this minute

/san/vol04/finance/archive/2019/q3_close.xlsx PII HIT

/san/vol04/legal/matters/custodian_87/mail.pst PST OWNER FOUND

/azure/blob/media/dsc_10442.mov GPS + CAMERA

/s3/eng-backups/2017/build-artifacts.tar ROT · OBSOLETE

/san/vol02/shared/marketing/logo_final_v7.ai DUPLICATE

/san/vol09/hr/benefits/enrollment_2024.pdf PHI HIT

Do more with Lightning IQ 2.0

Eliminate data blind spots. Deliver trust.

Identify sensitive information

Instantly locate and classify PII, PHI, and other confidential content across structured and unstructured sources.

Discover dark data

Shine a light on forgotten, hidden, or orphaned data that could pose compliance risks or drain resources - including abandoned PSTs, now with owners auto-derived from mail store properties.

Root out ROT

Identify and remove redundant, obsolete, and trivial files across entire data estates - fast. Duplicate identification mode flags duplicates while keeping them in the pipeline.

Remediate at scale

Process terabytes in minutes and petabytes in hours. Built for velocity without compromising accuracy.

Operationalize data quality

Don’t just delete data - optimize it. Risk, governance, legal, and innovation leaders reduce risk, improve efficiency, and deliver on innovation mandates.

Start small or go big

A single drive or an entire SAN cluster. Reusable scan and export templates make workflows consistent, repeatable, and scalable.

New in 2.0 — Costs

Every category of junk data now carries a price tag.

ROT Analysis now lives in a dedicated Costs section: cost, file counts, and data sizes per category, sub-categorized by search name. Identify duplicate and outdated data, index files 100+ folders deep across your entire SAN and build the business case in dollars - not adjectives.

Duplicates 312 TB $421,000

Obsolete — last modified pre-2018 486 TB $655,000

Trivial — system and cache files 94 TB $127,000

Orphaned PST archives 160 TB $217,000

$1,420,000 annual cost of ROT in this estate

New UI — ROT Analysis · Costs

Integrity guardrails

Act at scale. Prove you acted correctly.

Before Lightning IQ moves, copies, or deletes a file, it re-verifies the file’s hash against the scan. If the content changed after the decision was made, the file is skipped - never acted on stale data. Every session returns succeeded, failed, and skipped counts with throughput and duration by action type.

Succeeded

Skipped

Failed

HASH VERIFICATION / PRE-ACTION

✓ /san/vol04/archive/2019/q3_close.xlsx HASH MATCH · DELETED

✓ /s3/eng-backups/2017/build-artifacts.tar HASH MATCH · MOVED

! /san/vol02/shared/design/brand_kit.zip CHANGED · SKIPPED

✓ /azure/blob/media/dsc_10442.mov HASH MATCH · COPIED

✓ /san/vol09/hr/enrollment_2024.pdf HASH MATCH · MOVED

Defensible by design — auditable evidence of exactly what happened.

Your intelligence layer, not another silo

Turn a petabyte scan into a dashboard.

Native CSV, PARQUET, and JSONL output drops straight into Power BI and any BI tool. Legal export gains 39 new metadata fields and full-family binaries. We don’t ask you to rip anything out - we feed what you already run.

PARQUET · CSV · JSONL

BI-ready analytics exports

Structured output that drops straight into Power BI for self-service exploration - charts, slicers, drill-down into paths and categories.

+39 FIELDS

Expanded legal export metadata

Email headers, document properties, and geolocation in .dat files, plus full family binaries - not just hits.

REPORTING

Transparent remediation reporting

Succeeded, failed, and skipped counts with throughput and duration by action type. An auditable record of exactly what happened.

DEPLOYMENT

Cleaner cloud deployment

Workload Identity and ADC for Google Cloud Storage — no long-lived service account keys. Surfaced upload metrics pinpoint config, auth, or transient failures.

Scan and remediate in place across NFS / SMB Azure Blob AWS S3 Google Cloud Storage On-prem SAN

Investigation for everyone

If you can point and click, you can run a petabyte-scale investigation.

The 2.0 dynamic query builder composes complex Lucene searches visually — no syntax required. Search on custom and extrapolated metadata to classify by computed properties, not just filenames. Then act on what you find.

New UI — Dynamic Query Builder

Dynamic query builder

Compose complex Lucene searches visually. New users stop needing an expert; experienced users stop making syntax errors.

Custom and extrapolated metadata search

Filter on custom fields and machine-generated signals - classify against your retention schedule by computed properties, not filenames.

Geographic and temporal analytics

Map where a scan’s data was created and when. File counts and sizes by last-modified year, largest directories, deepest subdirectory trees.

Real-time scan notifications

Lifecycle updates pushed to Slack, email, and other channels - no more checking on scans manually.

Outcomes

From data chaos to data intelligence.

Lightning IQ up the darkness light bulg-1

Shine a bright light on every data blind spot in your org.

Capable of scanning and analyzing 100 billion records - 24+ petabytes - per day in any storage location. Scan, assess, remediate at lightning speed.

Identify duplicate outdated data index files 100 folders deep across your entire SAN and save up to 1M per petatbyte of ROT-1

Reduce your data storage costs by up to 70%.

Identify duplicate and outdated data, index files 100+ folders deep across your entire SAN, and save up to $1M+ per petabyte of ROT.

software that is monitoring AI output in real time to to reduce risk ligtning fast with cool dashboards and alerts-1

Transform risk assessment protocols via real-time insights.

Immediate, real-time insight across all storage locations. Take inside-out control of your data, lightning fast.

Our Vision

Our Mission