Fragmental Overlap Storage System CLI (Demo) — Verifiable Fragment Storage Engine

The Fragmental Overlap Storage System is a deterministic storage system that:

fragments data into reusable pieces
stores them in a global blob (.dbl)
tracks structure via a keyfile (.kbl)
verifies integrity before reporting
exposes full accounting in JSON

Core Concept

Instead of storing files:

File -> fragments -> shared pool (master.dbl)

Each file becomes a sequence of references into a global fragment pool.

Files

master.dbl -> fragment payload storage
master.kbl -> append-only fragment log
file.kbl -> per-file reconstruction map

Modes

Ingest
foss --mode=ingest --input=test.dat --dbl=master.dbl --kbl=master.kbl --kbl-out=file.kbl --compression=none --verify-fragments=on --emit=json --ladder-json=ladder.json --delete-src=off

Rehydrate
foss --mode=rehydrate --output=out.dat --dbl=master.dbl --kbl=file.kbl --compression=none --verify-fragments=on --emit=json

Report (key feature)
foss --mode=report-royalties --dbl=master.dbl --kbl=master.kbl

What Makes This Different

Verified before reported

Every fragment is:

bounds-checked
hash-verified
validated before inclusion

True storage accounting

Not just compression:

true_physical = blob + (master.kbl * 2)

Includes:

data plane (blob)
control plane (KBL)

Corruption-aware metrics

integrity_score
invalid fragment tracking
weighted valuation

Full transparency (JSON)

Example fields:

true_physical_bytes
savings_percent
control_plane_ratio
compression_effectiveness
weighted_logical_value

Advanced Capability (IMPORTANT)

The JSON output is machine-readable.

This allows:

ladder -> ingest -> report -> analyze -> adjust -> repeat

Meaning:

FOSS can be tuned like a compiler against your dataset

Example:

for ladder in ladders/*.json
do
foss --mode=ingest ...
foss --mode=report-royalties ...
parse_json_score ...
done

Audit-Grade Reporting

Each report includes:

verification pass
integrity score
full byte accounting

(optionally chained and signed in future builds)

Demo Build Notes

Limited file sizes
Limited ladder complexity
Intended for validation, not production

Author

Cecil A. Lacy
Inventor of the Fragmental Overlap Storage System (FOSS)
Patent Pending 19/264,676