Files
DataStack/core/Storage/manifest.md
Team Dark Devil 367dd819f8 docs: update architecture documentation and manifests
Refine technical documentation to reflect current architecture, component structure, and routing conventions for the vcon console.
2026-11-17 21:22:55 +06:00

11 lines
692 B
Markdown

# CSV Storage Engine Manifest
## Purpose
Partitioned CSV file storage engine (`core/Storage/csvStorage.ts`) responsible for writing, rotating, inspecting, and pruning collected event datasets on disk.
## Storage Conventions
- **Path Pattern**: `/storage/data/{clientId}/{YYYY-MM-DD}.csv`
- **Columns**: `clientId,eventId,timestamp,payload`
- **Size & Daily Rotation**: Creates a new daily file per client and rotates to `{YYYY-MM-DD}-part2.csv` when a file reaches `maxFileSizeBytes` (configurable via `fileRotationMb`, default `100MB`).
- **Retention Pruning**: `pruneExpiredPartitions(autoPruneDays)` automatically removes daily CSV partitions older than the configured retention period.