Refine technical documentation to reflect current architecture, component structure, and routing conventions for the vcon console.
2.8 KiB
2.8 KiB
Changelog
All notable changes to DataStack are documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
[1.0.0] — 2026-11-17
Added
- Decoupled Dual-Runtime Architecture:
- Next.js 15 App Router (Port 3000) serving the public overview,
/vcon/*administration console, authenticated REST ingestion (POST /api/events), and streaming dataset exports (GET /api/export). - Dedicated Express + Socket.IO server (Port 4000) handling persistent WebSocket handshakes,
sync_datasingle-event intake, andbatch_syncbatch ingestion.
- Next.js 15 App Router (Port 3000) serving the public overview,
- PostgreSQL Control-Plane Persistence (
pg.Pool):- Automatic schema provisioning and persistence for
admin_users,admin_login_attempts,client_sdks, andadmin_settings. - Live
SELECT 1database health checks integrated into/api/metricsand/vcon/dashboard.
- Automatic schema provisioning and persistence for
- Partitioned CSV Storage & Retention Engine:
- In-memory batch buffering (
DataBufferEngineand Port 4000 queue) flushing to/storage/data/{clientId}/{YYYY-MM-DD}.csvon threshold (batchFlushThreshold) or timer (batchFlushIntervalMs). - Automatic size-based file rotation (
{YYYY-MM-DD}-part2.csv) at configurablefileRotationMbthresholds. - Automatic retention pruning (
CSVStorageManager.pruneExpiredPartitions(autoPruneDays)) for expired daily CSV partitions.
- In-memory batch buffering (
- Client SDK Registry & Security Governance:
- Per-client HMAC-SHA256 JWT token issuance, one-click key rotation, live revocation (
CLIENT_REVOKED), and permanent client deletion (DELETE /api/clients/[id]). - Per-client sliding-window rate limiting, payload byte-size guards (
maxPayloadSizeKb), and 5-minute TTL idempotency deduplication with automatic memory cleanup. - Automatic bulk client token re-signing (
SDKManager.resignAllClientTokensAsync()) when the platformjwtSecretis updated in/vcon/settings.
- Per-client HMAC-SHA256 JWT token issuance, one-click key rotation, live revocation (
- Administrator Authentication & Session Hardening:
- First-run setup flow (
/vcon/setup) guarded byDATASTACK_ADMIN_SETUP_KEY. - Node.js
crypto.scryptpassword hashing, timing-safe credential verification, and 5-attempt / 15-minute brute-force login lockout. - WebCrypto HMAC-SHA256 session cookies (
8hstandard /30dRemember me) with preserved session TTL on profile updates (PUT /api/auth/profile).
- First-run setup flow (
- Official Python SDK (
datastack-sdkv1.0.0):- Pip-installable
DataStackClientwith JWT handshake authentication, automatic reconnection, andthreading.Eventacknowledgment synchronization forsync()andbatch_sync().
- Pip-installable
- Docker Compose & Coolify Production Stack:
- Multi-stage Dockerfiles (
Dockerfile.web,Dockerfile.server,Dockerfile.proxy), Nginx WebSocket/HTTP reverse proxy, and shareddatastack-dataandpgdatavolumes.
- Multi-stage Dockerfiles (