Files
DataStack/notes/005-ACTUAL-FEATURE-REGISTER.md
T
victorsteele428 fd57a3518d P02 diagnostics: confirm Redis ACK durability, CSV replay and health readiness gaps (#2)
test(p02): document reproduced durability/replay risk, no runtime patch [skip ci]
2026-11-22 09:07:23 +00:00

7.1 KiB

DataStack — Actual Implementation / Working-Feature Register

Frozen source HEAD: d725841ebc828d58cbe90f517da9e600f23c4630. Date: 2026-11-22. Evidence levels: SOURCE = verified code present; CI PASS = focused automated tests/build passed; LIVE READ = public read-only endpoint observed; NOT VERIFIED = no independent safe live runtime evidence. These are deliberately different. Do NOT infer production DB/S3/MCP health from a public online response.

Capability / feature Exact representative path Baseline evidence Actual live conclusion Changed by P01/P02/P03
Next.js 15 public landing and app pages app/**, docker/Dockerfile.web Next.js CI build PASS and 22/22 static pages; public landing loads LIVE READ for landing only None
Console admin authentication/setup app/api/auth/**, core/auth/adminUsers.ts, core/auth/adminSession.ts SOURCE + auth regression suite PASS Admin login NOT live-tested None
Roles / owner-admin-operator-viewer core/auth/**, components/layout/VconShell.tsx SOURCE + RBAC TS tests PASS NOT live-tested None
SDK registered clients, token issuance/revoke/rotate core/sdk/sdkManager.ts, app/api/clients/** SOURCE + client/auth TS regression PASS NOT live-tested None
Next.js HTTP event ingestion app/api/events/route.ts SOURCE + TS tests PASS No live writes performed None
Express + Socket.IO ingestion server/index.js, server/socket/handlers.js SOURCE + sync/SDK tests PASS Not live end-to-end verified None
Rate limit, dedupe, payload validation server/socket/handlers.js, app/api/events/route.ts SOURCE + tests PASS Not live verified None
Redis ingestion queue/fallback server/index.js:165-193, core/data/buffer.ts SOURCE + TS storage tests; R-01 ACK durability risk Not guaranteed lossless on outage None
CSV partition/rotation/flush server/workers/csvWriter.js, core/Storage/csvStorage.ts SOURCE + regression; ingestion image CI build PASS R-02 crash replay semantics NOT confirmed None
Compression and S3 archival core/Storage/s3Archive.ts, core/Storage/csvStorage.ts SOURCE + storage tests No live S3 credentials or archive tests None
Data browser, export CSV/JSON/NDJSON app/api/export/route.ts, app/api/data/route.ts SOURCE + TS tests NOT live-tested None
Storage quota / disk admission core/Storage/csvStorage.ts SOURCE + tests; 507 codes NOT live-tested None
Dashboard, client status, counts lib/vconUiHelpers.ts, app/vcon/clients/page.tsx SOURCE; client status helper tests; stale old regex CI-04 No live user session proof None
Prometheus and metrics bridge app/api/prometheus/route.ts, server/index.js SOURCE + tests NOT live authenticated None
Webhook alerts and SSRF/HMAC core/alerts/webhookNotifier.ts SOURCE + tests NOT live-tested None
CloudCmd file browser server/filesManager.js, tests/files-manager.test.ts SOURCE; files-manager suite 4 tests PASS NOT live authenticated None
MCP engine (17 permissions) server/mcp/mcpEngine.js, app/api/mcp/route.ts SOURCE + MCP server suite 3 tests PASS; write flags default false NOT live connected/authenticated None
Python SDK v2.2 + compat package sdk/python/datastack/datastack/**, sdk-python/** Windows CI 14/14 PASS No real external SDK session None
Node SDK v2.2 + offline spool sdk/node/datastack/** Native Windows SDK compile PASS; SDK-specific TS regression PASS No live external SDK session None
PWA/offline shell app/**, public/** SOURCE + phase06 suite PASS Browser offline not live-tested None
Docker Compose stack docker/docker-compose.yml CI config PASS, ingestion image PASS Deployed app already serves public health; deployed SHA unverified None
Docker web/proxy image docker/Dockerfile.web, docker/Dockerfile.proxy Web layer fail on containerd; proxy unrun Existing Coolify instance appears online but CI image parity unverified None
Health endpoint app/api/health/route.ts LIVE READ status:online on 2026-11-22T00:01:19Z Confirmed public API liveness; not end-to-end readiness None

Mandatory post-phase update convention

After EACH P01/P02/P03 close, amend only affected table rows:

  • Feature/capability (exact added/changed behavior or UNCHANGED)
  • Source file/line + new SHA
  • CI evidence (run URL, pass/failed count, build exit)
  • Live status (READ ONLY, AUTHENTICATED VERIFIED, NOT VERIFIED, etc.; no fictitious claims)
  • Compatibility (UI/auth/SDK/API/storage preserved? test proof)
  • Risk remaining and next approval. Do not mark "actual working" simply because a patch compiled. Distinguish source, CI, and actual deployment.

Change log

  • P00: No feature added/modified. notes/** documentation only. 0/3 implementation phases completed.
  • P01: CLOSED — 1/3 implementation phases. CI-01…05 corrected exclusively in package-lock, obsolete bun.lock removal, scoped regression/type tests and Gitea CI harness. No actual application, UI, backend, API, SDK or production functionality was added, removed or altered. Gitea #59: committed-lock Linux/Windows clean install PASS; Node SDK builds PASS; all 24 TS suites exit0 with zero timeouts; Next standalone 22/22 pages PASS. One historical #59 test-only declaration TS error fixed; #60 strict TS zero errors and full ESLint PASS. Previous canonical Python SDK 14/14 (#48) preserved but not rerun. No live endpoint mutation or deployment; live data/Redis/S3/MCP actual operational status is not established.
  • P02: BLOCKED pending separate approved runtime remediation. Three disposable fault-injection tests demonstrated existing behavior: positive ACK on Redis write failure with RAM-only data (R-01), duplicate appended event ID after Redis trim failure and retry in web-side buffer (R-02), and public health 200/online when Redis is down (R-03). These are diagnostic tests, not production fixes. Zero app/API/UI/SDK/runtime changes, no live deploy. CI #63. P01 remains closed (1/3 phases complete).
  • P03: pending.

P02 Diagnostic Feature Record — 2026-11-22

  • New production features: NONE. This phase adds only three disposable failure-injection scenarios across two existing test suites; tests are not production handlers. Existing source/UI/auth/backend/SDK/MCP, Redis/PG/CSV services, Next/Express health interfaces and deployment remain unmodified.
  • R-01: existing volatile RAM fallback and WS ACK behavior audited, not corrected. Do not mark ACK durability as working merely because a diagnostic test proves current behavior.
  • R-02: existing CSV-before-Redis-trim order audited, not corrected. Exactly-once replay safety is NOT VERIFIED.
  • R-03: current public Express health 200 plus redisConnected:false is liveness, not dependency readiness. Separate readiness remains NOT IMPLEMENTED.
  • Gitea disposable CI #63: https://dev.ivib.cc/vibtools/DataStack/actions/runs/63. The previous P01 working results remain valid; no live read/write test or production deploy is included in P02.