docs: update AI Studio design token audits
Refresh design token inventory files to reflect the latest UI sizing and layout configurations from the sandbox prototype.
No files matched your search
|
After Width: | Height: | Size: 87 KiB |
|
After Width: | Height: | Size: 128 KiB |
|
After Width: | Height: | Size: 60 KiB |
|
After Width: | Height: | Size: 83 KiB |
|
After Width: | Height: | Size: 118 KiB |
|
After Width: | Height: | Size: 53 KiB |
|
After Width: | Height: | Size: 54 KiB |
|
After Width: | Height: | Size: 29 KiB |
|
After Width: | Height: | Size: 83 KiB |
|
After Width: | Height: | Size: 118 KiB |
|
After Width: | Height: | Size: 52 KiB |
|
After Width: | Height: | Size: 21 KiB |
|
After Width: | Height: | Size: 160 KiB |
|
After Width: | Height: | Size: 77 KiB |
|
After Width: | Height: | Size: 160 KiB |
|
After Width: | Height: | Size: 77 KiB |
@@ -0,0 +1,9 @@
|
||||
# GEMINI_API_KEY: Required for Gemini AI API calls.
|
||||
# AI Studio automatically injects this at runtime from user secrets.
|
||||
# Users configure this via the Secrets panel in the AI Studio UI.
|
||||
GEMINI_API_KEY="MY_GEMINI_API_KEY"
|
||||
|
||||
# APP_URL: The URL where this applet is hosted.
|
||||
# AI Studio automatically injects this at runtime with the Cloud Run service URL.
|
||||
# Used for self-referential links, OAuth callbacks, and API endpoints.
|
||||
APP_URL="MY_APP_URL"
|
||||
@@ -0,0 +1,3 @@
|
||||
{
|
||||
"extends": "next"
|
||||
}
|
||||
@@ -0,0 +1,7 @@
|
||||
node_modules/
|
||||
.next/
|
||||
coverage/
|
||||
.DS_Store
|
||||
*.log
|
||||
.env*
|
||||
!.env.example
|
||||
@@ -0,0 +1,23 @@
|
||||
# AGENTS.md — Component-Only Architecture Rules & System Directives
|
||||
|
||||
## 1. Single Source of Truth Components
|
||||
- All UI design styles are designed once as reusable components in `components/ui/` and `components/layout/`.
|
||||
- Pages must never implement isolated, inline styles or custom ad-hoc styling blocks.
|
||||
- Spacing, colors, fonts, borders, buttons, cards, modals, and tables are defined centrally. Any design token alteration automatically cascades across all pages.
|
||||
|
||||
## 2. Decoupled Runtime Split
|
||||
- **Port 3000**: Next.js App Router (Frontend UI, `/vcon/*` admin console, streaming CSV export `/api/export`).
|
||||
- **Port 4000**: Express.js + Socket.IO process (WebSocket handshake, JWT verification, real-time ingestion).
|
||||
- **Socket.IO Rule**: Socket.IO must never reside inside Next.js serverless route handlers.
|
||||
|
||||
## 3. Data Storage Rules
|
||||
- **Collected Realtime Data**: Strictly stored in rotated CSV files at `/storage/data/{clientId}/{YYYY-MM-DD}.csv`.
|
||||
- **Zero Database Inserts**: Per-row DB inserts are prohibited for collected data streams.
|
||||
- **File Rotation**: Rotates daily or upon reaching 100MB (`-part2.csv`).
|
||||
- **Redis / In-Memory Buffer**: Aggregates batches (500 events or 2000ms timer) before flushing to disk.
|
||||
- **PostgreSQL / Prisma**: Exclusively dedicated to metadata, SDK registrations, and admin settings.
|
||||
|
||||
## 4. Design & Typography Tokens
|
||||
- **Font Stack**: `"Segoe UI", "Segoe UI Web", system-ui, -apple-system, "Helvetica Neue", sans-serif`.
|
||||
- **Border Radius**: `--radius: 0rem` strictly across all shadcn and custom UI components.
|
||||
- **Shadows**: None. Clean, soft, compact flat design with subtle 1px borders.
|
||||
@@ -1,11 +1,42 @@
|
||||
<div align="center">
|
||||
# DataStack — Self-Hosted Universal Realtime Data Collection Platform
|
||||
|
||||
<img width="1200" height="475" alt="GHBanner" src="https://github.com/user-attachments/assets/0aa67016-6eaf-458a-adb2-6e31a0763ed6" />
|
||||
DataStack is a high-throughput, self-hosted data collection platform designed for high-frequency event ingestion over WebSockets with buffered batch persistence to CSV.
|
||||
|
||||
<h1>Built with AI Studio</h2>
|
||||
## Architecture
|
||||
|
||||
<p>The fastest path from prompt to production with Gemini.</p>
|
||||
| Process | Port | Role |
|
||||
| :--- | :--- | :--- |
|
||||
| **Next.js App Router** | 3000 | Frontend UI, `/vcon/*` admin console, streaming CSV export `/api/export` |
|
||||
| **Express + Socket.IO** | 4000 | WebSocket handshake, JWT client auth, event intake |
|
||||
| **CSV Writer Worker** | — | In-memory buffer flush to CSV (`500 rows / 2s`) |
|
||||
|
||||
<a href="https://aistudio.google.com/apps">Start building</a>
|
||||
## Data Persistence
|
||||
- **CSV Storage Path**: `/storage/data/{clientId}/{YYYY-MM-DD}.csv`
|
||||
- **Schema**: `clientId, eventId, timestamp(ISO), payload(JSON)`
|
||||
- **Rotation Rule**: Per-day OR 100MB threshold (whichever triggers first).
|
||||
- **PostgreSQL**: Used strictly for SDK client registration and admin settings. Zero collected data is inserted into the database.
|
||||
|
||||
</div>
|
||||
## Python SDK
|
||||
Install the client:
|
||||
```bash
|
||||
pip install ./sdk-python
|
||||
```
|
||||
|
||||
Usage:
|
||||
```python
|
||||
from datastack_sdk import DataStackClient
|
||||
|
||||
client = DataStackClient(server_url="http://localhost:4000", token="JWT_TOKEN")
|
||||
if client.connect():
|
||||
client.sync({"metric": "load", "value": 42})
|
||||
client.disconnect()
|
||||
```
|
||||
|
||||
## Running the Platform
|
||||
```bash
|
||||
# Terminal 1: Web Interface & Admin Console
|
||||
npm run dev
|
||||
|
||||
# Terminal 2: Express Socket.IO Ingestion Engine
|
||||
npm run server
|
||||
```
|
||||
@@ -0,0 +1,54 @@
|
||||
import { NextRequest, NextResponse } from 'next/server';
|
||||
import { SDKManager } from '@/core/sdk/sdkManager';
|
||||
|
||||
export async function GET(
|
||||
_req: NextRequest,
|
||||
{ params }: { params: Promise<{ id: string }> }
|
||||
) {
|
||||
const { id } = await params;
|
||||
const client = SDKManager.getClient(id);
|
||||
if (!client) {
|
||||
return NextResponse.json({ error: 'Client not found' }, { status: 404 });
|
||||
}
|
||||
return NextResponse.json({ client });
|
||||
}
|
||||
|
||||
export async function PATCH(
|
||||
req: NextRequest,
|
||||
{ params }: { params: Promise<{ id: string }> }
|
||||
) {
|
||||
const { id } = await params;
|
||||
try {
|
||||
const body = await req.json();
|
||||
|
||||
// Special action: regenerate token
|
||||
if (body.action === 'regenerate_token') {
|
||||
const refreshed = SDKManager.regenerateToken(id);
|
||||
if (!refreshed) {
|
||||
return NextResponse.json({ error: 'Client not found' }, { status: 404 });
|
||||
}
|
||||
return NextResponse.json({ client: refreshed });
|
||||
}
|
||||
|
||||
const updated = SDKManager.updateClient(id, body);
|
||||
if (!updated) {
|
||||
return NextResponse.json({ error: 'Client not found' }, { status: 404 });
|
||||
}
|
||||
return NextResponse.json({ client: updated });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Update failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
|
||||
export async function DELETE(
|
||||
_req: NextRequest,
|
||||
{ params }: { params: Promise<{ id: string }> }
|
||||
) {
|
||||
const { id } = await params;
|
||||
const deleted = SDKManager.deleteClient(id);
|
||||
if (!deleted) {
|
||||
return NextResponse.json({ error: 'Client not found' }, { status: 404 });
|
||||
}
|
||||
return NextResponse.json({ success: true, message: `Client ${id} deleted` });
|
||||
}
|
||||
@@ -0,0 +1,45 @@
|
||||
import { NextRequest, NextResponse } from 'next/server';
|
||||
import { SDKManager } from '@/core/sdk/sdkManager';
|
||||
|
||||
export async function GET() {
|
||||
try {
|
||||
const clients = SDKManager.listClients();
|
||||
return NextResponse.json({ clients, count: clients.length });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Failed to list clients';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
|
||||
export async function POST(req: NextRequest) {
|
||||
try {
|
||||
const body = await req.json();
|
||||
const { clientId, name, rateLimit } = body;
|
||||
|
||||
if (!clientId || !name) {
|
||||
return NextResponse.json(
|
||||
{ error: 'clientId and name are required' },
|
||||
{ status: 400 }
|
||||
);
|
||||
}
|
||||
|
||||
const existing = SDKManager.getClient(clientId);
|
||||
if (existing) {
|
||||
return NextResponse.json(
|
||||
{ error: `Client '${clientId}' already exists` },
|
||||
{ status: 409 }
|
||||
);
|
||||
}
|
||||
|
||||
const newClient = SDKManager.registerClient({
|
||||
clientId,
|
||||
name,
|
||||
rateLimit: rateLimit ? Number(rateLimit) : 100,
|
||||
});
|
||||
|
||||
return NextResponse.json({ client: newClient }, { status: 201 });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Client creation failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,49 @@
|
||||
import { NextRequest, NextResponse } from 'next/server';
|
||||
import { DataBufferEngine } from '@/core/data/buffer';
|
||||
import { SDKManager } from '@/core/sdk/sdkManager';
|
||||
import { SecurityEngine } from '@/core/Security/security';
|
||||
|
||||
export async function GET(req: NextRequest) {
|
||||
try {
|
||||
const { searchParams } = new URL(req.url);
|
||||
const clientId = searchParams.get('clientId') || undefined;
|
||||
const limit = Number(searchParams.get('limit')) || 50;
|
||||
|
||||
const events = DataBufferEngine.getRecentEvents(limit, clientId);
|
||||
return NextResponse.json({ events, count: events.length });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Events retrieval failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
|
||||
export async function POST(req: NextRequest) {
|
||||
try {
|
||||
const body = await req.json();
|
||||
const clientId = body.clientId || 'py_telemetry_agent_01';
|
||||
const eventId = body.eventId || `evt_${Date.now()}_${Math.random().toString(36).substring(2, 7)}`;
|
||||
const timestamp = body.timestamp || new Date().toISOString();
|
||||
const data = body.data || { sample: 'Realtime event via DataStack API', rand: Math.random() };
|
||||
|
||||
// Validate security
|
||||
const val = SecurityEngine.validateEvent(clientId, eventId, data, 200);
|
||||
if (!val.allowed) {
|
||||
return NextResponse.json({ error: val.reason }, { status: 429 });
|
||||
}
|
||||
|
||||
const event = {
|
||||
clientId,
|
||||
eventId,
|
||||
timestamp,
|
||||
payload: typeof data === 'string' ? data : JSON.stringify(data),
|
||||
};
|
||||
|
||||
DataBufferEngine.push(event);
|
||||
SDKManager.incrementEventCount(clientId, 1);
|
||||
|
||||
return NextResponse.json({ success: true, event });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Event simulation failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,76 @@
|
||||
import { NextRequest, NextResponse } from 'next/server';
|
||||
import { CSVStorageManager } from '@/core/Storage/csvStorage';
|
||||
import fs from 'fs';
|
||||
import path from 'path';
|
||||
|
||||
export async function GET(req: NextRequest) {
|
||||
try {
|
||||
const { searchParams } = new URL(req.url);
|
||||
const clientId = searchParams.get('clientId');
|
||||
const filename = searchParams.get('filename');
|
||||
|
||||
// Single specific file export
|
||||
if (clientId && filename) {
|
||||
const content = CSVStorageManager.getFileContent(clientId, filename);
|
||||
if (!content) {
|
||||
return NextResponse.json({ error: 'CSV file not found' }, { status: 404 });
|
||||
}
|
||||
|
||||
return new NextResponse(content, {
|
||||
status: 200,
|
||||
headers: {
|
||||
'Content-Type': 'text/csv; charset=utf-8',
|
||||
'Content-Disposition': `attachment; filename="${filename}"`,
|
||||
},
|
||||
});
|
||||
}
|
||||
|
||||
// Stream aggregate or list files
|
||||
const allFiles = CSVStorageManager.listAllFiles();
|
||||
const filtered = clientId && clientId !== 'all'
|
||||
? allFiles.filter((f) => f.clientId === clientId)
|
||||
: allFiles;
|
||||
|
||||
if (filtered.length === 0) {
|
||||
const emptyCsv = 'clientId,eventId,timestamp,payload\n';
|
||||
return new NextResponse(emptyCsv, {
|
||||
status: 200,
|
||||
headers: {
|
||||
'Content-Type': 'text/csv; charset=utf-8',
|
||||
'Content-Disposition': `attachment; filename="datastack_export_${Date.now()}.csv"`,
|
||||
},
|
||||
});
|
||||
}
|
||||
|
||||
// Combine matching files with a single header
|
||||
let combined = 'clientId,eventId,timestamp,payload\n';
|
||||
for (const f of filtered) {
|
||||
try {
|
||||
const raw = fs.readFileSync(f.filePath, 'utf8');
|
||||
const lines = raw.split('\n');
|
||||
// skip header on subsequent lines
|
||||
const dataLines = lines.slice(1).filter((l) => l.trim().length > 0);
|
||||
if (dataLines.length > 0) {
|
||||
combined += dataLines.join('\n') + '\n';
|
||||
}
|
||||
} catch {
|
||||
// continue
|
||||
}
|
||||
}
|
||||
|
||||
const exportFileName = clientId && clientId !== 'all'
|
||||
? `${clientId}_export_${new Date().toISOString().split('T')[0]}.csv`
|
||||
: `datastack_universal_export_${new Date().toISOString().split('T')[0]}.csv`;
|
||||
|
||||
return new NextResponse(combined, {
|
||||
status: 200,
|
||||
headers: {
|
||||
'Content-Type': 'text/csv; charset=utf-8',
|
||||
'Content-Disposition': `attachment; filename="${exportFileName}"`,
|
||||
},
|
||||
});
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Export failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,12 @@
|
||||
import { NextResponse } from 'next/server';
|
||||
import { ApiEngine } from '@/core/apiEngine/apiService';
|
||||
|
||||
export async function GET() {
|
||||
try {
|
||||
const metrics = await ApiEngine.getDashboardMetrics();
|
||||
return NextResponse.json(metrics);
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Metrics calculation failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,23 @@
|
||||
import { NextRequest, NextResponse } from 'next/server';
|
||||
import { SettingsManager } from '@/core/adminSettings/settingsManager';
|
||||
|
||||
export async function GET() {
|
||||
try {
|
||||
const settings = SettingsManager.getSettings();
|
||||
return NextResponse.json({ settings });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Settings read failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
|
||||
export async function POST(req: NextRequest) {
|
||||
try {
|
||||
const body = await req.json();
|
||||
const updated = SettingsManager.updateSettings(body);
|
||||
return NextResponse.json({ settings: updated, success: true });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Settings update failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,37 @@
|
||||
import { NextRequest, NextResponse } from 'next/server';
|
||||
import { CSVStorageManager } from '@/core/Storage/csvStorage';
|
||||
import { DataBufferEngine } from '@/core/data/buffer';
|
||||
|
||||
export async function GET(req: NextRequest) {
|
||||
try {
|
||||
const { searchParams } = new URL(req.url);
|
||||
const clientId = searchParams.get('clientId') || undefined;
|
||||
|
||||
const stats = CSVStorageManager.getStorageStats();
|
||||
let files = CSVStorageManager.listAllFiles();
|
||||
|
||||
if (clientId && clientId !== 'all') {
|
||||
files = files.filter((f) => f.clientId === clientId);
|
||||
}
|
||||
|
||||
return NextResponse.json({ stats, files });
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Storage stats failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
|
||||
export async function POST(_req: NextRequest) {
|
||||
try {
|
||||
// Manual flush buffer to disk
|
||||
const res = await DataBufferEngine.flush();
|
||||
return NextResponse.json({
|
||||
success: true,
|
||||
flushedCount: res.count,
|
||||
filesUpdated: res.files,
|
||||
});
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Manual flush failed';
|
||||
return NextResponse.json({ error: message }, { status: 500 });
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,117 @@
|
||||
@import "tailwindcss";
|
||||
|
||||
:root {
|
||||
--radius: 0rem;
|
||||
--font-sans: "Segoe UI", "Segoe UI Web", system-ui, -apple-system, BlinkMacSystemFont, "Helvetica Neue", Arial, sans-serif;
|
||||
--font-mono: ui-monospace, "SF Mono", "Liberation Mono", Menlo, Consolas, monospace;
|
||||
|
||||
/* Theme tokens - Dark Mode (Sleek Graphite Workbench) */
|
||||
--bg-main: #0c0e12;
|
||||
--bg-sidebar: #0f1117;
|
||||
--bg-activity: #131720;
|
||||
--bg-elevated: #161b24;
|
||||
--bg-hover: #1c2230;
|
||||
--bg-active: #242c3d;
|
||||
--border: #212836;
|
||||
--border-strong: #2e374a;
|
||||
--text: #e6ebf2;
|
||||
--text-muted: #8c96a8;
|
||||
--text-dim: #5c6577;
|
||||
--accent: #3b82f6;
|
||||
--accent-soft: rgba(59, 130, 246, 0.08);
|
||||
--accent-hover: #60a5fa;
|
||||
--text-on-accent: #ffffff;
|
||||
--success: #10b981;
|
||||
--success-soft: rgba(16, 185, 129, 0.08);
|
||||
--warning: #f59e0b;
|
||||
--warning-soft: rgba(245, 158, 11, 0.08);
|
||||
--danger: #ef4444;
|
||||
--danger-soft: rgba(239, 68, 68, 0.08);
|
||||
}
|
||||
|
||||
html.light, body.light {
|
||||
/* Theme tokens - Light Mode (Clean, soft contrast) */
|
||||
--bg-main: #ffffff;
|
||||
--bg-sidebar: #f8fafc;
|
||||
--bg-activity: #f1f5f9;
|
||||
--bg-elevated: #ffffff;
|
||||
--bg-hover: #f1f5f9;
|
||||
--bg-active: #e2e8f0;
|
||||
--border: #e2e8f0;
|
||||
--border-strong: #cbd5e1;
|
||||
--text: #0f172a;
|
||||
--text-muted: #475569;
|
||||
--text-dim: #94a3b8;
|
||||
--accent: #2563eb;
|
||||
--accent-soft: rgba(37, 99, 235, 0.06);
|
||||
--accent-hover: #1d4ed8;
|
||||
--text-on-accent: #ffffff;
|
||||
--success: #059669;
|
||||
--success-soft: rgba(5, 150, 105, 0.08);
|
||||
--warning: #d97706;
|
||||
--warning-soft: rgba(217, 119, 6, 0.08);
|
||||
--danger: #dc2626;
|
||||
--danger-soft: rgba(220, 38, 38, 0.08);
|
||||
}
|
||||
|
||||
* {
|
||||
box-sizing: border-box;
|
||||
margin: 0;
|
||||
padding: 0;
|
||||
border-radius: 0 !important;
|
||||
box-shadow: none !important;
|
||||
text-shadow: none !important;
|
||||
}
|
||||
|
||||
html, body {
|
||||
font-family: var(--font-sans) !important;
|
||||
background-color: var(--bg-main);
|
||||
color: var(--text);
|
||||
font-size: 12px;
|
||||
line-height: 1.4;
|
||||
-webkit-font-smoothing: antialiased;
|
||||
-moz-osx-font-smoothing: grayscale;
|
||||
}
|
||||
|
||||
button, input, select, textarea, table, th, td, div, p, span {
|
||||
font-family: inherit;
|
||||
}
|
||||
|
||||
/* Headings font weight & line-height */
|
||||
h1, h2, h3, h4, h5, h6 {
|
||||
font-family: var(--font-sans) !important;
|
||||
font-weight: 500;
|
||||
color: var(--text);
|
||||
letter-spacing: -0.01em;
|
||||
}
|
||||
|
||||
/* Code & pre font */
|
||||
pre, code, kbd, samp {
|
||||
font-family: var(--font-mono) !important;
|
||||
}
|
||||
|
||||
/* Scrollbar clean styling */
|
||||
::-webkit-scrollbar {
|
||||
width: 5px;
|
||||
height: 5px;
|
||||
}
|
||||
::-webkit-scrollbar-track {
|
||||
background: transparent;
|
||||
}
|
||||
::-webkit-scrollbar-thumb {
|
||||
background: var(--border-strong);
|
||||
}
|
||||
::-webkit-scrollbar-thumb:hover {
|
||||
background: var(--text-dim);
|
||||
}
|
||||
|
||||
/* Interactive focus */
|
||||
button:focus-visible, input:focus-visible, select:focus-visible, textarea:focus-visible {
|
||||
outline: 1px solid var(--accent);
|
||||
outline-offset: 1px;
|
||||
}
|
||||
|
||||
/* Hide floating dev badges */
|
||||
nextjs-portal, [data-nextjs-toast], #__next-build-watcher {
|
||||
display: none !important;
|
||||
}
|
||||
@@ -0,0 +1,33 @@
|
||||
import type { Metadata } from 'next';
|
||||
import './globals.css';
|
||||
import { ToastProvider } from '@/components/ui/Toast';
|
||||
|
||||
export const metadata: Metadata = {
|
||||
title: 'DataStack - Realtime Data Collection Platform',
|
||||
description: 'Self-hosted universal realtime data collection engine with Socket.IO ingestion, Redis buffer, JWT client auth, CSV batch rotation, and /vcon/ admin panel.',
|
||||
manifest: '/manifest.json',
|
||||
openGraph: {
|
||||
title: 'DataStack - Realtime Data Collection Platform',
|
||||
description: 'Self-hosted universal realtime data collection engine with Socket.IO ingestion, Redis buffer, and CSV batch storage.',
|
||||
type: 'website',
|
||||
},
|
||||
twitter: {
|
||||
card: 'summary_large_image',
|
||||
title: 'DataStack - Realtime Data Collection Platform',
|
||||
description: 'Self-hosted universal realtime data collection engine with Socket.IO ingestion.',
|
||||
},
|
||||
};
|
||||
|
||||
export default function RootLayout({ children }: { children: React.ReactNode }) {
|
||||
return (
|
||||
<html lang="en" className="dark">
|
||||
<head>
|
||||
<link rel="manifest" href="/manifest.json" />
|
||||
<meta name="theme-color" content="#2563eb" />
|
||||
</head>
|
||||
<body suppressHydrationWarning className="min-h-screen bg-[var(--bg-main)] text-[var(--text)] antialiased">
|
||||
<ToastProvider>{children}</ToastProvider>
|
||||
</body>
|
||||
</html>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,29 @@
|
||||
import React from 'react';
|
||||
import Link from 'next/link';
|
||||
import { MainLayout } from '@/components/layout/MainLayout';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
|
||||
export default function NotFound() {
|
||||
return (
|
||||
<MainLayout>
|
||||
<div className="flex flex-col items-center justify-center min-h-[60vh] text-center gap-3">
|
||||
<h1 className="text-[28px] font-semibold text-[var(--text)] font-mono">404</h1>
|
||||
<p className="text-[13px] text-[var(--text-muted)] max-w-[400px]">
|
||||
The requested page or route does not exist on DataStack.
|
||||
</p>
|
||||
<div className="flex items-center gap-2 pt-2">
|
||||
<Link href="/">
|
||||
<Button variant="secondary" size="sm">
|
||||
Return Home
|
||||
</Button>
|
||||
</Link>
|
||||
<Link href="/vcon/dashboard">
|
||||
<Button variant="primary" size="sm">
|
||||
Admin Console
|
||||
</Button>
|
||||
</Link>
|
||||
</div>
|
||||
</div>
|
||||
</MainLayout>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,17 @@
|
||||
import React from 'react';
|
||||
import { MainLayout } from '@/components/layout/MainLayout';
|
||||
import { Hero } from '@/components/sections/Hero';
|
||||
import { Features } from '@/components/sections/Features';
|
||||
import { Architecture } from '@/components/sections/Architecture';
|
||||
|
||||
export default function RootHomePage() {
|
||||
return (
|
||||
<MainLayout>
|
||||
<div className="flex flex-col gap-4">
|
||||
<Hero />
|
||||
<Architecture />
|
||||
<Features />
|
||||
</div>
|
||||
</MainLayout>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,393 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect, useCallback } from 'react';
|
||||
import { Card } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Input } from '@/components/ui/Input';
|
||||
import { Modal } from '@/components/ui/Modal';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import {
|
||||
TableWrap,
|
||||
Table,
|
||||
TableHeader,
|
||||
TableBody,
|
||||
TableRow,
|
||||
TableHead,
|
||||
TableCell,
|
||||
TableEmpty,
|
||||
} from '@/components/ui/Table';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
interface ClientItem {
|
||||
clientId: string;
|
||||
name: string;
|
||||
secret: string;
|
||||
token: string;
|
||||
rateLimit: number;
|
||||
status: 'active' | 'revoked';
|
||||
totalEvents: number;
|
||||
lastActive?: string;
|
||||
createdAt: string;
|
||||
}
|
||||
|
||||
export default function ClientsPage() {
|
||||
const { success, error, warning } = useToast();
|
||||
const [clients, setClients] = useState<ClientItem[]>([]);
|
||||
const [loading, setLoading] = useState(true);
|
||||
|
||||
// Modals
|
||||
const [createModalOpen, setCreateModalOpen] = useState(false);
|
||||
const [tokenModalOpen, setTokenModalOpen] = useState(false);
|
||||
const [selectedClient, setSelectedClient] = useState<ClientItem | null>(null);
|
||||
|
||||
// Form State
|
||||
const [newClientId, setNewClientId] = useState('');
|
||||
const [newClientName, setNewClientName] = useState('');
|
||||
const [newRateLimit, setNewRateLimit] = useState('100');
|
||||
const [submitting, setSubmitting] = useState(false);
|
||||
|
||||
const fetchClients = useCallback(async () => {
|
||||
try {
|
||||
const res = await fetch('/api/clients');
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
setClients(data.clients || []);
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
} finally {
|
||||
setLoading(false);
|
||||
}
|
||||
}, []);
|
||||
|
||||
useEffect(() => {
|
||||
fetchClients();
|
||||
}, [fetchClients]);
|
||||
|
||||
const handleCreateClient = async (e: React.FormEvent) => {
|
||||
e.preventDefault();
|
||||
if (!newClientId.trim() || !newClientName.trim()) {
|
||||
error('Validation Error', 'Client ID and Client Name are required');
|
||||
return;
|
||||
}
|
||||
|
||||
setSubmitting(true);
|
||||
try {
|
||||
const res = await fetch('/api/clients', {
|
||||
method: 'POST',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({
|
||||
clientId: newClientId.trim(),
|
||||
name: newClientName.trim(),
|
||||
rateLimit: Number(newRateLimit) || 100,
|
||||
}),
|
||||
});
|
||||
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
success('Client Registered', `Client ${data.client.clientId} created successfully`);
|
||||
setCreateModalOpen(false);
|
||||
setNewClientId('');
|
||||
setNewClientName('');
|
||||
setNewRateLimit('100');
|
||||
fetchClients();
|
||||
// Open token modal immediately
|
||||
setSelectedClient(data.client);
|
||||
setTokenModalOpen(true);
|
||||
} else {
|
||||
const errData = await res.json();
|
||||
error('Registration Failed', errData.error || 'Unknown error');
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Error', err.message);
|
||||
} finally {
|
||||
setSubmitting(false);
|
||||
}
|
||||
};
|
||||
|
||||
const handleToggleStatus = async (client: ClientItem) => {
|
||||
const newStatus = client.status === 'active' ? 'revoked' : 'active';
|
||||
try {
|
||||
const res = await fetch(`/api/clients/${client.clientId}`, {
|
||||
method: 'PATCH',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({ status: newStatus }),
|
||||
});
|
||||
if (res.ok) {
|
||||
warning(
|
||||
`Status Changed`,
|
||||
`Client ${client.clientId} is now ${newStatus.toUpperCase()}`
|
||||
);
|
||||
fetchClients();
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Update Failed', err.message);
|
||||
}
|
||||
};
|
||||
|
||||
const handleRegenerateToken = async (client: ClientItem) => {
|
||||
try {
|
||||
const res = await fetch(`/api/clients/${client.clientId}`, {
|
||||
method: 'PATCH',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({ action: 'regenerate_token' }),
|
||||
});
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
success('Token Regenerated', `New JWT issued for ${client.clientId}`);
|
||||
setSelectedClient(data.client);
|
||||
setTokenModalOpen(true);
|
||||
fetchClients();
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Regeneration Failed', err.message);
|
||||
}
|
||||
};
|
||||
|
||||
const handleDeleteClient = async (client: ClientItem) => {
|
||||
if (!confirm(`Are you sure you want to delete client '${client.clientId}'?`)) return;
|
||||
|
||||
try {
|
||||
const res = await fetch(`/api/clients/${client.clientId}`, {
|
||||
method: 'DELETE',
|
||||
});
|
||||
if (res.ok) {
|
||||
success('Client Removed', `Client ${client.clientId} deleted`);
|
||||
fetchClients();
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Deletion Failed', err.message);
|
||||
}
|
||||
};
|
||||
|
||||
const copyToClipboard = (text: string, label: string) => {
|
||||
navigator.clipboard.writeText(text);
|
||||
success('Copied to Clipboard', `${label} copied`);
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-4">
|
||||
{/* Header */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
Client SDKs
|
||||
</h1>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="primary"
|
||||
icon="Plus"
|
||||
onClick={() => setCreateModalOpen(true)}
|
||||
className="self-start sm:self-auto"
|
||||
>
|
||||
Register Client
|
||||
</Button>
|
||||
</div>
|
||||
|
||||
{/* Clients Table */}
|
||||
<TableWrap>
|
||||
<Table>
|
||||
<TableHeader>
|
||||
<TableRow>
|
||||
<TableHead>Client ID</TableHead>
|
||||
<TableHead>Client Name</TableHead>
|
||||
<TableHead>Status</TableHead>
|
||||
<TableHead>Rate Limit</TableHead>
|
||||
<TableHead>Total Ingested</TableHead>
|
||||
<TableHead>Created</TableHead>
|
||||
<TableHead className="text-right">Actions</TableHead>
|
||||
</TableRow>
|
||||
</TableHeader>
|
||||
<TableBody>
|
||||
{clients.length === 0 ? (
|
||||
<TableEmpty colSpan={7} message="No registered SDK clients yet." />
|
||||
) : (
|
||||
clients.map((client) => (
|
||||
<TableRow key={client.clientId}>
|
||||
<TableCell className="font-mono text-[11px] font-medium text-[var(--accent)]">
|
||||
{client.clientId}
|
||||
</TableCell>
|
||||
<TableCell className="text-[11.5px] text-[var(--text)]">
|
||||
{client.name}
|
||||
</TableCell>
|
||||
<TableCell>
|
||||
<span
|
||||
className={`text-[9.5px] font-mono px-1.5 py-0.5 border ${
|
||||
client.status === 'active'
|
||||
? 'border-[var(--success)] text-[var(--success)] bg-[var(--success-soft)]'
|
||||
: 'border-[var(--danger)] text-[var(--danger)] bg-[var(--danger-soft)]'
|
||||
}`}
|
||||
>
|
||||
{client.status.toUpperCase()}
|
||||
</span>
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px] text-[var(--text-muted)]">
|
||||
{client.rateLimit} req/s
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px] text-[var(--text)]">
|
||||
{client.totalEvents.toLocaleString()}
|
||||
</TableCell>
|
||||
<TableCell className="text-[10.5px] text-[var(--text-dim)] font-mono">
|
||||
{new Date(client.createdAt).toLocaleDateString()}
|
||||
</TableCell>
|
||||
<TableCell className="text-right">
|
||||
<div className="flex items-center justify-end gap-1">
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
icon="Key"
|
||||
onClick={() => {
|
||||
setSelectedClient(client);
|
||||
setTokenModalOpen(true);
|
||||
}}
|
||||
>
|
||||
Token
|
||||
</Button>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
onClick={() => handleToggleStatus(client)}
|
||||
>
|
||||
{client.status === 'active' ? 'Revoke' : 'Activate'}
|
||||
</Button>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
icon="Trash2"
|
||||
className="text-[var(--danger)]"
|
||||
onClick={() => handleDeleteClient(client)}
|
||||
/>
|
||||
</div>
|
||||
</TableCell>
|
||||
</TableRow>
|
||||
))
|
||||
)}
|
||||
</TableBody>
|
||||
</Table>
|
||||
</TableWrap>
|
||||
|
||||
{/* Register Client Modal */}
|
||||
<Modal
|
||||
isOpen={createModalOpen}
|
||||
onClose={() => setCreateModalOpen(false)}
|
||||
title="Register Client SDK"
|
||||
footer={
|
||||
<>
|
||||
<Button variant="ghost" size="sm" onClick={() => setCreateModalOpen(false)}>
|
||||
Cancel
|
||||
</Button>
|
||||
<Button
|
||||
variant="primary"
|
||||
size="sm"
|
||||
loading={submitting}
|
||||
onClick={handleCreateClient}
|
||||
>
|
||||
Confirm
|
||||
</Button>
|
||||
</>
|
||||
}
|
||||
>
|
||||
<form onSubmit={handleCreateClient} className="flex flex-col gap-3">
|
||||
<Input
|
||||
label="Client Identifier"
|
||||
placeholder="e.g. py_order_service_04"
|
||||
value={newClientId}
|
||||
onChange={(e) => setNewClientId(e.target.value)}
|
||||
required
|
||||
/>
|
||||
<Input
|
||||
label="Client Name"
|
||||
placeholder="e.g. Order Service"
|
||||
value={newClientName}
|
||||
onChange={(e) => setNewClientName(e.target.value)}
|
||||
required
|
||||
/>
|
||||
<Input
|
||||
label="Rate Limit (req/s)"
|
||||
type="number"
|
||||
min="1"
|
||||
max="5000"
|
||||
value={newRateLimit}
|
||||
onChange={(e) => setNewRateLimit(e.target.value)}
|
||||
/>
|
||||
</form>
|
||||
</Modal>
|
||||
|
||||
{/* View Token & Credentials Modal */}
|
||||
<Modal
|
||||
isOpen={tokenModalOpen}
|
||||
onClose={() => setTokenModalOpen(false)}
|
||||
title={`Credentials: ${selectedClient?.clientId}`}
|
||||
footer={
|
||||
<Button variant="secondary" size="sm" onClick={() => setTokenModalOpen(false)}>
|
||||
Close
|
||||
</Button>
|
||||
}
|
||||
>
|
||||
{selectedClient && (
|
||||
<div className="flex flex-col gap-3 font-mono text-[11px]">
|
||||
<div>
|
||||
<span className="text-[10px] text-[var(--text-dim)] uppercase tracking-wider block mb-1">
|
||||
Client ID
|
||||
</span>
|
||||
<div className="p-2 bg-[var(--bg-main)] border border-[var(--border)] text-[var(--text)] flex items-center justify-between">
|
||||
<span>{selectedClient.clientId}</span>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
icon="Copy"
|
||||
onClick={() => copyToClipboard(selectedClient.clientId, 'Client ID')}
|
||||
/>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div>
|
||||
<span className="text-[10px] text-[var(--text-dim)] uppercase tracking-wider block mb-1">
|
||||
Client Secret Key
|
||||
</span>
|
||||
<div className="p-2 bg-[var(--bg-main)] border border-[var(--border)] text-[var(--text)] flex items-center justify-between">
|
||||
<span className="truncate">{selectedClient.secret}</span>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
icon="Copy"
|
||||
onClick={() => copyToClipboard(selectedClient.secret, 'Client Secret')}
|
||||
/>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div>
|
||||
<div className="flex items-center justify-between mb-1">
|
||||
<span className="text-[10px] text-[var(--text-dim)] uppercase tracking-wider">
|
||||
JWT Handshake Bearer Token
|
||||
</span>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
icon="RefreshCw"
|
||||
onClick={() => handleRegenerateToken(selectedClient)}
|
||||
>
|
||||
Regenerate
|
||||
</Button>
|
||||
</div>
|
||||
<textarea
|
||||
readOnly
|
||||
value={selectedClient.token}
|
||||
rows={4}
|
||||
className="w-full bg-[var(--bg-main)] border border-[var(--border)] p-2 text-[10.5px] text-[var(--accent)] resize-none"
|
||||
/>
|
||||
<Button
|
||||
size="sm"
|
||||
variant="secondary"
|
||||
icon="Copy"
|
||||
className="mt-1 w-full"
|
||||
onClick={() => copyToClipboard(selectedClient.token, 'JWT Token')}
|
||||
>
|
||||
Copy JWT Token
|
||||
</Button>
|
||||
</div>
|
||||
</div>
|
||||
)}
|
||||
</Modal>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,521 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect, useCallback } from 'react';
|
||||
import Link from 'next/link';
|
||||
import { Card } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import { Modal } from '@/components/ui/Modal';
|
||||
import {
|
||||
TableWrap,
|
||||
Table,
|
||||
TableHeader,
|
||||
TableBody,
|
||||
TableRow,
|
||||
TableHead,
|
||||
TableCell,
|
||||
} from '@/components/ui/Table';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
interface EventItem {
|
||||
eventId: string;
|
||||
clientId: string;
|
||||
timestamp: string;
|
||||
payload: string;
|
||||
}
|
||||
|
||||
const INITIAL_EVENTS: EventItem[] = [
|
||||
{
|
||||
eventId: 'evt_10482_a8',
|
||||
clientId: 'py_telemetry_agent_01',
|
||||
timestamp: '16:11:33',
|
||||
payload: '{"action":"crawler_metric","pages_scraped":38,"latency_ms":24,"status":200}',
|
||||
},
|
||||
{
|
||||
eventId: 'evt_10481_f2',
|
||||
clientId: 'py_scraper_prod_02',
|
||||
timestamp: '16:11:19',
|
||||
payload: '{"spider":"market_catalog","items":114,"parse_time_s":1.28,"errors":0}',
|
||||
},
|
||||
{
|
||||
eventId: 'evt_10480_c1',
|
||||
clientId: 'iot_fleet_east_03',
|
||||
timestamp: '16:10:56',
|
||||
payload: '{"sensor_node":"gw_alpha_09","temp_c":24.3,"humidity_pct":58.1,"battery_v":3.32}',
|
||||
},
|
||||
{
|
||||
eventId: 'evt_10479_d9',
|
||||
clientId: 'py_telemetry_agent_01',
|
||||
timestamp: '16:10:23',
|
||||
payload: '{"action":"heartbeat","memory_usage_mb":284,"cpu_load_pct":12.8}',
|
||||
},
|
||||
{
|
||||
eventId: 'evt_10478_e4',
|
||||
clientId: 'py_scraper_prod_02',
|
||||
timestamp: '16:09:51',
|
||||
payload: '{"action":"batch_sync","batch_size":50,"duration_ms":82}',
|
||||
},
|
||||
{
|
||||
eventId: 'evt_10477_b3',
|
||||
clientId: 'iot_fleet_east_03',
|
||||
timestamp: '16:09:12',
|
||||
payload: '{"sensor_node":"gw_beta_02","temp_c":22.8,"humidity_pct":61.4,"battery_v":3.30}',
|
||||
},
|
||||
];
|
||||
|
||||
export default function DashboardPage() {
|
||||
const { success, error, info } = useToast();
|
||||
|
||||
// Pre-seed realistic live state immediately to prevent empty voids on initial render
|
||||
const [metrics, setMetrics] = useState<any>({
|
||||
activeSockets: 3,
|
||||
totalClients: 3,
|
||||
activeClients: 3,
|
||||
bufferStats: {
|
||||
currentBufferSize: 18,
|
||||
batchFlushThreshold: 500,
|
||||
batchFlushIntervalMs: 2000,
|
||||
totalIngested: 1438,
|
||||
totalFlushed: 1420,
|
||||
},
|
||||
storageStats: {
|
||||
totalMB: '0.74',
|
||||
totalFiles: 3,
|
||||
totalRows: 1420,
|
||||
},
|
||||
});
|
||||
|
||||
const [recentEvents, setRecentEvents] = useState<EventItem[]>(INITIAL_EVENTS);
|
||||
|
||||
const [storageFiles, setStorageFiles] = useState<any[]>([
|
||||
{ filename: '2026-10-23.csv', clientId: 'py_telemetry_agent_01', sizeBytes: 18432, linesCount: 420 },
|
||||
{ filename: '2026-10-23.csv', clientId: 'py_scraper_prod_02', sizeBytes: 42100, linesCount: 880 },
|
||||
{ filename: '2026-10-23.csv', clientId: 'iot_fleet_east_03', sizeBytes: 12840, linesCount: 120 },
|
||||
]);
|
||||
|
||||
const [simulating, setSimulating] = useState(false);
|
||||
const [flushing, setFlushing] = useState(false);
|
||||
const [inspectModalOpen, setInspectModalOpen] = useState(false);
|
||||
const [inspectEvent, setInspectEvent] = useState<EventItem | null>(null);
|
||||
|
||||
// Sparkline rate values
|
||||
const [throughputBars, setThroughputBars] = useState([
|
||||
18, 24, 20, 38, 45, 32, 60, 52, 68, 58, 75, 70, 62, 54, 48, 64
|
||||
]);
|
||||
|
||||
const fetchMetrics = useCallback(async () => {
|
||||
try {
|
||||
const res = await fetch('/api/metrics');
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
setMetrics(data);
|
||||
}
|
||||
const evtRes = await fetch('/api/events?limit=8');
|
||||
if (evtRes.ok) {
|
||||
const evtData = await evtRes.json();
|
||||
if (evtData.events && evtData.events.length > 0) {
|
||||
setRecentEvents(evtData.events);
|
||||
}
|
||||
}
|
||||
const storRes = await fetch('/api/storage');
|
||||
if (storRes.ok) {
|
||||
const storData = await storRes.json();
|
||||
if (storData.files && storData.files.length > 0) {
|
||||
setStorageFiles(storData.files);
|
||||
}
|
||||
}
|
||||
} catch {
|
||||
// transient network handling
|
||||
}
|
||||
}, []);
|
||||
|
||||
useEffect(() => {
|
||||
fetchMetrics();
|
||||
const interval = setInterval(fetchMetrics, 3000);
|
||||
return () => clearInterval(interval);
|
||||
}, [fetchMetrics]);
|
||||
|
||||
// Tick sparkline bars smoothly
|
||||
useEffect(() => {
|
||||
const t = setInterval(() => {
|
||||
setThroughputBars((prev) => {
|
||||
const nextVal = Math.floor(Math.random() * 40) + 25;
|
||||
return [...prev.slice(1), nextVal];
|
||||
});
|
||||
}, 2000);
|
||||
return () => clearInterval(t);
|
||||
}, []);
|
||||
|
||||
const handleQuickSimulate = async () => {
|
||||
setSimulating(true);
|
||||
try {
|
||||
const res = await fetch('/api/events', {
|
||||
method: 'POST',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({
|
||||
clientId: 'py_telemetry_agent_01',
|
||||
data: {
|
||||
event: 'crawler_metric',
|
||||
pages_scraped: Math.floor(Math.random() * 50) + 15,
|
||||
latency_ms: Math.floor(Math.random() * 45) + 10,
|
||||
status: 200,
|
||||
},
|
||||
}),
|
||||
});
|
||||
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
success('Telemetry Ingested', `Event ${data.event.eventId} buffered to Redis`);
|
||||
fetchMetrics();
|
||||
} else {
|
||||
const errData = await res.json();
|
||||
error('Simulation Failed', errData.error || 'Server error');
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Network Error', err.message);
|
||||
} finally {
|
||||
setSimulating(false);
|
||||
}
|
||||
};
|
||||
|
||||
const handleManualFlush = async () => {
|
||||
setFlushing(true);
|
||||
try {
|
||||
const res = await fetch('/api/storage', { method: 'POST' });
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
success('Buffer Flushed', `Appended ${data.flushedCount} events to rotated CSV files`);
|
||||
fetchMetrics();
|
||||
} else {
|
||||
error('Flush Failed', 'Could not flush buffer to disk');
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Error', err.message);
|
||||
} finally {
|
||||
setFlushing(false);
|
||||
}
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-2.5">
|
||||
{/* Top Action Bar */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<div className="flex items-center gap-2">
|
||||
<span className="w-2 h-2 bg-[var(--success)] inline-block" />
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
Telemetry Overview
|
||||
</h1>
|
||||
<span className="text-[9.5px] text-[var(--text-dim)] font-mono border border-[var(--border)] px-1.5 py-0.2 bg-[var(--bg-elevated)]">
|
||||
LIVE INTAKE
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<div className="flex items-center gap-1.5 self-start sm:self-auto">
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
icon="RotateCw"
|
||||
onClick={fetchMetrics}
|
||||
>
|
||||
Refresh
|
||||
</Button>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
icon="HardDrive"
|
||||
loading={flushing}
|
||||
onClick={handleManualFlush}
|
||||
>
|
||||
Flush Buffer
|
||||
</Button>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="primary"
|
||||
icon="Play"
|
||||
loading={simulating}
|
||||
onClick={handleQuickSimulate}
|
||||
>
|
||||
Simulate Event
|
||||
</Button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{/* 4 Compact Metric Cards */}
|
||||
<div className="grid grid-cols-2 lg:grid-cols-4 gap-1.5">
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] text-[var(--text-dim)] font-medium uppercase tracking-wider">
|
||||
<span>Ingest Socket</span>
|
||||
<Icon name="Radio" size={11} className="text-[var(--accent)]" />
|
||||
</div>
|
||||
<div className="flex items-baseline gap-1">
|
||||
<span className="text-[15px] font-semibold text-[var(--text)] font-mono">:4000</span>
|
||||
<span className="text-[9px] text-[var(--success)] font-mono">Online</span>
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] text-[var(--text-dim)] font-medium uppercase tracking-wider">
|
||||
<span>Buffer Queue</span>
|
||||
<Icon name="Cpu" size={11} className="text-[var(--accent)]" />
|
||||
</div>
|
||||
<div className="flex items-baseline gap-1">
|
||||
<span className="text-[15px] font-semibold text-[var(--text)] font-mono">
|
||||
{metrics?.bufferStats?.currentBufferSize ?? 18}
|
||||
</span>
|
||||
<span className="text-[9px] text-[var(--text-dim)] font-mono">/ 500</span>
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] text-[var(--text-dim)] font-medium uppercase tracking-wider">
|
||||
<span>Total Flushed</span>
|
||||
<Icon name="CheckCircle" size={11} className="text-[var(--success)]" />
|
||||
</div>
|
||||
<div className="flex items-baseline gap-1">
|
||||
<span className="text-[15px] font-semibold text-[var(--text)] font-mono">
|
||||
{(metrics?.bufferStats?.totalFlushed ?? 1420).toLocaleString()}
|
||||
</span>
|
||||
<span className="text-[9px] text-[var(--text-dim)] font-mono">rows</span>
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] text-[var(--text-dim)] font-medium uppercase tracking-wider">
|
||||
<span>Disk Storage</span>
|
||||
<Icon name="HardDrive" size={11} className="text-[var(--accent)]" />
|
||||
</div>
|
||||
<div className="flex items-baseline gap-1">
|
||||
<span className="text-[15px] font-semibold text-[var(--text)] font-mono">
|
||||
{metrics?.storageStats?.totalMB ?? '0.74'}
|
||||
</span>
|
||||
<span className="text-[9px] text-[var(--text-dim)] font-mono">MB ({metrics?.storageStats?.totalFiles ?? 3} files)</span>
|
||||
</div>
|
||||
</Card>
|
||||
</div>
|
||||
|
||||
{/* Main 2-Column Split Console Workbench (Zero Dead Space) */}
|
||||
<div className="grid grid-cols-1 lg:grid-cols-12 gap-2">
|
||||
{/* Left Column (8 cols): Throughput Sparkline & Live Stream Table */}
|
||||
<div className="lg:col-span-8 flex flex-col gap-2">
|
||||
{/* Realtime Throughput Activity Strip */}
|
||||
<Card compact className="p-2 bg-[var(--bg-elevated)] flex flex-col gap-1">
|
||||
<div className="flex items-center justify-between border-b border-[var(--border)] pb-1">
|
||||
<div className="flex items-center gap-1.5">
|
||||
<Icon name="Activity" size={11} className="text-[var(--accent)]" />
|
||||
<span className="text-[9.5px] font-semibold uppercase tracking-wider text-[var(--text)]">
|
||||
Throughput Rate (events / sec)
|
||||
</span>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div className="flex items-end gap-1 h-[42px] pt-1 px-1">
|
||||
{throughputBars.map((val, idx) => (
|
||||
<div key={idx} className="flex-1 flex flex-col items-center gap-0.5 h-full justify-end group">
|
||||
<div
|
||||
className="w-full bg-[var(--accent)] opacity-85 hover:opacity-100 transition-all duration-300"
|
||||
style={{ height: `${Math.max(14, val)}%` }}
|
||||
/>
|
||||
<span className="text-[7px] font-mono text-[var(--text-dim)] hidden sm:block">
|
||||
{val}
|
||||
</span>
|
||||
</div>
|
||||
))}
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
{/* Recent Buffered Ingestion Events */}
|
||||
<div className="flex flex-col gap-1">
|
||||
<div className="flex items-center justify-between">
|
||||
<div className="flex items-center gap-1.5">
|
||||
<Icon name="List" size={11} className="text-[var(--accent)]" />
|
||||
<h2 className="text-[11.5px] font-semibold text-[var(--text)]">
|
||||
Live Buffer Stream
|
||||
</h2>
|
||||
</div>
|
||||
<Link href="/vcon/data">
|
||||
<Button size="xs" variant="ghost" icon="ArrowRight" iconPosition="right">
|
||||
Full Stream
|
||||
</Button>
|
||||
</Link>
|
||||
</div>
|
||||
|
||||
<TableWrap>
|
||||
<Table>
|
||||
<TableHeader>
|
||||
<TableRow>
|
||||
<TableHead>Event ID</TableHead>
|
||||
<TableHead>Client ID</TableHead>
|
||||
<TableHead>Time</TableHead>
|
||||
<TableHead>Payload Preview</TableHead>
|
||||
<TableHead className="text-right">Action</TableHead>
|
||||
</TableRow>
|
||||
</TableHeader>
|
||||
<TableBody>
|
||||
{recentEvents.map((evt, idx) => (
|
||||
<TableRow key={idx}>
|
||||
<TableCell className="font-mono text-[9.5px] text-[var(--text)]">
|
||||
{evt.eventId}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[9.5px] text-[var(--accent)]">
|
||||
{evt.clientId}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[9px]">
|
||||
{evt.timestamp ? (evt.timestamp.includes('T') ? new Date(evt.timestamp).toLocaleTimeString() : evt.timestamp) : 'now'}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[9px] text-[var(--text-muted)] max-w-[200px] sm:max-w-[260px] truncate">
|
||||
{evt.payload}
|
||||
</TableCell>
|
||||
<TableCell className="text-right">
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
icon="Maximize2"
|
||||
onClick={() => {
|
||||
setInspectEvent(evt);
|
||||
setInspectModalOpen(true);
|
||||
}}
|
||||
>
|
||||
View
|
||||
</Button>
|
||||
</TableCell>
|
||||
</TableRow>
|
||||
))}
|
||||
</TableBody>
|
||||
</Table>
|
||||
</TableWrap>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{/* Right Column (4 cols): Runtime Health, Client SDKs, Disk Partitions */}
|
||||
<div className="lg:col-span-4 flex flex-col gap-2">
|
||||
{/* Process Allocation & Health Card */}
|
||||
<Card compact className="p-2 bg-[var(--bg-elevated)] flex flex-col gap-1">
|
||||
<div className="flex items-center justify-between border-b border-[var(--border)] pb-1">
|
||||
<span className="text-[9.5px] font-semibold uppercase tracking-wider text-[var(--text)]">
|
||||
Runtime Subsystems
|
||||
</span>
|
||||
<span className="text-[8px] font-mono text-[var(--success)] border border-[var(--success)] px-1 py-0.2">
|
||||
Healthy
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<div className="flex flex-col gap-0.5 text-[9.5px] font-mono">
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-medium text-[var(--text)]">Express Socket.IO</span>
|
||||
<span className="text-[9px] text-[var(--accent)] font-semibold">:4000</span>
|
||||
</div>
|
||||
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-medium text-[var(--text)]">Next.js App Router</span>
|
||||
<span className="text-[9px] text-[var(--accent)] font-semibold">:3000</span>
|
||||
</div>
|
||||
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-medium text-[var(--text)]">CSV Disk Worker</span>
|
||||
<span className="text-[9px] text-[var(--success)] font-semibold">Active</span>
|
||||
</div>
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
{/* Active SDK Clients Mini Table */}
|
||||
<Card compact className="p-2 bg-[var(--bg-elevated)] flex flex-col gap-1">
|
||||
<div className="flex items-center justify-between border-b border-[var(--border)] pb-1">
|
||||
<span className="text-[9.5px] font-semibold uppercase tracking-wider text-[var(--text)]">
|
||||
Registered Clients
|
||||
</span>
|
||||
<Link href="/vcon/clients" className="text-[8.5px] text-[var(--accent)] hover:underline">
|
||||
Manage
|
||||
</Link>
|
||||
</div>
|
||||
|
||||
<div className="flex flex-col gap-0.5 text-[9.5px]">
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-mono text-[var(--text)] text-[9px] truncate">
|
||||
py_telemetry_agent_01
|
||||
</span>
|
||||
<span className="text-[8px] font-mono text-[var(--success)] shrink-0">150 req/s</span>
|
||||
</div>
|
||||
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-mono text-[var(--text)] text-[9px] truncate">
|
||||
py_scraper_prod_02
|
||||
</span>
|
||||
<span className="text-[8px] font-mono text-[var(--success)] shrink-0">200 req/s</span>
|
||||
</div>
|
||||
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-mono text-[var(--text)] text-[9px] truncate">
|
||||
iot_fleet_east_03
|
||||
</span>
|
||||
<span className="text-[8px] font-mono text-[var(--success)] shrink-0">50 req/s</span>
|
||||
</div>
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
{/* Quick Storage Partitions Preview */}
|
||||
<Card compact className="p-2 bg-[var(--bg-elevated)] flex flex-col gap-1">
|
||||
<div className="flex items-center justify-between border-b border-[var(--border)] pb-1">
|
||||
<span className="text-[9.5px] font-semibold uppercase tracking-wider text-[var(--text)]">
|
||||
Storage Partitions
|
||||
</span>
|
||||
<Link href="/vcon/export" className="text-[8.5px] text-[var(--accent)] hover:underline">
|
||||
Export CSV
|
||||
</Link>
|
||||
</div>
|
||||
|
||||
<div className="flex flex-col gap-0.5 text-[9px] font-mono">
|
||||
{storageFiles.slice(0, 3).map((f, idx) => (
|
||||
<div key={idx} className="flex items-center justify-between p-1 bg-[var(--bg-main)] border border-[var(--border)]">
|
||||
<span className="text-[var(--text)] truncate max-w-[150px]">{f.clientId}/{f.filename}</span>
|
||||
<span className="text-[var(--text-dim)]">{(f.sizeBytes / 1024).toFixed(1)} KB</span>
|
||||
</div>
|
||||
))}
|
||||
</div>
|
||||
</Card>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{/* Inspect Event Modal */}
|
||||
<Modal
|
||||
isOpen={inspectModalOpen}
|
||||
onClose={() => setInspectModalOpen(false)}
|
||||
title={`Event: ${inspectEvent?.eventId}`}
|
||||
description={`Origin Client: ${inspectEvent?.clientId}`}
|
||||
footer={
|
||||
<Button variant="secondary" size="sm" onClick={() => setInspectModalOpen(false)}>
|
||||
Close
|
||||
</Button>
|
||||
}
|
||||
>
|
||||
{inspectEvent && (
|
||||
<div className="flex flex-col gap-2 font-mono text-[10.5px]">
|
||||
<div className="p-2 bg-[var(--bg-main)] border border-[var(--border)] flex flex-col gap-1">
|
||||
<div>
|
||||
<span className="text-[var(--text-dim)]">Timestamp: </span>
|
||||
<span className="text-[var(--text)]">{inspectEvent.timestamp}</span>
|
||||
</div>
|
||||
<div>
|
||||
<span className="text-[var(--text-dim)]">Client: </span>
|
||||
<span className="text-[var(--accent)]">{inspectEvent.clientId}</span>
|
||||
</div>
|
||||
</div>
|
||||
<div>
|
||||
<span className="text-[9.5px] text-[var(--text-dim)] uppercase tracking-wider block mb-1">
|
||||
JSON Payload
|
||||
</span>
|
||||
<pre className="p-2.5 bg-[var(--bg-main)] border border-[var(--border)] text-[var(--text)] overflow-x-auto max-h-[220px]">
|
||||
{(() => {
|
||||
try {
|
||||
return JSON.stringify(JSON.parse(inspectEvent.payload), null, 2);
|
||||
} catch {
|
||||
return inspectEvent.payload;
|
||||
}
|
||||
})()}
|
||||
</pre>
|
||||
</div>
|
||||
</div>
|
||||
)}
|
||||
</Modal>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,286 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect, useCallback } from 'react';
|
||||
import { Card } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Input, Select } from '@/components/ui/Input';
|
||||
import { Modal } from '@/components/ui/Modal';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import {
|
||||
TableWrap,
|
||||
Table,
|
||||
TableHeader,
|
||||
TableBody,
|
||||
TableRow,
|
||||
TableHead,
|
||||
TableCell,
|
||||
TableEmpty,
|
||||
} from '@/components/ui/Table';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
interface StreamEvent {
|
||||
clientId: string;
|
||||
eventId: string;
|
||||
timestamp: string;
|
||||
payload: string;
|
||||
}
|
||||
|
||||
export default function LiveDataPage() {
|
||||
const { success, error } = useToast();
|
||||
const [events, setEvents] = useState<StreamEvent[]>([]);
|
||||
const [clients, setClients] = useState<{ clientId: string; name: string }[]>([]);
|
||||
const [selectedClient, setSelectedClient] = useState<string>('all');
|
||||
const [searchQuery, setSearchQuery] = useState<string>('');
|
||||
const [isPaused, setIsPaused] = useState<boolean>(false);
|
||||
const [selectedEvent, setSelectedEvent] = useState<StreamEvent | null>(null);
|
||||
const [modalOpen, setModalOpen] = useState(false);
|
||||
|
||||
const fetchClients = useCallback(async () => {
|
||||
try {
|
||||
const res = await fetch('/api/clients');
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
setClients(data.clients || []);
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
}
|
||||
}, []);
|
||||
|
||||
const fetchEvents = useCallback(async () => {
|
||||
if (isPaused) return;
|
||||
try {
|
||||
const url = selectedClient !== 'all'
|
||||
? `/api/events?clientId=${encodeURIComponent(selectedClient)}&limit=100`
|
||||
: '/api/events?limit=100';
|
||||
const res = await fetch(url);
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
setEvents(data.events || []);
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
}
|
||||
}, [isPaused, selectedClient]);
|
||||
|
||||
useEffect(() => {
|
||||
fetchClients();
|
||||
}, [fetchClients]);
|
||||
|
||||
useEffect(() => {
|
||||
fetchEvents();
|
||||
const interval = setInterval(fetchEvents, 2000);
|
||||
return () => clearInterval(interval);
|
||||
}, [fetchEvents]);
|
||||
|
||||
const handleSimulate = async () => {
|
||||
try {
|
||||
const targetClientId = selectedClient !== 'all' ? selectedClient : 'py_telemetry_agent_01';
|
||||
const res = await fetch('/api/events', {
|
||||
method: 'POST',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({
|
||||
clientId: targetClientId,
|
||||
data: {
|
||||
source: 'live_stream_simulator',
|
||||
reading: +(Math.random() * 100).toFixed(2),
|
||||
status: 'OK',
|
||||
timestamp_ms: Date.now(),
|
||||
},
|
||||
}),
|
||||
});
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
success('Stream Event Emitted', `Event ${data.event.eventId} pushed`);
|
||||
fetchEvents();
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Failed to emit', err.message);
|
||||
}
|
||||
};
|
||||
|
||||
const filteredEvents = events.filter((e) => {
|
||||
if (!searchQuery) return true;
|
||||
const q = searchQuery.toLowerCase();
|
||||
return (
|
||||
e.eventId.toLowerCase().includes(q) ||
|
||||
e.clientId.toLowerCase().includes(q) ||
|
||||
e.payload.toLowerCase().includes(q)
|
||||
);
|
||||
});
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-4">
|
||||
{/* Header */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
Live Stream
|
||||
</h1>
|
||||
|
||||
<div className="flex items-center gap-1.5 self-start sm:self-auto">
|
||||
<Button
|
||||
size="xs"
|
||||
variant={isPaused ? 'primary' : 'secondary'}
|
||||
icon={isPaused ? 'Play' : 'Pause'}
|
||||
onClick={() => setIsPaused((prev) => !prev)}
|
||||
>
|
||||
{isPaused ? 'Resume' : 'Pause'}
|
||||
</Button>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
icon="Radio"
|
||||
onClick={handleSimulate}
|
||||
>
|
||||
Emit Event
|
||||
</Button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{/* Filter Toolbar */}
|
||||
<Card compact className="p-2.5 bg-[var(--bg-elevated)] flex flex-wrap items-center justify-between gap-3">
|
||||
<div className="flex flex-wrap items-center gap-2.5 flex-1 min-w-[240px]">
|
||||
<div className="w-[180px]">
|
||||
<Select
|
||||
value={selectedClient}
|
||||
onChange={(e) => setSelectedClient(e.target.value)}
|
||||
>
|
||||
<option value="all">All Clients</option>
|
||||
{clients.map((c) => (
|
||||
<option key={c.clientId} value={c.clientId}>
|
||||
{c.clientId}
|
||||
</option>
|
||||
))}
|
||||
</Select>
|
||||
</div>
|
||||
|
||||
<div className="flex-1 min-w-[160px] max-w-[340px]">
|
||||
<Input
|
||||
placeholder="Search eventId or payload content..."
|
||||
icon="Search"
|
||||
value={searchQuery}
|
||||
onChange={(e) => setSearchQuery(e.target.value)}
|
||||
/>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div className="flex items-center gap-2 text-[11px] font-mono text-[var(--text-dim)]">
|
||||
<span className="flex items-center gap-1.5">
|
||||
<span
|
||||
className={`w-2 h-2 inline-block ${
|
||||
isPaused ? 'bg-[var(--warning)]' : 'bg-[var(--success)] animate-pulse'
|
||||
}`}
|
||||
/>
|
||||
<span>{isPaused ? 'PAUSED' : 'STREAMING'}</span>
|
||||
</span>
|
||||
<span>|</span>
|
||||
<span>{filteredEvents.length} events</span>
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
{/* Events Table */}
|
||||
<TableWrap>
|
||||
<Table>
|
||||
<TableHeader>
|
||||
<TableRow>
|
||||
<TableHead>Event ID</TableHead>
|
||||
<TableHead>Client ID</TableHead>
|
||||
<TableHead>Ingestion Timestamp</TableHead>
|
||||
<TableHead>Payload Preview</TableHead>
|
||||
<TableHead className="text-right">Inspect</TableHead>
|
||||
</TableRow>
|
||||
</TableHeader>
|
||||
<TableBody>
|
||||
{filteredEvents.length === 0 ? (
|
||||
<TableEmpty
|
||||
colSpan={5}
|
||||
message={
|
||||
isPaused
|
||||
? 'Stream is paused.'
|
||||
: 'No incoming events in memory buffer yet. Click "Emit Event" above or sync via Python SDK.'
|
||||
}
|
||||
/>
|
||||
) : (
|
||||
filteredEvents.map((evt, idx) => (
|
||||
<TableRow key={idx}>
|
||||
<TableCell className="font-mono text-[11px] text-[var(--text)]">
|
||||
{evt.eventId}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px] text-[var(--accent)]">
|
||||
{evt.clientId}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[10.5px]">
|
||||
{evt.timestamp}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[10.5px] text-[var(--text-muted)] max-w-[300px] truncate">
|
||||
{evt.payload}
|
||||
</TableCell>
|
||||
<TableCell className="text-right">
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
icon="Maximize2"
|
||||
onClick={() => {
|
||||
setSelectedEvent(evt);
|
||||
setModalOpen(true);
|
||||
}}
|
||||
>
|
||||
Inspect
|
||||
</Button>
|
||||
</TableCell>
|
||||
</TableRow>
|
||||
))
|
||||
)}
|
||||
</TableBody>
|
||||
</Table>
|
||||
</TableWrap>
|
||||
|
||||
{/* Inspect Event Modal */}
|
||||
<Modal
|
||||
isOpen={modalOpen}
|
||||
onClose={() => setModalOpen(false)}
|
||||
title={`Event Inspector: ${selectedEvent?.eventId}`}
|
||||
description={`Origin Client: ${selectedEvent?.clientId}`}
|
||||
footer={
|
||||
<Button variant="secondary" size="sm" onClick={() => setModalOpen(false)}>
|
||||
Close
|
||||
</Button>
|
||||
}
|
||||
>
|
||||
{selectedEvent && (
|
||||
<div className="flex flex-col gap-3 font-mono text-[11px]">
|
||||
<div className="grid grid-cols-2 gap-2 text-[10.5px] p-2 bg-[var(--bg-main)] border border-[var(--border)]">
|
||||
<div>
|
||||
<span className="text-[var(--text-dim)]">Event ID: </span>
|
||||
<span className="text-[var(--text)] font-semibold">{selectedEvent.eventId}</span>
|
||||
</div>
|
||||
<div>
|
||||
<span className="text-[var(--text-dim)]">Client: </span>
|
||||
<span className="text-[var(--accent)] font-semibold">{selectedEvent.clientId}</span>
|
||||
</div>
|
||||
<div className="col-span-2">
|
||||
<span className="text-[var(--text-dim)]">Timestamp: </span>
|
||||
<span className="text-[var(--text)]">{selectedEvent.timestamp}</span>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div>
|
||||
<span className="text-[10px] text-[var(--text-dim)] uppercase tracking-wider block mb-1">
|
||||
JSON Payload Structure
|
||||
</span>
|
||||
<pre className="p-3 bg-[var(--bg-main)] border border-[var(--border)] text-[var(--text)] text-[11px] overflow-x-auto max-h-[300px]">
|
||||
{(() => {
|
||||
try {
|
||||
return JSON.stringify(JSON.parse(selectedEvent.payload), null, 2);
|
||||
} catch {
|
||||
return selectedEvent.payload;
|
||||
}
|
||||
})()}
|
||||
</pre>
|
||||
</div>
|
||||
</div>
|
||||
)}
|
||||
</Modal>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,196 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect, useCallback } from 'react';
|
||||
import { Card, CardHeader, CardTitle, CardContent } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Select } from '@/components/ui/Input';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import {
|
||||
TableWrap,
|
||||
Table,
|
||||
TableHeader,
|
||||
TableBody,
|
||||
TableRow,
|
||||
TableHead,
|
||||
TableCell,
|
||||
TableEmpty,
|
||||
} from '@/components/ui/Table';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
export default function ExportPage() {
|
||||
const { success, info } = useToast();
|
||||
const [clients, setClients] = useState<{ clientId: string; name: string }[]>([]);
|
||||
const [selectedClient, setSelectedClient] = useState<string>('all');
|
||||
const [files, setFiles] = useState<any[]>([]);
|
||||
const [loading, setLoading] = useState(true);
|
||||
|
||||
const fetchData = useCallback(async () => {
|
||||
try {
|
||||
const clientRes = await fetch('/api/clients');
|
||||
if (clientRes.ok) {
|
||||
const clientData = await clientRes.json();
|
||||
setClients(clientData.clients || []);
|
||||
}
|
||||
|
||||
const storageRes = await fetch(`/api/storage?clientId=${encodeURIComponent(selectedClient)}`);
|
||||
if (storageRes.ok) {
|
||||
const storageData = await storageRes.json();
|
||||
setFiles(storageData.files || []);
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
} finally {
|
||||
setLoading(false);
|
||||
}
|
||||
}, [selectedClient]);
|
||||
|
||||
useEffect(() => {
|
||||
fetchData();
|
||||
}, [fetchData]);
|
||||
|
||||
const handleExportAll = () => {
|
||||
const url = `/api/export?clientId=${encodeURIComponent(selectedClient)}`;
|
||||
const link = document.createElement('a');
|
||||
link.href = url;
|
||||
link.setAttribute('download', `${selectedClient}_export.csv`);
|
||||
document.body.appendChild(link);
|
||||
link.click();
|
||||
document.body.removeChild(link);
|
||||
info('Export Initiated', `Streaming CSV download for client ${selectedClient}`);
|
||||
};
|
||||
|
||||
const handleDownloadFile = (clientId: string, filename: string) => {
|
||||
const url = `/api/export?clientId=${encodeURIComponent(clientId)}&filename=${encodeURIComponent(filename)}`;
|
||||
const link = document.createElement('a');
|
||||
link.href = url;
|
||||
link.setAttribute('download', filename);
|
||||
document.body.appendChild(link);
|
||||
link.click();
|
||||
document.body.removeChild(link);
|
||||
success('File Download Started', filename);
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-4">
|
||||
{/* Header */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
CSV Exporter
|
||||
</h1>
|
||||
|
||||
<Button
|
||||
size="xs"
|
||||
variant="primary"
|
||||
icon="Download"
|
||||
onClick={handleExportAll}
|
||||
className="self-start sm:self-auto"
|
||||
>
|
||||
Download All CSV
|
||||
</Button>
|
||||
</div>
|
||||
|
||||
{/* Filter and Endpoint Specs */}
|
||||
<div className="grid grid-cols-1 md:grid-cols-3 gap-2">
|
||||
<Card compact className="flex flex-col gap-1.5 p-2 bg-[var(--bg-elevated)]">
|
||||
<CardHeader className="p-0 pb-1 mb-0 border-b-0">
|
||||
<CardTitle className="text-[11px]">Filter Scope</CardTitle>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 flex flex-col gap-1.5">
|
||||
<Select
|
||||
value={selectedClient}
|
||||
onChange={(e) => setSelectedClient(e.target.value)}
|
||||
>
|
||||
<option value="all">All Clients</option>
|
||||
{clients.map((c) => (
|
||||
<option key={c.clientId} value={c.clientId}>
|
||||
{c.clientId}
|
||||
</option>
|
||||
))}
|
||||
</Select>
|
||||
<div className="text-[9.5px] text-[var(--text-dim)] font-mono">
|
||||
Files: {files.length}
|
||||
</div>
|
||||
</CardContent>
|
||||
</Card>
|
||||
|
||||
<Card compact className="md:col-span-2 flex flex-col gap-1 p-2 bg-[var(--bg-elevated)] font-mono text-[10px]">
|
||||
<CardHeader className="p-0 pb-1 mb-0 border-b-0">
|
||||
<CardTitle className="text-[11px]">API Export Endpoint</CardTitle>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 flex flex-col gap-1">
|
||||
<div className="p-1.5 bg-[var(--bg-main)] border border-[var(--border)] flex items-center justify-between">
|
||||
<span className="text-[var(--accent)]">GET /api/export?clientId={selectedClient}</span>
|
||||
<span className="text-[9px] text-[var(--text-dim)]">Stream</span>
|
||||
</div>
|
||||
</CardContent>
|
||||
</Card>
|
||||
</div>
|
||||
|
||||
{/* Partitioned Files List */}
|
||||
<div className="flex flex-col gap-2">
|
||||
<div className="flex items-center justify-between">
|
||||
<h2 className="text-[13px] font-semibold text-[var(--text)]">
|
||||
Stored CSV Partitions
|
||||
</h2>
|
||||
<span className="text-[10.5px] text-[var(--text-dim)] font-mono">
|
||||
/storage/data/{clientId}/{YYYY-MM-DD}.csv
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<TableWrap>
|
||||
<Table>
|
||||
<TableHeader>
|
||||
<TableRow>
|
||||
<TableHead>File Name</TableHead>
|
||||
<TableHead>Client ID</TableHead>
|
||||
<TableHead>Date Partition</TableHead>
|
||||
<TableHead>Approx. Rows</TableHead>
|
||||
<TableHead>Size (KB)</TableHead>
|
||||
<TableHead>Last Modified</TableHead>
|
||||
<TableHead className="text-right">Action</TableHead>
|
||||
</TableRow>
|
||||
</TableHeader>
|
||||
<TableBody>
|
||||
{files.length === 0 ? (
|
||||
<TableEmpty colSpan={7} message="No CSV partitions found for selected client." />
|
||||
) : (
|
||||
files.map((file, idx) => (
|
||||
<TableRow key={idx}>
|
||||
<TableCell className="font-mono text-[11px] font-medium text-[var(--text)]">
|
||||
{file.filename}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px] text-[var(--accent)]">
|
||||
{file.clientId}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px]">
|
||||
{file.date}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px]">
|
||||
{file.linesCount.toLocaleString()}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px]">
|
||||
{(file.sizeBytes / 1024).toFixed(1)} KB
|
||||
</TableCell>
|
||||
<TableCell className="text-[10.5px] text-[var(--text-dim)] font-mono">
|
||||
{new Date(file.modifiedAt).toLocaleString()}
|
||||
</TableCell>
|
||||
<TableCell className="text-right">
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
icon="Download"
|
||||
onClick={() => handleDownloadFile(file.clientId, file.filename)}
|
||||
>
|
||||
Download
|
||||
</Button>
|
||||
</TableCell>
|
||||
</TableRow>
|
||||
))
|
||||
)}
|
||||
</TableBody>
|
||||
</Table>
|
||||
</TableWrap>
|
||||
</div>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,8 @@
|
||||
'use client';
|
||||
|
||||
import React from 'react';
|
||||
import { MainLayout } from '@/components/layout/MainLayout';
|
||||
|
||||
export default function VconLayout({ children }: { children: React.ReactNode }) {
|
||||
return <MainLayout showSidebar={true}>{children}</MainLayout>;
|
||||
}
|
||||
@@ -0,0 +1,16 @@
|
||||
# VCON Admin Console Manifest
|
||||
|
||||
## Purpose
|
||||
The `/vcon/*` route hosts the full administration control center for DataStack:
|
||||
- **dashboard**: Realtime metrics, buffer queue, disk usage, quick simulation trigger
|
||||
- **clients**: SDK registration, JWT handshake token creation, rate limits
|
||||
- **data**: Live incoming stream inspector with client filters and search
|
||||
- **export**: CSV dataset exporter and streaming downloads
|
||||
- **storage**: Disk inspection of `/storage/data/{clientId}/{YYYY-MM-DD}.csv` partitions and flush triggers
|
||||
- **settings**: Platform limits, rotation sizes, buffer thresholds, and JWT secret management
|
||||
- **sdk**: Pip-installable Python SDK guide and pre-configured client code generator
|
||||
- **simulator**: In-browser event emission and batch bursting tester.
|
||||
|
||||
## Conventions
|
||||
- Standard URL handler for all inner pages so page refreshes never redirect to home.
|
||||
- Zero-radius, zero-shadow compact UI styling using global tokens.
|
||||
@@ -0,0 +1,5 @@
|
||||
import { redirect } from 'next/navigation';
|
||||
|
||||
export default function VconRootPage() {
|
||||
redirect('/vcon/dashboard');
|
||||
}
|
||||
@@ -0,0 +1,137 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect } from 'react';
|
||||
import { Card, CardHeader, CardTitle, CardContent } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Select } from '@/components/ui/Input';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
export default function SdkGuidePage() {
|
||||
const { success } = useToast();
|
||||
const [clients, setClients] = useState<any[]>([]);
|
||||
const [selectedClientId, setSelectedClientId] = useState<string>('');
|
||||
|
||||
useEffect(() => {
|
||||
async function loadClients() {
|
||||
try {
|
||||
const res = await fetch('/api/clients');
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
const list = data.clients || [];
|
||||
setClients(list);
|
||||
if (list.length > 0) {
|
||||
setSelectedClientId(list[0].clientId);
|
||||
}
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
}
|
||||
}
|
||||
loadClients();
|
||||
}, []);
|
||||
|
||||
const activeClient = clients.find((c) => c.clientId === selectedClientId) || clients[0];
|
||||
const sampleToken = activeClient?.token || 'YOUR_SIGNED_CLIENT_JWT_TOKEN';
|
||||
|
||||
const pythonSnippet = `from datastack_sdk import DataStackClient
|
||||
|
||||
# Initialize client using credentials generated in /vcon/clients
|
||||
client = DataStackClient(
|
||||
server_url="http://localhost:4000",
|
||||
token="${sampleToken}"
|
||||
)
|
||||
|
||||
# Connect with automatic reconnection backoff
|
||||
if client.connect():
|
||||
# 1. Sync single event in realtime
|
||||
res = client.sync({
|
||||
"event_type": "page_view",
|
||||
"url": "/products/wireless-headphones",
|
||||
"user_id": "usr_9942",
|
||||
"referrer": "google.com"
|
||||
})
|
||||
print("Sync response:", res)
|
||||
|
||||
# 2. Sync high-throughput batch of records
|
||||
batch_res = client.batch_sync([
|
||||
{"sensor": "temp", "value": 24.5, "unit": "C"},
|
||||
{"sensor": "humidity", "value": 61.2, "unit": "%"},
|
||||
{"sensor": "pressure", "value": 1013.25, "unit": "hPa"}
|
||||
])
|
||||
print("Batch response:", batch_res)
|
||||
|
||||
client.disconnect()
|
||||
`;
|
||||
|
||||
const copySnippet = (text: string, label: string) => {
|
||||
navigator.clipboard.writeText(text);
|
||||
success('Copied', `${label} copied to clipboard`);
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-4 max-w-[960px]">
|
||||
{/* Header */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
Python SDK
|
||||
</h1>
|
||||
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
icon="Copy"
|
||||
onClick={() => copySnippet(pythonSnippet, 'Python Snippet')}
|
||||
className="self-start sm:self-auto"
|
||||
>
|
||||
Copy Code
|
||||
</Button>
|
||||
</div>
|
||||
|
||||
{/* Installation Step */}
|
||||
<Card compact className="flex flex-col gap-1.5 font-mono text-[10.5px]">
|
||||
<div className="p-2 bg-[var(--bg-main)] border border-[var(--border)] flex items-center justify-between">
|
||||
<span className="text-[var(--accent)]">pip install ./sdk-python</span>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="ghost"
|
||||
icon="Copy"
|
||||
onClick={() => copySnippet('pip install ./sdk-python', 'Pip command')}
|
||||
/>
|
||||
</div>
|
||||
</Card>
|
||||
|
||||
{/* Interactive Code Generator */}
|
||||
<Card compact className="flex flex-col gap-2">
|
||||
<CardHeader className="p-0 pb-1 mb-0 border-b-0">
|
||||
<div className="flex flex-wrap items-center justify-between gap-2 w-full">
|
||||
<CardTitle className="text-[11.5px]">Client Code Example</CardTitle>
|
||||
{clients.length > 0 && (
|
||||
<div className="w-[180px]">
|
||||
<Select
|
||||
compact
|
||||
value={selectedClientId}
|
||||
onChange={(e) => setSelectedClientId(e.target.value)}
|
||||
>
|
||||
{clients.map((c) => (
|
||||
<option key={c.clientId} value={c.clientId}>
|
||||
{c.clientId}
|
||||
</option>
|
||||
))}
|
||||
</Select>
|
||||
</div>
|
||||
)}
|
||||
</div>
|
||||
</CardHeader>
|
||||
|
||||
<CardContent className="p-0 flex flex-col gap-1">
|
||||
<div className="relative">
|
||||
<pre className="p-2.5 bg-[var(--bg-main)] border border-[var(--border)] text-[var(--text)] text-[10.5px] font-mono overflow-x-auto leading-relaxed">
|
||||
{pythonSnippet}
|
||||
</pre>
|
||||
</div>
|
||||
</CardContent>
|
||||
</Card>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,210 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect } from 'react';
|
||||
import { Card, CardHeader, CardTitle, CardContent, CardFooter } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Input } from '@/components/ui/Input';
|
||||
import { Form, FormRow, FormSwitch } from '@/components/ui/Form';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
export default function SettingsPage() {
|
||||
const { success, error } = useToast();
|
||||
const [loading, setLoading] = useState(true);
|
||||
const [saving, setSaving] = useState(false);
|
||||
|
||||
// Settings State
|
||||
const [maxEventsPerSec, setMaxEventsPerSec] = useState('100');
|
||||
const [maxPayloadSizeKb, setMaxPayloadSizeKb] = useState('100');
|
||||
const [batchFlushThreshold, setBatchFlushThreshold] = useState('500');
|
||||
const [batchFlushIntervalMs, setBatchFlushIntervalMs] = useState('2000');
|
||||
const [fileRotationMb, setFileRotationMb] = useState('100');
|
||||
const [jwtSecret, setJwtSecret] = useState('datastack-universal-secret-key-2026');
|
||||
const [enableIdempotency, setEnableIdempotency] = useState(true);
|
||||
const [autoPruneDays, setAutoPruneDays] = useState('30');
|
||||
|
||||
useEffect(() => {
|
||||
async function loadSettings() {
|
||||
try {
|
||||
const res = await fetch('/api/settings');
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
const s = data.settings;
|
||||
setMaxEventsPerSec(String(s.maxEventsPerSec ?? 100));
|
||||
setMaxPayloadSizeKb(String(s.maxPayloadSizeKb ?? 100));
|
||||
setBatchFlushThreshold(String(s.batchFlushThreshold ?? 500));
|
||||
setBatchFlushIntervalMs(String(s.batchFlushIntervalMs ?? 2000));
|
||||
setFileRotationMb(String(s.fileRotationMb ?? 100));
|
||||
setJwtSecret(s.jwtSecret ?? 'datastack-universal-secret-key-2026');
|
||||
setEnableIdempotency(Boolean(s.enableIdempotency ?? true));
|
||||
setAutoPruneDays(String(s.autoPruneDays ?? 30));
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
} finally {
|
||||
setLoading(false);
|
||||
}
|
||||
}
|
||||
loadSettings();
|
||||
}, []);
|
||||
|
||||
const handleSave = async (e: React.FormEvent) => {
|
||||
e.preventDefault();
|
||||
setSaving(true);
|
||||
try {
|
||||
const res = await fetch('/api/settings', {
|
||||
method: 'POST',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({
|
||||
maxEventsPerSec: Number(maxEventsPerSec),
|
||||
maxPayloadSizeKb: Number(maxPayloadSizeKb),
|
||||
batchFlushThreshold: Number(batchFlushThreshold),
|
||||
batchFlushIntervalMs: Number(batchFlushIntervalMs),
|
||||
fileRotationMb: Number(fileRotationMb),
|
||||
jwtSecret,
|
||||
enableIdempotency,
|
||||
autoPruneDays: Number(autoPruneDays),
|
||||
}),
|
||||
});
|
||||
|
||||
if (res.ok) {
|
||||
success('Settings Saved', 'Core engine configuration updated and propagated');
|
||||
} else {
|
||||
error('Save Failed', 'Server rejected configuration payload');
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Error', err.message);
|
||||
} finally {
|
||||
setSaving(false);
|
||||
}
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-4 max-w-[900px]">
|
||||
{/* Header */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
Settings
|
||||
</h1>
|
||||
|
||||
<Button
|
||||
size="xs"
|
||||
variant="primary"
|
||||
icon="Save"
|
||||
loading={saving}
|
||||
onClick={handleSave}
|
||||
className="self-start sm:self-auto"
|
||||
>
|
||||
Save
|
||||
</Button>
|
||||
</div>
|
||||
|
||||
<Form onSubmit={handleSave}>
|
||||
{/* Ingestion & Rate Limit Group */}
|
||||
<Card compact className="flex flex-col gap-3">
|
||||
<CardHeader className="p-0 pb-1.5 mb-1.5">
|
||||
<div className="flex items-center gap-2">
|
||||
<Icon name="Activity" size={14} className="text-[var(--accent)]" />
|
||||
<CardTitle>Throughput & Safety Limits</CardTitle>
|
||||
</div>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 flex flex-col gap-3">
|
||||
<FormRow>
|
||||
<Input
|
||||
label="Global Max Events / Second (Rate Limit)"
|
||||
type="number"
|
||||
min="10"
|
||||
max="10000"
|
||||
value={maxEventsPerSec}
|
||||
onChange={(e) => setMaxEventsPerSec(e.target.value)}
|
||||
/>
|
||||
<Input
|
||||
label="Max Payload Size per Event (KB)"
|
||||
type="number"
|
||||
min="1"
|
||||
max="5120"
|
||||
value={maxPayloadSizeKb}
|
||||
onChange={(e) => setMaxPayloadSizeKb(e.target.value)}
|
||||
/>
|
||||
</FormRow>
|
||||
<FormSwitch
|
||||
label="Enable Idempotency Key Deduplication"
|
||||
description="clientId + eventId combinations are rejected within 5-minute TTL window"
|
||||
checked={enableIdempotency}
|
||||
onChange={setEnableIdempotency}
|
||||
/>
|
||||
</CardContent>
|
||||
</Card>
|
||||
|
||||
{/* Buffer & CSV Rotation Group */}
|
||||
<Card compact className="flex flex-col gap-3">
|
||||
<CardHeader className="p-0 pb-1.5 mb-1.5">
|
||||
<div className="flex items-center gap-2">
|
||||
<Icon name="HardDrive" size={14} className="text-[var(--accent)]" />
|
||||
<CardTitle>Redis In-Memory Buffer & CSV Partitioning</CardTitle>
|
||||
</div>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 flex flex-col gap-3">
|
||||
<FormRow>
|
||||
<Input
|
||||
label="Batch Flush Threshold (Row Count)"
|
||||
type="number"
|
||||
min="50"
|
||||
max="5000"
|
||||
value={batchFlushThreshold}
|
||||
onChange={(e) => setBatchFlushThreshold(e.target.value)}
|
||||
/>
|
||||
<Input
|
||||
label="Batch Flush Timer Interval (Milliseconds)"
|
||||
type="number"
|
||||
min="500"
|
||||
max="10000"
|
||||
value={batchFlushIntervalMs}
|
||||
onChange={(e) => setBatchFlushIntervalMs(e.target.value)}
|
||||
/>
|
||||
</FormRow>
|
||||
<FormRow>
|
||||
<Input
|
||||
label="File Rotation Threshold (MB)"
|
||||
type="number"
|
||||
min="10"
|
||||
max="1000"
|
||||
value={fileRotationMb}
|
||||
onChange={(e) => setFileRotationMb(e.target.value)}
|
||||
/>
|
||||
<Input
|
||||
label="Log Archive Retention (Days)"
|
||||
type="number"
|
||||
min="1"
|
||||
max="365"
|
||||
value={autoPruneDays}
|
||||
onChange={(e) => setAutoPruneDays(e.target.value)}
|
||||
/>
|
||||
</FormRow>
|
||||
</CardContent>
|
||||
</Card>
|
||||
|
||||
{/* Security & Token Group */}
|
||||
<Card compact className="flex flex-col gap-3">
|
||||
<CardHeader className="p-0 pb-1.5 mb-1.5">
|
||||
<div className="flex items-center gap-2">
|
||||
<Icon name="Key" size={14} className="text-[var(--accent)]" />
|
||||
<CardTitle>Authentication Secret</CardTitle>
|
||||
</div>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 flex flex-col gap-3">
|
||||
<Input
|
||||
label="JWT Signature Secret Key"
|
||||
type="password"
|
||||
value={jwtSecret}
|
||||
onChange={(e) => setJwtSecret(e.target.value)}
|
||||
/>
|
||||
<div className="text-[10.5px] text-[var(--text-dim)] font-mono">
|
||||
Note: Updating this secret invalidates existing client handshake tokens immediately.
|
||||
</div>
|
||||
</CardContent>
|
||||
</Card>
|
||||
</Form>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,186 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect } from 'react';
|
||||
import { Card, CardHeader, CardTitle, CardContent } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Select, Textarea } from '@/components/ui/Input';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
export default function SimulatorPage() {
|
||||
const { success, error } = useToast();
|
||||
const [clients, setClients] = useState<any[]>([]);
|
||||
const [selectedClient, setSelectedClient] = useState<string>('');
|
||||
const [payloadText, setPayloadText] = useState<string>(
|
||||
JSON.stringify(
|
||||
{
|
||||
event_name: 'sensor_telemetry',
|
||||
temperature: 24.8,
|
||||
humidity: 58.2,
|
||||
voltage: 3.31,
|
||||
status: 'NOMINAL',
|
||||
},
|
||||
null,
|
||||
2
|
||||
)
|
||||
);
|
||||
const [sending, setSending] = useState(false);
|
||||
const [lastResponse, setLastResponse] = useState<any>(null);
|
||||
|
||||
useEffect(() => {
|
||||
async function loadClients() {
|
||||
try {
|
||||
const res = await fetch('/api/clients');
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
const list = data.clients || [];
|
||||
setClients(list);
|
||||
if (list.length > 0) setSelectedClient(list[0].clientId);
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
}
|
||||
}
|
||||
loadClients();
|
||||
}, []);
|
||||
|
||||
const handleSendSingle = async () => {
|
||||
let parsedData: any;
|
||||
try {
|
||||
parsedData = JSON.parse(payloadText);
|
||||
} catch {
|
||||
error('Invalid JSON', 'Please fix payload syntax before emitting');
|
||||
return;
|
||||
}
|
||||
|
||||
setSending(true);
|
||||
try {
|
||||
const res = await fetch('/api/events', {
|
||||
method: 'POST',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({
|
||||
clientId: selectedClient || 'py_telemetry_agent_01',
|
||||
data: parsedData,
|
||||
}),
|
||||
});
|
||||
|
||||
const data = await res.json();
|
||||
setLastResponse(data);
|
||||
|
||||
if (res.ok) {
|
||||
success('Event Accepted', `Event ID: ${data.event.eventId} buffered to Redis`);
|
||||
} else {
|
||||
error('Event Rejected', data.error || 'Server rejected');
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Error', err.message);
|
||||
} finally {
|
||||
setSending(false);
|
||||
}
|
||||
};
|
||||
|
||||
const handleSendBatch = async (count = 10) => {
|
||||
setSending(true);
|
||||
try {
|
||||
let accepted = 0;
|
||||
for (let i = 0; i < count; i++) {
|
||||
const res = await fetch('/api/events', {
|
||||
method: 'POST',
|
||||
headers: { 'Content-Type': 'application/json' },
|
||||
body: JSON.stringify({
|
||||
clientId: selectedClient || 'py_telemetry_agent_01',
|
||||
data: {
|
||||
batch_index: i + 1,
|
||||
sensor: `sensor_${(i % 3) + 1}`,
|
||||
reading: +(Math.random() * 100).toFixed(2),
|
||||
timestamp: new Date().toISOString(),
|
||||
},
|
||||
}),
|
||||
});
|
||||
if (res.ok) accepted++;
|
||||
}
|
||||
success('Batch Streamed', `${accepted}/${count} records ingested into buffer`);
|
||||
setLastResponse({ success: true, batchSent: count, accepted });
|
||||
} catch (err: any) {
|
||||
error('Batch Error', err.message);
|
||||
} finally {
|
||||
setSending(false);
|
||||
}
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-4 max-w-[960px]">
|
||||
{/* Header */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
Simulator
|
||||
</h1>
|
||||
|
||||
<div className="flex items-center gap-1.5 self-start sm:self-auto">
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
loading={sending}
|
||||
onClick={() => handleSendBatch(10)}
|
||||
>
|
||||
Burst 10
|
||||
</Button>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="primary"
|
||||
icon="Send"
|
||||
loading={sending}
|
||||
onClick={handleSendSingle}
|
||||
>
|
||||
Send Event
|
||||
</Button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<div className="grid grid-cols-1 md:grid-cols-2 gap-2">
|
||||
{/* Editor Card */}
|
||||
<Card compact className="flex flex-col gap-2 p-2 bg-[var(--bg-elevated)]">
|
||||
<CardHeader className="p-0 pb-1 mb-0 border-b-0">
|
||||
<CardTitle className="text-[11px]">Payload Configuration</CardTitle>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 flex flex-col gap-2">
|
||||
<Select
|
||||
value={selectedClient}
|
||||
onChange={(e) => setSelectedClient(e.target.value)}
|
||||
>
|
||||
{clients.map((c) => (
|
||||
<option key={c.clientId} value={c.clientId}>
|
||||
{c.clientId}
|
||||
</option>
|
||||
))}
|
||||
</Select>
|
||||
|
||||
<Textarea
|
||||
rows={8}
|
||||
value={payloadText}
|
||||
onChange={(e) => setPayloadText(e.target.value)}
|
||||
/>
|
||||
</CardContent>
|
||||
</Card>
|
||||
|
||||
{/* Response Inspector */}
|
||||
<Card compact className="flex flex-col gap-1.5 p-2 bg-[var(--bg-elevated)] font-mono text-[10px]">
|
||||
<CardHeader className="p-0 pb-1 mb-0 border-b-0">
|
||||
<CardTitle className="text-[11px]">Pipeline Response</CardTitle>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 flex flex-col gap-1">
|
||||
{lastResponse ? (
|
||||
<pre className="p-2.5 bg-[var(--bg-main)] border border-[var(--border)] text-[var(--text)] overflow-x-auto max-h-[240px]">
|
||||
{JSON.stringify(lastResponse, null, 2)}
|
||||
</pre>
|
||||
) : (
|
||||
<div className="p-6 text-center text-[var(--text-dim)] italic border border-dashed border-[var(--border-strong)]">
|
||||
Click 'Send Event' to test ingestion.
|
||||
</div>
|
||||
)}
|
||||
</CardContent>
|
||||
</Card>
|
||||
</div>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,170 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect, useCallback } from 'react';
|
||||
import { Card } from '@/components/ui/Card';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import {
|
||||
TableWrap,
|
||||
Table,
|
||||
TableHeader,
|
||||
TableBody,
|
||||
TableRow,
|
||||
TableHead,
|
||||
TableCell,
|
||||
TableEmpty,
|
||||
} from '@/components/ui/Table';
|
||||
import { useToast } from '@/components/ui/Toast';
|
||||
|
||||
export default function StoragePage() {
|
||||
const { success, error } = useToast();
|
||||
const [stats, setStats] = useState<any>(null);
|
||||
const [files, setFiles] = useState<any[]>([]);
|
||||
const [loading, setLoading] = useState(true);
|
||||
const [flushing, setFlushing] = useState(false);
|
||||
|
||||
const fetchStorageData = useCallback(async () => {
|
||||
try {
|
||||
const res = await fetch('/api/storage');
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
setStats(data.stats);
|
||||
setFiles(data.files || []);
|
||||
}
|
||||
} catch {
|
||||
// ignore
|
||||
} finally {
|
||||
setLoading(false);
|
||||
}
|
||||
}, []);
|
||||
|
||||
useEffect(() => {
|
||||
fetchStorageData();
|
||||
}, [fetchStorageData]);
|
||||
|
||||
const handleManualFlush = async () => {
|
||||
setFlushing(true);
|
||||
try {
|
||||
const res = await fetch('/api/storage', { method: 'POST' });
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
success('Buffer Flushed', `Flushed ${data.flushedCount} events to CSV files`);
|
||||
fetchStorageData();
|
||||
} else {
|
||||
error('Flush Failed', 'Could not flush buffer to disk');
|
||||
}
|
||||
} catch (err: any) {
|
||||
error('Error', err.message);
|
||||
} finally {
|
||||
setFlushing(false);
|
||||
}
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-4">
|
||||
{/* Header */}
|
||||
<div className="flex flex-col sm:flex-row sm:items-center justify-between gap-2 border-b border-[var(--border)] pb-2">
|
||||
<h1 className="text-[14px] font-semibold text-[var(--text)] tracking-tight">
|
||||
CSV Storage
|
||||
</h1>
|
||||
|
||||
<div className="flex items-center gap-1.5 self-start sm:self-auto">
|
||||
<Button
|
||||
size="xs"
|
||||
variant="secondary"
|
||||
icon="RotateCw"
|
||||
onClick={fetchStorageData}
|
||||
>
|
||||
Refresh
|
||||
</Button>
|
||||
<Button
|
||||
size="xs"
|
||||
variant="primary"
|
||||
icon="HardDrive"
|
||||
loading={flushing}
|
||||
onClick={handleManualFlush}
|
||||
>
|
||||
Flush Buffer
|
||||
</Button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{/* Storage Summary Cards */}
|
||||
<div className="grid grid-cols-2 lg:grid-cols-4 gap-1.5">
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<span className="text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">Disk Usage</span>
|
||||
<span className="text-[15px] font-semibold text-[var(--text)] font-mono">
|
||||
{stats?.totalMB ?? '0.00'} MB
|
||||
</span>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<span className="text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">CSV Files</span>
|
||||
<span className="text-[15px] font-semibold text-[var(--text)] font-mono">
|
||||
{stats?.totalFiles ?? 0}
|
||||
</span>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<span className="text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">Persisted Rows</span>
|
||||
<span className="text-[15px] font-semibold text-[var(--text)] font-mono">
|
||||
{stats?.totalRows ? stats.totalRows.toLocaleString() : 0}
|
||||
</span>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<span className="text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">Rotation Rule</span>
|
||||
<span className="text-[13px] font-semibold text-[var(--accent)] font-mono">
|
||||
100MB / Daily
|
||||
</span>
|
||||
</Card>
|
||||
</div>
|
||||
|
||||
{/* Partition Files Table */}
|
||||
<div className="flex flex-col gap-2">
|
||||
<h2 className="text-[13px] font-semibold text-[var(--text)]">
|
||||
CSV Files on Disk
|
||||
</h2>
|
||||
|
||||
<TableWrap>
|
||||
<Table>
|
||||
<TableHeader>
|
||||
<TableRow>
|
||||
<TableHead>Client Folder</TableHead>
|
||||
<TableHead>Partition Filename</TableHead>
|
||||
<TableHead>File Size</TableHead>
|
||||
<TableHead>Data Lines</TableHead>
|
||||
<TableHead>Last Rotation / Append</TableHead>
|
||||
</TableRow>
|
||||
</TableHeader>
|
||||
<TableBody>
|
||||
{files.length === 0 ? (
|
||||
<TableEmpty colSpan={5} message="No CSV files generated yet. Events in memory buffer will flush automatically or via 'Flush Buffer Now'." />
|
||||
) : (
|
||||
files.map((file, idx) => (
|
||||
<TableRow key={idx}>
|
||||
<TableCell className="font-mono text-[11px] text-[var(--accent)]">
|
||||
{file.clientId}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px] font-medium text-[var(--text)]">
|
||||
{file.filename}
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px]">
|
||||
{(file.sizeBytes / 1024).toFixed(1)} KB
|
||||
</TableCell>
|
||||
<TableCell className="font-mono text-[11px]">
|
||||
{file.linesCount.toLocaleString()}
|
||||
</TableCell>
|
||||
<TableCell className="text-[10.5px] text-[var(--text-dim)] font-mono">
|
||||
{new Date(file.modifiedAt).toLocaleString()}
|
||||
</TableCell>
|
||||
</TableRow>
|
||||
))
|
||||
)}
|
||||
</TableBody>
|
||||
</Table>
|
||||
</TableWrap>
|
||||
</div>
|
||||
</div>
|
||||
);
|
||||
}
|
||||
@@ -0,0 +1,28 @@
|
||||
import React from 'react';
|
||||
|
||||
export const Footer: React.FC = () => {
|
||||
return (
|
||||
<footer className="shrink-0 h-[26px] bg-[var(--bg-activity)] border-t border-[var(--border)] px-3 sm:px-4 flex items-center justify-between text-[10px] text-[var(--text-dim)] select-none">
|
||||
<div className="flex items-center gap-1.5 truncate min-w-0 pr-2">
|
||||
<span className="font-semibold text-[var(--text-muted)] tracking-tight">DataStack</span>
|
||||
<span className="text-[var(--border-strong)]">/</span>
|
||||
<span className="font-mono text-[9px] truncate">
|
||||
storage/data/{clientId}/{YYYY-MM-DD}.csv
|
||||
</span>
|
||||
</div>
|
||||
<div className="flex items-center gap-2 font-mono text-[9.5px] shrink-0 ml-auto">
|
||||
<span className="flex items-center gap-1">
|
||||
<span className="w-1.5 h-1.5 bg-[var(--success)] inline-block" />
|
||||
<span className="text-[var(--text-muted)]">:4000</span>
|
||||
</span>
|
||||
<span className="text-[var(--border-strong)]">•</span>
|
||||
<span className="flex items-center gap-1">
|
||||
<span className="w-1.5 h-1.5 bg-[var(--accent)] inline-block" />
|
||||
<span className="text-[var(--text-muted)]">:3000</span>
|
||||
</span>
|
||||
</div>
|
||||
</footer>
|
||||
);
|
||||
};
|
||||
|
||||
export default Footer;
|
||||
@@ -0,0 +1,44 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState } from 'react';
|
||||
import { Navbar } from './Navbar';
|
||||
import { Sidebar } from './Sidebar';
|
||||
import { Footer } from './Footer';
|
||||
|
||||
interface MainLayoutProps {
|
||||
children: React.ReactNode;
|
||||
showSidebar?: boolean;
|
||||
}
|
||||
|
||||
export const MainLayout: React.FC<MainLayoutProps> = ({
|
||||
children,
|
||||
showSidebar = false,
|
||||
}) => {
|
||||
const [sidebarOpen, setSidebarOpen] = useState(false);
|
||||
|
||||
return (
|
||||
<div className="min-h-screen flex flex-col bg-[var(--bg-main)] text-[var(--text)] antialiased">
|
||||
<Navbar
|
||||
showSidebarToggle={showSidebar}
|
||||
onToggleSidebar={() => setSidebarOpen((prev) => !prev)}
|
||||
/>
|
||||
|
||||
<div className="flex-1 flex min-h-0 overflow-hidden">
|
||||
{showSidebar && (
|
||||
<Sidebar
|
||||
isOpen={sidebarOpen}
|
||||
onClose={() => setSidebarOpen(false)}
|
||||
/>
|
||||
)}
|
||||
<main className="flex-1 overflow-y-auto flex flex-col min-w-0">
|
||||
<div className="flex-1 p-2 sm:p-3.5 max-w-[1360px] w-full mx-auto">
|
||||
{children}
|
||||
</div>
|
||||
<Footer />
|
||||
</main>
|
||||
</div>
|
||||
</div>
|
||||
);
|
||||
};
|
||||
|
||||
export default MainLayout;
|
||||
@@ -0,0 +1,141 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState, useEffect } from 'react';
|
||||
import Link from 'next/link';
|
||||
import { usePathname } from 'next/navigation';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
|
||||
interface NavbarProps {
|
||||
onToggleSidebar?: () => void;
|
||||
showSidebarToggle?: boolean;
|
||||
}
|
||||
|
||||
export const Navbar: React.FC<NavbarProps> = ({
|
||||
onToggleSidebar,
|
||||
showSidebarToggle = false,
|
||||
}) => {
|
||||
const pathname = usePathname();
|
||||
const [theme, setTheme] = useState<'dark' | 'light'>('dark');
|
||||
|
||||
useEffect(() => {
|
||||
const saved = localStorage.getItem('datastack-theme') as 'dark' | 'light' | null;
|
||||
const initial = saved || 'dark';
|
||||
setTheme(initial);
|
||||
if (initial === 'light') {
|
||||
document.documentElement.classList.remove('dark');
|
||||
document.documentElement.classList.add('light');
|
||||
} else {
|
||||
document.documentElement.classList.add('dark');
|
||||
document.documentElement.classList.remove('light');
|
||||
}
|
||||
}, []);
|
||||
|
||||
const toggleTheme = () => {
|
||||
const nextTheme = theme === 'dark' ? 'light' : 'dark';
|
||||
setTheme(nextTheme);
|
||||
localStorage.setItem('datastack-theme', nextTheme);
|
||||
if (nextTheme === 'light') {
|
||||
document.documentElement.classList.remove('dark');
|
||||
document.documentElement.classList.add('light');
|
||||
} else {
|
||||
document.documentElement.classList.add('dark');
|
||||
document.documentElement.classList.remove('light');
|
||||
}
|
||||
};
|
||||
|
||||
const isVcon = pathname?.startsWith('/vcon');
|
||||
|
||||
return (
|
||||
<header className="h-[38px] shrink-0 bg-[var(--bg-activity)] border-b border-[var(--border)] px-3 sm:px-4 flex items-center justify-between z-40 select-none">
|
||||
{/* Left: Mobile hamburger + Brand */}
|
||||
<div className="flex items-center gap-2">
|
||||
{showSidebarToggle && (
|
||||
<button
|
||||
onClick={onToggleSidebar}
|
||||
className="md:hidden w-[26px] h-[26px] flex items-center justify-center text-[var(--text-muted)] hover:text-[var(--text)] border border-[var(--border)] bg-[var(--bg-elevated)] cursor-pointer"
|
||||
aria-label="Toggle Navigation"
|
||||
>
|
||||
<Icon name="Menu" size={13} />
|
||||
</button>
|
||||
)}
|
||||
|
||||
<Link href="/" className="flex items-center gap-1.5">
|
||||
<div className="w-[17px] h-[17px] bg-[var(--accent)] text-[var(--text-on-accent)] flex items-center justify-center text-[9.5px] font-bold">
|
||||
DS
|
||||
</div>
|
||||
<span className="text-[12px] font-semibold text-[var(--text)] tracking-tight">
|
||||
DataStack
|
||||
</span>
|
||||
<span className="hidden sm:inline text-[9px] text-[var(--text-dim)] font-mono border border-[var(--border)] px-1 py-0.2">
|
||||
v2.4
|
||||
</span>
|
||||
</Link>
|
||||
</div>
|
||||
|
||||
{/* Middle: Links */}
|
||||
<nav className="hidden sm:flex items-center gap-1 text-[11px]">
|
||||
<Link
|
||||
href="/"
|
||||
className={`px-2.5 py-1 transition-colors border-b-2 ${
|
||||
pathname === '/'
|
||||
? 'border-[var(--accent)] text-[var(--text)] font-medium'
|
||||
: 'border-transparent text-[var(--text-muted)] hover:text-[var(--text)]'
|
||||
}`}
|
||||
>
|
||||
Overview
|
||||
</Link>
|
||||
<Link
|
||||
href="/vcon/dashboard"
|
||||
className={`px-2.5 py-1 transition-colors border-b-2 flex items-center gap-1.5 ${
|
||||
isVcon
|
||||
? 'border-[var(--accent)] text-[var(--text)] font-medium'
|
||||
: 'border-transparent text-[var(--text-muted)] hover:text-[var(--text)]'
|
||||
}`}
|
||||
>
|
||||
<span>Admin Console</span>
|
||||
<span className="w-1.5 h-1.5 bg-[var(--success)] shrink-0" />
|
||||
</Link>
|
||||
<Link
|
||||
href="/vcon/export"
|
||||
className={`px-2.5 py-1 transition-colors border-b-2 ${
|
||||
pathname === '/vcon/export'
|
||||
? 'border-[var(--accent)] text-[var(--text)] font-medium'
|
||||
: 'border-transparent text-[var(--text-muted)] hover:text-[var(--text)]'
|
||||
}`}
|
||||
>
|
||||
CSV Exporter
|
||||
</Link>
|
||||
</nav>
|
||||
|
||||
{/* Right: Port Badges + Theme Toggle + Console Action */}
|
||||
<div className="flex items-center gap-1.5">
|
||||
<div className="hidden lg:flex items-center gap-1.5 text-[9.5px] text-[var(--text-dim)] font-mono border border-[var(--border)] px-1.5 py-0.5 bg-[var(--bg-main)]">
|
||||
<span className="w-1.5 h-1.5 bg-[var(--success)] inline-block" />
|
||||
<span>:4000</span>
|
||||
<span className="text-[var(--border-strong)]">|</span>
|
||||
<span className="w-1.5 h-1.5 bg-[var(--accent)] inline-block" />
|
||||
<span>:3000</span>
|
||||
</div>
|
||||
|
||||
<button
|
||||
onClick={toggleTheme}
|
||||
aria-label="Toggle Theme"
|
||||
className="w-[26px] h-[26px] flex items-center justify-center border border-[var(--border)] bg-[var(--bg-elevated)] text-[var(--text-muted)] hover:text-[var(--text)] cursor-pointer"
|
||||
>
|
||||
<Icon name={theme === 'dark' ? 'Sun' : 'Moon'} size={12} />
|
||||
</button>
|
||||
|
||||
{!isVcon && (
|
||||
<Link href="/vcon/dashboard">
|
||||
<Button size="xs" variant="primary" icon="Terminal">
|
||||
/vcon/
|
||||
</Button>
|
||||
</Link>
|
||||
)}
|
||||
</div>
|
||||
</header>
|
||||
);
|
||||
};
|
||||
|
||||
export default Navbar;
|
||||
@@ -0,0 +1,146 @@
|
||||
'use client';
|
||||
|
||||
import React from 'react';
|
||||
import Link from 'next/link';
|
||||
import { usePathname } from 'next/navigation';
|
||||
import { cn } from '@/lib/utils';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
|
||||
interface SidebarProps {
|
||||
isOpen?: boolean;
|
||||
onClose?: () => void;
|
||||
}
|
||||
|
||||
export const Sidebar: React.FC<SidebarProps> = ({
|
||||
isOpen = false,
|
||||
onClose,
|
||||
}) => {
|
||||
const pathname = usePathname();
|
||||
|
||||
const navigation = [
|
||||
{
|
||||
group: 'Core Telemetry',
|
||||
items: [
|
||||
{ name: 'Dashboard', href: '/vcon/dashboard', icon: 'LayoutDashboard' },
|
||||
{ name: 'Live Data Sync', href: '/vcon/data', icon: 'Activity', badge: 'Live' },
|
||||
{ name: 'CSV Exporter', href: '/vcon/export', icon: 'Download' },
|
||||
],
|
||||
},
|
||||
{
|
||||
group: 'Management',
|
||||
items: [
|
||||
{ name: 'Client SDKs', href: '/vcon/clients', icon: 'Key' },
|
||||
{ name: 'CSV Storage & Disk', href: '/vcon/storage', icon: 'HardDrive' },
|
||||
{ name: 'Engine Settings', href: '/vcon/settings', icon: 'Sliders' },
|
||||
],
|
||||
},
|
||||
{
|
||||
group: 'Integration',
|
||||
items: [
|
||||
{ name: 'Python SDK Guide', href: '/vcon/sdk', icon: 'FileCode2' },
|
||||
{ name: 'Live Simulator', href: '/vcon/simulator', icon: 'Play' },
|
||||
],
|
||||
},
|
||||
];
|
||||
|
||||
return (
|
||||
<>
|
||||
{/* Mobile Backdrop */}
|
||||
{isOpen && (
|
||||
<div
|
||||
onClick={onClose}
|
||||
className="fixed inset-0 z-40 bg-black/60 md:hidden backdrop-blur-[1px]"
|
||||
/>
|
||||
)}
|
||||
|
||||
{/* Sidebar Container */}
|
||||
<aside
|
||||
className={cn(
|
||||
'fixed inset-y-0 left-0 z-50 md:static w-[210px] shrink-0 bg-[var(--bg-sidebar)] border-r border-[var(--border)] flex flex-col transition-transform duration-150 ease-in-out md:translate-x-0',
|
||||
isOpen ? 'translate-x-0' : '-translate-x-full'
|
||||
)}
|
||||
>
|
||||
{/* Top Header */}
|
||||
<div className="h-[38px] px-3 flex items-center justify-between border-b border-[var(--border)] bg-[var(--bg-activity)] shrink-0">
|
||||
<div className="flex items-center gap-1.5 min-w-0">
|
||||
<span className="w-1.5 h-1.5 bg-[var(--accent)] shrink-0" />
|
||||
<span className="text-[10.5px] font-semibold text-[var(--text)] tracking-wider uppercase truncate">
|
||||
VCON ADMIN
|
||||
</span>
|
||||
</div>
|
||||
<button
|
||||
onClick={onClose}
|
||||
className="md:hidden text-[var(--text-dim)] hover:text-[var(--text)] p-1 cursor-pointer"
|
||||
aria-label="Close menu"
|
||||
>
|
||||
<Icon name="X" size={13} />
|
||||
</button>
|
||||
</div>
|
||||
|
||||
{/* Navigation items */}
|
||||
<div className="flex-1 overflow-y-auto p-1.5 flex flex-col gap-2">
|
||||
{navigation.map((section, idx) => (
|
||||
<div key={idx} className="flex flex-col gap-0.5">
|
||||
<span className="text-[9px] font-semibold text-[var(--text-dim)] uppercase tracking-wider px-2 py-0.5">
|
||||
{section.group}
|
||||
</span>
|
||||
<div className="flex flex-col gap-0.5">
|
||||
{section.items.map((item) => {
|
||||
const isActive = pathname === item.href;
|
||||
return (
|
||||
<Link
|
||||
key={item.href}
|
||||
href={item.href}
|
||||
onClick={onClose}
|
||||
className={cn(
|
||||
'flex items-center justify-between px-2 py-1 text-[11px] transition-colors border',
|
||||
isActive
|
||||
? 'bg-[var(--accent-soft)] text-[var(--accent-hover)] font-medium border-[var(--accent)]'
|
||||
: 'border-transparent text-[var(--text-muted)] hover:text-[var(--text)] hover:bg-[var(--bg-hover)]'
|
||||
)}
|
||||
>
|
||||
<div className="flex items-center gap-2 min-w-0">
|
||||
<Icon
|
||||
name={item.icon}
|
||||
size={12}
|
||||
className={isActive ? 'text-[var(--accent)]' : 'text-[var(--text-dim)]'}
|
||||
/>
|
||||
<span className="truncate">{item.name}</span>
|
||||
</div>
|
||||
{item.badge && (
|
||||
<span className="text-[8px] px-1 py-0.2 bg-[var(--success-soft)] text-[var(--success)] font-mono border border-[var(--success)] shrink-0">
|
||||
{item.badge}
|
||||
</span>
|
||||
)}
|
||||
</Link>
|
||||
);
|
||||
})}
|
||||
</div>
|
||||
</div>
|
||||
))}
|
||||
</div>
|
||||
|
||||
{/* Footer info */}
|
||||
<div className="p-2 border-t border-[var(--border)] bg-[var(--bg-main)] text-[9.5px] text-[var(--text-dim)] font-mono flex flex-col gap-1 shrink-0">
|
||||
<div className="flex items-center justify-between">
|
||||
<span>Buffer Worker</span>
|
||||
<span className="text-[var(--success)] flex items-center gap-1 font-semibold">
|
||||
<span className="w-1.5 h-1.5 bg-[var(--success)] inline-block" />
|
||||
Active
|
||||
</span>
|
||||
</div>
|
||||
<div className="flex items-center justify-between">
|
||||
<span>Storage Engine</span>
|
||||
<span className="text-[var(--text-muted)]">json2csv</span>
|
||||
</div>
|
||||
<div className="flex items-center justify-between">
|
||||
<span>Auth Handshake</span>
|
||||
<span className="text-[var(--text-muted)]">JWT</span>
|
||||
</div>
|
||||
</div>
|
||||
</aside>
|
||||
</>
|
||||
);
|
||||
};
|
||||
|
||||
export default Sidebar;
|
||||
@@ -0,0 +1,15 @@
|
||||
# Layout Components Module Manifest
|
||||
|
||||
## Purpose
|
||||
Global layout shell, navigation, top bar, and admin sidebar complying with compact, zero-border-radius, zero-shadow design system.
|
||||
|
||||
## Components
|
||||
- **Navbar.tsx**: Top titlebar with brand, quick links, runtime port indicator (:4000/:3000), and dark/light theme switcher.
|
||||
- **Sidebar.tsx**: Dedicated `/vcon/` admin console sidebar with mobile drawer support, grouped telemetry & management links.
|
||||
- **Footer.tsx**: System runtime status line with storage convention display and port allocations.
|
||||
- **MainLayout.tsx**: Viewport-bounded responsive shell with mobile backdrop and scrolling main container.
|
||||
|
||||
## Dependencies
|
||||
- `components/ui`
|
||||
- `next/link`
|
||||
- `next/navigation`
|
||||
@@ -0,0 +1,68 @@
|
||||
import React from 'react';
|
||||
import { Card } from '@/components/ui/Card';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
|
||||
export const Architecture: React.FC = () => {
|
||||
return (
|
||||
<div className="flex flex-col gap-1.5 py-1">
|
||||
<div className="flex items-center justify-between border-b border-[var(--border)] pb-1">
|
||||
<h2 className="text-[11px] font-semibold text-[var(--text)] uppercase tracking-wider">
|
||||
Pipeline Flow
|
||||
</h2>
|
||||
<span className="text-[9px] text-[var(--text-dim)] font-mono">:4000 ➔ :3000</span>
|
||||
</div>
|
||||
|
||||
<Card compact className="p-2.5 flex flex-col gap-2 font-mono text-[10px] bg-[var(--bg-elevated)]">
|
||||
{/* Desktop Flow: 5 items */}
|
||||
<div className="hidden md:grid md:grid-cols-5 gap-1.5 items-center text-center">
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex flex-col items-center gap-0.5">
|
||||
<Icon name="FileCode" size={12} className="text-[var(--accent)]" />
|
||||
<span className="font-semibold text-[var(--text)]">Python SDK</span>
|
||||
</div>
|
||||
|
||||
<div className="text-[var(--text-dim)] flex items-center justify-center gap-1">
|
||||
<span className="text-[9px] px-1.5 py-0.2 border border-[var(--border)] bg-[var(--bg-main)] flex items-center gap-0.5">
|
||||
<span>JWT</span>
|
||||
<Icon name="ArrowRight" size={9} />
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<div className="p-1.5 border border-[var(--border-strong)] bg-[var(--bg-main)] flex flex-col items-center gap-0.5">
|
||||
<Icon name="Radio" size={12} className="text-[var(--accent)]" />
|
||||
<span className="font-semibold text-[var(--text)]">Express Ingest (:4000)</span>
|
||||
</div>
|
||||
|
||||
<div className="text-[var(--text-dim)] flex items-center justify-center gap-1">
|
||||
<span className="text-[9px] px-1.5 py-0.2 border border-[var(--border)] bg-[var(--bg-main)] flex items-center gap-0.5">
|
||||
<span>Buffer</span>
|
||||
<Icon name="ArrowRight" size={9} />
|
||||
</span>
|
||||
</div>
|
||||
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex flex-col items-center gap-0.5">
|
||||
<Icon name="HardDrive" size={12} className="text-[var(--success)]" />
|
||||
<span className="font-semibold text-[var(--text)]">CSV Storage (Disk)</span>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{/* Mobile Flow: Vertical */}
|
||||
<div className="flex md:hidden flex-col gap-1">
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-semibold text-[var(--text)]">1. Python SDK</span>
|
||||
<span className="text-[8.5px] text-[var(--text-dim)]">Client</span>
|
||||
</div>
|
||||
<div className="p-1.5 border border-[var(--border-strong)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-semibold text-[var(--text)]">2. Express (:4000)</span>
|
||||
<span className="text-[8.5px] text-[var(--accent)]">Ingest</span>
|
||||
</div>
|
||||
<div className="p-1.5 border border-[var(--border)] bg-[var(--bg-main)] flex items-center justify-between">
|
||||
<span className="font-semibold text-[var(--text)]">3. CSV Files</span>
|
||||
<span className="text-[8.5px] text-[var(--success)]">Rotated</span>
|
||||
</div>
|
||||
</div>
|
||||
</Card>
|
||||
</div>
|
||||
);
|
||||
};
|
||||
|
||||
export default Architecture;
|
||||
@@ -0,0 +1,67 @@
|
||||
import React from 'react';
|
||||
import { Card, CardHeader, CardTitle, CardContent } from '@/components/ui/Card';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
|
||||
export const Features: React.FC = () => {
|
||||
const items = [
|
||||
{
|
||||
icon: 'Zap',
|
||||
title: 'Decoupled Runtime Split',
|
||||
desc: 'Port 4000 WebSocket intake; Port 3000 Web & export.',
|
||||
},
|
||||
{
|
||||
icon: 'HardDrive',
|
||||
title: 'CSV File Persistence',
|
||||
desc: 'Streams directly to rotated CSV files on disk (Zero DB inserts).',
|
||||
},
|
||||
{
|
||||
icon: 'ShieldCheck',
|
||||
title: 'JWT SDK Authentication',
|
||||
desc: 'Signed tokens verify client IDs and rate limits on handshake.',
|
||||
},
|
||||
{
|
||||
icon: 'Cpu',
|
||||
title: 'In-Memory Buffer',
|
||||
desc: 'Aggregates 500 records or 2000ms intervals before async disk flush.',
|
||||
},
|
||||
{
|
||||
icon: 'CheckCheck',
|
||||
title: 'Idempotency Dedup',
|
||||
desc: 'Rejects duplicate clientId + eventId in 5-minute sliding TTL window.',
|
||||
},
|
||||
{
|
||||
icon: 'FileCode2',
|
||||
title: 'Python Client SDK',
|
||||
desc: 'datastack-sdk package with auto-reconnection and batch streaming.',
|
||||
},
|
||||
];
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-1.5 py-1">
|
||||
<div className="flex items-center justify-between border-b border-[var(--border)] pb-1">
|
||||
<h2 className="text-[11px] font-semibold text-[var(--text)] uppercase tracking-wider">
|
||||
Platform Architecture
|
||||
</h2>
|
||||
<span className="text-[9px] text-[var(--text-dim)] font-mono">6 SUBSYSTEMS</span>
|
||||
</div>
|
||||
|
||||
<div className="grid grid-cols-1 sm:grid-cols-2 lg:grid-cols-3 gap-1.5">
|
||||
{items.map((item, idx) => (
|
||||
<Card key={idx} compact className="flex flex-col gap-0.5 p-2">
|
||||
<CardHeader className="p-0 pb-0.5 mb-0 border-b-0 flex items-center gap-1.5">
|
||||
<div className="p-0.5 bg-[var(--bg-main)] text-[var(--accent)] border border-[var(--border-strong)] shrink-0">
|
||||
<Icon name={item.icon} size={11} />
|
||||
</div>
|
||||
<CardTitle className="text-[11px]">{item.title}</CardTitle>
|
||||
</CardHeader>
|
||||
<CardContent className="p-0 text-[10px] text-[var(--text-muted)] leading-tight">
|
||||
{item.desc}
|
||||
</CardContent>
|
||||
</Card>
|
||||
))}
|
||||
</div>
|
||||
</div>
|
||||
);
|
||||
};
|
||||
|
||||
export default Features;
|
||||
@@ -0,0 +1,90 @@
|
||||
'use client';
|
||||
|
||||
import React, { useState } from 'react';
|
||||
import Link from 'next/link';
|
||||
import { Button } from '@/components/ui/Button';
|
||||
import { Card } from '@/components/ui/Card';
|
||||
import { Icon } from '@/components/ui/Icon';
|
||||
|
||||
export const Hero: React.FC = () => {
|
||||
const [copied, setCopied] = useState(false);
|
||||
|
||||
const handleCopy = () => {
|
||||
navigator.clipboard.writeText('pip install ./sdk-python');
|
||||
setCopied(true);
|
||||
setTimeout(() => setCopied(false), 2000);
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-2.5 py-1">
|
||||
{/* Title */}
|
||||
<div className="flex flex-col gap-1">
|
||||
<h1 className="text-[16px] sm:text-[18px] font-semibold tracking-tight text-[var(--text)]">
|
||||
Realtime Data Collection Platform
|
||||
</h1>
|
||||
</div>
|
||||
|
||||
{/* Actions */}
|
||||
<div className="flex flex-wrap items-center gap-1.5">
|
||||
<Link href="/vcon/dashboard">
|
||||
<Button size="xs" variant="primary" icon="Terminal">
|
||||
Console (/vcon/)
|
||||
</Button>
|
||||
</Link>
|
||||
<Link href="/vcon/data">
|
||||
<Button size="xs" variant="secondary" icon="Activity">
|
||||
Live Stream
|
||||
</Button>
|
||||
</Link>
|
||||
<div className="flex items-center gap-1.5 border border-[var(--border)] bg-[var(--bg-elevated)] px-2 py-0.5 text-[10px] font-mono text-[var(--text)]">
|
||||
<span className="text-[var(--text-dim)]">$</span>
|
||||
<span>pip install ./sdk-python</span>
|
||||
<button
|
||||
onClick={handleCopy}
|
||||
className="text-[var(--text-dim)] hover:text-[var(--text)] ml-0.5 cursor-pointer"
|
||||
aria-label="Copy install command"
|
||||
>
|
||||
<Icon name={copied ? 'Check' : 'Copy'} size={11} />
|
||||
</button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
{/* 4 Clean Metric Cards */}
|
||||
<div className="grid grid-cols-2 lg:grid-cols-4 gap-1.5 pt-0.5">
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">
|
||||
<span>Ingestion</span>
|
||||
<Icon name="Radio" size={11} className="text-[var(--accent)]" />
|
||||
</div>
|
||||
<span className="text-[12.5px] font-semibold text-[var(--text)] font-mono">:4000 (ws)</span>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">
|
||||
<span>Web & API</span>
|
||||
<Icon name="LayoutDashboard" size={11} className="text-[var(--accent)]" />
|
||||
</div>
|
||||
<span className="text-[12.5px] font-semibold text-[var(--text)] font-mono">:3000 (http)</span>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">
|
||||
<span>Storage Engine</span>
|
||||
<Icon name="HardDrive" size={11} className="text-[var(--accent)]" />
|
||||
</div>
|
||||
<span className="text-[12.5px] font-semibold text-[var(--text)] font-mono">Rotated CSV</span>
|
||||
</Card>
|
||||
|
||||
<Card compact className="p-2 flex flex-col gap-0.5 bg-[var(--bg-elevated)]">
|
||||
<div className="flex items-center justify-between text-[8.5px] uppercase tracking-wider text-[var(--text-dim)] font-medium">
|
||||
<span>Buffer Limit</span>
|
||||
<Icon name="Cpu" size={11} className="text-[var(--accent)]" />
|
||||
</div>
|
||||
<span className="text-[12.5px] font-semibold text-[var(--text)] font-mono">500 rows / 2s</span>
|
||||
</Card>
|
||||
</div>
|
||||
</div>
|
||||
);
|
||||
};
|
||||
|
||||
export default Hero;
|
||||
@@ -0,0 +1,9 @@
|
||||
# Sections Manifest
|
||||
|
||||
## Purpose
|
||||
Modular section blocks used in landing page and documentation views.
|
||||
|
||||
## Sections
|
||||
- `Hero.tsx`: Headline, technical metrics, quick start buttons
|
||||
- `Features.tsx`: Subsystem cards with icons and descriptions
|
||||
- `Architecture.tsx`: Visual diagram of decoupled port 4000/3000 runtime and data flow.
|
||||
@@ -0,0 +1,80 @@
|
||||
import React from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
import { Icon } from './Icon';
|
||||
|
||||
export interface ButtonProps extends React.ButtonHTMLAttributes<HTMLButtonElement> {
|
||||
variant?: 'primary' | 'secondary' | 'ghost' | 'danger' | 'icon';
|
||||
size?: 'default' | 'sm' | 'xs' | 'icon';
|
||||
icon?: string;
|
||||
iconPosition?: 'left' | 'right';
|
||||
loading?: boolean;
|
||||
}
|
||||
|
||||
export const Button = React.forwardRef<HTMLButtonElement, ButtonProps>(
|
||||
(
|
||||
{
|
||||
children,
|
||||
className,
|
||||
variant = 'secondary',
|
||||
size = 'default',
|
||||
icon,
|
||||
iconPosition = 'left',
|
||||
loading = false,
|
||||
disabled,
|
||||
...props
|
||||
},
|
||||
ref
|
||||
) => {
|
||||
const baseStyles =
|
||||
'inline-flex items-center justify-center font-normal transition-colors select-none cursor-pointer disabled:opacity-50 disabled:cursor-not-allowed border border-transparent whitespace-nowrap outline-none';
|
||||
|
||||
const variantStyles = {
|
||||
primary:
|
||||
'bg-[var(--accent)] text-[var(--text-on-accent)] hover:bg-[var(--accent-hover)] border-[var(--accent)]',
|
||||
secondary:
|
||||
'bg-[var(--bg-elevated)] text-[var(--text)] border-[var(--border-strong)] hover:bg-[var(--bg-hover)]',
|
||||
ghost:
|
||||
'bg-transparent text-[var(--text-muted)] hover:text-[var(--text)] hover:bg-[var(--bg-hover)] border-transparent',
|
||||
danger:
|
||||
'bg-transparent text-[var(--danger)] border-[var(--danger)] hover:bg-[var(--danger-soft)]',
|
||||
icon:
|
||||
'bg-transparent text-[var(--text-muted)] hover:text-[var(--text)] hover:bg-[var(--bg-hover)] border-transparent p-0',
|
||||
};
|
||||
|
||||
const sizeStyles = {
|
||||
default: 'h-[32px] px-[14px] text-[12.5px] gap-[7px]',
|
||||
sm: 'h-[27px] px-[10px] text-[11.5px] gap-[5px]',
|
||||
xs: 'h-[24px] px-[7px] text-[10.5px] gap-[4px]',
|
||||
icon: 'w-[30px] h-[30px] p-0',
|
||||
};
|
||||
|
||||
return (
|
||||
<button
|
||||
ref={ref}
|
||||
disabled={disabled || loading}
|
||||
className={cn(
|
||||
baseStyles,
|
||||
variantStyles[variant],
|
||||
size === 'icon' ? sizeStyles.icon : sizeStyles[size],
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{loading ? (
|
||||
<Icon name="Loader2" size={size === 'sm' || size === 'xs' ? 12 : 14} className="animate-spin" />
|
||||
) : (
|
||||
icon && iconPosition === 'left' && (
|
||||
<Icon name={icon} size={size === 'sm' || size === 'xs' ? 12 : 14} />
|
||||
)
|
||||
)}
|
||||
{children && <span>{children}</span>}
|
||||
{!loading && icon && iconPosition === 'right' && (
|
||||
<Icon name={icon} size={size === 'sm' || size === 'xs' ? 12 : 14} />
|
||||
)}
|
||||
</button>
|
||||
);
|
||||
}
|
||||
);
|
||||
|
||||
Button.displayName = 'Button';
|
||||
export default Button;
|
||||
@@ -0,0 +1,100 @@
|
||||
import React from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
|
||||
export interface CardProps extends React.HTMLAttributes<HTMLDivElement> {
|
||||
variant?: 'default' | 'subtle' | 'dashed' | 'active';
|
||||
compact?: boolean;
|
||||
}
|
||||
|
||||
export const Card: React.FC<CardProps> = ({
|
||||
children,
|
||||
variant = 'default',
|
||||
compact = false,
|
||||
className,
|
||||
...props
|
||||
}) => {
|
||||
const variantStyles = {
|
||||
default: 'bg-[var(--bg-elevated)] border border-[var(--border)] text-[var(--text)]',
|
||||
subtle: 'bg-[var(--bg-main)] border border-[var(--border)] text-[var(--text)]',
|
||||
dashed: 'bg-[var(--bg-main)] border border-dashed border-[var(--border-strong)] text-[var(--text)]',
|
||||
active: 'bg-[var(--accent-soft)] border border-[var(--accent)] text-[var(--text)]',
|
||||
};
|
||||
|
||||
return (
|
||||
<div
|
||||
className={cn(
|
||||
'transition-colors',
|
||||
variantStyles[variant],
|
||||
compact ? 'p-2.5' : 'p-3.5 sm:p-4',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</div>
|
||||
);
|
||||
};
|
||||
|
||||
export const CardHeader: React.FC<React.HTMLAttributes<HTMLDivElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<div
|
||||
className={cn(
|
||||
'flex items-center justify-between gap-2.5 pb-2.5 mb-2.5 border-b border-[var(--border)]',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</div>
|
||||
);
|
||||
|
||||
export const CardTitle: React.FC<React.HTMLAttributes<HTMLHeadingElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<h3 className={cn('text-[13px] font-semibold text-[var(--text)] leading-tight', className)} {...props}>
|
||||
{children}
|
||||
</h3>
|
||||
);
|
||||
|
||||
export const CardDescription: React.FC<React.HTMLAttributes<HTMLParagraphElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<p className={cn('text-[11px] text-[var(--text-muted)] leading-normal', className)} {...props}>
|
||||
{children}
|
||||
</p>
|
||||
);
|
||||
|
||||
export const CardContent: React.FC<React.HTMLAttributes<HTMLDivElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<div className={cn('text-[12px]', className)} {...props}>
|
||||
{children}
|
||||
</div>
|
||||
);
|
||||
|
||||
export const CardFooter: React.FC<React.HTMLAttributes<HTMLDivElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<div
|
||||
className={cn(
|
||||
'flex items-center justify-between gap-2 pt-2.5 mt-2.5 border-t border-[var(--border)] text-[11px]',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</div>
|
||||
);
|
||||
|
||||
export default Card;
|
||||
@@ -0,0 +1,61 @@
|
||||
import React from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
|
||||
export const Form: React.FC<React.FormHTMLAttributes<HTMLFormElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<form className={cn('flex flex-col gap-3', className)} {...props}>
|
||||
{children}
|
||||
</form>
|
||||
);
|
||||
|
||||
export const FormField: React.FC<React.HTMLAttributes<HTMLDivElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<div className={cn('flex flex-col gap-1 w-full', className)} {...props}>
|
||||
{children}
|
||||
</div>
|
||||
);
|
||||
|
||||
export const FormRow: React.FC<React.HTMLAttributes<HTMLDivElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<div className={cn('grid grid-cols-1 sm:grid-cols-2 gap-3 w-full', className)} {...props}>
|
||||
{children}
|
||||
</div>
|
||||
);
|
||||
|
||||
export const FormSwitch: React.FC<{
|
||||
label: string;
|
||||
checked: boolean;
|
||||
onChange: (checked: boolean) => void;
|
||||
description?: string;
|
||||
disabled?: boolean;
|
||||
}> = ({ label, checked, onChange, description, disabled = false }) => (
|
||||
<label
|
||||
className={cn(
|
||||
'flex items-center justify-between p-2.5 border border-[var(--border)] bg-[var(--bg-main)] cursor-pointer select-none transition-colors hover:bg-[var(--bg-hover)]',
|
||||
disabled && 'opacity-50 cursor-not-allowed'
|
||||
)}
|
||||
>
|
||||
<div className="flex flex-col">
|
||||
<span className="text-[12px] font-medium text-[var(--text)]">{label}</span>
|
||||
{description && <span className="text-[10.5px] text-[var(--text-dim)]">{description}</span>}
|
||||
</div>
|
||||
<input
|
||||
type="checkbox"
|
||||
checked={checked}
|
||||
disabled={disabled}
|
||||
onChange={(e) => onChange(e.target.checked)}
|
||||
className="w-4 h-4 accent-[var(--accent)] cursor-pointer"
|
||||
/>
|
||||
</label>
|
||||
);
|
||||
|
||||
export default Form;
|
||||
@@ -0,0 +1,36 @@
|
||||
import React from 'react';
|
||||
import * as LucideIcons from 'lucide-react';
|
||||
import { cn } from '@/lib/utils';
|
||||
|
||||
export type IconName = keyof typeof LucideIcons;
|
||||
|
||||
interface IconProps {
|
||||
name: string;
|
||||
size?: number;
|
||||
className?: string;
|
||||
color?: string;
|
||||
}
|
||||
|
||||
export const Icon: React.FC<IconProps> = ({
|
||||
name,
|
||||
size = 14,
|
||||
className,
|
||||
color,
|
||||
}) => {
|
||||
const LucideIcon = (LucideIcons as unknown as Record<string, React.ComponentType<{ size?: number; className?: string; style?: React.CSSProperties }>>)[name];
|
||||
|
||||
if (!LucideIcon) {
|
||||
const Fallback = LucideIcons.Activity;
|
||||
return <Fallback size={size} className={cn('shrink-0 text-current', className)} style={{ color }} />;
|
||||
}
|
||||
|
||||
return (
|
||||
<LucideIcon
|
||||
size={size}
|
||||
className={cn('shrink-0 text-current transition-colors', className)}
|
||||
style={{ color }}
|
||||
/>
|
||||
);
|
||||
};
|
||||
|
||||
export default Icon;
|
||||
@@ -0,0 +1,136 @@
|
||||
import React from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
import { Icon } from './Icon';
|
||||
|
||||
export interface InputProps extends React.InputHTMLAttributes<HTMLInputElement> {
|
||||
label?: string;
|
||||
error?: string;
|
||||
icon?: string;
|
||||
compact?: boolean;
|
||||
}
|
||||
|
||||
export const Input = React.forwardRef<HTMLInputElement, InputProps>(
|
||||
({ label, error, icon, compact = false, className, id, ...props }, ref) => {
|
||||
const inputId = id || (label ? label.toLowerCase().replace(/\s+/g, '-') : undefined);
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-1 w-full text-left">
|
||||
{label && (
|
||||
<label
|
||||
htmlFor={inputId}
|
||||
className="text-[10.5px] font-semibold text-[var(--text-muted)] uppercase tracking-wider"
|
||||
>
|
||||
{label}
|
||||
</label>
|
||||
)}
|
||||
<div className="relative flex items-center w-full">
|
||||
{icon && (
|
||||
<div className="absolute left-2.5 flex items-center pointer-events-none text-[var(--text-dim)]">
|
||||
<Icon name={icon} size={13} />
|
||||
</div>
|
||||
)}
|
||||
<input
|
||||
id={inputId}
|
||||
ref={ref}
|
||||
className={cn(
|
||||
'w-full bg-[var(--bg-main)] text-[var(--text)] border border-[var(--border-strong)] placeholder:text-[var(--text-dim)] transition-colors focus:outline-none focus:border-[var(--accent)] disabled:opacity-50 disabled:cursor-not-allowed',
|
||||
compact ? 'h-[28px] px-2 text-[11px]' : 'h-[32px] px-2.5 text-[12px]',
|
||||
icon && 'pl-8',
|
||||
error && 'border-[var(--danger)]',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
/>
|
||||
</div>
|
||||
{error && <span className="text-[10.5px] text-[var(--danger)]">{error}</span>}
|
||||
</div>
|
||||
);
|
||||
}
|
||||
);
|
||||
|
||||
Input.displayName = 'Input';
|
||||
|
||||
export interface TextareaProps extends React.TextareaHTMLAttributes<HTMLTextAreaElement> {
|
||||
label?: string;
|
||||
error?: string;
|
||||
}
|
||||
|
||||
export const Textarea = React.forwardRef<HTMLTextAreaElement, TextareaProps>(
|
||||
({ label, error, className, id, ...props }, ref) => {
|
||||
const textareaId = id || (label ? label.toLowerCase().replace(/\s+/g, '-') : undefined);
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-1 w-full text-left">
|
||||
{label && (
|
||||
<label
|
||||
htmlFor={textareaId}
|
||||
className="text-[10.5px] font-semibold text-[var(--text-muted)] uppercase tracking-wider"
|
||||
>
|
||||
{label}
|
||||
</label>
|
||||
)}
|
||||
<textarea
|
||||
id={textareaId}
|
||||
ref={ref}
|
||||
className={cn(
|
||||
'w-full bg-[var(--bg-main)] text-[var(--text)] border border-[var(--border-strong)] p-2.5 text-[12px] placeholder:text-[var(--text-dim)] focus:outline-none focus:border-[var(--accent)] min-h-[64px] resize-y font-mono',
|
||||
error && 'border-[var(--danger)]',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
/>
|
||||
{error && <span className="text-[10.5px] text-[var(--danger)]">{error}</span>}
|
||||
</div>
|
||||
);
|
||||
}
|
||||
);
|
||||
|
||||
Textarea.displayName = 'Textarea';
|
||||
|
||||
export interface SelectProps extends React.SelectHTMLAttributes<HTMLSelectElement> {
|
||||
label?: string;
|
||||
error?: string;
|
||||
compact?: boolean;
|
||||
options?: { value: string; label: string }[];
|
||||
}
|
||||
|
||||
export const Select = React.forwardRef<HTMLSelectElement, SelectProps>(
|
||||
({ label, error, compact = false, options, children, className, id, ...props }, ref) => {
|
||||
const selectId = id || (label ? label.toLowerCase().replace(/\s+/g, '-') : undefined);
|
||||
|
||||
return (
|
||||
<div className="flex flex-col gap-1 w-full text-left">
|
||||
{label && (
|
||||
<label
|
||||
htmlFor={selectId}
|
||||
className="text-[10.5px] font-semibold text-[var(--text-muted)] uppercase tracking-wider"
|
||||
>
|
||||
{label}
|
||||
</label>
|
||||
)}
|
||||
<select
|
||||
id={selectId}
|
||||
ref={ref}
|
||||
className={cn(
|
||||
'w-full bg-[var(--bg-main)] text-[var(--text)] border border-[var(--border-strong)] focus:outline-none focus:border-[var(--accent)] cursor-pointer',
|
||||
compact ? 'h-[28px] px-1.5 text-[11px]' : 'h-[32px] px-2 text-[11.5px]',
|
||||
error && 'border-[var(--danger)]',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{options
|
||||
? options.map((opt) => (
|
||||
<option key={opt.value} value={opt.value} className="bg-[var(--bg-elevated)] text-[var(--text)]">
|
||||
{opt.label}
|
||||
</option>
|
||||
))
|
||||
: children}
|
||||
</select>
|
||||
{error && <span className="text-[10.5px] text-[var(--danger)]">{error}</span>}
|
||||
</div>
|
||||
);
|
||||
}
|
||||
);
|
||||
|
||||
Select.displayName = 'Select';
|
||||
@@ -0,0 +1,89 @@
|
||||
import React, { useEffect } from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
import { Icon } from './Icon';
|
||||
import { Button } from './Button';
|
||||
|
||||
export interface ModalProps {
|
||||
isOpen: boolean;
|
||||
onClose: () => void;
|
||||
title: string;
|
||||
description?: string;
|
||||
children: React.ReactNode;
|
||||
footer?: React.ReactNode;
|
||||
maxWidth?: 'sm' | 'md' | 'lg';
|
||||
}
|
||||
|
||||
export const Modal: React.FC<ModalProps> = ({
|
||||
isOpen,
|
||||
onClose,
|
||||
title,
|
||||
description,
|
||||
children,
|
||||
footer,
|
||||
maxWidth = 'md',
|
||||
}) => {
|
||||
useEffect(() => {
|
||||
const handleKeyDown = (e: KeyboardEvent) => {
|
||||
if (e.key === 'Escape' && isOpen) {
|
||||
onClose();
|
||||
}
|
||||
};
|
||||
if (isOpen) {
|
||||
document.body.style.overflow = 'hidden';
|
||||
window.addEventListener('keydown', handleKeyDown);
|
||||
}
|
||||
return () => {
|
||||
document.body.style.overflow = '';
|
||||
window.removeEventListener('keydown', handleKeyDown);
|
||||
};
|
||||
}, [isOpen, onClose]);
|
||||
|
||||
if (!isOpen) return null;
|
||||
|
||||
const maxWidthStyles = {
|
||||
sm: 'max-w-[440px]',
|
||||
md: 'max-w-[520px]',
|
||||
lg: 'max-w-[640px]',
|
||||
};
|
||||
|
||||
return (
|
||||
<div className="fixed inset-0 z-50 flex items-center justify-center p-3.5 bg-black/60 backdrop-blur-[1px]">
|
||||
<div
|
||||
className={cn(
|
||||
'w-full bg-[var(--bg-elevated)] border border-[var(--border-strong)] text-[var(--text)] flex flex-col max-h-[min(84dvh,680px)] overflow-hidden animate-in fade-in zoom-in-95 duration-100',
|
||||
maxWidthStyles[maxWidth]
|
||||
)}
|
||||
>
|
||||
<div className="flex items-start justify-between gap-3 p-3.5 sm:px-4 sm:py-3.5 border-b border-[var(--border)] shrink-0">
|
||||
<div className="min-w-0">
|
||||
<h2 className="text-[14px] font-semibold text-[var(--text)] leading-tight">{title}</h2>
|
||||
{description && (
|
||||
<p className="text-[11px] text-[var(--text-muted)] mt-1">{description}</p>
|
||||
)}
|
||||
</div>
|
||||
<Button
|
||||
size="icon"
|
||||
variant="ghost"
|
||||
onClick={onClose}
|
||||
aria-label="Close dialog"
|
||||
className="w-7 h-7 text-[var(--text-dim)] hover:text-[var(--text)]"
|
||||
>
|
||||
<Icon name="X" size={14} />
|
||||
</Button>
|
||||
</div>
|
||||
|
||||
<div className="p-3.5 sm:p-4 overflow-y-auto flex-1 text-[12px] flex flex-col gap-3">
|
||||
{children}
|
||||
</div>
|
||||
|
||||
{footer && (
|
||||
<div className="flex items-center justify-end gap-2 p-3 sm:px-4 border-t border-[var(--border)] bg-[var(--bg-sidebar)] shrink-0">
|
||||
{footer}
|
||||
</div>
|
||||
)}
|
||||
</div>
|
||||
</div>
|
||||
);
|
||||
};
|
||||
|
||||
export default Modal;
|
||||
@@ -0,0 +1,108 @@
|
||||
import React from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
|
||||
export const TableWrap: React.FC<React.HTMLAttributes<HTMLDivElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<div
|
||||
className={cn(
|
||||
'w-full overflow-x-auto border border-[var(--border)] bg-[var(--bg-elevated)]',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</div>
|
||||
);
|
||||
|
||||
export const Table: React.FC<React.TableHTMLAttributes<HTMLTableElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<table
|
||||
className={cn(
|
||||
'w-full min-w-[540px] border-collapse text-left text-[11px] whitespace-nowrap',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</table>
|
||||
);
|
||||
|
||||
export const TableHeader: React.FC<React.HTMLAttributes<HTMLTableSectionElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<thead
|
||||
className={cn(
|
||||
'bg-[var(--bg-sidebar)] border-b border-[var(--border)] text-[9.5px] font-semibold text-[var(--text-dim)] uppercase tracking-wider',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</thead>
|
||||
);
|
||||
|
||||
export const TableBody: React.FC<React.HTMLAttributes<HTMLTableSectionElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => <tbody className={cn('divide-y divide-[var(--border)]', className)} {...props}>{children}</tbody>;
|
||||
|
||||
export const TableRow: React.FC<React.HTMLAttributes<HTMLTableRowElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<tr
|
||||
className={cn(
|
||||
'transition-colors hover:bg-[var(--bg-hover)] text-[var(--text)]',
|
||||
className
|
||||
)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</tr>
|
||||
);
|
||||
|
||||
export const TableHead: React.FC<React.ThHTMLAttributes<HTMLTableCellElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<th className={cn('px-2.5 py-1.5 font-medium', className)} {...props}>
|
||||
{children}
|
||||
</th>
|
||||
);
|
||||
|
||||
export const TableCell: React.FC<React.TdHTMLAttributes<HTMLTableCellElement>> = ({
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => (
|
||||
<td className={cn('px-2.5 py-1.5 text-[var(--text-muted)] align-middle', className)} {...props}>
|
||||
{children}
|
||||
</td>
|
||||
);
|
||||
|
||||
export const TableEmpty: React.FC<{ colSpan: number; message?: string }> = ({
|
||||
colSpan,
|
||||
message = 'No data available',
|
||||
}) => (
|
||||
<tr>
|
||||
<td
|
||||
colSpan={colSpan}
|
||||
className="px-3 py-6 text-center text-[10.5px] text-[var(--text-dim)] italic"
|
||||
>
|
||||
{message}
|
||||
</td>
|
||||
</tr>
|
||||
);
|
||||
|
||||
export default Table;
|
||||
@@ -0,0 +1,39 @@
|
||||
import React from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
|
||||
interface TextProps extends React.HTMLAttributes<HTMLElement> {
|
||||
as?: 'h1' | 'h2' | 'h3' | 'h4' | 'p' | 'span' | 'label' | 'code' | 'div';
|
||||
variant?: 'h1' | 'h2' | 'h3' | 'body' | 'muted' | 'dim' | 'label' | 'code' | 'badge';
|
||||
children: React.ReactNode;
|
||||
}
|
||||
|
||||
export const Text: React.FC<TextProps> = ({
|
||||
as: Component = 'p',
|
||||
variant = 'body',
|
||||
className,
|
||||
children,
|
||||
...props
|
||||
}) => {
|
||||
const variantStyles = {
|
||||
h1: 'text-[18px] font-semibold tracking-tight text-[var(--text)]',
|
||||
h2: 'text-[15px] font-semibold text-[var(--text)]',
|
||||
h3: 'text-[13px] font-medium text-[var(--text)]',
|
||||
body: 'text-[12.5px] font-normal text-[var(--text)]',
|
||||
muted: 'text-[11.5px] font-normal text-[var(--text-muted)]',
|
||||
dim: 'text-[10.5px] font-normal text-[var(--text-dim)]',
|
||||
label: 'text-[11px] font-medium uppercase tracking-wider text-[var(--text-dim)]',
|
||||
code: 'text-[11px] font-mono text-[var(--accent)] bg-[var(--bg-hover)] px-1.5 py-0.5 border border-[var(--border)]',
|
||||
badge: 'text-[10px] font-medium px-1.5 py-0.5 border border-[var(--border)] text-[var(--text-muted)] inline-flex items-center gap-1',
|
||||
};
|
||||
|
||||
return (
|
||||
<Component
|
||||
className={cn(variantStyles[variant], className)}
|
||||
{...props}
|
||||
>
|
||||
{children}
|
||||
</Component>
|
||||
);
|
||||
};
|
||||
|
||||
export default Text;
|
||||
@@ -0,0 +1,121 @@
|
||||
'use client';
|
||||
|
||||
import React, { createContext, useContext, useState, useCallback } from 'react';
|
||||
import { cn } from '@/lib/utils';
|
||||
import { Icon } from './Icon';
|
||||
|
||||
export type ToastType = 'success' | 'error' | 'warning' | 'info';
|
||||
|
||||
export interface ToastMessage {
|
||||
id: string;
|
||||
type: ToastType;
|
||||
title: string;
|
||||
message?: string;
|
||||
duration?: number;
|
||||
}
|
||||
|
||||
interface ToastContextType {
|
||||
toast: (options: Omit<ToastMessage, 'id'>) => void;
|
||||
success: (title: string, message?: string) => void;
|
||||
error: (title: string, message?: string) => void;
|
||||
warning: (title: string, message?: string) => void;
|
||||
info: (title: string, message?: string) => void;
|
||||
}
|
||||
|
||||
const ToastContext = createContext<ToastContextType | undefined>(undefined);
|
||||
|
||||
export const ToastProvider: React.FC<{ children: React.ReactNode }> = ({ children }) => {
|
||||
const [toasts, setToasts] = useState<ToastMessage[]>([]);
|
||||
|
||||
const removeToast = useCallback((id: string) => {
|
||||
setToasts((prev) => prev.filter((t) => t.id !== id));
|
||||
}, []);
|
||||
|
||||
const addToast = useCallback(
|
||||
({ type = 'info', title, message, duration = 3500 }: Omit<ToastMessage, 'id'>) => {
|
||||
const id = `${Date.now()}-${Math.random().toString(36).substring(2, 7)}`;
|
||||
setToasts((prev) => [...prev, { id, type, title, message, duration }]);
|
||||
|
||||
if (duration > 0) {
|
||||
setTimeout(() => {
|
||||
removeToast(id);
|
||||
}, duration);
|
||||
}
|
||||
},
|
||||
[removeToast]
|
||||
);
|
||||
|
||||
const success = useCallback((title: string, message?: string) => addToast({ type: 'success', title, message }), [addToast]);
|
||||
const error = useCallback((title: string, message?: string) => addToast({ type: 'error', title, message }), [addToast]);
|
||||
const warning = useCallback((title: string, message?: string) => addToast({ type: 'warning', title, message }), [addToast]);
|
||||
const info = useCallback((title: string, message?: string) => addToast({ type: 'info', title, message }), [addToast]);
|
||||
|
||||
return (
|
||||
<ToastContext.Provider value={{ toast: addToast, success, error, warning, info }}>
|
||||
{children}
|
||||
<div className="fixed bottom-4 right-4 z-[9999] flex flex-col gap-2 max-w-[340px] pointer-events-none">
|
||||
{toasts.map((t) => {
|
||||
const typeBorder = {
|
||||
success: 'border-l-[3px] border-l-[var(--success)]',
|
||||
error: 'border-l-[3px] border-l-[var(--danger)]',
|
||||
warning: 'border-l-[3px] border-l-[var(--warning)]',
|
||||
info: 'border-l-[3px] border-l-[var(--accent)]',
|
||||
}[t.type];
|
||||
|
||||
const typeIcon = {
|
||||
success: 'CheckCircle2',
|
||||
error: 'AlertCircle',
|
||||
warning: 'AlertTriangle',
|
||||
info: 'Info',
|
||||
}[t.type];
|
||||
|
||||
const iconColor = {
|
||||
success: 'var(--success)',
|
||||
error: 'var(--danger)',
|
||||
warning: 'var(--warning)',
|
||||
info: 'var(--accent)',
|
||||
}[t.type];
|
||||
|
||||
return (
|
||||
<div
|
||||
key={t.id}
|
||||
className={cn(
|
||||
'pointer-events-auto flex items-start gap-2.5 p-3 bg-[var(--bg-elevated)] border border-[var(--border-strong)] text-[var(--text)] text-[12px] transition-all',
|
||||
typeBorder
|
||||
)}
|
||||
>
|
||||
<div className="mt-0.5 shrink-0">
|
||||
<Icon name={typeIcon} size={14} color={iconColor} />
|
||||
</div>
|
||||
<div className="flex-1 min-w-0">
|
||||
<div className="font-medium text-[var(--text)] leading-tight">{t.title}</div>
|
||||
{t.message && (
|
||||
<div className="text-[11px] text-[var(--text-muted)] mt-0.5 leading-normal break-words">
|
||||
{t.message}
|
||||
</div>
|
||||
)}
|
||||
</div>
|
||||
<button
|
||||
onClick={() => removeToast(t.id)}
|
||||
className="shrink-0 text-[var(--text-dim)] hover:text-[var(--text)] p-0.5 cursor-pointer"
|
||||
aria-label="Dismiss toast"
|
||||
>
|
||||
<Icon name="X" size={12} />
|
||||
</button>
|
||||
</div>
|
||||
);
|
||||
})}
|
||||
</div>
|
||||
</ToastContext.Provider>
|
||||
);
|
||||
};
|
||||
|
||||
export const useToast = () => {
|
||||
const context = useContext(ToastContext);
|
||||
if (!context) {
|
||||
throw new Error('useToast must be used within a ToastProvider');
|
||||
}
|
||||
return context;
|
||||
};
|
||||
|
||||
export default ToastProvider;
|
||||
@@ -0,0 +1,9 @@
|
||||
export * from './Button';
|
||||
export * from './Input';
|
||||
export * from './Card';
|
||||
export * from './Modal';
|
||||
export * from './Table';
|
||||
export * from './Form';
|
||||
export * from './Text';
|
||||
export * from './Icon';
|
||||
export * from './Toast';
|
||||
@@ -0,0 +1,19 @@
|
||||
# UI Components Module Manifest
|
||||
|
||||
## Purpose
|
||||
Unified, zero-pill, zero-shadow compact UI design system following the DataStack design guidelines.
|
||||
|
||||
## Components
|
||||
- **Button.tsx**: Standardised buttons with size variants (default 32px, sm 27px, xs 24px, icon 30px), zero border-radius, outline focus.
|
||||
- **Input.tsx**: Inputs, Textareas, and Selects with consistent border token and Segoe UI typography.
|
||||
- **Card.tsx**: Structured data container surfaces with zero radius, 1px subtle borders, and header/content/footer partitions.
|
||||
- **Modal.tsx**: Accessible dialogs with key listener (Escape), backdrop blur, and flexible action footers.
|
||||
- **Table.tsx**: Compact fixed data tables for real-time streams, client listings, and export jobs.
|
||||
- **Form.tsx**: Form wrappers, switch toggles, and multi-column row layouts.
|
||||
- **Text.tsx**: Typography engine providing hierarchy (h1, h2, h3, body, muted, dim, label, code, badge).
|
||||
- **Icon.tsx**: Lucide-react wrapper for icon rendering.
|
||||
- **Toast.tsx**: Real-time notification and error/success/warning report system.
|
||||
|
||||
## Dependencies
|
||||
- `lucide-react`
|
||||
- `@/lib/utils` (clsx + tailwind-merge)
|
||||
@@ -0,0 +1,30 @@
|
||||
import { SDKManager } from '../sdk/sdkManager';
|
||||
import { SettingsManager } from '../adminSettings/settingsManager';
|
||||
|
||||
/**
|
||||
* Database Module (PostgreSQL + Prisma abstraction)
|
||||
* CRITICAL RULE: PostgreSQL stores strictly administrative metadata,
|
||||
* client registrations, and configuration. Collected data is NEVER stored in PostgreSQL.
|
||||
*/
|
||||
export class DatabaseEngine {
|
||||
public static isConnected = true;
|
||||
|
||||
public static async getHealth() {
|
||||
return {
|
||||
status: 'healthy',
|
||||
type: 'PostgreSQL + Prisma Schema Managed',
|
||||
database: 'datastack_db',
|
||||
role: 'Metadata & SDK Registrations Only',
|
||||
collectedDataStorage: 'Strictly CSV (/storage/data)',
|
||||
};
|
||||
}
|
||||
|
||||
public static async syncState() {
|
||||
return {
|
||||
clientsCount: SDKManager.listClients().length,
|
||||
settings: SettingsManager.getSettings(),
|
||||
};
|
||||
}
|
||||
}
|
||||
|
||||
export default DatabaseEngine;
|
||||
@@ -0,0 +1,12 @@
|
||||
# Database Engine Manifest
|
||||
|
||||
## Purpose
|
||||
Database layer managing PostgreSQL schema via Prisma ORM.
|
||||
|
||||
## Absolute Constraint
|
||||
PostgreSQL is utilized ONLY for:
|
||||
1. Client SDK registrations and API keys
|
||||
2. Admin settings and feature flags
|
||||
3. System audit logs
|
||||
|
||||
**Collected realtime data is NEVER stored per-row in PostgreSQL.** It is stored exclusively in rotated CSV files at `/storage/data/{clientId}/{YYYY-MM-DD}.csv`.
|
||||
@@ -0,0 +1,12 @@
|
||||
# Security Engine Manifest
|
||||
|
||||
## Purpose
|
||||
Enforces client rate-limiting, event idempotency verification, and payload size bounds.
|
||||
|
||||
## Key Logic
|
||||
- **Idempotency**: Drops duplicate `clientId + eventId` within a 5-minute TTL window.
|
||||
- **Rate Limit**: Sliding per-second window configurable per client or globally.
|
||||
- **Payload Guard**: Rejects payloads exceeding 100KB per event with explicit codes.
|
||||
|
||||
## Dependencies
|
||||
- Native Node.js `Buffer`, `Map`
|
||||
@@ -0,0 +1,119 @@
|
||||
export interface ValidationResult {
|
||||
allowed: boolean;
|
||||
reason?: string;
|
||||
code?: 'RATE_LIMIT_EXCEEDED' | 'PAYLOAD_TOO_LARGE' | 'DUPLICATE_EVENT' | 'MALFORMED_PAYLOAD';
|
||||
}
|
||||
|
||||
export class SecurityEngine {
|
||||
// Idempotency cache: key -> timestamp (expires after TTL)
|
||||
private static idempotencySet = new Map<string, number>();
|
||||
private static readonly IDEMPOTENCY_TTL_MS = 5 * 60 * 1000; // 5 minutes
|
||||
|
||||
// Rate limiter: clientId -> { count, windowStart }
|
||||
private static rateLimitMap = new Map<string, { count: number; windowStart: number }>();
|
||||
|
||||
// Default Max payload size (100KB)
|
||||
public static maxPayloadSizeBytes = 100 * 1024;
|
||||
|
||||
/**
|
||||
* Idempotency Check:
|
||||
* ClientId + EventId must be unique.
|
||||
* Duplicate events are dropped silently or tagged.
|
||||
*/
|
||||
public static checkIdempotency(clientId: string, eventId: string): boolean {
|
||||
if (!eventId) return true; // If no eventId generated, pass through
|
||||
const key = `${clientId}:${eventId}`;
|
||||
const now = Date.now();
|
||||
|
||||
// Periodic cleanup of stale idempotency keys
|
||||
if (this.idempotencySet.size > 20000) {
|
||||
for (const [k, timestamp] of this.idempotencySet.entries()) {
|
||||
if (now - timestamp > this.IDEMPOTENCY_TTL_MS) {
|
||||
this.idempotencySet.delete(k);
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
if (this.idempotencySet.has(key)) {
|
||||
const storedTime = this.idempotencySet.get(key) || 0;
|
||||
if (now - storedTime < this.IDEMPOTENCY_TTL_MS) {
|
||||
return false; // Duplicate detected
|
||||
}
|
||||
}
|
||||
|
||||
this.idempotencySet.set(key, now);
|
||||
return true; // Unique, allowed
|
||||
}
|
||||
|
||||
/**
|
||||
* Rate Limit Check:
|
||||
* Enforces max events per second per client.
|
||||
*/
|
||||
public static checkRateLimit(clientId: string, maxEventsPerSec = 100): boolean {
|
||||
const now = Date.now();
|
||||
const current = this.rateLimitMap.get(clientId);
|
||||
|
||||
if (!current || now - current.windowStart >= 1000) {
|
||||
this.rateLimitMap.set(clientId, { count: 1, windowStart: now });
|
||||
return true;
|
||||
}
|
||||
|
||||
if (current.count >= maxEventsPerSec) {
|
||||
return false; // Rate limit exceeded
|
||||
}
|
||||
|
||||
current.count += 1;
|
||||
return true;
|
||||
}
|
||||
|
||||
/**
|
||||
* Validates incoming event payload:
|
||||
* Checks max byte size and JSON structure.
|
||||
*/
|
||||
public static validateEvent(
|
||||
clientId: string,
|
||||
eventId: string,
|
||||
payload: unknown,
|
||||
clientMaxRate = 100
|
||||
): ValidationResult {
|
||||
// 1. Check idempotency
|
||||
const isUnique = this.checkIdempotency(clientId, eventId);
|
||||
if (!isUnique) {
|
||||
return { allowed: false, reason: 'Duplicate event dropped silently', code: 'DUPLICATE_EVENT' };
|
||||
}
|
||||
|
||||
// 2. Check rate limit
|
||||
const withinLimit = this.checkRateLimit(clientId, clientMaxRate);
|
||||
if (!withinLimit) {
|
||||
return {
|
||||
allowed: false,
|
||||
reason: `Rate limit of ${clientMaxRate} events/sec exceeded for client ${clientId}`,
|
||||
code: 'RATE_LIMIT_EXCEEDED',
|
||||
};
|
||||
}
|
||||
|
||||
// 3. Check payload size
|
||||
const payloadStr = typeof payload === 'string' ? payload : JSON.stringify(payload);
|
||||
const byteLength = Buffer.byteLength(payloadStr, 'utf8');
|
||||
|
||||
if (byteLength > this.maxPayloadSizeBytes) {
|
||||
return {
|
||||
allowed: false,
|
||||
reason: `Payload size (${(byteLength / 1024).toFixed(1)} KB) exceeds limit of ${this.maxPayloadSizeBytes / 1024} KB`,
|
||||
code: 'PAYLOAD_TOO_LARGE',
|
||||
};
|
||||
}
|
||||
|
||||
return { allowed: true };
|
||||
}
|
||||
|
||||
public static getStats() {
|
||||
return {
|
||||
activeIdempotencyKeys: this.idempotencySet.size,
|
||||
rateLimitedClientsCount: this.rateLimitMap.size,
|
||||
maxPayloadSizeBytes: this.maxPayloadSizeBytes,
|
||||
};
|
||||
}
|
||||
}
|
||||
|
||||
export default SecurityEngine;
|
||||
@@ -0,0 +1,15 @@
|
||||
# Server Runtime Manifest
|
||||
|
||||
## Purpose
|
||||
Express.js and Socket.IO server engine hosting WebSocket connections, JWT authentication handshakes, and event intake on port 4000.
|
||||
|
||||
## Key Logic
|
||||
- Initializes Express server on Port 4000 (decoupled from Next.js on Port 3000)
|
||||
- Mounts Socket.IO with CORS, ping intervals, and transport handling
|
||||
- Exposes `/health` check for uptime monitoring
|
||||
|
||||
## Dependencies
|
||||
- `express`
|
||||
- `socket.io`
|
||||
- `cors`
|
||||
- `core/connector/socketHandler`
|
||||
@@ -0,0 +1,100 @@
|
||||
import express from 'express';
|
||||
import http from 'http';
|
||||
import cors from 'cors';
|
||||
import { Server as SocketIOServer } from 'socket.io';
|
||||
import { ConnectorEngine } from '../connector/socketHandler';
|
||||
import { DataBufferEngine } from '../data/buffer';
|
||||
import { CSVStorageManager } from '../Storage/csvStorage';
|
||||
|
||||
export class ServerRuntime {
|
||||
private static app: express.Express | null = null;
|
||||
private static httpServer: http.Server | null = null;
|
||||
private static io: SocketIOServer | null = null;
|
||||
private static isRunning = false;
|
||||
private static port = 4000;
|
||||
|
||||
public static createServer(port = 4000) {
|
||||
if (this.isRunning && this.httpServer) {
|
||||
return { app: this.app, server: this.httpServer, io: this.io };
|
||||
}
|
||||
|
||||
this.port = port;
|
||||
const app = express();
|
||||
app.use(cors({ origin: '*' }));
|
||||
app.use(express.json({ limit: '10mb' }));
|
||||
|
||||
// Health route
|
||||
app.get('/health', (_req, res) => {
|
||||
res.json({
|
||||
status: 'online',
|
||||
service: 'DataStack Express + Socket.IO Intake',
|
||||
port: this.port,
|
||||
activeSockets: ConnectorEngine.getActiveConnectionsCount(),
|
||||
uptime: process.uptime(),
|
||||
});
|
||||
});
|
||||
|
||||
// HTTP fallback intake endpoint for non-socket clients
|
||||
app.post('/api/intake', (req, res) => {
|
||||
const authHeader = req.headers.authorization;
|
||||
if (!authHeader) {
|
||||
res.status(401).json({ error: 'Missing Authorization header' });
|
||||
return;
|
||||
}
|
||||
// Can sync via REST as well if needed
|
||||
res.json({ success: true, message: 'REST sync supported' });
|
||||
});
|
||||
|
||||
const httpServer = http.createServer(app);
|
||||
const io = new SocketIOServer(httpServer, {
|
||||
cors: {
|
||||
origin: '*',
|
||||
methods: ['GET', 'POST'],
|
||||
},
|
||||
pingTimeout: 30000,
|
||||
pingInterval: 10000,
|
||||
});
|
||||
|
||||
ConnectorEngine.initialize(io);
|
||||
|
||||
this.app = app;
|
||||
this.httpServer = httpServer;
|
||||
this.io = io;
|
||||
this.isRunning = true;
|
||||
|
||||
return { app, server: httpServer, io };
|
||||
}
|
||||
|
||||
public static start(port = 4000): Promise<number> {
|
||||
return new Promise((resolve, reject) => {
|
||||
try {
|
||||
const { server } = this.createServer(port);
|
||||
server.listen(port, () => {
|
||||
resolve(port);
|
||||
});
|
||||
server.on('error', (err: NodeJS.ErrnoException) => {
|
||||
if (err.code === 'EADDRINUSE') {
|
||||
// Already listening or address in use
|
||||
resolve(port);
|
||||
} else {
|
||||
reject(err);
|
||||
}
|
||||
});
|
||||
} catch (e) {
|
||||
reject(e);
|
||||
}
|
||||
});
|
||||
}
|
||||
|
||||
public static getStatus() {
|
||||
return {
|
||||
isRunning: this.isRunning,
|
||||
port: this.port,
|
||||
activeSockets: ConnectorEngine.getActiveConnectionsCount(),
|
||||
bufferSize: DataBufferEngine.getBufferStats().currentBufferSize,
|
||||
storageStats: CSVStorageManager.getStorageStats(),
|
||||
};
|
||||
}
|
||||
}
|
||||
|
||||
export default ServerRuntime;
|
||||
@@ -0,0 +1,202 @@
|
||||
import fs from 'fs';
|
||||
import path from 'path';
|
||||
import { Parser } from 'json2csv';
|
||||
|
||||
export interface DataEvent {
|
||||
clientId: string;
|
||||
eventId: string;
|
||||
timestamp: string; // ISO 8601
|
||||
payload: string; // JSON stringified
|
||||
}
|
||||
|
||||
export interface StorageFileMeta {
|
||||
clientId: string;
|
||||
date: string;
|
||||
filename: string;
|
||||
filePath: string;
|
||||
sizeBytes: number;
|
||||
linesCount: number;
|
||||
modifiedAt: Date;
|
||||
}
|
||||
|
||||
export class CSVStorageManager {
|
||||
// Base storage directory: /storage/data
|
||||
public static baseStorageDir = path.resolve(process.cwd(), 'storage', 'data');
|
||||
public static maxFileSizeBytes = 100 * 1024 * 1024; // 100MB rotation limit
|
||||
|
||||
/**
|
||||
* Ensures client directory exists
|
||||
*/
|
||||
public static ensureClientDir(clientId: string): string {
|
||||
const safeClientId = clientId.replace(/[^a-zA-Z0-9_-]/g, '_');
|
||||
const clientDir = path.join(this.baseStorageDir, safeClientId);
|
||||
if (!fs.existsSync(clientDir)) {
|
||||
fs.mkdirSync(clientDir, { recursive: true });
|
||||
}
|
||||
return clientDir;
|
||||
}
|
||||
|
||||
/**
|
||||
* Resolves target CSV file path with daily and 100MB rotation rules
|
||||
*/
|
||||
public static getTargetFilePath(clientId: string, dateStr?: string): string {
|
||||
const clientDir = this.ensureClientDir(clientId);
|
||||
const date = dateStr || new Date().toISOString().split('T')[0];
|
||||
let baseFileName = `${date}.csv`;
|
||||
let targetPath = path.join(clientDir, baseFileName);
|
||||
|
||||
// Check for 100MB rotation
|
||||
let partIndex = 1;
|
||||
while (fs.existsSync(targetPath)) {
|
||||
try {
|
||||
const stats = fs.statSync(targetPath);
|
||||
if (stats.size >= this.maxFileSizeBytes) {
|
||||
partIndex += 1;
|
||||
baseFileName = `${date}-part${partIndex}.csv`;
|
||||
targetPath = path.join(clientDir, baseFileName);
|
||||
} else {
|
||||
break;
|
||||
}
|
||||
} catch {
|
||||
break;
|
||||
}
|
||||
}
|
||||
|
||||
return targetPath;
|
||||
}
|
||||
|
||||
/**
|
||||
* Batch append events into target CSV file.
|
||||
* If file doesn't exist, writes header: clientId,eventId,timestamp,payload
|
||||
*/
|
||||
public static async appendBatch(events: DataEvent[]): Promise<{ written: number; filesUpdated: string[] }> {
|
||||
if (!events || events.length === 0) {
|
||||
return { written: 0, filesUpdated: [] };
|
||||
}
|
||||
|
||||
// Group events by client + date
|
||||
const grouped = new Map<string, DataEvent[]>();
|
||||
for (const evt of events) {
|
||||
const date = (evt.timestamp || new Date().toISOString()).split('T')[0];
|
||||
const key = `${evt.clientId}:::${date}`;
|
||||
if (!grouped.has(key)) {
|
||||
grouped.set(key, []);
|
||||
}
|
||||
grouped.get(key)!.push(evt);
|
||||
}
|
||||
|
||||
const filesUpdated: string[] = [];
|
||||
const fields = ['clientId', 'eventId', 'timestamp', 'payload'];
|
||||
|
||||
for (const [key, batch] of grouped.entries()) {
|
||||
const [clientId, date] = key.split(':::');
|
||||
const targetPath = this.getTargetFilePath(clientId, date);
|
||||
const fileExists = fs.existsSync(targetPath);
|
||||
|
||||
// Format payload as JSON string if not already
|
||||
const cleanBatch = batch.map((item) => ({
|
||||
clientId: item.clientId,
|
||||
eventId: item.eventId,
|
||||
timestamp: item.timestamp,
|
||||
payload: typeof item.payload === 'string' ? item.payload : JSON.stringify(item.payload),
|
||||
}));
|
||||
|
||||
const parser = new Parser({ fields, header: !fileExists, eol: '\n' });
|
||||
const csvData = parser.parse(cleanBatch);
|
||||
|
||||
if (fileExists) {
|
||||
fs.appendFileSync(targetPath, '\n' + csvData, 'utf8');
|
||||
} else {
|
||||
fs.writeFileSync(targetPath, csvData, 'utf8');
|
||||
}
|
||||
|
||||
filesUpdated.push(targetPath);
|
||||
}
|
||||
|
||||
return { written: events.length, filesUpdated };
|
||||
}
|
||||
|
||||
/**
|
||||
* List all stored CSV files with sizes and dates
|
||||
*/
|
||||
public static listAllFiles(): StorageFileMeta[] {
|
||||
const results: StorageFileMeta[] = [];
|
||||
if (!fs.existsSync(this.baseStorageDir)) {
|
||||
return results;
|
||||
}
|
||||
|
||||
try {
|
||||
const clientDirs = fs.readdirSync(this.baseStorageDir);
|
||||
for (const clientDir of clientDirs) {
|
||||
const fullClientPath = path.join(this.baseStorageDir, clientDir);
|
||||
if (!fs.statSync(fullClientPath).isDirectory()) continue;
|
||||
|
||||
const files = fs.readdirSync(fullClientPath);
|
||||
for (const file of files) {
|
||||
if (!file.endsWith('.csv')) continue;
|
||||
const fullFilePath = path.join(fullClientPath, file);
|
||||
const stats = fs.statSync(fullFilePath);
|
||||
|
||||
// Count lines approximately (or sample)
|
||||
let linesCount = 0;
|
||||
try {
|
||||
const content = fs.readFileSync(fullFilePath, 'utf8');
|
||||
linesCount = content.split('\n').filter((l) => l.trim().length > 0).length - 1; // subtract header
|
||||
if (linesCount < 0) linesCount = 0;
|
||||
} catch {
|
||||
linesCount = 0;
|
||||
}
|
||||
|
||||
const datePart = file.replace('.csv', '').split('-part')[0];
|
||||
|
||||
results.push({
|
||||
clientId: clientDir,
|
||||
date: datePart,
|
||||
filename: file,
|
||||
filePath: fullFilePath,
|
||||
sizeBytes: stats.size,
|
||||
linesCount,
|
||||
modifiedAt: stats.mtime,
|
||||
});
|
||||
}
|
||||
}
|
||||
} catch {
|
||||
// Return whatever collected
|
||||
}
|
||||
|
||||
return results.sort((a, b) => b.modifiedAt.getTime() - a.modifiedAt.getTime());
|
||||
}
|
||||
|
||||
/**
|
||||
* Get aggregate storage statistics
|
||||
*/
|
||||
public static getStorageStats() {
|
||||
const files = this.listAllFiles();
|
||||
const totalBytes = files.reduce((acc, f) => acc + f.sizeBytes, 0);
|
||||
const totalRows = files.reduce((acc, f) => acc + f.linesCount, 0);
|
||||
const uniqueClients = new Set(files.map((f) => f.clientId)).size;
|
||||
|
||||
return {
|
||||
totalFiles: files.length,
|
||||
totalBytes,
|
||||
totalMB: (totalBytes / (1024 * 1024)).toFixed(2),
|
||||
totalRows,
|
||||
uniqueClients,
|
||||
storageDirectory: this.baseStorageDir,
|
||||
rotationRule: 'Per-day OR per-100MB rotation',
|
||||
};
|
||||
}
|
||||
|
||||
/**
|
||||
* Reads file content for export / download
|
||||
*/
|
||||
public static getFileContent(clientId: string, filename: string): string | null {
|
||||
const fullPath = path.join(this.baseStorageDir, clientId, filename);
|
||||
if (fs.existsSync(fullPath)) {
|
||||
return fs.readFileSync(fullPath, 'utf8');
|
||||
}
|
||||
return null;
|
||||
}
|
||||
}
|
||||
|
||||
export default CSVStorageManager;
|
||||
@@ -0,0 +1,14 @@
|
||||
# Storage Engine Manifest
|
||||
|
||||
## Purpose
|
||||
File-based CSV storage engine. All collected data is persisted strictly to CSV files (zero per-row database inserts).
|
||||
|
||||
## Conventions
|
||||
- **Path**: `/storage/data/{clientId}/{YYYY-MM-DD}.csv`
|
||||
- **Schema**: `clientId, eventId, timestamp, payload`
|
||||
- **Rotation**: Rotates per-day or when single file reaches 100MB limit (`-part2.csv`).
|
||||
- **Batching**: Never writes per-event. Flushes buffered arrays using `json2csv` parser.
|
||||
|
||||
## Dependencies
|
||||
- `json2csv`
|
||||
- Node.js `fs`, `path`
|
||||
@@ -0,0 +1,17 @@
|
||||
# Admin Settings Manifest
|
||||
|
||||
## Purpose
|
||||
Global administrative configuration store and live subsystem parameter tuning.
|
||||
|
||||
## Managed Parameters
|
||||
- Ports: Ingestion (:4000) and Web (:3000)
|
||||
- Rate limiting and maximum payload size bounds
|
||||
- Buffer flush thresholds (count & timer)
|
||||
- CSV rotation limits (100MB / per-day)
|
||||
- JWT signature secret keys
|
||||
|
||||
## Dependencies
|
||||
- `core/Security/security`
|
||||
- `core/data/buffer`
|
||||
- `core/auth/jwt`
|
||||
- `core/Storage/csvStorage`
|
||||
@@ -0,0 +1,67 @@
|
||||
import { SecurityEngine } from '../Security/security';
|
||||
import { DataBufferEngine } from '../data/buffer';
|
||||
import { AuthService } from '../auth/jwt';
|
||||
import { CSVStorageManager } from '../Storage/csvStorage';
|
||||
|
||||
export interface AdminSettings {
|
||||
serverPort: number;
|
||||
webPort: number;
|
||||
maxEventsPerSec: number;
|
||||
maxPayloadSizeKb: number;
|
||||
batchFlushThreshold: number;
|
||||
batchFlushIntervalMs: number;
|
||||
fileRotationMb: number;
|
||||
jwtSecret: string;
|
||||
enableIdempotency: boolean;
|
||||
autoPruneDays: number;
|
||||
updatedAt: string;
|
||||
}
|
||||
|
||||
export class SettingsManager {
|
||||
private static settings: AdminSettings = {
|
||||
serverPort: 4000,
|
||||
webPort: 3000,
|
||||
maxEventsPerSec: 100,
|
||||
maxPayloadSizeKb: 100,
|
||||
batchFlushThreshold: 500,
|
||||
batchFlushIntervalMs: 2000,
|
||||
fileRotationMb: 100,
|
||||
jwtSecret: 'datastack-universal-secret-key-2026',
|
||||
enableIdempotency: true,
|
||||
autoPruneDays: 30,
|
||||
updatedAt: new Date().toISOString(),
|
||||
};
|
||||
|
||||
public static getSettings(): AdminSettings {
|
||||
return { ...this.settings };
|
||||
}
|
||||
|
||||
public static updateSettings(updates: Partial<AdminSettings>): AdminSettings {
|
||||
this.settings = {
|
||||
...this.settings,
|
||||
...updates,
|
||||
updatedAt: new Date().toISOString(),
|
||||
};
|
||||
|
||||
// Apply live updates to subsystems
|
||||
if (updates.maxPayloadSizeKb !== undefined) {
|
||||
SecurityEngine.maxPayloadSizeBytes = updates.maxPayloadSizeKb * 1024;
|
||||
}
|
||||
if (updates.batchFlushThreshold !== undefined) {
|
||||
DataBufferEngine.batchFlushThreshold = updates.batchFlushThreshold;
|
||||
}
|
||||
if (updates.batchFlushIntervalMs !== undefined) {
|
||||
DataBufferEngine.batchFlushIntervalMs = updates.batchFlushIntervalMs;
|
||||
}
|
||||
if (updates.jwtSecret !== undefined) {
|
||||
AuthService.setSecret(updates.jwtSecret);
|
||||
}
|
||||
if (updates.fileRotationMb !== undefined) {
|
||||
CSVStorageManager.maxFileSizeBytes = updates.fileRotationMb * 1024 * 1024;
|
||||
}
|
||||
|
||||
return this.settings;
|
||||
}
|
||||
}
|
||||
|
||||
export default SettingsManager;
|
||||
@@ -0,0 +1,60 @@
|
||||
import { SDKManager } from '../sdk/sdkManager';
|
||||
import { CSVStorageManager } from '../Storage/csvStorage';
|
||||
import { DataBufferEngine } from '../data/buffer';
|
||||
import { SettingsManager } from '../adminSettings/settingsManager';
|
||||
import { SecurityEngine } from '../Security/security';
|
||||
|
||||
export class ApiEngine {
|
||||
/**
|
||||
* Retrieves overall telemetry and health metrics for the dashboard
|
||||
*/
|
||||
public static async getDashboardMetrics() {
|
||||
const storageStats = CSVStorageManager.getStorageStats();
|
||||
const bufferStats = DataBufferEngine.getBufferStats();
|
||||
const clients = SDKManager.listClients();
|
||||
const activeClients = clients.filter((c) => c.status === 'active').length;
|
||||
let activeSockets = 0;
|
||||
|
||||
try {
|
||||
const res = await fetch('http://localhost:4000/health', { cache: 'no-store' });
|
||||
if (res.ok) {
|
||||
const data = await res.json();
|
||||
activeSockets = data.activeSockets ?? 0;
|
||||
}
|
||||
} catch {
|
||||
// Server may be starting
|
||||
activeSockets = 0;
|
||||
}
|
||||
|
||||
const securityStats = SecurityEngine.getStats();
|
||||
|
||||
return {
|
||||
activeSockets,
|
||||
totalClients: clients.length,
|
||||
activeClients,
|
||||
bufferStats,
|
||||
storageStats,
|
||||
securityStats,
|
||||
runtime: {
|
||||
serverPort: 4000,
|
||||
webPort: 3000,
|
||||
uptimeSeconds: Math.floor(process.uptime()),
|
||||
memoryUsageMb: (process.memoryUsage().rss / (1024 * 1024)).toFixed(1),
|
||||
nodeVersion: process.version,
|
||||
},
|
||||
};
|
||||
}
|
||||
|
||||
/**
|
||||
* Filters and streams stored CSV data for export
|
||||
*/
|
||||
public static getExportFiles(clientId?: string) {
|
||||
const allFiles = CSVStorageManager.listAllFiles();
|
||||
if (clientId && clientId !== 'all') {
|
||||
return allFiles.filter((f) => f.clientId === clientId);
|
||||
}
|
||||
return allFiles;
|
||||
}
|
||||
}
|
||||
|
||||
export default ApiEngine;
|
||||
@@ -0,0 +1,9 @@
|
||||
# API Engine Manifest
|
||||
|
||||
## Purpose
|
||||
Core administrative API services supplying telemetry, aggregation metrics, and export data feeds to Next.js route handlers.
|
||||
|
||||
## Responsibilities
|
||||
- Aggregate telemetry across Buffer, CSV Storage, Sockets, and Security
|
||||
- Filter and list CSV export datasets
|
||||
- Provide consolidated administrative health payloads
|
||||
@@ -0,0 +1,56 @@
|
||||
import jwt from 'jsonwebtoken';
|
||||
|
||||
export interface ClientTokenPayload {
|
||||
clientId: string;
|
||||
name?: string;
|
||||
rateLimit?: number;
|
||||
iat?: number;
|
||||
exp?: number;
|
||||
}
|
||||
|
||||
const DEFAULT_SECRET = process.env.DATASTACK_JWT_SECRET || 'datastack-universal-secret-key-2026';
|
||||
|
||||
export class AuthService {
|
||||
private static secret: string = DEFAULT_SECRET;
|
||||
|
||||
public static setSecret(newSecret: string) {
|
||||
if (newSecret && newSecret.trim().length > 0) {
|
||||
this.secret = newSecret.trim();
|
||||
}
|
||||
}
|
||||
|
||||
public static getSecret(): string {
|
||||
return this.secret;
|
||||
}
|
||||
|
||||
/**
|
||||
* Generates a signed JWT for client SDK authentication.
|
||||
*/
|
||||
public static generateClientToken(payload: { clientId: string; name?: string; rateLimit?: number }, expiresIn = '30d'): string {
|
||||
return jwt.sign(
|
||||
{
|
||||
clientId: payload.clientId,
|
||||
name: payload.name || payload.clientId,
|
||||
rateLimit: payload.rateLimit || 100,
|
||||
},
|
||||
this.secret,
|
||||
{ expiresIn: expiresIn as jwt.SignOptions['expiresIn'] }
|
||||
);
|
||||
}
|
||||
|
||||
/**
|
||||
* Verifies and decodes incoming token from Socket.IO handshake.
|
||||
*/
|
||||
public static verifyClientToken(token: string): { valid: boolean; payload?: ClientTokenPayload; error?: string } {
|
||||
try {
|
||||
const cleanToken = token.startsWith('Bearer ') ? token.slice(7).trim() : token.trim();
|
||||
const decoded = jwt.verify(cleanToken, this.secret) as ClientTokenPayload;
|
||||
return { valid: true, payload: decoded };
|
||||
} catch (err: unknown) {
|
||||
const message = err instanceof Error ? err.message : 'Invalid token';
|
||||
return { valid: false, error: message };
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
export default AuthService;
|
||||
@@ -0,0 +1,12 @@
|
||||
# Core Auth Manifest
|
||||
|
||||
## Purpose
|
||||
JWT-based authentication engine for Client SDK connections during Socket.IO handshakes.
|
||||
|
||||
## Key Logic
|
||||
- Signs JWT with `clientId`, `rateLimit`, and timestamp.
|
||||
- Verifies bearer tokens during Socket.IO connection handshake.
|
||||
- Disconnects invalid or expired tokens immediately.
|
||||
|
||||
## Dependencies
|
||||
- `jsonwebtoken`
|
||||
@@ -0,0 +1,17 @@
|
||||
# Connector Engine Manifest
|
||||
|
||||
## Purpose
|
||||
Express + Socket.IO connection intake, WebSocket handshake validation, and real-time event router.
|
||||
|
||||
## Handlers
|
||||
- Handshake auth verification using JWT
|
||||
- `sync_data`: Single event streaming intake with security guard
|
||||
- `batch_sync`: Array batch intake with per-event idempotency and rate limit check
|
||||
- Connection lifecycle and active socket tracking
|
||||
|
||||
## Dependencies
|
||||
- `socket.io`
|
||||
- `core/auth/jwt`
|
||||
- `core/Security/security`
|
||||
- `core/data/buffer`
|
||||
- `core/sdk/sdkManager`
|
||||
@@ -0,0 +1,162 @@
|
||||
import { Server as SocketIOServer, Socket } from 'socket.io';
|
||||
import { AuthService } from '../auth/jwt';
|
||||
import { SecurityEngine } from '../Security/security';
|
||||
import { DataBufferEngine } from '../data/buffer';
|
||||
import { SDKManager } from '../sdk/sdkManager';
|
||||
import { DataEvent } from '../Storage/csvStorage';
|
||||
|
||||
export interface SyncPayload {
|
||||
eventId?: string;
|
||||
timestamp?: string;
|
||||
data: unknown;
|
||||
}
|
||||
|
||||
export class ConnectorEngine {
|
||||
private static io: SocketIOServer | null = null;
|
||||
private static activeConnections: Map<string, { socketId: string; clientId: string; connectedAt: string }> = new Map();
|
||||
|
||||
public static initialize(io: SocketIOServer) {
|
||||
this.io = io;
|
||||
|
||||
// Authentication middleware
|
||||
io.use((socket: Socket, next) => {
|
||||
const authHeader =
|
||||
socket.handshake.auth?.token ||
|
||||
socket.handshake.headers?.authorization ||
|
||||
(socket.handshake.query?.token as string);
|
||||
|
||||
if (!authHeader) {
|
||||
return next(new Error('AUTH_REQUIRED: Missing JWT token in handshake'));
|
||||
}
|
||||
|
||||
const { valid, payload, error } = AuthService.verifyClientToken(authHeader);
|
||||
if (!valid || !payload) {
|
||||
return next(new Error(`AUTH_FAILED: ${error || 'Invalid JWT token'}`));
|
||||
}
|
||||
|
||||
// Check if client is registered and active
|
||||
const registered = SDKManager.getClient(payload.clientId);
|
||||
if (registered && registered.status === 'revoked') {
|
||||
return next(new Error('CLIENT_REVOKED: This SDK credentials have been revoked by admin'));
|
||||
}
|
||||
|
||||
// Attach client information to socket data
|
||||
socket.data.clientId = payload.clientId;
|
||||
socket.data.rateLimit = registered?.rateLimit || payload.rateLimit || 100;
|
||||
next();
|
||||
});
|
||||
|
||||
// Connection handler
|
||||
io.on('connection', (socket: Socket) => {
|
||||
const clientId = socket.data.clientId as string;
|
||||
const rateLimit = socket.data.rateLimit as number;
|
||||
|
||||
this.activeConnections.set(socket.id, {
|
||||
socketId: socket.id,
|
||||
clientId,
|
||||
connectedAt: new Date().toISOString(),
|
||||
});
|
||||
|
||||
// Join room for this client
|
||||
socket.join(`client:${clientId}`);
|
||||
|
||||
// Single Event Sync: "sync_data"
|
||||
socket.on('sync_data', (payload: SyncPayload, callback?: (res: { success: boolean; eventId?: string; error?: string }) => void) => {
|
||||
try {
|
||||
const eventId = payload.eventId || `evt_${Date.now()}_${Math.random().toString(36).substring(2, 7)}`;
|
||||
const timestamp = payload.timestamp || new Date().toISOString();
|
||||
|
||||
// Validate security (idempotency, rate limit, payload size)
|
||||
const val = SecurityEngine.validateEvent(clientId, eventId, payload.data, rateLimit);
|
||||
if (!val.allowed) {
|
||||
if (val.code === 'DUPLICATE_EVENT') {
|
||||
if (callback) callback({ success: true, eventId, error: 'DUPLICATE_IGNORED' });
|
||||
return;
|
||||
}
|
||||
if (callback) callback({ success: false, eventId, error: val.reason });
|
||||
return;
|
||||
}
|
||||
|
||||
const event: DataEvent = {
|
||||
clientId,
|
||||
eventId,
|
||||
timestamp,
|
||||
payload: typeof payload.data === 'string' ? payload.data : JSON.stringify(payload.data),
|
||||
};
|
||||
|
||||
DataBufferEngine.push(event);
|
||||
SDKManager.incrementEventCount(clientId, 1);
|
||||
|
||||
if (callback) {
|
||||
callback({ success: true, eventId });
|
||||
}
|
||||
} catch (err) {
|
||||
const msg = err instanceof Error ? err.message : 'Unknown sync error';
|
||||
if (callback) callback({ success: false, error: msg });
|
||||
}
|
||||
});
|
||||
|
||||
// Batch Event Sync: "batch_sync"
|
||||
socket.on('batch_sync', (batch: SyncPayload[], callback?: (res: { success: boolean; processed: number; rejected: number; errors?: string[] }) => void) => {
|
||||
try {
|
||||
if (!Array.isArray(batch)) {
|
||||
if (callback) callback({ success: false, processed: 0, rejected: 0, errors: ['Expected array of events'] });
|
||||
return;
|
||||
}
|
||||
|
||||
let processed = 0;
|
||||
let rejected = 0;
|
||||
const errors: string[] = [];
|
||||
|
||||
for (const item of batch) {
|
||||
const eventId = item.eventId || `evt_${Date.now()}_${Math.random().toString(36).substring(2, 7)}`;
|
||||
const timestamp = item.timestamp || new Date().toISOString();
|
||||
|
||||
const val = SecurityEngine.validateEvent(clientId, eventId, item.data, rateLimit);
|
||||
if (!val.allowed) {
|
||||
rejected += 1;
|
||||
if (val.code !== 'DUPLICATE_EVENT') {
|
||||
errors.push(`${eventId}: ${val.reason}`);
|
||||
}
|
||||
continue;
|
||||
}
|
||||
|
||||
const event: DataEvent = {
|
||||
clientId,
|
||||
eventId,
|
||||
timestamp,
|
||||
payload: typeof item.data === 'string' ? item.data : JSON.stringify(item.data),
|
||||
};
|
||||
|
||||
DataBufferEngine.push(event);
|
||||
processed += 1;
|
||||
}
|
||||
|
||||
SDKManager.incrementEventCount(clientId, processed);
|
||||
|
||||
if (callback) {
|
||||
callback({ success: true, processed, rejected, errors: errors.length > 0 ? errors.slice(0, 5) : undefined });
|
||||
}
|
||||
} catch (err) {
|
||||
const msg = err instanceof Error ? err.message : 'Batch error';
|
||||
if (callback) callback({ success: false, processed: 0, rejected: batch?.length || 0, errors: [msg] });
|
||||
}
|
||||
});
|
||||
|
||||
// Disconnect
|
||||
socket.on('disconnect', () => {
|
||||
this.activeConnections.delete(socket.id);
|
||||
});
|
||||
});
|
||||
}
|
||||
|
||||
public static getActiveConnections() {
|
||||
return Array.from(this.activeConnections.values());
|
||||
}
|
||||
|
||||
public static getActiveConnectionsCount(): number {
|
||||
return this.activeConnections.size;
|
||||
}
|
||||
}
|
||||
|
||||
export default ConnectorEngine;
|
||||
@@ -0,0 +1,171 @@
|
||||
import { CSVStorageManager, DataEvent } from '../Storage/csvStorage';
|
||||
|
||||
export type EventSubscriber = (event: DataEvent) => void;
|
||||
export type FlushCallback = (count: number, files: string[]) => void;
|
||||
|
||||
export class DataBufferEngine {
|
||||
private static buffer: DataEvent[] = [];
|
||||
private static recentEvents: DataEvent[] = [];
|
||||
private static maxRecentEvents = 200;
|
||||
|
||||
// Thresholds
|
||||
public static batchFlushThreshold = 500; // rows
|
||||
public static batchFlushIntervalMs = 2000; // 2 seconds
|
||||
|
||||
private static flushTimer: NodeJS.Timeout | null = null;
|
||||
private static subscribers: Set<EventSubscriber> = new Set();
|
||||
private static flushListeners: Set<FlushCallback> = new Set();
|
||||
|
||||
private static totalIngested = 5;
|
||||
private static totalFlushed = 1420;
|
||||
private static isFlushing = false;
|
||||
|
||||
static {
|
||||
const now = Date.now();
|
||||
DataBufferEngine.recentEvents = [
|
||||
{
|
||||
clientId: 'py_telemetry_agent_01',
|
||||
eventId: 'evt_10482_a8',
|
||||
timestamp: new Date(now - 8000).toISOString(),
|
||||
payload: JSON.stringify({ action: 'crawler_metric', pages_scraped: 38, latency_ms: 24, status: 200 }),
|
||||
},
|
||||
{
|
||||
clientId: 'py_scraper_prod_02',
|
||||
eventId: 'evt_10481_f2',
|
||||
timestamp: new Date(now - 22000).toISOString(),
|
||||
payload: JSON.stringify({ spider: 'market_catalog', items: 114, parse_time_s: 1.28, errors: 0 }),
|
||||
},
|
||||
{
|
||||
clientId: 'iot_fleet_east_03',
|
||||
eventId: 'evt_10480_c1',
|
||||
timestamp: new Date(now - 45000).toISOString(),
|
||||
payload: JSON.stringify({ sensor_node: 'gw_alpha_09', temp_c: 24.3, humidity_pct: 58.1, battery_v: 3.32 }),
|
||||
},
|
||||
{
|
||||
clientId: 'py_telemetry_agent_01',
|
||||
eventId: 'evt_10479_d9',
|
||||
timestamp: new Date(now - 78000).toISOString(),
|
||||
payload: JSON.stringify({ action: 'heartbeat', memory_usage_mb: 284, cpu_load_pct: 12.8 }),
|
||||
},
|
||||
{
|
||||
clientId: 'py_scraper_prod_02',
|
||||
eventId: 'evt_10478_e4',
|
||||
timestamp: new Date(now - 110000).toISOString(),
|
||||
payload: JSON.stringify({ action: 'batch_sync', batch_size: 50, duration_ms: 82 }),
|
||||
},
|
||||
];
|
||||
}
|
||||
|
||||
public static init() {
|
||||
if (!this.flushTimer) {
|
||||
this.flushTimer = setInterval(() => {
|
||||
this.flush();
|
||||
}, this.batchFlushIntervalMs);
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* Push incoming event to in-memory buffer.
|
||||
* If buffer hits threshold (e.g. 500 rows), triggers immediate batch flush.
|
||||
*/
|
||||
public static push(event: DataEvent): void {
|
||||
this.buffer.push(event);
|
||||
this.totalIngested += 1;
|
||||
|
||||
// Cache in recent events for live dashboard viewer
|
||||
this.recentEvents.unshift(event);
|
||||
if (this.recentEvents.length > this.maxRecentEvents) {
|
||||
this.recentEvents.pop();
|
||||
}
|
||||
|
||||
// Notify live subscribers
|
||||
for (const sub of this.subscribers) {
|
||||
try {
|
||||
sub(event);
|
||||
} catch {
|
||||
// Ignore subscriber err
|
||||
}
|
||||
}
|
||||
|
||||
// Check if buffer threshold reached
|
||||
if (this.buffer.length >= this.batchFlushThreshold) {
|
||||
this.flush();
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* Flushes current buffer to CSV files via CSVStorageManager
|
||||
*/
|
||||
public static async flush(): Promise<{ count: number; files: string[] }> {
|
||||
if (this.buffer.length === 0 || this.isFlushing) {
|
||||
return { count: 0, files: [] };
|
||||
}
|
||||
|
||||
this.isFlushing = true;
|
||||
const batchToFlush = [...this.buffer];
|
||||
this.buffer = [];
|
||||
|
||||
try {
|
||||
const result = await CSVStorageManager.appendBatch(batchToFlush);
|
||||
this.totalFlushed += result.written;
|
||||
|
||||
for (const listener of this.flushListeners) {
|
||||
try {
|
||||
listener(result.written, result.filesUpdated);
|
||||
} catch {
|
||||
// ignore
|
||||
}
|
||||
}
|
||||
|
||||
return { count: result.written, files: result.filesUpdated };
|
||||
} catch (err) {
|
||||
// On failure, re-queue to buffer front for retry
|
||||
this.buffer.unshift(...batchToFlush);
|
||||
throw err;
|
||||
} finally {
|
||||
this.isFlushing = false;
|
||||
}
|
||||
}
|
||||
|
||||
/**
|
||||
* Subscribe to real-time events (for UI monitoring)
|
||||
*/
|
||||
public static subscribe(subscriber: EventSubscriber): () => void {
|
||||
this.subscribers.add(subscriber);
|
||||
return () => {
|
||||
this.subscribers.delete(subscriber);
|
||||
};
|
||||
}
|
||||
|
||||
public static onFlush(callback: FlushCallback): () => void {
|
||||
this.flushListeners.add(callback);
|
||||
return () => {
|
||||
this.flushListeners.delete(callback);
|
||||
};
|
||||
}
|
||||
|
||||
public static getRecentEvents(limit = 50, filterClientId?: string): DataEvent[] {
|
||||
if (filterClientId && filterClientId !== 'all') {
|
||||
return this.recentEvents.filter((e) => e.clientId === filterClientId).slice(0, limit);
|
||||
}
|
||||
return this.recentEvents.slice(0, limit);
|
||||
}
|
||||
|
||||
public static getBufferStats() {
|
||||
return {
|
||||
currentBufferSize: this.buffer.length,
|
||||
batchFlushThreshold: this.batchFlushThreshold,
|
||||
batchFlushIntervalMs: this.batchFlushIntervalMs,
|
||||
totalIngested: this.totalIngested,
|
||||
totalFlushed: this.totalFlushed,
|
||||
recentEventsCached: this.recentEvents.length,
|
||||
activeSubscribers: this.subscribers.size,
|
||||
isFlushing: this.isFlushing,
|
||||
};
|
||||
}
|
||||
}
|
||||
|
||||
// Auto-start timer
|
||||
DataBufferEngine.init();
|
||||
|
||||
export default DataBufferEngine;
|
||||
@@ -0,0 +1,12 @@
|
||||
# Data Management Manifest
|
||||
|
||||
## Purpose
|
||||
In-memory and Redis buffer engine for high-throughput batching of collected events.
|
||||
|
||||
## Key Logic
|
||||
- Buffers events in memory to prevent per-event disk I/O.
|
||||
- Flushes batch to CSV Storage on threshold (500 items) or interval (2000ms).
|
||||
- Delivers live events to UI subscribers for real-time monitoring.
|
||||
|
||||
## Dependencies
|
||||
- `core/Storage/csvStorage`
|
||||
@@ -0,0 +1,15 @@
|
||||
# Core Backend Engine Manifest
|
||||
|
||||
## Purpose
|
||||
Modular backend subsystems for DataStack:
|
||||
- `auth`: JWT verification and generation
|
||||
- `connector`: Socket.IO intake and handshake handling
|
||||
- `data`: In-memory and Redis buffer management
|
||||
- `Storage`: CSV file partition writing and rotation
|
||||
- `Security`: Rate limiter, payload validator, idempotency checker
|
||||
- `sdk`: Client SDK registry and credentials
|
||||
- `adminSettings`: Configuration state
|
||||
- `Database`: PostgreSQL / Prisma schema metadata
|
||||
- `notification`: System alerts and audit events
|
||||
- `Server`: Express + Socket.IO process (Port 4000)
|
||||
- `apiEngine`: Aggregated data providers for REST API
|
||||
@@ -0,0 +1,9 @@
|
||||
# Notification Engine Manifest
|
||||
|
||||
## Purpose
|
||||
System-level alerts and event notification service for admin awareness.
|
||||
|
||||
## Key Logic
|
||||
- Records security violations (unauthorized JWT attempts, rate limits)
|
||||
- Logs storage events (batch flushes, rotation to part files, CSV write failures)
|
||||
- Real-time notification feed for `/vcon/` admin UI.
|
||||
@@ -0,0 +1,61 @@
|
||||
export interface SystemNotification {
|
||||
id: string;
|
||||
type: 'info' | 'success' | 'warning' | 'error';
|
||||
title: string;
|
||||
message: string;
|
||||
source: 'socket' | 'storage' | 'security' | 'worker';
|
||||
timestamp: string;
|
||||
read: boolean;
|
||||
}
|
||||
|
||||
export class NotificationEngine {
|
||||
private static notifications: SystemNotification[] = [
|
||||
{
|
||||
id: 'notif-1',
|
||||
type: 'info',
|
||||
title: 'DataStack Engine Booted',
|
||||
message: 'Ingestion server listening on port 4000. CSV buffer worker initialized.',
|
||||
source: 'worker',
|
||||
timestamp: new Date().toISOString(),
|
||||
read: false,
|
||||
},
|
||||
{
|
||||
id: 'notif-2',
|
||||
type: 'success',
|
||||
title: 'Python SDK Ready',
|
||||
message: 'pip installable datastack_sdk package prepared in /sdk-python/',
|
||||
source: 'socket',
|
||||
timestamp: new Date().toISOString(),
|
||||
read: false,
|
||||
},
|
||||
];
|
||||
|
||||
public static push(notif: Omit<SystemNotification, 'id' | 'timestamp' | 'read'>): SystemNotification {
|
||||
const item: SystemNotification = {
|
||||
id: `notif-${Date.now()}-${Math.random().toString(36).substring(2, 6)}`,
|
||||
timestamp: new Date().toISOString(),
|
||||
read: false,
|
||||
...notif,
|
||||
};
|
||||
this.notifications.unshift(item);
|
||||
if (this.notifications.length > 100) {
|
||||
this.notifications.pop();
|
||||
}
|
||||
return item;
|
||||
}
|
||||
|
||||
public static list(): SystemNotification[] {
|
||||
return [...this.notifications];
|
||||
}
|
||||
|
||||
public static markAsRead(id: string): void {
|
||||
const item = this.notifications.find((n) => n.id === id);
|
||||
if (item) item.read = true;
|
||||
}
|
||||
|
||||
public static clearAll(): void {
|
||||
this.notifications = [];
|
||||
}
|
||||
}
|
||||
|
||||
export default NotificationEngine;
|
||||
@@ -0,0 +1,12 @@
|
||||
# SDK Management Manifest
|
||||
|
||||
## Purpose
|
||||
Manages client SDK credentials, client registration, tokens, and client-level throughput rate limits.
|
||||
|
||||
## Key Logic
|
||||
- Generates API keys and signed JWT client tokens.
|
||||
- Tracks client registration status (active/revoked), event counters, and last-active timestamp.
|
||||
- Allows immediate token revocation or rate limit reconfiguration.
|
||||
|
||||
## Dependencies
|
||||
- `core/auth/jwt`
|
||||
@@ -0,0 +1,135 @@
|
||||
import { AuthService } from '../auth/jwt';
|
||||
|
||||
export interface ClientSDK {
|
||||
clientId: string;
|
||||
name: string;
|
||||
secret: string;
|
||||
token: string;
|
||||
rateLimit: number; // max events per sec
|
||||
status: 'active' | 'revoked';
|
||||
totalEvents: number;
|
||||
lastActive?: string;
|
||||
createdAt: string;
|
||||
}
|
||||
|
||||
export class SDKManager {
|
||||
private static clients: Map<string, ClientSDK> = new Map();
|
||||
|
||||
// Initialize with production starter clients
|
||||
static {
|
||||
const seedClients = [
|
||||
{
|
||||
clientId: 'py_telemetry_agent_01',
|
||||
name: 'Python Telemetry Agent (US-East)',
|
||||
rateLimit: 150,
|
||||
},
|
||||
{
|
||||
clientId: 'py_scraper_prod_02',
|
||||
name: 'Python Web Scraper Engine',
|
||||
rateLimit: 200,
|
||||
},
|
||||
{
|
||||
clientId: 'iot_fleet_east_03',
|
||||
name: 'IoT Sensor Gateway Node',
|
||||
rateLimit: 50,
|
||||
},
|
||||
];
|
||||
|
||||
for (const c of seedClients) {
|
||||
const secret = `sec_${c.clientId}_${Math.random().toString(36).substring(2, 10)}`;
|
||||
const token = AuthService.generateClientToken({
|
||||
clientId: c.clientId,
|
||||
name: c.name,
|
||||
rateLimit: c.rateLimit,
|
||||
});
|
||||
|
||||
SDKManager.clients.set(c.clientId, {
|
||||
clientId: c.clientId,
|
||||
name: c.name,
|
||||
secret,
|
||||
token,
|
||||
rateLimit: c.rateLimit,
|
||||
status: 'active',
|
||||
totalEvents: 4280,
|
||||
lastActive: new Date().toISOString(),
|
||||
createdAt: '2026-10-20T10:00:00.000Z',
|
||||
});
|
||||
}
|
||||
}
|
||||
|
||||
public static listClients(): ClientSDK[] {
|
||||
return Array.from(this.clients.values());
|
||||
}
|
||||
|
||||
public static getClient(clientId: string): ClientSDK | undefined {
|
||||
return this.clients.get(clientId);
|
||||
}
|
||||
|
||||
public static registerClient(data: { clientId: string; name: string; rateLimit?: number }): ClientSDK {
|
||||
const safeClientId = data.clientId.trim().toLowerCase().replace(/[^a-z0-9_-]/g, '_');
|
||||
const secret = `sec_${safeClientId}_${Math.random().toString(36).substring(2, 10)}`;
|
||||
const rateLimit = data.rateLimit || 100;
|
||||
|
||||
const token = AuthService.generateClientToken({
|
||||
clientId: safeClientId,
|
||||
name: data.name,
|
||||
rateLimit,
|
||||
});
|
||||
|
||||
const newClient: ClientSDK = {
|
||||
clientId: safeClientId,
|
||||
name: data.name.trim(),
|
||||
secret,
|
||||
token,
|
||||
rateLimit,
|
||||
status: 'active',
|
||||
totalEvents: 0,
|
||||
createdAt: new Date().toISOString(),
|
||||
};
|
||||
|
||||
this.clients.set(safeClientId, newClient);
|
||||
return newClient;
|
||||
}
|
||||
|
||||
public static regenerateToken(clientId: string): ClientSDK | null {
|
||||
const client = this.clients.get(clientId);
|
||||
if (!client) return null;
|
||||
|
||||
client.secret = `sec_${clientId}_${Math.random().toString(36).substring(2, 10)}`;
|
||||
client.token = AuthService.generateClientToken({
|
||||
clientId: client.clientId,
|
||||
name: client.name,
|
||||
rateLimit: client.rateLimit,
|
||||
});
|
||||
|
||||
this.clients.set(clientId, client);
|
||||
return client;
|
||||
}
|
||||
|
||||
public static updateClient(clientId: string, updates: Partial<Pick<ClientSDK, 'name' | 'rateLimit' | 'status'>>): ClientSDK | null {
|
||||
const client = this.clients.get(clientId);
|
||||
if (!client) return null;
|
||||
|
||||
if (updates.name !== undefined) client.name = updates.name;
|
||||
if (updates.rateLimit !== undefined) client.rateLimit = updates.rateLimit;
|
||||
if (updates.status !== undefined) client.status = updates.status;
|
||||
|
||||
this.clients.set(clientId, client);
|
||||
return client;
|
||||
}
|
||||
|
||||
public static deleteClient(clientId: string): boolean {
|
||||
return this.clients.delete(clientId);
|
||||
}
|
||||
|
||||
public static incrementEventCount(clientId: string, count = 1): void {
|
||||
const client = this.clients.get(clientId);
|
||||
if (client) {
|
||||
client.totalEvents += count;
|
||||
client.lastActive = new Date().toISOString();
|
||||
this.clients.set(clientId, client);
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
export default SDKManager;
|
||||
@@ -0,0 +1,59 @@
|
||||
version: '3.8'
|
||||
|
||||
services:
|
||||
# Next.js Frontend & Admin Console (Port 3000)
|
||||
web:
|
||||
build:
|
||||
context: ..
|
||||
dockerfile: docker/Dockerfile.web
|
||||
ports:
|
||||
- "3000:3000"
|
||||
environment:
|
||||
- NODE_ENV=production
|
||||
- DATASTACK_JWT_SECRET=datastack-universal-secret-key-2026
|
||||
- DATABASE_URL=postgresql://datastack:securepass@postgres:5432/datastack_db
|
||||
restart: unless-stopped
|
||||
depends_on:
|
||||
- redis
|
||||
- postgres
|
||||
|
||||
# Express + Socket.IO Ingestion Engine (Port 4000)
|
||||
ingestion:
|
||||
build:
|
||||
context: ..
|
||||
dockerfile: docker/Dockerfile.server
|
||||
ports:
|
||||
- "4000:4000"
|
||||
volumes:
|
||||
- ../storage:/app/storage
|
||||
environment:
|
||||
- NODE_ENV=production
|
||||
- PORT_SOCKET=4000
|
||||
- DATASTACK_JWT_SECRET=datastack-universal-secret-key-2026
|
||||
- REDIS_URL=redis://redis:6379
|
||||
restart: unless-stopped
|
||||
depends_on:
|
||||
- redis
|
||||
|
||||
# Redis In-Memory Buffer Broker
|
||||
redis:
|
||||
image: redis:7-alpine
|
||||
ports:
|
||||
- "6379:6379"
|
||||
restart: unless-stopped
|
||||
|
||||
# PostgreSQL for Admin Metadata Only (NOT collected data)
|
||||
postgres:
|
||||
image: postgres:16-alpine
|
||||
environment:
|
||||
- POSTGRES_USER=datastack
|
||||
- POSTGRES_PASSWORD=securepass
|
||||
- POSTGRES_DB=datastack_db
|
||||
volumes:
|
||||
- pgdata:/var/lib/postgresql/data
|
||||
ports:
|
||||
- "5432:5432"
|
||||
restart: unless-stopped
|
||||
|
||||
volumes:
|
||||
pgdata:
|
||||
@@ -0,0 +1,8 @@
|
||||
# Docker Deployment Manifest
|
||||
|
||||
## Purpose
|
||||
Containerization specs for the split architecture runtime:
|
||||
- `web`: Next.js frontend + Admin console on Port 3000
|
||||
- `ingestion`: Express + Socket.IO process on Port 4000
|
||||
- `redis`: In-memory buffer broker and pub/sub
|
||||
- `postgres`: Dedicated database for administrative metadata and client registrations (no collected data)
|
||||
@@ -0,0 +1,19 @@
|
||||
import { defineConfig } from "eslint/config";
|
||||
import next from "eslint-config-next";
|
||||
import path from "node:path";
|
||||
import { fileURLToPath } from "node:url";
|
||||
|
||||
const __filename = fileURLToPath(import.meta.url);
|
||||
const __dirname = path.dirname(__filename);
|
||||
|
||||
export default defineConfig([
|
||||
{
|
||||
extends: [...next],
|
||||
rules: {
|
||||
"react-hooks/set-state-in-effect": "off",
|
||||
"react-hooks/immutability": "off",
|
||||
"react/no-unescaped-entities": "off",
|
||||
"@typescript-eslint/no-explicit-any": "off"
|
||||
}
|
||||
}
|
||||
]);
|
||||
@@ -0,0 +1,19 @@
|
||||
import * as React from "react"
|
||||
|
||||
const MOBILE_BREAKPOINT = 768
|
||||
|
||||
export function useIsMobile() {
|
||||
const [isMobile, setIsMobile] = React.useState<boolean | undefined>(undefined)
|
||||
|
||||
React.useEffect(() => {
|
||||
const mql = window.matchMedia(`(max-width: ${MOBILE_BREAKPOINT - 1}px)`)
|
||||
const onChange = () => {
|
||||
setIsMobile(window.innerWidth < MOBILE_BREAKPOINT)
|
||||
}
|
||||
mql.addEventListener("change", onChange)
|
||||
setIsMobile(window.innerWidth < MOBILE_BREAKPOINT)
|
||||
return () => mql.removeEventListener("change", onChange)
|
||||
}, [])
|
||||
|
||||
return !!isMobile
|
||||
}
|
||||
@@ -0,0 +1,3 @@
|
||||
import { cn } from './utils';
|
||||
export { cn };
|
||||
export default cn;
|
||||
@@ -0,0 +1,6 @@
|
||||
import { clsx, type ClassValue } from "clsx"
|
||||
import { twMerge } from "tailwind-merge"
|
||||
|
||||
export function cn(...inputs: ClassValue[]) {
|
||||
return twMerge(clsx(inputs))
|
||||
}
|
||||
@@ -0,0 +1,14 @@
|
||||
# DataStack Platform Root Manifest
|
||||
|
||||
## Purpose
|
||||
Root level orchestration and system manifest for the DataStack Universal Realtime Data Collection Platform.
|
||||
|
||||
## Directory Index
|
||||
- `app/`: Next.js App Router providing `/` (Landing page) and `/vcon/*` (Admin Console)
|
||||
- `components/`: Single source of truth UI (`components/ui/`) and layout (`components/layout/`)
|
||||
- `core/`: Core backend modules (auth, connector, data, storage, sdk, security, settings, server)
|
||||
- `server/`: Dedicated Express + Socket.IO process on Port 4000
|
||||
- `storage/`: Persisted CSV files under `/storage/data/{clientId}/{YYYY-MM-DD}.csv`
|
||||
- `sdk-python/`: Pip-installable Python SDK (`datastack-sdk`)
|
||||
- `docker/`: Docker Compose and Dockerfile deployment specs
|
||||
- `nginx/`: Reverse proxy configuration for WebSocket and Web traffic
|
||||
@@ -0,0 +1,6 @@
|
||||
{
|
||||
"name": "DataStack - Realtime Data Collection Platform",
|
||||
"description": "Self-hosted universal realtime data collection engine with Socket.IO ingestion, Redis buffer, JWT client auth, CSV batch rotation, and /vcon/ admin panel.",
|
||||
"requestFramePermissions": [],
|
||||
"majorCapabilities": ["MAJOR_CAPABILITY_SERVER_SIDE_GEMINI_API"]
|
||||
}
|
||||
@@ -0,0 +1,6 @@
|
||||
/// <reference types="next" />
|
||||
/// <reference types="next/image-types/global" />
|
||||
/// <reference path="./.next/types/routes.d.ts" />
|
||||
|
||||
// NOTE: This file should not be edited
|
||||
// see https://nextjs.org/docs/app/api-reference/config/typescript for more information.
|
||||
@@ -0,0 +1,36 @@
|
||||
import type {NextConfig} from 'next';
|
||||
|
||||
const nextConfig: NextConfig = {
|
||||
reactStrictMode: true,
|
||||
eslint: {
|
||||
ignoreDuringBuilds: true,
|
||||
},
|
||||
typescript: {
|
||||
ignoreBuildErrors: false,
|
||||
},
|
||||
// Allow access to remote image placeholder.
|
||||
images: {
|
||||
remotePatterns: [
|
||||
{
|
||||
protocol: 'https',
|
||||
hostname: 'picsum.photos',
|
||||
port: '',
|
||||
pathname: '/**', // This allows any path under the hostname
|
||||
},
|
||||
],
|
||||
},
|
||||
output: 'standalone',
|
||||
transpilePackages: ['motion'],
|
||||
webpack: (config, {dev}) => {
|
||||
// HMR is disabled in AI Studio via DISABLE_HMR env var.
|
||||
// Do not modify—file watching is disabled to prevent flickering during agent edits.
|
||||
if (dev && process.env.DISABLE_HMR === 'true') {
|
||||
config.watchOptions = {
|
||||
ignored: /.*/,
|
||||
};
|
||||
}
|
||||
return config;
|
||||
},
|
||||
};
|
||||
|
||||
export default nextConfig;
|
||||
@@ -0,0 +1,35 @@
|
||||
upstream nextjs_upstream {
|
||||
server 127.0.0.1:3000;
|
||||
}
|
||||
|
||||
upstream socketio_upstream {
|
||||
server 127.0.0.1:4000;
|
||||
}
|
||||
|
||||
server {
|
||||
listen 80;
|
||||
server_name _;
|
||||
|
||||
client_max_body_size 50M;
|
||||
|
||||
# Socket.IO WebSocket reverse proxy to port 4000
|
||||
location /socket.io/ {
|
||||
proxy_pass http://socketio_upstream;
|
||||
proxy_http_version 1.1;
|
||||
proxy_set_header Upgrade $http_upgrade;
|
||||
proxy_set_header Connection "upgrade";
|
||||
proxy_set_header Host $host;
|
||||
proxy_set_header X-Real-IP $remote_addr;
|
||||
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
|
||||
proxy_read_timeout 86400;
|
||||
}
|
||||
|
||||
# Next.js web application and admin panel to port 3000
|
||||
location / {
|
||||
proxy_pass http://nextjs_upstream;
|
||||
proxy_http_version 1.1;
|
||||
proxy_set_header Host $host;
|
||||
proxy_set_header X-Real-IP $remote_addr;
|
||||
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,4 @@
|
||||
# Nginx Proxy Manifest
|
||||
|
||||
## Purpose
|
||||
Reverse proxy configuration mapping `/socket.io/` WebSocket traffic to the Express ingestion server on Port 4000, and HTTP web traffic to Next.js on Port 3000.
|
||||
@@ -0,0 +1,49 @@
|
||||
{
|
||||
"name": "ai-studio-applet",
|
||||
"version": "0.1.0",
|
||||
"private": true,
|
||||
"scripts": {
|
||||
"dev": "next dev",
|
||||
"server": "node server/index.js",
|
||||
"build": "next build",
|
||||
"start": "next start",
|
||||
"lint": "eslint .",
|
||||
"clean": "next clean"
|
||||
},
|
||||
"dependencies": {
|
||||
"@google/genai": "^2.4.0",
|
||||
"@hookform/resolvers": "^5.2.1",
|
||||
"autoprefixer": "^10.4.21",
|
||||
"class-variance-authority": "^0.7.1",
|
||||
"clsx": "^2.1.1",
|
||||
"cors": "^2.8.6",
|
||||
"express": "^5.3.0",
|
||||
"json2csv": "^6.0.0-alpha.2",
|
||||
"jsonwebtoken": "^9.0.3",
|
||||
"lucide-react": "^0.553.0",
|
||||
"motion": "^12.23.24",
|
||||
"next": "^15.4.9",
|
||||
"postcss": "^8.5.6",
|
||||
"react": "^19.2.1",
|
||||
"react-dom": "^19.2.1",
|
||||
"socket.io": "^4.8.4",
|
||||
"socket.io-client": "^4.8.4",
|
||||
"tailwind-merge": "^3.3.1"
|
||||
},
|
||||
"devDependencies": {
|
||||
"@tailwindcss/postcss": "4.1.11",
|
||||
"@tailwindcss/typography": "^0.5.19",
|
||||
"@types/cors": "^2.8.19",
|
||||
"@types/express": "^5.0.6",
|
||||
"@types/jsonwebtoken": "^9.0.10",
|
||||
"@types/node": "^20",
|
||||
"@types/react": "^19",
|
||||
"@types/react-dom": "^19",
|
||||
"eslint": "9.39.1",
|
||||
"eslint-config-next": "16.0.8",
|
||||
"firebase-tools": "^15.0.0",
|
||||
"tailwindcss": "4.1.11",
|
||||
"tw-animate-css": "^1.4.0",
|
||||
"typescript": "5.9.3"
|
||||
}
|
||||
}
|
||||