ES
EuroStream v0.2.0

Lambda Real-Time Streaming & Medallion Lakehouse

Bronze Ingested

WAL

Orders: Payments:

Silver Cleaned

SHA-256

Customers: Watermark:

Gold Customer 360

Curated

Order Facts: Lake: 6 Parquet

Fraud Caught

300s Win

Suppressed: SLA: 60s

Throughput Traffic FlowEvents / Stream

Fraud Detections by RuleWindowed Anomalies

Marketing Consent DistributionArt. 6 Gating

Bronze Raw Capture

Durable append-only event stream (orders, clicks, payments, fraud alerts). Clear-text PII is securely masked to <anonymized> on erasure.

Silver Masked Dimension

Deduplicated on business keys with deterministic salted SHA-256 PII hashing. Watermarked incremental merge saves ~90% compute at scale.

Gold Curated Lakehouse

Consent-gated Customer 360, order facts, and fraud summaries. Exported to de-identified Parquet lake for BI & ML consumption.

Severity Rule Customer ID Detection Detail Timestamp Action
No fraud alerts matching filter. Click "Score Stream" or "Simulate Fraud Burst" above.

Medallion Layer Matrix & Lake Tables

Namespace.TableLayerRow CountWatermarkStorage EnginePII Policy
bronze.ordersBronzeDuckDB + TursoClear-text → Anonymized
bronze.paymentsBronzeDuckDB + TursoClear-text → Anonymized
silver.customersSilverParquet + TursoSalted SHA-256
gold.customer_360GoldParquet + TursoConsent-Gated View
gold.order_factsGoldParquet + TursoDe-identified Facts

Live Customer 360 Explorer

Customer ID Total Orders Total Spend (€) Avg Order (€) Marketing Consent Fraud Flag Action
No customer records loaded. Run "Transform" to materialize Customer 360.

DSAR Right-to-Erasure

Article 17 demands verified removal across raw capture, masked dimensions, business aggregates, streaming state, and public lake.

Cascade Verified
Confirmation Hash:
Layers touched:

6-Layer Cascading Guarantee SLA: 60s max

1. Suppression Registry

Memory & DB filter blocks all future events across processes.

2. Bronze Anonymize

Replaces clear-text email, IBAN, IP with <anonymized>.

3. Silver Deletion

Hard DELETE from customers, orders, and payments dimensions.

4. Gold Deletion

Removes customer_360, order facts, and fraud summaries.

5. Fraud Alerts Purge

Purges all windowed fraud memory and bronze alerts.

6. Parquet Lake Re-snapshot

Exports fresh Parquet snapshots so lake has zero stale traces.

Tamper-Evident Erasure Audit Trail

Request IDCustomer IDLayersStatusConfirmation HashCompleted At
No erasures recorded yet. Execute an erasure above to view the audit log.

Data Quality Governance Gates

No data quality runs recorded. Click "Run Checks" to execute.

Live Stack & Engine Health

Event Bus Backend
Turso Cloud Sync
Schema Contractsgovernance/contracts.json

Prometheus Observability Explorer

Scrape endpoint: