51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Constructing a Resumable Real-Time Data Pipeline Observability UI with Qwik and Apache Hudi Constructing a Resumable Real-Time Data Pipeline Observability UI with Qwik and Apache Hudi
Our core data ingestion pipelines were becoming black boxes. When a job failed or data quality issues arose, the post-mo
2023-10-27 Data Engineering
Qwik Observability Apache Hudi Google Cloud Pub/Sub Real-Time Systems
Aggregating Mobile CI/CD and Kong Gateway Telemetry with Vector for Canary Release Analysis Aggregating Mobile CI/CD and Kong Gateway Telemetry with Vector for Canary Release Analysis
The mobile canary release process was a black box. We would deploy a new build to a 5% user cohort, and then the frantic
2023-10-27 DevOps
Kong Observability Canary Release CI/CD for Mobile Vector
Implementing Real-Time IAM Anomaly Detection Using Vector Embeddings with NestJS Pinecone and ELK Implementing Real-Time IAM Anomaly Detection Using Vector Embeddings with NestJS Pinecone and ELK
Our role-based access control (RBAC) system, built on a fairly standard IAM model, failed silently. The breach wasn’t a
2023-10-27 Security Engineering
NestJS Observability IAM Pinecone ELK Stack Anomaly Detection
Constructing a Real-Time Security Event Correlation Pipeline with a Data Lake, TimescaleDB, and Meilisearch Constructing a Real-Time Security Event Correlation Pipeline with a Data Lake, TimescaleDB, and Meilisearch
Our Security Operations Center (SOC) was drowning in data. The primary culprit was the firehose of logs from our Web App
2023-10-27 Data Engineering
Security Go Meilisearch Data Lake WAF TimescaleDB
Synchronizing a Collaborative Visual Editor's XState Machine with a Go-Gin WebSocket Backend Synchronizing a Collaborative Visual Editor's XState Machine with a Go-Gin WebSocket Backend
The initial proof-of-concept for our internal workflow tool was deceptive in its simplicity. A drag-and-drop interface f
2023-10-27 Full-Stack Development
Go-Gin XState UnoCSS WebSockets State Machines
Implementing a Replayable Event-Sourced Feature Store with Ray Compute Clusters on Nomad Implementing a Replayable Event-Sourced Feature Store with Ray Compute Clusters on Nomad
The request from the machine learning team was deceptive in its simplicity: “We need to backfill features for our new fr
2023-10-27 MLOps Engineering
Distributed Systems Event Sourcing Nomad Ray Feature Store
43 / 52