51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Constructing a Resumable Real-Time Data Pipeline Observability UI with Qwik and Apache Hudi Constructing a Resumable Real-Time Data Pipeline Observability UI with Qwik and Apache Hudi
Our core data ingestion pipelines were becoming black boxes. When a job failed or data quality issues arose, the post-mo
2023-10-27 Data Engineering
Qwik Observability Apache Hudi Google Cloud Pub/Sub Real-Time Systems
Aggregating Mobile CI/CD and Kong Gateway Telemetry with Vector for Canary Release Analysis Aggregating Mobile CI/CD and Kong Gateway Telemetry with Vector for Canary Release Analysis
The mobile canary release process was a black box. We would deploy a new build to a 5% user cohort, and then the frantic
2023-10-27 DevOps
Kong Observability Canary Release CI/CD for Mobile Vector
Building a Declarative MLOps Platform for CV Models with Crossplane and Kong Building a Declarative MLOps Platform for CV Models with Crossplane and Kong
The friction between our data science and platform engineering teams had become untenable. Data scientists, working in P
2023-10-27 MLOps
Kong Kubernetes Pandas Crossplane CV AI Data Science
Implementing Real-Time IAM Anomaly Detection Using Vector Embeddings with NestJS Pinecone and ELK Implementing Real-Time IAM Anomaly Detection Using Vector Embeddings with NestJS Pinecone and ELK
Our role-based access control (RBAC) system, built on a fairly standard IAM model, failed silently. The breach wasn’t a
2023-10-27 Security Engineering
NestJS Observability ELK Stack Pinecone IAM Anomaly Detection
Constructing a Real-Time Security Event Correlation Pipeline with a Data Lake, TimescaleDB, and Meilisearch Constructing a Real-Time Security Event Correlation Pipeline with a Data Lake, TimescaleDB, and Meilisearch
Our Security Operations Center (SOC) was drowning in data. The primary culprit was the firehose of logs from our Web App
2023-10-27 Data Engineering
Security Go Data Lake Meilisearch WAF TimescaleDB
Implementing a Replayable Event-Sourced Feature Store with Ray Compute Clusters on Nomad Implementing a Replayable Event-Sourced Feature Store with Ray Compute Clusters on Nomad
The request from the machine learning team was deceptive in its simplicity: “We need to backfill features for our new fr
2023-10-27 MLOps Engineering
Distributed Systems Event Sourcing Nomad Ray Feature Store
43 / 52