51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Orchestrating a Real-Time Feature Pipeline from Nuxt.js to Kubeflow via a JavaScript Gateway and NoSQL Store Orchestrating a Real-Time Feature Pipeline from Nuxt.js to Kubeflow via a JavaScript Gateway and NoSQL Store
The technical pain point was feature staleness. Our personalization models, served on a robust Kubeflow cluster, were co
2023-10-27 System Architecture
Node.js MLOps MongoDB JavaScript Nuxt.js NoSQL Kubeflow
Client-Side Execution of Snowflake Data Models Using a Rust-WASM Engine and Recoil for State Synchronization Client-Side Execution of Snowflake Data Models Using a Rust-WASM Engine and Recoil for State Synchronization
The core technical pain point originated from a seemingly simple user request for one of our internal financial analytic
2023-10-27 Software Architecture
Rust Frontend Snowflake WebAssembly Recoil
Building a Transactional Data Lakehouse Ingest Pipeline with TiDB CDC NATS and Apache Hudi Building a Transactional Data Lakehouse Ingest Pipeline with TiDB CDC NATS and Apache Hudi
The 24-hour latency on our core analytics dataset was no longer acceptable. Our batch ETL jobs, pulling snapshots from a
2023-10-27 Data Engineering
NATS GitHub Astro TiDB Apache Hudi
Implementing a Kubernetes Operator for Declarative MapReduce-Based Indexing Implementing a Kubernetes Operator for Declarative MapReduce-Based Indexing
The operational burden of our log search platform had become untenable. We were ingesting terabytes of unstructured appl
2023-10-27 Cloud Native
Kubernetes Cloud Native & DevOps Search MapReduce Golang Operator
Building a Multi-Tenant MLOps Feature Store Metadata API with Koa and PostgreSQL Building a Multi-Tenant MLOps Feature Store Metadata API with Koa and PostgreSQL
The spreadsheet was the breaking point. Multiple data science teams, each with their own feature engineering pipelines,
2023-10-27 MLOps
Node.js Architecture MLOps PostgreSQL Koa Multi-tenancy
Implementing a Distributed C++ Circuit Breaker with a Memcached Backend and Ant Design Dashboard Implementing a Distributed C++ Circuit Breaker with a Memcached Backend and Ant Design Dashboard
A critical downstream payment gateway API began exhibiting intermittent failures, with latency spiking from 50ms to over
2023-10-27 Backend Development
Distributed Systems Ant Design Memcached Caddy C++ Resilience Engineering
35 / 52