51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Stateful RAG Pipeline Coordination Using etcd with Celery and a Zig-Accelerated Reranker Stateful RAG Pipeline Coordination Using etcd with Celery and a Zig-Accelerated Reranker
The initial RAG pipeline was deceptive in its simplicity. A Python service would accept a query, generate an embedding,
2023-10-27 Distributed Systems
Performance etcd ChromaDB RAG Zig Celery
Implementing Cross-Language Build Caching in a Scala Python and TypeScript Monorepo Implementing Cross-Language Build Caching in a Scala Python and TypeScript Monorepo
Our CI pipeline execution time for the main repository had ballooned from a manageable 12 minutes to an unacceptable 48
2023-10-27 Build Systems
CI/CD Python Scala Monorepo Bazel
Implementing a CDC-Powered Middleware for Synchronizing Offline-First Svelte and Jetpack Compose UIs Implementing a CDC-Powered Middleware for Synchronizing Offline-First Svelte and Jetpack Compose UIs
The core challenge was straightforward in its definition, but complex in its constraints: create a real-time view of sha
2023-10-27 Distributed Systems
GitHub Actions Service Workers Kafka Distributed & Middleware Jetpack Compose CDC Ktor Svelte
Implementing Correlated Logging Across a Hybrid MLOps Stack with Nuxt.js Azure Functions and Google PubSub Implementing Correlated Logging Across a Hybrid MLOps Stack with Nuxt.js Azure Functions and Google PubSub
The initial architecture for our MLOps control plane seemed straightforward. A Nuxt.js front-end provided the user inter
2023-10-27 Observability
Distributed Tracing MLOps ELK Stack Nuxt.js Azure Functions Logging Google Cloud Pub/Sub
Architecting a CQRS-Driven Web Intelligence System with Puppeteer-Based Commands and Service Worker-Powered Queries Architecting a CQRS-Driven Web Intelligence System with Puppeteer-Based Commands and Service Worker-Powered Queries
The core challenge is a fundamental dichotomy in system requirements: a data ingestion process that is inherently slow,
2023-10-27 System Design
CQRS Node.js Service Workers Architecture Puppeteer LangChain
Implementing a gRPC Bridge Between a Node.js BFF and a Rust Microservice for High-Throughput Graph Traversal Implementing a gRPC Bridge Between a Node.js BFF and a Rust Microservice for High-Throughput Graph Traversal
The central challenge was latency. A new social analytics dashboard, rendered with React and Styled-components, needed t
2023-10-27 Architecture
Styled-components gRPC Rust Neo4j Fastify Tonic
32 / 52