51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Implementing an Observable and Continuously Deployed RAG Service on Azure Functions with Nginx and Fluentd Implementing an Observable and Continuously Deployed RAG Service on Azure Functions with Nginx and Fluentd
The initial RAG prototype was a monolithic Flask application running on a single VM. It worked for the demo, but product
2023-10-27 MLOps
Fluentd Nginx CircleCI Azure Functions LlamaIndex
A Versioned Shared Kernel for ORM Models Manages Data Consistency Across Sanic Polyrepo Services A Versioned Shared Kernel for ORM Models Manages Data Consistency Across Sanic Polyrepo Services
The move from a monolith to a polyrepo microservice architecture introduced an immediate and painful problem: managing s
2023-10-27 Backend Architecture
Microservices ORM Polyrepo Sanic DDD Tortoise ORM
An Immutable Infrastructure Approach to Polyglot Kafka Stream Processing An Immutable Infrastructure Approach to Polyglot Kafka Stream Processing
A data corruption bug that only manifests in the production environment is one of the most challenging problems in distr
2023-10-27 Architecture
DevOps Kafka Scala Packer TypeScript Immutable Infrastructure
Building a Real-Time Data Reconciliation Pipeline with Koa Delta Lake and Redux Building a Real-Time Data Reconciliation Pipeline with Koa Delta Lake and Redux
The core technical challenge was twofold: our operations team required a live, sub-second view of critical inventory tab
2023-10-27 Data Engineering
Node.js Kafka Koa Delta Lake WebSocket CDC Redux
Implementing Idempotent SQS Batch Processing and Contextual Sentry Reporting in a Micronaut Service Implementing Idempotent SQS Batch Processing and Contextual Sentry Reporting in a Micronaut Service
The initial system architecture was straightforward, but it proved to be naive under production load. We were handling a
2023-10-27 Backend Engineering
Observability Rollup AWS SQS Sentry Micronaut
Implementing a Hybrid Python-Rust gRPC Service for Low-Latency Computer Vision and NLP Workloads Implementing a Hybrid Python-Rust gRPC Service for Low-Latency Computer Vision and NLP Workloads
The initial system was a pure Python monolith, built on Tornado for its asynchronous capabilities. It was designed to in
2023-10-27 System Architecture
SciPy Python gRPC Rust Tonic Tornado NLP OpenCV
11 / 52