51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Integrating a High-Traffic PHP Application with a TensorFlow Inference Service Using a Resilient Kafka Pipeline Integrating a High-Traffic PHP Application with a TensorFlow Inference Service Using a Resilient Kafka Pipeline
The core business logic resides in a monolithic PHP 7.4 application, processing thousands of financial transactions per
2023-10-27 Architecture
Microservices TensorFlow Kafka PHP Real-Time Systems
Implementing a Polyglot CQRS Pipeline with Cassandra Writes and Firestore Real-Time Projections Implementing a Polyglot CQRS Pipeline with Cassandra Writes and Firestore Real-Time Projections
The operational dashboard for our global IoT sensor network was failing. The original architecture, a monolithic Node.js
2023-10-27 Distributed Systems
CQRS Firestore AWS SNS Cassandra AWS Lambda Lit Event-Driven Architecture
Implementing a Zero-Trust Data Analytics Pipeline with Trino, Jupyter, and Consul Connect Implementing a Zero-Trust Data Analytics Pipeline with Trino, Jupyter, and Consul Connect
The initial request seemed straightforward: allow our data science team to run ad-hoc queries against a Trino cluster an
2023-10-27 Data Engineering
SSG Zero Trust Consul Connect Service Mesh Presto / Trino Jupyter
Constructing an Idempotent Batching Consumer for Bridging a REST API and HBase via RabbitMQ Constructing an Idempotent Batching Consumer for Bridging a REST API and HBase via RabbitMQ
The initial system architecture was straightforward, almost deceptively so. A fleet of RESTful API endpoints, built with
2023-10-27 Data Engineering
RabbitMQ RESTful API HBase Java System Design
Constructing a High-Throughput Search Pipeline from Hadoop to Solr with a Shadcn UI Frontend and Playwright-Driven Validation Constructing a High-Throughput Search Pipeline from Hadoop to Solr with a Shadcn UI Frontend and Playwright-Driven Validation
The operational challenge was straightforward: terabytes of semi-structured application logs were being dumped into HDFS
2023-10-27 Data Engineering
Solr Hadoop Shadcn UI Playwright Search Big Data E2E Testing
Stateful RAG Pipeline Coordination Using etcd with Celery and a Zig-Accelerated Reranker Stateful RAG Pipeline Coordination Using etcd with Celery and a Zig-Accelerated Reranker
The initial RAG pipeline was deceptive in its simplicity. A Python service would accept a query, generate an embedding,
2023-10-27 Distributed Systems
Performance etcd ChromaDB RAG Zig Celery
33 / 52