51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Implementing a Fault-Tolerant Go CDC Pipeline for Meilisearch Using a Monorepo and Consul for State Management Implementing a Fault-Tolerant Go CDC Pipeline for Meilisearch Using a Monorepo and Consul for State Management
The search index was perpetually out of sync. Our team’s initial approach for keeping our Meilisearch instance updated w
2023-10-27 Backend Development
Consul Go Meilisearch Monorepo PostgreSQL CDC
Achieving ACID-like Guarantees in Serverless Workflows with Apache Pulsar Transactions and AWS Lambda Achieving ACID-like Guarantees in Serverless Workflows with Apache Pulsar Transactions and AWS Lambda
The mandate was clear: build a new order processing backend using a serverless architecture. The business logic, however
2023-10-27 Distributed Systems
Pulsar Serverless Saga Pattern ACID AWS Lambda
Implementing End-to-End Multi-Tenancy Isolation from UI Styling to Database with Cilium and ScyllaDB Implementing End-to-End Multi-Tenancy Isolation from UI Styling to Database with Cilium and ScyllaDB
The initial architecture for our real-time analytics platform was causing production incidents. Built on a shared-everyt
2023-10-27 Cloud Native
ScyllaDB APISIX Kubernetes Multi-tenancy eBPF Cilium CSS Modules
Implementing eBPF-Based Kernel Observability in AWS Lambda Environments Implementing eBPF-Based Kernel Observability in AWS Lambda Environments
The black box nature of AWS Lambda is both its greatest strength and a significant operational challenge. We had a Pytho
2023-10-27 Cloud Native
Observability eBPF Cilium AWS Lambda NoSQL
Constructing a Resilient Audit Trail for WebAuthn Events from Docker Swarm to SQL Server via Fluentd Constructing a Resilient Audit Trail for WebAuthn Events from Docker Swarm to SQL Server via Fluentd
The initial deployment of our new passwordless authentication service, built on WebAuthn, across the Docker Swarm cluste
2023-10-27 Observability
Fluentd Security WebAuthn Docker Swarm SQL Server Logging
Engineering an Idempotent Data Pipeline for Synchronizing Apache Hudi Commits to a Meilisearch Index via AWS SNS Engineering an Idempotent Data Pipeline for Synchronizing Apache Hudi Commits to a Meilisearch Index via AWS SNS
The initial request was straightforward: provide sub-second search capabilities over our rapidly growing multi-terabyte
2023-10-27 Data Engineering
Meilisearch Idempotency AWS SNS Spark Apache Hudi Code Review
26 / 52