51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Orchestrating Containerized SciPy Computations and Nuxt.js Deployments with a Unified Tekton Pipeline Orchestrating Containerized SciPy Computations and Nuxt.js Deployments with a Unified Tekton Pipeline
The initial workflow was a predictable bottleneck. A data science team would finalize a new statistical model using Pyth
2023-10-27 DevOps
SciPy Kubernetes GitOps MLOps Nuxt.js Tekton
Implementing a Fault-Tolerant Go CDC Pipeline for Meilisearch Using a Monorepo and Consul for State Management Implementing a Fault-Tolerant Go CDC Pipeline for Meilisearch Using a Monorepo and Consul for State Management
The search index was perpetually out of sync. Our team’s initial approach for keeping our Meilisearch instance updated w
2023-10-27 Backend Development
Consul Go Meilisearch PostgreSQL Monorepo CDC
Achieving ACID-like Guarantees in Serverless Workflows with Apache Pulsar Transactions and AWS Lambda Achieving ACID-like Guarantees in Serverless Workflows with Apache Pulsar Transactions and AWS Lambda
The mandate was clear: build a new order processing backend using a serverless architecture. The business logic, however
2023-10-27 Distributed Systems
Serverless Pulsar Saga Pattern ACID AWS Lambda
Constructing a Resilient Audit Trail for WebAuthn Events from Docker Swarm to SQL Server via Fluentd Constructing a Resilient Audit Trail for WebAuthn Events from Docker Swarm to SQL Server via Fluentd
The initial deployment of our new passwordless authentication service, built on WebAuthn, across the Docker Swarm cluste
2023-10-27 Observability
Fluentd Security WebAuthn Docker Swarm SQL Server Logging
Implementing eBPF-Based Kernel Observability in AWS Lambda Environments Implementing eBPF-Based Kernel Observability in AWS Lambda Environments
The black box nature of AWS Lambda is both its greatest strength and a significant operational challenge. We had a Pytho
2023-10-27 Cloud Native
Observability Cilium eBPF AWS Lambda NoSQL
Engineering an Idempotent Data Pipeline for Synchronizing Apache Hudi Commits to a Meilisearch Index via AWS SNS Engineering an Idempotent Data Pipeline for Synchronizing Apache Hudi Commits to a Meilisearch Index via AWS SNS
The initial request was straightforward: provide sub-second search capabilities over our rapidly growing multi-terabyte
2023-10-27 Data Engineering
AWS SNS Spark Meilisearch Idempotency Apache Hudi Code Review
26 / 52