51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Implementing an Asynchronous Inference Gateway with Kong, Kafka, and Ruby Implementing an Asynchronous Inference Gateway with Kong, Kafka, and Ruby
The primary bottleneck in our real-time personalization service was a synchronous call to a Keras model. The model infer
2023-10-27 System Design
Microservices Redis API Gateway Keras Kong Kafka Ruby
Orchestrating TiDB Chaos Experiments with Tekton Pipelines and WAF-based L7 Fault Injection Orchestrating TiDB Chaos Experiments with Tekton Pipelines and WAF-based L7 Fault Injection
The post-mortem was clear. A transient network partition between two availability zones caused a minor leadership electi
2023-10-27 Resilience Engineering
Consul Tekton WAF Zipkin TiDB Chaos Engineering
Implementing Distributed Tracing for Node.js gRPC Services Within a VPC Implementing Distributed Tracing for Node.js gRPC Services Within a VPC
The system went dark. A user-facing request to our api-gateway service timed out. The logs for that service showed a req
2023-10-27 Observability
Microservices OpenTelemetry Distributed Tracing Node.js gRPC VPC
Constructing a Real-Time Hybrid Search Index by Streaming TiDB Changes to OpenSearch Vector Engine via Kotlin Constructing a Real-Time Hybrid Search Index by Streaming TiDB Changes to OpenSearch Vector Engine via Kotlin
The operational data store, a distributed TiDB cluster, handles our transactional workload with ACID guarantees. However
2023-10-27 Data Engineering
Kafka Kotlin CDC TiDB OpenSearch Vector
Isolating Untrusted Workloads with containerd within Dynamically Configured AWS VPCs and WebAuthn-based Access Control Isolating Untrusted Workloads with containerd within Dynamically Configured AWS VPCs and WebAuthn-based Access Control
Executing arbitrary, untrusted code on behalf of multiple users is a significant security challenge. A simple container
2023-10-27 Cloud Native Security
Security AWS WebAuthn VPC NoSQL containerd Golang
Implementing a Hot-Reloadable Lua-Based Aggregation Engine in a Tornado WebSocket Server for TimescaleDB Ingestion Implementing a Hot-Reloadable Lua-Based Aggregation Engine in a Tornado WebSocket Server for TimescaleDB Ingestion
The core operational challenge was a firehose of time-series data originating from a fleet of tens of thousands of IoT d
2023-10-27 System Architecture
Python Lua WebSocket UI Tornado TimescaleDB Data Engineering
48 / 52