51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Implementing an Asynchronous Batch Processing Pipeline for Computer Vision Ingestion Using Axum and Tokio Implementing an Asynchronous Batch Processing Pipeline for Computer Vision Ingestion Using Axum and Tokio
A naive implementation of a computer vision service often follows a simple request-response model: an HTTP endpoint rece
2023-10-27 Rust Engineering
Rust MongoDB NoSQL Axum OpenCV Tokio Concurrency
Engineering Dynamic Service Topology Observability from a Puppet-Managed Monolith Using Consul Connect Grafana and a Test-Driven React Interface Engineering Dynamic Service Topology Observability from a Puppet-Managed Monolith Using Consul Connect Grafana and a Test-Driven React Interface
The outage began, as they often do, with a seemingly innocuous change. A Puppet-driven configuration update modified a c
2023-10-27 Software Architecture
Grafana Software Engineering & Architecture React Testing Library Puppet Consul Connect
Implementing a Low-Latency Analytics Pipeline from DynamoDB to ClickHouse Using a Quarkus Stream Consumer and Dask for Parallel Processing Implementing a Low-Latency Analytics Pipeline from DynamoDB to ClickHouse Using a Quarkus Stream Consumer and Dask for Parallel Processing
The core operational dataset, residing in DynamoDB, was generating write traffic exceeding 10,000 transactions per secon
2023-10-27 Data Engineering
Dask Python DynamoDB CDC ClickHouse Java Quarkus
Integrating a JPA Monolith with Kubeflow Using Debezium and Transactional Outbox for Reliable ML Triggers Integrating a JPA Monolith with Kubeflow Using Debezium and Transactional Outbox for Reliable ML Triggers
The initial request seemed simple: when a high-value customer record is created or updated in our legacy Java monolith,
2023-10-27 Architecture
Podman MLOps JPA/Hibernate CDC Debezium Kubeflow Google Cloud Pub/Sub
A Secure Event-Driven Image Analysis Pipeline with Knative OpenCV Linkerd and Seaborn A Secure Event-Driven Image Analysis Pipeline with Knative OpenCV Linkerd and Seaborn
Our initial system for detecting steganography in user-uploaded images was a monolithic Python service running on a set
2023-10-27 Cloud Native
Microservices Knative Security Kubernetes Seaborn Linkerd OpenCV
Managing Concurrent Delta Lake Writes from a Multi-User Web Application Managing Concurrent Delta Lake Writes from a Multi-User Web Application
The core challenge began with a simple, yet deceptive, requirement: allow our data science team to collaboratively clean
2023-10-27 Data Engineering
Flask Delta Lake React Concurrency Data Lakehouse
50 / 52