51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
Managing Concurrent Delta Lake Writes from a Multi-User Web Application Managing Concurrent Delta Lake Writes from a Multi-User Web Application
The core challenge began with a simple, yet deceptive, requirement: allow our data science team to collaboratively clean
2023-10-27 Data Engineering
Flask React Delta Lake Concurrency Data Lakehouse
Building a Reproducible ML Training Pipeline with Apache Iceberg as a Versioned Dataset on DigitalOcean Building a Reproducible ML Training Pipeline with Apache Iceberg as a Versioned Dataset on DigitalOcean
The project started with a familiar, sinking feeling. We were retraining a computer vision model in Keras, built six mon
2023-10-27 Data Engineering
Keras Python MLOps DigitalOcean Apache Iceberg
Constructing an Asynchronous NLP Pipeline for Document Similarity Alerts with Spring Boot, SNS, and ChromaDB Constructing an Asynchronous NLP Pipeline for Document Similarity Alerts with Spring Boot, SNS, and ChromaDB
The initial system was deceptively simple and fundamentally broken for any real-world load. A user would upload a docume
2023-10-27 Backend Architecture
JWT AWS SNS ChromaDB Spring Boot NLP
Implementing a Fault-Tolerant Replicated State Machine Using Raft and Embedded SQLite Implementing a Fault-Tolerant Replicated State Machine Using Raft and Embedded SQLite
The project required a fault-tolerant data store with SQL capabilities for a set of services running in a resource-const
2023-10-27 Distributed Systems
Frontend Dgraph SQLite Raft Loki
Designing a CQRS Architecture with TimescaleDB to Mitigate High-Cardinality Issues in Real-Time Monitoring Frontends Designing a CQRS Architecture with TimescaleDB to Mitigate High-Cardinality Issues in Real-Time Monitoring Frontends
The collapse of a monitoring system under its own data weight is a familiar story. The initial antagonist is often an un
2023-10-27 System Design
CQRS Babel Observability Architecture TimescaleDB MobX
Implementing a Federated Micro-Frontend Architecture with a SAML-to-gRPC Authentication Bridge Using esbuild Implementing a Federated Micro-Frontend Architecture with a SAML-to-gRPC Authentication Bridge Using esbuild
The project started with a familiar, painful directive: modernize a sprawling, monolithic enterprise portal. Its fronten
2023-10-27 System Design
Styled-components Authentication gRPC SAML Micro-frontends esbuild
51 / 52