51eshare's Tech Blog
This site is dedicated to sharing IT-related technologies.
  Post Categories
Architecture 35 Observability 23 Backend Development 17 Backend Architecture 15 Distributed Systems 33 Cloud Native 22 Software Architecture 15 Security 3 MLOps 17 Cloud Native & DevOps 1 DevOps 35 Data Engineering 41 Web Development 2 API Gateway 1 Mobile Development 3 Software Engineering & Architecture 1 Security Architecture 1 System Design 9 AI Engineering 2 Frontend Architecture 1 Platform Engineering 3 Build Tools 1 System Architecture 6 Real-Time Systems 1 Resilience Engineering 3 DevSecOps 1 MLOps Engineering 1 Cloud Native Security 1 Backend Engineering 2 Cloud Architecture 4 Full-Stack Development 2 Rust Engineering 1 Build Systems 1 Frontend Engineering 2 WebAssembly 1 Security Engineering 2 Cloud Security 1
Building a Real-Time Semantic Search Layer over SQL Server Using Change Data Capture and Weaviate Building a Real-Time Semantic Search Layer over SQL Server Using Change Data Capture and Weaviate
The core OLTP system, built on SQL Server, was the untouchable monolith, reliably handling millions of product inventory
2023-10-27 Data Engineering
Python Kafka SQL Server Debezium NumPy Weaviate Change Data Capture
Implementing a Zero-Trust Mobile Telemetry Pipeline with mTLS, Loki, and Apache Iceberg Implementing a Zero-Trust Mobile Telemetry Pipeline with mTLS, Loki, and Apache Iceberg
The existing mobile telemetry pipeline was a liability. We were authenticating our Android clients against the ingestion
2023-10-27 Data Engineering
Qwik Android mTLS Observability Apache Iceberg Loki
Automating Data Lineage Tracking from Code to Lake with ESLint, Neo4j, and Apache Hudi Automating Data Lineage Tracking from Code to Lake with ESLint, Neo4j, and Apache Hudi
The incident that finally broke our manual processes began with a one-line change to a seemingly innocuous data transfor
2023-10-27 Data Engineering
DevOps ESLint Neo4j Apache Hudi Data Lineage AST
Implementing a CDC-Based Dual-Write Pipeline from Oracle to Apache Iceberg and Weaviate via Azure Functions Implementing a CDC-Based Dual-Write Pipeline from Oracle to Apache Iceberg and Weaviate via Azure Functions
The project started with a familiar constraint: modernize a critical feature without touching the monolithic core. The s
2023-10-27 Data Engineering
Oracle Azure Functions CDC Apache Iceberg Weaviate Data Lakehouse MobX
Implementing a Tiered IIoT Data Architecture with TimescaleDB and HBase for a Jetpack Compose Client Implementing a Tiered IIoT Data Architecture with TimescaleDB and HBase for a Jetpack Compose Client
The core technical problem is managing data from a fleet of several million industrial sensors, each emitting telemetry
2023-10-27 Data Engineering
Architecture Kotlin Jetpack Compose HBase TimescaleDB IIoT
Implementing a Real-Time Oracle-to-Dgraph Synchronization Pipeline Using CDC and WebSockets Implementing a Real-Time Oracle-to-Dgraph Synchronization Pipeline Using CDC and WebSockets
The core technical challenge was to propagate data changes from a legacy Oracle monolith, representing a complex network
2023-10-27 Data Engineering
Oracle Kafka WebSockets CDC Dgraph Cypress Backend
5 / 7