Distributed Message Queue Cluster Setup with ZooKeeper and Kafka
Message Queue Fundamentals
Understanding Message Queues
A message represents data transmitted between applications. Messages can range from simple text strings to complex structures containing embedded objects.
A Message Queue (MQ) serves as an asynchronous communication mechanism in software systems. It decouples communication between differen ...
Posted on Wed, 17 Jun 2026 16:15:00 +0000 by nickmagus
Apache ZooKeeper Fundamentals and Hands-On Setup
Apache ZooKeeper is a centralized, fault-tolerant service for maintaining configuration information, naming, distributed synchronization, and group services in distributed systems.
Installation and Setup
ZooKeeper binaries can be downloaded from the official Apache releases page. After extraction, configure zoo.cfg in the conf/ directory. A min ...
Posted on Tue, 16 Jun 2026 17:49:15 +0000 by php_dev_101
Big Data Fundamentals and Core Technologies Overview
HDFS File System Commands
Disk Usage Information
Retrieve disk usage statistics for a specific path:
hadoop fs -df /home/myfile
Merge Files
Combine multiple files from HDFS into a single local file:
hadoop fs -getmerge /user/hduser0011/test /home/myfile/dir
Write Output to HDFS
Direct console output to an HDFS file:
echo abc | hadoop fs -put ...
Posted on Thu, 11 Jun 2026 18:46:45 +0000 by brucensal
Service Registration and Discovery: From Theory to Practice
Service Registration and Discovery: From Theory to Practice
1. What is Service Registration and Discovery?
Let's start by understanding what service registration and discovery means.
Service Registration is the process of registering information about a module that provides a specific service (typically its IP address and port) with a common in ...
Posted on Thu, 11 Jun 2026 17:15:56 +0000 by mohabitar
Distributed Lock Implementations in Java with Redis and ZooKeeper
Redis-Based Distributed Locking with Redisson
Distributed systems often require mechanisms to ensure that only one process or thread can access a shared resource at a time across different service instances. Redis, a popular in-memory data store, can be effectively leveraged for this purpose, particularly through libraries like Redisson.
Maven ...
Posted on Sun, 07 Jun 2026 18:00:34 +0000 by Pilly
Orchestrating Distributed Systems with Apache Zookeeper and Kafka
Overview of Apache Zookeeper
Apache Zookeeper is a high-performance coordination service for distributted applications. It exposes a simple set of primitives—often used to implement higher-level services for synchronization, configuration maintenance, and groups/naming. It is designed to be highly available and reliable, forming the backbone of ...
Posted on Sat, 06 Jun 2026 18:34:36 +0000 by suttercain
Spring MVC XML Configuration for Apache Dubbo Service Provider and Consumer
Provider Side – Service & Data Layer
1.1 Mavan Dependencies
<dependencies>
<!-- ZooKeeper client -->
<dependency>
<groupId>org.apache.zookeeper</groupId>
<artifactId>zookeeper</artifactId>
<version>${zk.version}</version>
</dependency>
&l ...
Posted on Fri, 05 Jun 2026 18:19:08 +0000 by johnsmith153
Dubbo: A Distributed Service Framework for Scalable Microservices
As web applications grew in scale, monolithic architectures became unsustainable. The transition from single-tier systems to distributed service-based models became inevitable to support scalability, resilience, and agile development.
Monolithic Architecture
In early-stage applications with low traffic, all components—UI, business logic, and da ...
Posted on Fri, 05 Jun 2026 18:15:27 +0000 by rachelk
Distributed Cron Scheduling with ElasticJob: Sharding, High Availability, and Runtime Rescaling
Consider a typical microservice deployment where an order processing service runs across multiple instances. A common requirement is to daily scan for successfully processed orders from the previous day and notify downstream analytics services.
A naive implemantation using Spring’s @Scheduled annotation leads to duplicate execution in productio ...
Posted on Mon, 01 Jun 2026 16:08:38 +0000 by phillyrob
Hadoop Distributed System Fundamentals and Cluster Setup
Big Data Processing Overview
Big data involves analyzing massive datasets to extract valuable insights for organizational decision-making. Core processing stages include:
Data acquisition
Data processing
Result visualization
Hadoop Framework
Hadoop provides distributed processing capabilities for large datasets across computer clusters. Its a ...
Posted on Tue, 26 May 2026 01:24:57 +0000 by SidewinderX