Troubleshooting Common Errors in Big Data Environment Setup: Hadoop, Spark, HBase, Hive, and ZooKeeper
Hadoop Pseudo-Distributed Mode Issues
Configuration Parsing Failure in hdfs-site.xml
When you encounter FATAL conf.Configuration: error parsing conf hdfs-site.xml, the root cause is typically an encoding mismatch. Resolve it by opening the file and saving it with a uniform character encoding such as UTF-8.
HDFS Command Deprecation Warning
The w ...
Posted on Wed, 13 May 2026 16:56:31 +0000 by ashutosh.titan
Deploying and Operating Kafka with the wurstmeister/kafka Docker Image
Environment Setup
Operating System: CentOS 7
Docker Version: 17.03.2-ce
Docker Compose Version: 1.23.2
Docker Compose Configuration
To deploy Kafka with Zookeeper, create a docker-compose.yml file with the following content. This configuration avoids common issues like build failures and connection errors.
version: '2'
services:
zookeeper:
...
Posted on Thu, 07 May 2026 21:17:43 +0000 by TLawrence
Deploying Multiple ZooKeeper Instances on a Single Host
Environment Setup
Target system: CentOS 7.3 (sinngle machine)
ZooKeeper version: 3.5.2
Installation path: /opt/zk
Instance ports: 2181, 2182, 2183
Config files: /opt/zk/conf/node1.cfg through node3.cfg
Install rqeuired Java runtime:
yum install java-1.8.0-openjdk -y
Installation Steps
Download the distribution package:
wget https://archive.apa ...
Posted on Thu, 07 May 2026 17:00:49 +0000 by HowdeeDoodee
ZooKeeper Watcher Mechanism: Principles and Practical Guide
ZooKeeper Watcher Mechanism: Principles and Practical Guide
This article explores the ZooKeeper Watcher mechanism, a core component for distributed coordination. It covers fundamental concepts, the publish/subscribe model, workflow, application scenarios, and practical command examples.
Background
We have three cloud servers (2C4G each) running ...
Posted on Thu, 07 May 2026 05:59:21 +0000 by markszy