Working with Hadoop Distributed File System: CLI and Programmatic Access
Command-Line Operations in HDFS
The Hadoop Distributed File System provides a robust shell interface for managing distributed storage. Below are esssential commands for navigating and manipulating the filesystem:
# List contents of the root directory
hadoop fs -ls /
# Create a new directory structure
hadoop fs -mkdir -p /data/logs
# Transfer ...
Posted on Wed, 30 Sep 2026 16:26:50 +0000 by justinma
Apache Hadoop Deployment Strategies and HDFS Initialization on Docker
Local Mode (Standalone): In this configuration, Hadoop functions purely as a library. It executes MapReduce jobs on a single machine without managing background processes. This mode is intended solely for debugging code and rapid prototyping.
Pseudo-Distributed Mode: Here, all Hadoop daemons run as separate background processes on a single hos ...
Posted on Mon, 18 May 2026 22:40:05 +0000 by The Cat