Hive Data Warehouse Integration
Overview of Hive
1.1 Hive functions as a data warehouse within the Hadoop ecosystem. It manages and queries data stored in Hadoop. Essentially, Hive serves as an SQL parsing engine that converts SQL queries into MapReduce jobs.
Hive includes a mapping tool that translates SQL tables and columns into files and directories on HDFS. This mapping ...
Posted on Sun, 10 May 2026 17:23:35 +0000 by adnan1983
Implementing Custom InputFormat in Hadoop MapReduce
Experimental Principle
1. InputFormat Concept
The InputFormat class in Hadoop defines how input files are split and read. It provides the following functionality:
Selects files or objects to process as input
Defines InputSplits that partition files into tasks
Provides a factory method for RecordReader to read files
Hadoop includes several bui ...
Posted on Sat, 09 May 2026 20:06:23 +0000 by pdmiller