Extracting Keys from JSON Data in Hive

Process Overview

To extract keys from JSON data in Hive, follow these steps:

Step Action
1 Create a Hive table
2 Load JSON data into the table
3 Extract keys from the JSON

Step 1: Create a Hive Table

Define a table to store JSON strings. Use the following SQL command:

CREATE TABLE IF NOT EXISTS json_data_table (
    json_content STRING
);

Step 2: Load JSON Data into the Table

Import JSON data from a file into the table. Execute this SQL statement:

LOAD DATA LOCAL INPATH '/path/to/your/json/file.json' INTO TABLE json_data_table;

Step 3: Extract Keys from JSON

Retrieve specific keys from the JSON strings using the get_json_object function. For example, to extract a key named user_id:

SELECT get_json_object(json_content, '$.user_id') AS user_id
FROM json_data_table;

This query returns the value associated with the user_id key for each row in the table.

Example Workflow

To illustrate the process, consider a JSON file with data like {"user_id": 123, "name": "John"}. After loading it into the table, running the extraction query will output 123 for the user_id key.

Additional Notes

  • Ensure the JSON data is propelry formatted to avoid errors during extraction.
  • Use paths like $.key in get_json_object to navigate nested JSON structures.
  • This method works for both simple and complex JSON objects in Hive.

Tags: Hive JSON Data Extraction sql Big Data

Posted on Thu, 23 Jul 2026 16:21:48 +0000 by wildcolour