Elastic MapReduce
- Release Notes and Announcements
- Announcements
- Security Announcements
- Product Introduction
- Product release
- Purchase Guide
- EMR on CVM Billing Instructions
- EMR on TKE Billing Instructions
- EMR Serverless HBase Billing Instructions
- Getting Started
- EMR on CVM Operation Guide
- Planning Cluster
- Cross-AZ Cluster
- Configuring Cluster
- Administrative rights
- Managing Cluster
- Auto Scaling
- Disk Management
- Managing Service
- Configuration Management
- YARN Resource Scheduling
- Monitoring and Alarms
- Application Analysis
- Monitoring Metrics
- EMR on TKE Operation Guide
- Configuring Cluster
- Permission Management
- Cluster Management
- Service Management
- Configuration Management
- Monitoring and Ops
- Application Analysis
- EMR Serverless HBase Operation Guide
- Planning an Instance
- Managing an Instance
- Monitoring and Alarms
- Development Guide
- EMR Development Guide
- Hadoop Development Guide
- Spark Development Guide
- Hbase Development Guide
- Phoenix on Hbase Development Guide
- Hive Development Guide
- Basic Hive Operations
- Advanced Usage
- Presto Development Guide
- Sqoop Development Guide
- Hue Development Guide
- Flume Development Guide
- Kerberos Development Guide
- Knox Development Guide
- Alluxio Development Guide
- Kylin Development Guide
- Livy Development Guide
- Kyuubi Development Guide
- Zeppelin Development Guide
- Hudi Development Guide
- Superset Development Guide
- Impala Development Guide
- Druid Development Guide
- TensorFlow Development Guide
- Kudu Development Guide
- Ranger Development Guide
- Ranger User Guide
- Kafka Development Guide
- StarRocks Development Guide
- Flink Development Guide
- Practical Tutorial
- Practice of EMR on CVM Ops
- Data Migration
- Practical Tutorial on Custom Scaling
- Practical Tutorial on Setting Scaling Rules
- API Documentation
- Making API Requests
- Cluster Resource Management APIs
- Cluster Services APIs
- FAQs
- EMR on CVM
DocumentationElastic MapReduceEMR Development GuideHive Development GuidePractical TutorialPractices on Loading JSON Data to Hive
Practices on Loading JSON Data to Hive
Last updated: 2025-02-12 16:16:58
1. Connect to Hive
Log in to a master node of the EMR cluster, switch to the "hadoop" user, go to the Hive directory, and connect to Hive by running the following command:
[root@10 ~]# su hadoop[hadoop@10 root]$ cd /usr/local/service/hive
2. Prepare data
Create a data file in JSON format. Compile the following code and save:
vim test.data{"name":"Mary","age":12,"course":[{"name":"math","location":"b208"},{"name":"english","location":"b702"}],"grade":[99,98,95]}{"name":"Bob","age":20,"course":[{"name":"music","location":"b108"},{"name":"history","location":"b711"}],"grade":[91,92,93]}
Store the data file in HDFS:
hadoop fs -put ./test.data /
3. Create a table
Connect to Hive:
[hadoop@10 hive]$ hive
Create a table based on the mapping:
hive> CREATE TABLE test (name string, age int, course array<map<string,string>>, grade array<int>) ROW FORMAT SERDE 'org.apache.hive.hcatalog.data.JsonSerDe' STORED AS TEXTFILE;
4. Import data
hive>LOAD DATA INPATH '/test.data' into table test;
5. Check whether data import is successful
Query all data:
hive> select * from test;OKMary 12 [{"name":"math","location":"b208"},{"name":"english","location":"b702"}] [99,98,95]Bob 20 [{"name":"music","location":"b108"},{"name":"history","location":"b711"}] [91,92,93]Time taken: 0.153 seconds, Fetched: 2 row(s)
Query the first score of each record:
hive> select grade[0] from test;OK9991Time taken: 0.374 seconds, Fetched: 2 row(s)
Query the name and location of the first course of each record:
hive> select course[0]['name'], course[0]['location'] from test;OKmath b208music b108Time taken: 0.162 seconds, Fetched: 2 row(s)
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No