tencent cloud

All product documents
Elastic MapReduce
Mounting CHDFS Instance
Last updated: 2023-12-27 10:02:48
Mounting CHDFS Instance
Last updated: 2023-12-27 10:02:48

Overview

CHDFS is a high-performance distributed file system with standard HDFS access protocols and hierarchical namespaces. EMR supports read/write of data in CHDFS. This document describes how to mount a CHDFS instance to an EMR cluster.

Directions

Scenario 1. Mounting a CHDFS instance to a new cluster

Note:
New cluster: This refers to clusters created on or after December 31, 2019. For new clusters, the default CHDFS mounting address of EMR is /data/emr/hdfs/tmp/chdfs.
An EMR cluster is automatically adaptive to CHDFS. Create a CHDFS instance and set permissions reasonably to interconnect the CHDFS instance and EMR cluster. The configuration steps are as follows:
1. Create a CHDFS instance in the same region as the EMR cluster as instructed in Creating CHDFS Instance.
2. Create a permission group as needed as instructed in Creating Permission Group.
3. Create permission rules as needed as instructed in Creating Permission Rule.
4. Create a mount point on the same network as the EMR cluster as instructed in Creating Mount Point.
5. Check the connectivity between the CHDFS instance and the EMR cluster. Use the hadoop fs command line tool to run the hadoop fs –ls ofs://${mountpoint}/ command. Here, mountpoint is the mounting address. If the file list is output properly, the CHDFS has been successfully mounted.

Scenario 2. Mounting a CHDFS instance to a legacy cluster

Note:
Legacy cluster: This refers to clusters created before December 31, 2019.
For more information on how to mount a CHDFS instance to a legacy EMR cluster, see Mounting CHDFS Instance.
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 available.

7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon