Elastic MapReduce
- Release Notes and Announcements
- Announcements
- Security Announcements
- Product Introduction
- Product release
- Purchase Guide
- EMR on CVM Billing Instructions
- EMR on TKE Billing Instructions
- EMR Serverless HBase Billing Instructions
- Getting Started
- EMR on CVM Operation Guide
- Planning Cluster
- Cross-AZ Cluster
- Configuring Cluster
- Administrative rights
- Managing Cluster
- Auto Scaling
- Disk Management
- Managing Service
- Configuration Management
- YARN Resource Scheduling
- Monitoring and Alarms
- Application Analysis
- Monitoring Metrics
- EMR on TKE Operation Guide
- Configuring Cluster
- Permission Management
- Cluster Management
- Service Management
- Configuration Management
- Monitoring and Ops
- Application Analysis
- EMR Serverless HBase Operation Guide
- Planning an Instance
- Managing an Instance
- Monitoring and Alarms
- Development Guide
- EMR Development Guide
- Hadoop Development Guide
- Spark Development Guide
- Hbase Development Guide
- Phoenix on Hbase Development Guide
- Hive Development Guide
- Basic Hive Operations
- Advanced Usage
- Presto Development Guide
- Sqoop Development Guide
- Hue Development Guide
- Flume Development Guide
- Kerberos Development Guide
- Knox Development Guide
- Alluxio Development Guide
- Kylin Development Guide
- Livy Development Guide
- Kyuubi Development Guide
- Zeppelin Development Guide
- Hudi Development Guide
- Superset Development Guide
- Impala Development Guide
- Druid Development Guide
- TensorFlow Development Guide
- Kudu Development Guide
- Ranger Development Guide
- Ranger User Guide
- Kafka Development Guide
- StarRocks Development Guide
- Flink Development Guide
- Practical Tutorial
- Practice of EMR on CVM Ops
- Data Migration
- Practical Tutorial on Custom Scaling
- Practical Tutorial on Setting Scaling Rules
- API Documentation
- Making API Requests
- Cluster Resource Management APIs
- Cluster Services APIs
- FAQs
- EMR on CVM
HDFS Common Operations
Last updated: 2020-12-21 17:21:45
Tencent Cloud Elastic MapReduce (EMR) Hadoop service has integrated COS. If you enable COS when purchasing an EMR cluster, you can manipulate the data stored in COS using common Hadoop commands as shown below:
#cat datahadoop fs -cat /usr/hive/warehouse/hivewithhdfs.db/record/data.txt#Modify the directory or file permissionhadoop fs -chmod -R 777 /usr#Change the file or directory ownerhadoop fs -chown -R root:root /usr#Create a folderhadoop fs -mkdir <paths>#Send a local file to HDFShadoop fs -put <localsrc> ... <dst>#Copy a local file to HDFShadoop fs -copyFromLocal <localsrc> URI#View the storage usage of a file or directoryhadoop fs -du URI [URI …]#Delete a filehadoop fs -rm URI [URI …]#Set the number of copies of a directory or filehadoop fs–setrep [-R] [-w] REP PATH [PATH …]#Check for bad blocks of a cluster filehadoop fsck <path> [-move | -delete | -openforwrite] [-files [-blocks [-locations | -racks]]]
For more HDFS commands, see the community documentation. If your cluster is a high-availability cluster (dual-namenode), you can see which namenode is active by running following commands:
#nn1 is the ID of the namenode; usually nn1 and nn2.hdfs haadmin -getServiceState nn1#View the current cluster reporthdfs dfsadmin -report#namenode exits safe modehdfs dfsadmin -safemode leave
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No