tencent cloud

All product documents
Tencent Cloud WeData
DocumentationTencent Cloud WeDataOperation GuideData IntegrationReal-time Synchronization Task Configuration and Operation and MaintenanceData Sources Supported by Real-time SynchronizationData Source ListHDFS Data Source
HDFS Data Source
Download PDF
Last updated: 2024-11-01 17:00:28
HDFS Data Source
Last updated: 2024-11-01 17:00:28
Download PDF

HDFS Single Table Write Node Configuration

1. On the Data Integration page, in the left sidebar, click Real-time Sync.
2. At the top of the Real-time Sync page, select Single Table Sync to create a new one (you can choose between form and canvas modes) and enter the configuration page.
3. Click the left write, click and select HDFS node and configure node information.



4. You can refer to the table below to configure parameter information.
Parameters
Description
Data Destination
Select available HDFS data sources in the current project.
File Path
Path information of the file system. The path supports using '*' as a wildcard. After specifying the wildcard, multiple file information will be traversed.
File Type
HDFS supports four file types: txt, orc, parquet, csv.
txt: represents TextFile file format.
orc: represents ORCFile file format.
parquet: represents standard Parquet file format.
csv: represents standard HDFS file format (logical two-dimensional table).
Advanced Settings
You can configure parameters according to business needs.
5. Preview Data Fields and map them with Read Node Configuration Fields, click Save.

HDFS Log Collection Write Node Configuration

Parameters
Description
Data Destination
Select available HDFS data sources in the current project.
File Path
Path information of the file system. The path supports using '*' as a wildcard. After specifying the wildcard, multiple file information will be traversed.
File Type
HDFS supports four file types: txt, orc, parquet, csv.
Advanced Settings (optional)
You can configure parameters according to business needs.

Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback

Contact Us

Contact our sales team or business advisors to help your business.

Contact Us
Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

Submit a Ticket
7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon