Tencent Cloud

HBase Data Source

Last updated: 2024-11-01 17:50:37

Supported Editions
Supports HBase 2.2.x, 2.3.x versions.
Use Limits
1. HBase Reader does not support reading data written by Phoenix, as Phoenix has special handling.
2. HBase Writer supports concatenating multiple source fields as the rowkey in the HBase table.
3. The timestamp (version) to write to HBase supports:
Using the current time as the version;
Specifying a source column as the version;
Specifying a time as the version.
HBase Offline Single Table Read Node Configuration
﻿
﻿
﻿
Parameters
Description
Data Source
Available HBase Data Source
Namespace
Select the available space under this data source
Table
Supports selecting or manually entering the table name to be read
Read Mode
Supports horizontal table reading mode, treating HBase tables as ordinary 2D tables (horizontal tables) and reading the latest version data
Supports vertical table reading mode, treating HBase tables as vertical tables
maxVersion
Specify the number of versions to read. The value can only be -1 or a number greater than 1. -1 means read all versions. The default is -1 if not specified
Note:
When the reading mode is Vertical Table, it is necessary to configure maxVersion.
Encoding
Configuration for reading file encoding. Supports UTF-8 and GBK encoding.
Start RowKey
Specify the start RowKey.
Stop RowKey
Specify the end RowKey.
Scan Cache Size
Supports input of the number of rows to read from HBase each time. The default is 256 if not specified.
Scan Batch Size
Supports input of the number of columns to read from HBase each time. The default is 100 if not specified.
HBase Offline Single Table Write Node Configuration
﻿
﻿
﻿
Parameters
Description
Data Destination
Specify the HBase data source to write to.
Namespace
Supports selecting or manually entering the space to write to.
Table
Supports selecting or manually entering the table name to write to:
If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Write Column
HBase supports two methods for writing columns:
Fixed columns (specify column family and column name).
Dynamic columns (column family and column name vary with the source field value); you need to manually configure the column contents, column family connector, column name connector, and value connector (options: '\\u001', '|', ':', ',').
rowKey Rule
Configure the HBase table RowKey generation rules
Write Column Contents
When selecting dynamic columns (column family and column name vary with the source field value), you need to manually configure the column contents, column family connector, column name connector, and value connector (options: '\\u001', '|', ':', ',').
Value Version No.
Specify the timestamp to write to HBase. Supports the Write Time, Specified Time , or Specified Time Column (choose one). If not configured, the current time is used:
index: Specify the index of the corresponding Reader endpoint column, starting from 0. Ensure it can be converted to LONG.
type: If it is of type Date, it will attempt to parse with 'yyyy-MM-dd HH:mm:ss' and 'yyyy-MM-dd HH:mm:ssSss'. If a specific time is specified, the index is -1.
value: The value of the specified time, of type LONG.
Data type conversion support
Read  
The data types and conversion relationships supported for HBase reading are as follows (when processing HBase, the data type of the HBase data source and the data type of the data processing engine are mapped):
HBase Data Types
Internal Types
int, short ,long
Long
float, double
Double
string,binary string
String
date
Date
boolean
Boolean
Write
The data types and conversion relationships supported for HBase reading are as follows:
Internal Types
HBase Data Types
Long
int, short ,long
Double
float, double
String
string,binary string
Date
date
Boolean
boolean

tencent cloud

Recent Pages

HBase Data Source

Supported Editions

Use Limits

HBase Offline Single Table Read Node Configuration

HBase Offline Single Table Write Node Configuration

Data type conversion support

Read

Write

Was this page helpful?

Was this page helpful?

Parameters	Description
Data Source	Available HBase Data Source
Namespace	Select the available space under this data source
Table	Supports selecting or manually entering the table name to be read
Read Mode	Supports horizontal table reading mode, treating HBase tables as ordinary 2D tables (horizontal tables) and reading the latest version data Supports vertical table reading mode, treating HBase tables as vertical tables
maxVersion	Specify the number of versions to read. The value can only be -1 or a number greater than 1. -1 means read all versions. The default is -1 if not specified Note: When the reading mode is Vertical Table, it is necessary to configure maxVersion.
Encoding	Configuration for reading file encoding. Supports UTF-8 and GBK encoding.
Start RowKey	Specify the start RowKey.
Stop RowKey	Specify the end RowKey.
Scan Cache Size	Supports input of the number of rows to read from HBase each time. The default is 256 if not specified.
Scan Batch Size	Supports input of the number of columns to read from HBase each time. The default is 100 if not specified.

Parameters	Description
Data Destination	Specify the HBase data source to write to.
Namespace	Supports selecting or manually entering the space to write to.
Table	Supports selecting or manually entering the table name to write to: If the data source network is not connected and the table information cannot be fetched directly, you can manually enter the table name. Data synchronization can still be performed when the Data Integration network is connected.
Write Column	HBase supports two methods for writing columns: Fixed columns (specify column family and column name). Dynamic columns (column family and column name vary with the source field value); you need to manually configure the column contents, column family connector, column name connector, and value connector (options: '\\u001', '\|', ':', ',').
rowKey Rule	Configure the HBase table RowKey generation rules
Write Column Contents	When selecting dynamic columns (column family and column name vary with the source field value), you need to manually configure the column contents, column family connector, column name connector, and value connector (options: '\\u001', '\|', ':', ',').
Value Version No.	Specify the timestamp to write to HBase. Supports the Write Time, Specified Time , or Specified Time Column (choose one). If not configured, the current time is used: index: Specify the index of the corresponding Reader endpoint column, starting from 0. Ensure it can be converted to LONG. type: If it is of type Date, it will attempt to parse with 'yyyy-MM-dd HH:mm:ss' and 'yyyy-MM-dd HH:mm:ssSss'. If a specific time is specified, the index is -1. value: The value of the specified time, of type LONG.

HBase Data Types	Internal Types
int, short ,long	Long
float, double	Double
string,binary string	String
date	Date
boolean	Boolean

tencent cloud

Sign Up

Log in

Recent Pages

HBase Data Source

Supported Editions

Use Limits

HBase Offline Single Table Read Node Configuration

HBase Offline Single Table Write Node Configuration

Data type conversion support

Read

Write

Was this page helpful?

Was this page helpful?