tencent cloud

$0 14-Day TrialExperience EdgeOne for acceleration and security protection!

Feedback

Tencent Effect SDK

Gesture Detection

Last updated: 2023-08-03 14:27:27

Overview

Input the camera's OpenGL texture and output real-time gesture detection data. You can use this data for further development.

Android Interface Description

Android Integration Guide

Integrate Tencent Effect SDK on Android, for details please refer to: Integrate Tencent Effect SDK Independently.

Android Interface Invocation

1.Turn on the gesture detection feature switch (in XmagicApi.java)
public void setFeatureEnableDisable(String featureName, boolean enable);
Fill in featureName with XmagicConstant.FeatureName.HAND_DETECT, and set enable to true.
2.Set data callback (in XmagicApi.java)
void setAIDataListener(XmagicApi.OnAIDataListener aiDataListener)

public interface OnAIDataListener {
void onFaceDataUpdated(List<TEFaceData> faceDataList);
void onHandDataUpdated(List<TEHandData> handDataList);
void onBodyDataUpdated(List<TEBodyData> bodyDataList);
void onAIDataUpdated(String data);
}
onAIDataUpdated returns a JSON structured string data.

iOS Interface Description

iOS Integration Guide

Integrate Tencent Effect SDK on iOS, for details please refer to: Integrate Tencent Effect SDK Independently.

iOS Interface Invocation

1.Turn on the gesture detection feature switch (in Xmagic.h)
- (void)setFeatureEnableDisable:(NSString *_Nonnull)featureName enable:(BOOL)enable;
Fill in featureName with HAND_DETECT (can be imported from TEDefine.h), and set enable to true.
2.Set data callback (in Xmagic.h)
- (void)registerSDKEventListener:(id<YTSDKEventListener> _Nullable)listener;

- (void)onAIEvent:(id)event
{
NSDictionary *eventDict = (NSDictionary *)event;
if (eventDict[@"ai_info"] != nil) {
NSLog(@"ai_info %@",eventDict[@"ai_info"]);
}
}
eventDict[@"ai_info"] is the returned JSON structured string data.


Callback JSON Data Description

In the callback JSON data, the gesture-related data is in "hand_info", and the format is as follows:
"hand_info": {
"gesture": "PAPER",
"hand_point_2d": [180.71888732910156, 569.2958984375, ... , 353.8714294433594, 836.246826171875]
}
The explanations of each field in hand_info are as follows:
Field
Explanation
gesture
Gesture Type Name
hand_point_2d
Captured gesture data information
The following gestures are currently supported:
Order
Gesture
Type Name
Example Image
1
Heart
HEART

img
加载中


2
Gestrue with number 5(open)
PAPER

img
加载中


3
Gesture with number 2
SCISSOR

img
加载中


4
Fist
FIST

img
加载中


5
Gesture with number 1
ONE

img
加载中


6
I love you
LOVE

img
加载中


7
Thumb up
LIKE

img
加载中


8
OK
OK

img
加载中


9
Rock
ROCK

img
加载中


10
Gesture with number 6
SIX

img
加载中


11
Gesture with number 8
EIGHT

img
加载中


12
Lift
LIFT

img
加载中


13
Gesture with number 3
THREE

img
加载中


14
Gesture with number 4
FOUR

img
加载中


If it is an undetected gesture, the gesture type name is OTHER.
Contact Us

Contact our sales team or business advisors to help your business.

Technical Support

Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

7x24 Phone Support
Hong Kong, China
+852 800 906 020 (Toll Free)
United States
+1 844 606 0804 (Toll Free)
United Kingdom
+44 808 196 4551 (Toll Free)
Canada
+1 888 605 7930 (Toll Free)
Australia
+61 1300 986 386 (Toll Free)
EdgeOne hotline
+852 300 80699
More local hotlines coming soon