Notes:
The current platform's custom asset management module only supports Instant Avatar and Voice Clone Ultra Edition.
Other custom assets cannot be viewed on the platform until customization is completed and they are pushed for rack installation to your account.
I. Adding a Custom Task
The customers who have purchased avatar customization and voice clone quotas can submit materials for customization through the TCADH platform. Access path: Homepage > Image Settings > Customized Asset Management.
1.1. Quota Balance Check
Ensure that you have purchased the avatar customization services. If not, go to the Product Purchase Page to purchase the avatar customization production service. If a prompt indicating no available quota appears at the top of the page, contact your account manager to confirm the activation status of your custom avatar and voice quotas.
If a prompt indicating sufficient quota balance appears at the top of the page, you may proceed to entering the custom content.
1.2. Information Entry and Upload Guide
Follow the prompts to fill in and upload the required information for custom avatars and voices.
The materials required for upload vary based on the customization content. The primary information to fill in and upload includes:
1) Basic Information
Digital human name: The name entered on the page will be used directly to name the custom avatar and voice.
Avatar gender: This required field will determine the category of the voice after rack installation.
Customization type: This required field allows multiple options. Choosing options like Customized Image and VRS will display the respective upload forms for avatar and voice materials.
Remarks: Used to help distinguish between custom tickets for future reference.
2) Authorization Information
You need to download and sign the Image Authorization Letter on the right side of the page. The file should be in PDF format and less than 10 MB.
3) Avatar Materials
Video Background: Required.
Background Removal Required: (Remove the shooting background - green screen/white screen video, with support for background replacement.)
No Background Removal Required: (Keep the original shooting background without replacement. Choose this option for videos with a non-green screen and non-white background.)
Training Materials: See Avatar Recording Guide to ensure you fully understand the must-knows and FAQs for customization. To ensure sufficient lip movement training materials, see the broadcast reference script on the right side of the page for recording guidance.
Each material is trained individually, and each digital human name will be defined based on the entered digital human name combined with the uploaded file name, such as Tom_White Shirt or Tom_Blue Suit. Name each file precisely according to clothing features to ensure clear differentiation.
Supports uploading 1 to 9 video materials; however, the actual number of uploads allowed depends on the current account's customization balance and cannot exceed the available quota.
4) Voice Materials
Training Materials
A single zip package is used to customize one timbre.
5) Demo Script
Demo Driving Methods:
Text Driven: Generates a text-driven demo video based on the text you input and the selected timbre.
Default timbre: A standard public timbre will be selected by default for video synthesis;
Specified timbre: Allows customers to specify a timbre and speech rate for video synthesis;
Text-Driven content: You can modify the text content as needed.
Voice Driven: Generates a voice-driven demo video based on the audio you upload.
Quick Voice Cloning
Attempts to extract and quickly clone the voice from the video, additionally generating a text-driven demo;
Since the audio quality in the video cannot be guaranteed, quick voice cloning may occasionally fail;
If the voice clone fails, the system will attempt to use the audio from the video directly to generate a voice-driven demo.
This demo will not affect the normal synthesis of other demos.
1.3. Material Submission
Once submission is confirmed, your custom quota will be deducted, and the delivery team will proceed with the customization.
II. Viewing and Managing Customization Progress
After submitting materials for training, go to the Custom Asset Management page to view the submission and review progress. Access path: Home > Image Setting > Custom Asset Management.
You can view your submitted custom task list categorized by asset type. Detailed operation guides for each type of asset customization are as follows:
2.1. Instant Avatar
1) Customization Progress Overview
The customization of Instant Avatar primarily includes the following stages. Some stages, such as material submission, authorization review, and effect confirmation, may require your participation, while the remaining stages are automated and need no operation from you. You can quickly filter specific custom tasks with Customization Progress or Digital Human Name.
You can use the progress bar to check the current status of the custom task.
Notes:
Compared to Studio Avatar, Instant Avatar is more time-sensitive in customization. Therefore, we will only conduct an identity authorization review for the model and will not review the dimensions, visuals, lighting, or actions of your avatar materials. Ensure the quality of these materials independently.
2) Material Submission Stage
If the material submission fails, hover over the red dot with your mouse pointer to view the reason for the failure. Then, click Resubmit to go to the material upload page.
If you submitted multiple materials in batch for avatar customization and only some of them fail, clicking Resubmit will only require you to re-submit the failed materials.
3) Authorization Review Stage
If a message indicating Audit not passed appears, hover over the red dot with your mouse pointer to view the reason for disapproval, then click Resubmit to upload the revised material.
The authorization review is typically completed within three business days and the results will be automatically sent to you once finished. No follow-up is necessary.
4) Effect Confirmation Stage
Click Confirm to go to the Image Customization Effect Confirmation page and view the custom demo results.
If you are satisfied with the results, click Acknowledge Training Effect to trigger the automatic rack installation process. Within a few minutes, the avatar will appear in your avatar assets for further use.
If you are unsatisfied with the customization results, click Disapprove Effects, Return Quota, and Abandon Customization to terminate the customization process. The corresponding custom quota for this task will automatically be refunded to your account.
Notes:
The Instant Avatar model is not an exclusive training model; therefore, without altering the avatar training materials, it is not possible to achieve better training results by resubmitting for retraining.
The custom engine for Instant Avatar will automatically match your video materials with general lip movement data. Therefore, the generated digital human may have pronunciation differences in lip movement habits and appearance compared to the model. If you wish to achieve a lip movement more consistent with that of the model, select Studio Avatar.
2.2. Photo Avatar
1) Customization Progress Overview
The customization of Photo Avatar primarily includes material submission, review, and intelligent training stages, all of which are automated processes.
You can use the progress bar to check the current status of the custom task.
2) Material Submission Failure
In this stage, failure may occur if the material format does not meet the requirements. Hover over the red dot with your mouse pointer to view the reason for the failure. Then, click Resubmit to go to the material upload page.
3) Authorization Review Stage
In this stage, failure may occur if the material contains sensitive information or if the face is not detected. Hover over the red dot with your mouse pointer to view the reason for disapproval. Then, click Resubmit to upload the revised material.
4) Intelligent Training Completion
After training is complete, the Photo Avatar will automatically be delivered to your avatar assets for further use.
Note: Photo Avatars are designed for low-cost and quick turnaround. Typically, they are ready for use within 10 minutes after material submission.
After the intelligent image training is completed, the assets will be automatically issued to the participants' accounts. Quotas will not be returned.
2.3. Avatar Voice Clone - Ultra Edition
1) Customization Progress Overview
The customization of Voice Clone primarily includes the following stages, all of which are automated and require no operation from you. You can quickly filter specific custom tasks by Customization Progress or Digital Human Name.
You can use the progress bar to check the current status of the custom task. Once materials are submitted, customization is typically completed within 10 minutes.
2) Once customization is complete, you can use your synthesized audio or create digital human broadcasting videos in the Digital Human Platform > Scenario Application > Audio and Video Broadcasting module.
2.4. Detailed Explanation for Demo Confirmation
For Instant Avatar, we provide the following demo options during the effect confirmation stage for customers to review, including:
1. Text-driven demo: A text-driven video generated using the specified script content and the specified timbre;
2. Voice-driven demo: A voice-driven video generated using the specified audio;
3. Quick voice clone demo: A text-driven video generated by extracting and quickly cloning the voice from the video;
4. Silent preview video: This video consists of all selected video segments for the avatar. You can also retrieve it via the ReferenceVideoSegmentUrl in the Personal Asset Management API > Sample Persona List Interface. Once the automatic rack installation process is complete, the avatar or voice will appear in your personal assets. Tencent Cloud will send a notification via the message center, email, or SMS. For example, take 2D Avatar as an example.
1) Message Center Notification:
Was this page helpful?