This article will guide you on how to migrate files from AWS S3 to VOD Professional Edition using the VOD migration tool.
Preparations
1. If you already have a Professional Edition application, refer to Quick Start to create a Professional Edition application. Directions
Step 1: Create an AWS IAM Account and Grant Permissions
Note:
The following content is for reference only. Specific operations are subject to the actual display and services provided by AWS S3.
1. Log in to the AWS Console, go to the Identity and Access Management (IAM) interface, click Users to enter the user management page.
2. After entering the user management page, click Create user.
3. Enter the user's name and click Next.
4. On the permissions settings page, click the Attach policies directly option, enter "S3" in the search bar, select the AmazonS3FullAccess permission from the search results, click Next and complete the user creation.
Step 2: Create an AWS IAM User Access Key
Notes:
The following content is for reference only. Specific operations are subject to the actual display and services provided by AWS S3.
1. After the AWS IAM user is created, click the username.
2. Select Security credentials > Access keys, then click Create access key.
3. Select Other, click Next to create. Be sure to save the Access key ID and Secret access key.
Step 3. Create a Migration Task
1. Log in to the VOD console, click Migration tool on the left sidebar to enter the migration task list, and click Create new task to set the migration parameters. 2. Set the migration task name. The task name length should be between 1 to 60 characters, and the allowed characters are Chinese, English, numbers(0-9), underscore(_), and hyphens (-).
3. Estimate the task size. Please accurately fill in the task size so that we can better prepare the necessary resources. This field is not mandatory.
4. Set the file source for the migration.
Service provider: The migration source service provider here should be AWS S3.
AccessKey and SecretKey: Enter the AccessKeyID and AccessKeySecret of the AWS IAM user account previously created for migration in the text box.
Migration bucket name: After entering the key, click the "Migration bucket name" dropdown on the right side of Refresh to get the source Cloud Object Storage bucket list. You can also choose to manually enter the source bucket name.
Header Migration Method: If the file in the source bucket has headers and tags set and they need to be retained after migration, please choose to retain or set the replacement rule.
Filename Filtering rules: Choose to migrate all the files of the specified bucket, or only migrate files with a specified prefix.
Time range: Enable time period to only migrate files that are added or changed within a specified time period.
Execution speed, Speed Limiting Method: All public cloud object storage services have speed limits. To ensure business stability, check with the source vendor and set the maximum available migration bandwidth in Mbps before migrating.
5. Select the target location to migrate to.
Service provider: Default is Tencent Cloud VOD - Professional Version.
Migrate target application: Select the target application you want to migrate to. If you have just created an application, you can click the refresh button on the right side of the application selection box to get the latest Professional Version application list.
Migrate target storage bucket: Select the specific bucket under the target application.
Save path: Specify the directory in the target bucket for migration.
Save to Root Directory: Save the files from the source bucket to the root directory of the target bucket following their original relative paths.
Save to the specified directory: Save the files from the source bucket to the specified directory while maintaining their original relative paths. For example, if the files in the source bucket are /testa.txt
and /dir/testb.txt
, and "migration" is entered in the text box, the paths of these files in the target bucket after migration will be: /migration/testa.txt
and /migration/dir/testb.txt
.
Files with the same name: Specify the handling method for files with the same name.
Note:
If you choose to overwrite the same name file, it will directly overwrite the file with the same name during migration.
If the same name file is selected to Skip, it will be judged based on the last modification time, LastModified, that is:
If the LastModified of the file in the source location is later than or equal to the LastModified of the file in the destination location, then overwrite.
If the LastModified of the file in the source address is earlier than the LastModified of the file in the destination address, then skip is executed.
Perform secondary migration if the object (file) content is changed during migration.
Step 4. Viewing the Migration Status and Progress
In the main interface of the File Migration Tool, you can view the status and progress of all file migration tasks:
For the "Task Completion" status, green indicates the task is completed with all files successfully migrated, while yellow indicates the migration task is completed but some files failed to migrate.
Clicking the "Retry Failed Tasks" link will retry the migration of the failed files within the task; files that have already been successfully migrated will not be retransmitted.
Clicking the "Export" link allows you to export a list of files that failed to migrate during the process.