TiDB, an open source cloud-native distributed database, made its data migration platform (DM) available as open source today.
Data Migration (DM) by TiDB is an integrated data synchronization task management platform that provides support for full data migration as well as the incremental data migration from MySQL/MariaDB into TiDB. It helps reduce the operations cost and also make the troubleshooting process easy.
The Data Migration tool by TiDB comes with three major components, namely, DM-master, DM-worker, and dmctl.
DM Master handles and schedules the operation of all the data synchronization related tasks. It stores the topology information of the DM cluster and keeps a track on the running state of DM worker processes and data synchronization tasks.
DM-worker, on the other hand, handles the execution of only specific data synchronization tasks. It manages the storage of configuration information of the data synchronization subtasks and also monitors their running state.
The third component in DM tool, called, dmctl is a command line tool that helps control the DM cluster. It creates/updates/drops data synchronization tasks. So, it checks the running state of these tasks, handles any errors that occur during these tasks, and also verifies their configuration correctness.
DM is licensed under the Apache License, Version 2.0, allowing users to freely use, and modify the platform. This will also allow users to contribute new features or track any bug fixes to make the platform better for everyone.
For more information, check out the official DM tool documentation.