AWS RDS Migration

adrianlp05

At our company we are trying to migrate data from an old Local SQL Server database to a RDS MySql database using SSIS. The original database is roughly 4GB in size and we are required to do the migration without taking down the production servers. The dev team reports that the migration runs fine with data being transferred, but after several hours (roughly 8 hours, but it's not exact. Sometimes it's less sometimes it's more) the connection abruptly closes. We have tried everything we can possibly think of on our side but we don't know what else could be going wrong. Based on their tests and ours, we think it could be the instance is closing the connection after being open for too long. Does anyone know what could be causing this?.

We need another alternative tool to make the migration and the target databases remains fully operational during the process?

way0utwest

What you should do is transfer in stages. Move a set of data from local SQL Server to RDS MySQL to a staging table, then immediately move it to production. Use some date/time markers in the staging tables to track what's moved, then don't try to move it again. Build in restart logic in SSIS to only transfer things that haven't been transferred. That might be better than trying to devise a perfect solution.

If you are using SSIS, the target is always there, you're just moving data. If this has worked before, is it one transaction? Or do you end up with some data in the MySQL db?

adrianlp05

Thanks for your reply. Now I'm planning to use for this migration the AWS DMS / SCT. What do you think about it?

adrianlp05

Now I want to connect my local sql database as source in SCT to convert it to MySQL. Can I connect local databases as source in AWS SCT?

RichardL

Hi @adrianlp05

Thanks for your post.
Currently we do not have tools that convert Microsoft SQL Server to MySQL.

ManC

Hi, reading DMS whitepapers it says need non third party log backups to work, we have a redgate tool backup in place on the planned source instance , so we will need to stop redgate logbackups and set native logbackups ?

way0utwest

There is a tool with SQL Backup to convert your .sqb files to .bak or .trn files. https://documentation.red-gate.com/sbu9/tools-and-utilities/sql-backup-file-converter