MySQL SSH (data source)

MySQL is an open-source relational database that powers many applications and is one of the most popular databases in the world. The MySQL data integration for the Data Warehouse created by Kondado allows you to replicate your tables and views to your analytical cloud, integrally or incrementally (capturing only new and updated data).

The SSH data source differs from the traditional MySQL data source in that it connects to the database through an intermediate server, also called a tunnel or bastion.

Adding the data source

To automate MySQL ETL via SSH with Kondado for your database, follow the steps below:

1) Add the Kondado IPs n the intermediary server (and in your VPC) for the port that will be used for the connection (usually 22)

2) On the database server, release the connection to the intermediary server on the port that will be used (usually 3306).

3) On the Kondado platform, go to add data sources page and select the My SQL data source

4) Give your data source a name and fill in the information for your intermediate server and then your database. In “Server PEM key” just copy the text of the file with the PEM key.

Now just save the data source and start integrating MySQL data into the Data Lake or Data Warehouse via SSH.

Pipelines

Relationship Chart

Tables and Views

With our pipeline, you will be able to integrate tables as well as views

If your table has a datetime/timestamp type column that marks when a record was changed/inserted, your pipeline can be incremental

It will be necessary to define the primary key, which can be defined by several columns and refers to the column (or set of columns) that define a record as being unique

The created table will have a format similar to the one below:

Field Type

col_x

text

col_y

text

col_z

text