MariaDB
Overview
This page contains the setup guide and reference information for the MariaDB source connector. We utilise the official CData Python (opens in a new tab) connector to ingest your data.
Features
Feature | Supported | Notes |
---|---|---|
Full Refresh Sync | Yes | |
Incremental Sync | Yes |
Getting started
Requirements and prerequisites
- Create a dedicated read-only user
- Whitelist Y42's production IP addresses.
Setup guide
Step 1: (Optional) Create a dedicated read-only user
This stage is optional but strongly suggested to allow better permission management and auditing.
- To create a dedicated database user, execute the following commands on your database:
_10CREATE USER 'y42'@'%' IDENTIFIED BY 'your_password_here';
- The appropriate permissions vary between the
STANDARD
andCDC
replication methods. For theSTANDARD
replication method, only theSELECT
permission is needed._10GRANT SELECT ON <database name>.* TO 'y42'@'%';
Step 2: Set up the MariaDB source
- Create a new source, select CData - MariaDB from the Source type dropdown and enter a name for it.
- On the source setup page, create a new MariaDB secret, enter a unique name for it.
- For the Host, Port, and DB Name, enter the hostname, port number, and name for your MariaDB database.
- For User and Password, enter the username and password you created in Step 1.
- (Optional) If you want to connect via SSH tunnel, select "SSH Tunnel Method": SSH Key Authentication or Password Authentication.
Step 3: (Optional) Connect via SSH tunnel
In case of an SSH connection, select "SSH Tunnel Method" other than "No Tunnel" and configure SSH tunneling:
- For SSH Tunnel Jump Server Host, enter the hostname or IP address for the intermediate (bastion) server that Y42 will connect to.
- For SSH Connection Port, enter the port on the bastion server. The default port for SSH connections is 22.
- For SSH Login Username, enter the username to use when connecting to the bastion server. Note: This is the operating system username and not the MariaDB username.
- For authentication:
- If you selected SSH Key Authentication, set the SSH Private Key to the private key that you are using to create the SSH connection.
To generate a private key for SSH Tunneling, execute the following command:
The command produces the private key in PEM format and the public key remains in the standard format used by the_10ssh-keygen -t rsa -m PEM -f myuser_rsa
authorized_keys
file on your bastion server. Add the public key to your bastion host to the user you want to use for data sync. The private key is provided via copy-and-paste to the configuration screen. - If you selected Password Authentication, enter the password for the operating system user to connect to the bastion server. Note: This is the operating system password and not the MariaDB password.
- If you selected SSH Key Authentication, set the SSH Private Key to the private key that you are using to create the SSH connection.
To generate a private key for SSH Tunneling, execute the following command: