Redshift, created by AWS, is an ideal database for storing large volumes of data. It was developed using Postgres itself (one of the best known general purpose databases), but it has a columnar architecture that offers incredible processing speed.
In this article, we'll show you how to register a Redshift database as a destination on Kondado's platform.
3) Fill in your database information as shown below:
Name: This is the internal description of your destination on the Kondado platform
Address: Your database server address (this is the public IP associated with your cluster and can be found on your cluster's AWS page under Properties > Network and security settings > Publicly accessible elastic IP address)
Port: Your database port (can be found on your cluster's AWS page under Properties > Database configurations > Port)
Database: the database name (can be found on your cluster's AWS page under Properties > Database configurations > Database name)
User: the username that Kondado will use to enter data into your database. This user must have DROP, INSERT, CREATE, ALTER, SELECT, and DELETE permissions (can be found on your cluster's AWS page under Properties > Database configurations > Admin user name)
Password: the user's password
Schema: inform a schema or leave the default “public” [1]
Click save and your new destination will be created!
[1] Kondado will try to create the schema with the value informed in the “schema” parameter and if this is not possible (for example, due to lack of permission), the public schema will be used. Even if the schema already exists, Kondado must have permission to create schemas (“GRANT CREATE ON DATABASE db TO user”) if you do not want to use the public schema. For existing schemas, it is also important that the user registered at Kondado has permission to use the schema (“GRANT USAGE ON SCHEMA schema_name TO user;”)
Add Redshift as a Data Destination on Kondado
Register your AWS Redshift cluster as a destination on Kondado to store and manage large volumes of data for your pipelines.
Configure cluster access and whitelist Kondado IPs
Before adding Redshift, ensure your cluster allows external access and that Kondado's IP addresses are whitelisted in your AWS security settings.
Navigate to destinations and select Redshift
On the Kondado platform, go to the add new destinations page and select Redshift from the available data destinations.
Enter your cluster connection details
Fill in the Name, Address (public elastic IP), Port, Database name, User, and Password. Find these values on your cluster's AWS page under Properties > Database configurations.
Set user permissions and schema
Ensure your database user has DROP, INSERT, CREATE, ALTER, SELECT, and DELETE permissions. Specify a schema or leave the default 'public'—Kondado will attempt to create it if needed.
Save and verify your destination
Click save to create your destination. Kondado will connect to your Redshift cluster and make it available for your data integration pipelines.