The Via Kondado destination allows access via Link to data replicated and modeled by Kondado
Accessing your data
Copy-paste link
The connection to Via Kondado is made via API. You can easily obtain the API access link for any table, similar to the modal below. You can change the decimal separator between comma and dot, then click the copy icon to get the link
Copy-paste link for pipelines
To get all the links of your pipeline tables, simply access your pipeline and click the share icon
The link for each table will also be available by clicking DETAILS
Copy-paste link for models
Manually constructing the link
Our reading API must be accessed with a GET request to the host https://hub.kondado.io
and authenticated with the token
parameter (query string)
Access token
To get the access token for your destination, just access it, click the 3 horizontal bars, and then "View token"
This token allows access to your data. Keep it in a safe place
Reading data
To get the data from a table table_x
, just access the path data/table_x
.
If the decimal_sep
parameter is not provided, the decimal separator will be the dot; use decimal_sep=comma
to get your data separated by a comma, for example:
https://hub.kondado.io/data/table_x?token=your_token&decimal_sep=comma
Reading metadata
The /metadata
path returns metadata of your tables in JSON format
/metadata/show_tables
returns an ARRAY of JSONs with the list of tables in your destination in the key tbl_name/metadata/kdd_show_tables
returns an ARRAY of JSONs with the list of tables in your destination, including information on the location of each table within Kondado:tbl_name
provides the table nametbl_id
provides the table IDorigin_object_type
indicates the type of object the table references, where "pipeline" means pipeline and "kubo" means modelorigin_object_id
provides the ID of this objectorigin_object_sub_location
provides the location of the table within the object for pipelines that contain more than one table; it is empty if it is the main pipeline table or a table of a modelorigin_object_created_rev
is an internal code indicating the version of the object referencing the tablecreatedAt
is the table creation dateupdatedAt
is the last update date of the table
/metadata/kdd_show_table_sizes
returns an ARRAY of JSONs with the list of tables in your destination and information about the sizes of these tables:tbl_name
provides the table nametbl_id
provides the table IDnum_rows
indicates the number of rows in the tablenum_cols
indicates the number of columns in the tablenum_cells
indicates the number of cells in the tablesize_bytes
is the table size in bytesbillable_mb_size
is the table size in megabytes for access countingbillable_requests
shows how many accesses the table will consume when read
/metadata/schemas/table_x
returns the schema of the tabletable_x
col_type
informs the field name (key/header)col_type
represents the field type: text, float, int, timestamp, date, or boolean
Format of returned data
Whenever the data link (/data
) is accessed, the latest version of your table in Via Kondado will be returned in CSV format, which allows compatibility with various visualization and analysis tools.
The column separator of this file will be the comma, and you can switch between comma or dot as the decimal separator with the decimal_sep
parameter if you create the link manually or directly in the link acquisition modal on our platform.
To increase the compatibility and formatting of the CSV, line breaks (/n, /r, and /r/n) in text type fields will be removed in replicated tables. In model tables, this removal will only occur due to changes made by the model's SQL.
Additionally, most accents and special characters will be replaced.
How to use
Units
Each Via Kondado destination can be configured to have a certain capacity, according to the number of allocated units. A unit has 3 components:
- Accesses
- Each unit grants 2000 accesses/month
- It is a measure of data access and indicates how many reads per 10mb (megabytes) per month can be performed via data and metadata links of the destination.
- Example: A 2mb table costs 1 access to be read. A 18mb table costs 2 access when read
- Cells:
- Each unit grants 10 million cells stored per month
- It is a measure of data storage. It indicates how many cells per month can be stored in the destination. Similar to a spreadsheet, a cell is the smallest unit of a table and represents the intersection of a row and a column. Within a given month, the number of stored cells vary, as a table can grow/shrink in size, as well as be removed or created at any time, and the monthly cell storage measure reflects this variation
- Active models
- Each unit grants 2 active models
Changing units
You can change the number of units directly on the destination page
The modal that will open will indicate the total monthly pricing. Free units may be granted at our discretion. Just click SAVE to apply the new configuration
Free unit
The free unit included in the plan is applied upon destination creation or when units are changed
Change access token
To change the access token of your destination, just access it, click the 3 horizontal bars, and then "Change token"
You should change your token whenever you suspect it has been compromised. Frequent changes are also recommended. When you change your token, a new one will be generated, and the previous one will stop working, requiring you to update the new token in your links
Create
After your free trial period, you can have as many Via Kondado instances as you want, each containing its own data and having its own access token. To create a new destination, just click "Create+" on the top bar, choose Via Kondado, give a name and a number of units to the new destination
Disable and archive
To disable and archive your destination, just access it, click the 3 horizontal bars, and then "Disable and archive". This action is irreversible, it will remove the data from the tables of this destination and make it inaccessible via Link. Pipelines and models of this destination will be archived
Remove data without disabling the destination
You can archive an pipeline or model to remove this specific data from your Via Kondado destination
Security recommendations
Your token allows access to your data, use the highest degree of security in its handling
It is possible to obtain this token in various ways through the Kondado platform, so we recommend protecting access to your Kondado account by applying appropriate login settings, allowing access only with methods that have two-factor authentication enabled and restricted domains.
Table names
Table names must comply with the following rules:
- Do not start with duckdb_, pragma_, pg_, or sqlite_
- Do not contain special characters or spaces
- Always use lowercase
Models
You can use our models functionality in the Via Kondado destination, which uses DuckDB syntax, with the following particularities:
- Your SQL should only contain one SELECT command
- The SHOW command is not allowed in your SQL
- Column aliases will be normalized in the final table, replacing non-ANSI characters and spaces with “_”
- The dot notation "." should not be used to refer to tables in your SQL
- The RANGE function is not allowed
- PIVOT and UNPIVOT must be wrapped within a subquery (for example: SELECT * FROM (PIVOT Cities ON YEAR USING SUM(POPULATION)) and SELECT * FROM monthly_sales UNPIVOT (sales FOR month IN (jan, feb, mar, apr, may, jun)))
- The total execution time of your model, including the loading of dependent tables, should not exceed 10 minutes, with a maximum of 5 minutes for the SQL execution itself. If these limits are exceeded, it may be necessary to query fewer tables, work with reduced tables (e.g., with preliminary treatment using other upstream models), or simplify your SQL
- Due to the architecture of the Via Kondado destination, there may be considerable variation between the execution times of the same model
Model editor
The Via Kondado model editor allows you to test your SQL during editing.
The test uses samples of the queried tables, which will return a different result from the real SQL execution with the original data
To test your SQL, first select a Via Kondado destination, and then you will see the TEST SQL button. Just click it. You can also use the CTRL+ENTER shortcut
The test will consider all the SQL contained in the editor, regardless of what is selected or if the text has been saved (which can also be done with CTRL+S)
If an error is found during the test, it will be displayed. If there are no errors, the execution result with the sample data will be shown, and you can also immediately run your model. Clicking this button will also save the SQL currently in your editor
– This destination is in beta mode