Via Kondado

The Via Kondado destination allows access via Link to data replicated and modeled by Kondado

Accessing your data


Copy-paste link


The connection to Via Kondado is made via API. You can easily obtain the API access link for any table, similar to the modal below. You can change the decimal separator between comma and dot, then click the copy icon to get the link

Copy-paste link for pipelines


To get all the links of your pipeline tables, simply access your pipeline and click the share icon

 

The link for each table will also be available by clicking DETAILS

Copy-paste link for models

Manually constructing the link


Our reading API must be accessed with a GET request to the host https://hub.kondado.io and authenticated with the token parameter (query string)

Access token


To get the access token for your destination, just access it, click the 3 horizontal bars, and then "View token"

This token allows access to your data. Keep it in a safe place

Reading data


To get the data from a table table_x, just access the path data/table_x.

If the decimal_sep parameter is not provided, the decimal separator will be the dot; use decimal_sep=comma to get your data separated by a comma, for example:

https://hub.kondado.io/data/table_x?token=your_token&decimal_sep=comma

Reading metadata


The /metadata path returns metadata of your tables in JSON format

  • /metadata/show_tables returns an ARRAY of JSONs with the list of tables in your destination in the key tbl_name
  • /metadata/kdd_show_tables returns an ARRAY of JSONs with the list of tables in your destination, including information on the location of each table within Kondado:
    • tbl_name provides the table name
    • tbl_id provides the table ID
    • origin_object_type indicates the type of object the table references, where "pipeline" means pipeline and "kubo" means model
    • origin_object_id provides the ID of this object
    • origin_object_sub_location provides the location of the table within the object for pipelines that contain more than one table; it is empty if it is the main pipeline table or a table of a model
    • origin_object_created_rev is an internal code indicating the version of the object referencing the table
    • createdAt is the table creation date
    • updatedAt is the last update date of the table
  • /metadata/kdd_show_table_sizes returns an ARRAY of JSONs with the list of tables in your destination and information about the sizes of these tables:
    • tbl_name provides the table name
    • tbl_id provides the table ID
    • num_rows indicates the number of rows in the table
    • num_cols indicates the number of columns in the table
    • num_cells indicates the number of cells in the table
    • size_bytes is the table size in bytes
    • billable_mb_size is the table size in megabytes for access counting
    • billable_requests shows how many accesses the table will consume when read
  • /metadata/schemas/table_x returns the schema of the table table_x
    • col_type informs the field name (key/header)
    • col_type represents the field type: text, float, int, timestamp, date, or boolean
       

Format of returned data

Whenever the data link (/data) is accessed, the latest version of your table in Via Kondado will be returned in CSV format, which allows compatibility with various visualization and analysis tools.

The column separator of this file will be the comma, and you can switch between comma or dot as the decimal separator with the decimal_sep parameter if you create the link manually or directly in the link acquisition modal on our platform.

To increase the compatibility and formatting of the CSV, line breaks (/n, /r, and /r/n) in text type fields will be removed in replicated tables. In model tables, this removal will only occur due to changes made by the model's SQL.

Additionally, most accents and special characters will be replaced.

How to use

Units

Each Via Kondado destination can be configured to have a certain capacity, according to the number of allocated units. A unit has 3 components:

  • Accesses
    • Each unit grants 2000 accesses/month
    • It is a measure of data access and indicates how many reads per 10mb (megabytes) per month can be performed via data and metadata links of the destination.
    • Example: A 2mb table costs 1 access to be read. A 18mb table costs 2 access when read
  • Cells:
    • Each unit grants 10 million cells stored per month
    • It is a measure of data storage. It indicates how many cells per month can be stored in the destination. Similar to a spreadsheet, a cell is the smallest unit of a table and represents the intersection of a row and a column. Within a given month, the number of stored cells vary, as a table can grow/shrink in size, as well as be removed or created at any time, and the monthly cell storage measure reflects this variation
  • Active models
    • Each unit grants 2 active models

Changing units


You can change the number of units directly on the destination page

 

The modal that will open will indicate the total monthly pricing. Free units may be granted at our discretion. Just click SAVE to apply the new configuration

Free unit


The free unit included in the plan is applied upon destination creation or when units are changed

Change access token

To change the access token of your destination, just access it, click the 3 horizontal bars, and then "Change token"

You should change your token whenever you suspect it has been compromised. Frequent changes are also recommended. When you change your token, a new one will be generated, and the previous one will stop working, requiring you to update the new token in your links

Create

After your free trial period, you can have as many Via Kondado instances as you want, each containing its own data and having its own access token. To create a new destination, just click "Create+" on the top bar, choose Via Kondado, give a name and a number of units to the new destination

Disable and archive


To disable and archive your destination, just access it, click the 3 horizontal bars, and then "Disable and archive". This action is irreversible, it will remove the data from the tables of this destination and make it inaccessible via Link. Pipelines and models of this destination will be archived

Remove data without disabling the destination

You can archive an pipeline or model to remove this specific data from your Via Kondado destination

Security recommendations


Your token allows access to your data, use the highest degree of security in its handling

It is possible to obtain this token in various ways through the Kondado platform, so we recommend protecting access to your Kondado account by applying appropriate login settings, allowing access only with methods that have two-factor authentication enabled and restricted domains.

Table names


Table names must comply with the following rules:

  • Do not start with duckdb_, pragma_, pg_, or sqlite_
  • Do not contain special characters or spaces
  • Always use lowercase

Models


You can use our models functionality in the Via Kondado destination, which uses DuckDB syntax, with the following particularities:

  1. Your SQL should only contain one SELECT command
  2. The SHOW command is not allowed in your SQL
  3. Column aliases will be normalized in the final table, replacing non-ANSI characters and spaces with “_”
  4. The dot notation "." should not be used to refer to tables in your SQL
  5. The RANGE function is not allowed
  6. PIVOT and UNPIVOT must be wrapped within a subquery (for example: SELECT * FROM (PIVOT Cities ON YEAR USING SUM(POPULATION)) and SELECT * FROM monthly_sales UNPIVOT (sales FOR month IN (jan, feb, mar, apr, may, jun)))
  7. The total execution time of your model, including the loading of dependent tables, should not exceed 10 minutes, with a maximum of 5 minutes for the SQL execution itself. If these limits are exceeded, it may be necessary to query fewer tables, work with reduced tables (e.g., with preliminary treatment using other upstream models), or simplify your SQL
  8. Due to the architecture of the Via Kondado destination, there may be considerable variation between the execution times of the same model
     

Learn more about models

Model editor


The Via Kondado model editor allows you to test your SQL during editing.

The test uses samples of the queried tables, which will return a different result from the real SQL execution with the original data

To test your SQL, first select a Via Kondado destination, and then you will see the TEST SQL button. Just click it. You can also use the CTRL+ENTER shortcut

The test will consider all the SQL contained in the editor, regardless of what is selected or if the text has been saved (which can also be done with CTRL+S)

If an error is found during the test, it will be displayed. If there are no errors, the execution result with the sample data will be shown, and you can also immediately run your model. Clicking this button will also save the SQL currently in your editor

– This destination is in beta mode