The efficiency of data projects is deeply tied to the quality of knowledge management. As your company deals with an increasing number of data sources and objects, it becomes essential to establish effective organization and ensure data traceability.
A key component of data traceability is metadata, which, simply put, is an essential element for data traceability. It is not merely "data about data"; instead, it provides succinct descriptions that help you understand the meaning of data without needing to access the data directly.
By using the Kondado platform to centralize and model information from multiple sources, we ensure that processed data is removed from our servers after fulfilling its purpose. This guarantees that you retain the only copy of this information.
To manage this data flow efficiently, our platform adopts its proprietary concept called the "Common Metadata Schema" (CMS). The CMS allows us to standardize and structure information from various sources in a scalable and agile manner. Thanks to this, we can quickly develop new connectors and establish secure communication between our graphical interface and our integration and modeling servers.
Recently, we have taken another step forward by introducing a metadata search functionality on our platform. Now, you can search for table names, columns, and queries, making it easier to track the full flow of your data. To use this feature, simply access our platform, type the desired term into the top search bar, and press enter:
You will see the complete results of your search. In the example below, the term " yourls_yourls_url" was searched across all metadata of your integrations and models. In this case, no results were found in the models. The search covered names, tables, columns, and queries. In the "Hits" column, you will see where the searched term was found:
Now, imagine that you are managing your data destination and come across a table called "rdstationcrm_tasks". You then decide to find out where it comes from, its frequency, and how it is configured. Since you already know it is a table, you are not interested in columns with this name.
You can apply these filters by clicking on "FILTERS" just below the search box:
Simply select the fields you would like to search and press "SEARCH":
In this case, we searched for the term and included "Full Tables" and "Delta Tables" under "Integrations," as well as the "Table Name" under "Models." Now you have located which integration or model controls the table:
Search and trace metadata in Kondado
Use Kondado's metadata search and filters to track tables, columns, and queries across your data integrations and models.
Access the Kondado platform
Log in to the Kondado platform where your integrations and models are centralized. The metadata search bar is located at the top of the interface.
Enter your search term
Type the table name, column name, or query you want to trace into the search bar and press enter. The system will scan all metadata across your integrations and models.
Review initial search results
Examine the results page to see where your term appears. The "Hits" column indicates whether matches were found in names, tables, columns, or queries. Check if results appear in integrations, models, or both.
Apply filters to refine results
Click "FILTERS" below the search box to narrow your search. Select specific categories such as "Full Tables" or "Delta Tables" under Integrations, or "Table Name" under Models, then press "SEARCH" to update results.
Trace the data source and configuration
From the filtered results, identify which integration or model controls the table. This reveals the origin, frequency, and configuration of data objects like "rdstationcrm_tasks" without accessing the raw data directly.
