The efficiency of data projects is deeply tied to the quality of knowledge management. As your company deals with an increasing number of data sources and objects, it becomes essential to establish effective organization and ensure data traceability.
A key component of data traceability is metadata, which, simply put, is an essential element for data traceability. It is not merely "data about data"; instead, it provides succinct descriptions that help you understand the meaning of data without needing to access the data directly.
By using the Kondado platform to centralize and model information from multiple sources, we ensure that processed data is removed from our servers after fulfilling its purpose. This guarantees that you retain the only copy of this information.
To manage this data flow efficiently, our platform adopts its proprietary concept called the "Common Metadata Schema" (CMS). The CMS allows us to standardize and structure information from various sources in a scalable and agile manner. Thanks to this, we can quickly develop new connectors and establish secure communication between our graphical interface and our integration and modeling servers.
Recently, we have taken another step forward by introducing a metadata search functionality on our platform. Now, you can search for table names, columns, and queries, making it easier to track the full flow of your data. To use this feature, simply access our platform, type the desired term into the top search bar, and press enter:
You will see the complete results of your search. In the example below, the term " yourls_yourls_url" was searched across all metadata of your integrations and models. In this case, no results were found in the models. The search covered names, tables, columns, and queries. In the "Hits" column, you will see where the searched term was found:
Now, imagine that you are managing your data destination and come across a table called "rdstationcrm_tasks". You then decide to find out where it comes from, its frequency, and how it is configured. Since you already know it is a table, you are not interested in columns with this name.
You can apply these filters by clicking on "FILTERS" just below the search box:
Simply select the fields you would like to search and press "SEARCH":
In this case, we searched for the term and included "Full Tables" and "Delta Tables" under "Integrations," as well as the "Table Name" under "Models." Now you have located which integration or model controls the table: