Data Catalog
When to consider the Data Catalog solution?
✓ There is a large number of unconnected data sources (databases, files, systems) living “their own life” in the company
✓ Systems contain data in different structures, quality
✓ It is complicated for employees to find out the origin of data in data warehouses intended for strategic analyzes
✓ It is complicated for employees to determine changes in the data, the steps of their transformation from their creation to the target use
✓ There are unnecessary costs for maintaining resources with duplicate and poor-quality data
✓ Damage arises due to ambiguity of data, such as incorrect production planning, incorrect strategic decisions, or improperly chosen customer management
✓ Data sources are becoming confusing and it is not possible to eliminate redundant systems for maintaining only the really needed data set
✓ Editing data is complicated due to their inconsistency and inability to identify the consequences of the change
✓ There are no workflows to control data access and manage working with the data
How will the Data Catalog solution help your business?
The Data Cataloging solution allows you to consolidate all data sources in your company. By connecting with functions for data integration and data quality, it is possible to automatically map data flows and transformation operations over data (e.g. change of data types, aggregation, mapping and consolidation of tables, etc.) and thus create a comprehensive picture of the data processing process in the company.
It will no longer be a problem for analytical units in the company to monitor the entire process of data creation, its origin, quality, and reliability for fast and accurate analyzes. The solution will make it easier for analytical units to search for and create new data sources, thus enabling a more flexible response according to the company's current business requirements. Cataloging brings the same benefits to IT departments and data curators, where it helps to improve data tracking, management, and quality. It captures and visualizes all metadata from analytics tools like Tabelau or Power BI, integration tools like Talend or Informatica, Salesforce, SAP, SQL query, and modeling tools.
More than 80% of the information associated with the data can be automatically documented and updated by the data catalog solution based on "smart" relationship sessions and machine learning algorithm.
Main advantages
+ Creating and managing company master data
+ Building workflows
+ One-stop-shop administration “under your own roof”
+ Support for a strong open community of developers
+ Easy integration cost planning
+ Elimination of dependence on third-party suppliers and partial systems
+ Creating a “single point of truth” and a clear database throughout the company
+ Involvement of data stewards to identify the same records from different sources
+ Intuitive graphical environment for access and management of business master data by users
+ Flexible and clear licensing policy without additional fees for data volumes and number of integrations
+ Ability to combine all solutions for Data Integration, Data Quality, Application Integration, and Big Data within one single product.
A comprehensive Data Fabric solution consists of the following functional areas:
In addition to the often used on-premise type of installation, Talend also offers a hybrid or cloud installation, which you can read more about here.