Introduction to Data Integration

Overview

Data integration is a set of business processes that encompass various types of data technologies such as ETL (Extract, Transform, Load) and data synchronization. It consolidates data from different sources into a meaningful and valuable dataset for business analysis.

In HENGSHI SENSE, data integration supports the cleaning, transformation, and merging of raw data from different business systems. It creates consistent dimension tables and fact tables based on business needs, writing the most analysis-ready data into a high-performance database or data warehouse. This data is then used for data modeling, metric calculation, and visual analysis, leading to more comprehensive and accurate reports.

Data integration allows users to no longer need third-party tools for data migration and transformation, as all data issues can be resolved within HENGSHI SENSE.

Function Overview

In data integration, the following features are included:

1. Support for multiple data source inputs, including local files, data connections, data marts, SQL inputs, etc.
2. Support for data cleaning.
3. Support for various data transformation methods, including data union, data aggregation, data merging, row-to-column transformation, and column-to-row transformation.
4. Support for batch data synchronization.
5. Support for manual and automatic project execution.