Data Integration
Overview
Data integration is a set of business processes that includes various data technologies such as ETL and data synchronization, integrating data from different sources into a meaningful and valuable dataset for business analysis.
In HENGSHI SENSE, data integration supports various cleaning, transformation, and merging operations on raw data from different business systems. It creates consistent dimension tables and fact tables based on business requirements, writing analysis-ready data into high-performance databases or data warehouses. This data can then be used for data modeling, metric calculation, and visualization analysis, resulting in more comprehensive and accurate reports.
Data integration eliminates the need for third-party tools for data migration and transformation, allowing users to solve all data-related issues in HENGSHI SENSE in a one-stop solution.
Feature Overview
The dataset functionality includes two submodules: Data Integration and Batch Synchronization. The Batch Synchronization module is primarily used for direct table data synchronization, while the Data Integration submodule offers more comprehensive features, including:
- Support for multiple data source inputs, including local files, data connections, data marts, SQL inputs, and more.
- Support for data cleansing.
- Support for various data transformation methods, including data union, data aggregation, data merging, row-to-column transposition, and column-to-row transposition.
Both Data Integration and Batch Synchronization support manual project execution and scheduled project execution.