PRODUCT DATASHEET
Semarchy
Convergence
for Data Integration
The Data Integration Platform for Evolutionary MDM
BENEFITS Deliver Successfully on Time and Budget
Provide the Right Data at the Right Time to the Business Support Future Scalability and
Performance Needs
Semarchy Convergence for Data Integration is the next generation high-performance data integration platform that enables your IT team to deliver the right data, at the right place, at the right time. It is a key component of the Semarchy Convergence product family. Used in conjunction with Semarchy Convergence for MDM, it manages the integration flows between the operational/analytic applications and the master data hub.
Convergence for Data Integration includes key features for better design-time productivity and higher run-time performances, including:
Extract-Load and Transform (ELT) architecture for best performance and scalability at a lower cost.
A powerful user experience based on a metadata-driven and declarative approach to development that emphasizes reusability, templating and team collaboration.
A rationalized approach to production through lightweight components, a simple deployment model and powerful monitoring capabilities.
Enterprise-class data integration supporting out of the box a wide range of technologies in an extensible connectivity framework, as well as real-time, batch and service-oriented integration patterns.
Semarchy Convergence for Data Integration allows you to leverage the master data certified with Semarchy Convergence for MDM in a variety of data integration projects, including data warehousing, data migration, application integration and B2B data exchange.
Key Features
High-Performance ELT Architecture
Traditional data integration products use the Extract-Transform-Load (ETL) architecture to run the data transformations. In this architecture, a dedicated proprietary engine is in charge of the data processing.
The ELT (Extract-Load and Transform) architecture used in Semarchy Convergence for Data Integration removes the need for this middle-tier engine. It leverages the data processing engines in place to run processes generated and optimized for these engines.
By removing the cost of the hardware, software, maintenance and tuning skills required for the ETL server, the ELT architecture guarantees the best TCO. This architecture scales naturally with the source and target data stores. It guarantees the best performance and scalability for data integration at any time.
Powerful User Experience
Semarchy Convergence for Data Integration uses an intuitive, familiar and robust Integrated Development Environment (IDE), the Semarchy DI Designer that contributes to the unified user experience of the Semarchy Convergence platform. This IDE is designed with features that ensure better productivity for development and higher efficiency for maintenance.
WHY ELT AND NOT ETL?
In the traditional ETL approach, data processing takes place in a dedicated ETL engine. This engine introduces additional complexity and cost in the data integration picture, and frequently becomes a performance bottleneck.
The ELT approach acknowledges that engines (for example, relational databases) having unbeatable capabilities for extreme data processing are already in place in every information system.
A light portion of the processing power of these engines is used in the ELT approach to perform the data transformations, removing the need for ETL servers while delivering the best performances. Unlike an ETL engine, the ELT architecture grows naturally when the engines in place scale to support the ever growing data volumes.
WHY DECLARATIVE DESIGN?
In the declarative design approach, repetition is entirely avoided. Technical patterns (for example, “how to insert/update data incrementally in a table”) are provided in the form of Templates. Data integration developers focus exclusively on the transformation rules, and use the templates to automatically generate the data processing flows.
Metadata Driven Approach: The entire integration logic design is driven
by metadata, supporting powerful cross-referencing and impact analysis capabilities that ease the development and maintenance of the data integration flows.
Declarative Design: Data mappings are designed graphically in a
declarative way, focusing on the purpose of these mappings. The technical processes required for achieving the data movement and transformation are automatically generated using built-in process templates.
Integration Process Workflows: Complex process workflows are designed
in diagrams, using a rich toolbox. Workflows support parallelism, conditional branching and event-based execution.
Components Reusability and Templating: The mappings as well as the
workflows can be reused within the same project or in other projects. Processes can be converted into user-defined templates for reusability.
Seamless Team Collaboration: Standard source control systems such as
Concurrent Versioning System (CVS) or Apache Subversion (SVN) are available from within the Semarchy DI Designer to safely share projects within the team or across teams in robust infrastructures.
Rationalized Production
Setting up and maintaining a production environment with Semarchy Convergence
Semarchy Convergence for Data Integration’s Mapping Editor uses a declarative design approach. In this approach, the data mappings are designed graphically and the processes to execute these mappings are generated using process templates which are optimized for the technologies involved in the data flow.
for Data Integration is made fast and simple:
Lightweight Runtime Deployment: Convergence for Data Integration uses
a single lightweight Java component – the Runtime Engine – to handle run-time execution and logging.
Rationalized Deployment Model: The deployment model for data
integration processes is designed for production users. Package files generated by the development team are easily configured and deployed by the production teams, using graphical or command-line interfaces.
Comprehensive Monitoring: The entire execution flow is tracked in logs
which are accessed using a Web-based administration dashboard. Live executions can be monitored and past executions can be replayed in diagrams that reflect the processes created at design-time.
Enterprise Data Integration
Semarchy Convergence for Data Integration provides universal data access and enterprise-class capabilities for integration.
Extensible Connectivity Framework: In Convergence for DI, connectivity is
a fully extensible framework. Technology Descriptors can be added or customized to support any type of technology without restricting the capabilities to a subset. Built-in Process Templates can also be customized to generate processes optimized for specific use cases.
Built-in Technology Adapters: Out of the box adapters provide read/write
access to a variety of systems and data formats including files, databases, XML, web services, applications, etc. They include both the technology descriptors and process templates for these technologies.
Real-Time and Batch Integration Patterns: Both the real-time (Using
Changed Data Capture) and batch integration patterns are supported. These patterns cover the most common use cases for Enterprise Data Integration and Master Data Management.
Data Integration Services: Semarchy Convergence for DI provides out of
Live executions can be monitored using process diagrams similar to those created at design-time. These diagrams indicate with color codes the execution progress. Detailed statistics are stored in the logs and can be accessed from these diagrams or from the web-based dashboards.
the box access to web services for integration purposes. In addition, data integration flows designed in Convergence for DI can be automatically exposed as web services and used as part of a Service Oriented Architecture (SOA).
Unified Convergence Product Suite: Semarchy Convergence for DI is fully
integrated with the Convergence Product Suite. Built-in process templates and patterns are provided to manage publishing and consuming master data in the Convergence for MDM golden data hub.
SEM_DI_DS_USEN-04 (21/08/2012)
14A Rue Professeur Deperet - 69160 - Tassin La Demi-Lune, France Phone : +33 42.603.4729 | www.semarchy.com | info@semarchy.com
Copyright © 2012 Semarchy. All rights reserved. Semarchy and Semarchy logo are trademarks or registered trademarks of Semarchy. All other trademarks are the property of their respective owners.
LEARN MORE
Learn more about Semarchy Convergence for Data Integration and the Semarchy Convergence platform. Visit us at
www.semarchy.com.
ABOUT SEMARCHY
Semarchy enables organizations to consolidate and enrich master data across all their business domains. The Semarchy Convergence product suite is specifically designed to reduce Master Data Management (MDM) project timescales and costs, for simple as well as complex master data projects.
Benefits
Through all these features, Semarchy Convergence for Data Integration enables you to deliver master data where and when the business needs it, in a simple, fast and safe way.
Deliver Successfully on Time and Budget
With Semarchy Convergence for Data Integration, the IT team can successfully deliver projects that meet your company’s quality standards on time and budget. Convergence for Data Integration increases your organization’s capability to react to evolving data requirements.
Provide the Right Data at the Right Time to the Business
Semarchy Convergence for Data Integration’s capabilities enable integration of any data format in any latency. With Convergence for Data Integration, the IT team can deliver data where and when it is expected by the Business.
Support Future Scalability and Performance Needs
The ELT architecture is the cornerstone that safeguards your data integration investments. Mission-critical integration initiatives running on top of Semarchy Convergence for Data Integration run with the best performances today, and support out of the box the future growth of your data volumes.
