Data Sheet | Data Integration Suite Unifying Big Data Integration When the volume and velocity of data warrants massively parallel processing (MPP) or large-scale distributed platforms such as Hadoop, moving data from source systems to target needs to be efficient and leveraging the processing capabilities of those platforms to transform data is optimal. Otherwise, your data integration processes will become the bottleneck of your Big Data solution.
Why Diyotta? The Diyotta Data Integration Suite is specifically designed to solve Big Data integration challenges of large data volumes, high velocity of data movement, and wide varieties of sources. Whether your Big Data platform is MPP, Hadoop or both, Diyotta manages data extraction, loading and transformations by leveraging your network and the processing power of your environment…and not needing any additional computing resources or intermediate processing servers. From source to target and data to information, Diyotta orchestrates it all.
In one production deployment, Diyotta is continuously populating dozens of tables and thousands of attributes: • 7-10 GBs every 5 minutes 7x24x365 • < 60 seconds average load time for 4GBs • 5 Billion records (~6TB) processed daily
Product Modules From administration through monitoring the operations of the Diyotta Data Integration Suite, all 5 modules are easily and securely accessed via a web browser.
Admin Module
Studio Module
Define projects, users, security and privileges Application and server logs Administer application configuration
Metaview Module Comprehensive data lineage with transformation logic Impact analysis on change requests Export Metadata in excel
©2014 Diyotta, Inc.
Create data movement designs for any supported target environment Smart expression editor Debugging capabilities
Scheduler Module Supports Diyotta streams and external commands Supports file events and task dependencies Activity control capabilities
Monitor Module Monitor real-time execution of streams and jobs Job/Stream restart capabilities View of operational statistics
www.diyotta.com