Data Sheet | Data Integration Suite Unifying Big Data Integration When the volume and velocity of data warrants massively parallel processing (MPP) or large-scale distributed platforms such as Hadoop, moving data from source systems to target needs to be efficient and leveraging the processing capabilities of those platforms to transform data is optimal. Otherwise, your data integration processes will become the bottleneck of your Big Data solution.
Why Diyotta? The Diyotta Data Integration Suite is specifically designed to solve Big Data integration challenges of large data volumes, high velocity of data movement, and wide varieties of sources. Whether your Big Data platform is MPP, Hadoop or both, Diyotta manages data extraction, loading and transformations by leveraging your network and the processing power of your environment…and not needing any additional computing resources or intermediate processing servers. From source to target and data to information, Diyotta orchestrates it all.
In one production deployment, Diyotta is continuously populating dozens of tables and thousands of attributes: • 7-10 GBs every 5 minutes 7x24x365 • < 60 seconds average load time for 4GBs • 5 Billion records (~6TB) processed daily
Product Modules From administration through monitoring the operations of the Diyotta Data Integration Suite, all 5 modules are easily and securely accessed via a web browser.
Admin Module
Studio Module
Define projects, users, security and privileges Application and server logs Administer application configuration
Metaview Module Comprehensive data lineage with transformation logic Impact analysis on change requests Export Metadata in excel
©2014 Diyotta, Inc.
Create data movement designs for any supported target environment Smart expression editor Debugging capabilities
Scheduler Module Supports Diyotta streams and external commands Supports file events and task dependencies Activity control capabilities
Monitor Module Monitor real-time execution of streams and jobs Job/Stream restart capabilities View of operational statistics
www.diyotta.com
How Diyotta Data Integration Suite Works You have the ability to define, manage and orchestrate your data integration processes through Diyotta. After your instructions have been defined, they are pushed to source systems to execute the extraction process and transmit the results to your target systems. Diyotta then pushes the next set of instructions to the target systems to transform the data and produce the final results…fast and efficient.
Key Features There are several significant advantages the Diyotta Data Integration Suite has over traditional ETL software and custom developed scripts/programs when solving your Big Data integration needs.
Specifically Designed for Big Data – Diyotta is architected to fully leverage the power and functionality of your parallel processing platform as the transformation engine. No Contact Us intermediate platform is required, leading to significantly reduced costs and limitless Diyotta.com/contact 1-888-365-4230 scalability.
High Performance Throughput – Data moves directly from source to target via Diyotta’s frictionless approach with compression and partitioning to ensure optimal performance for large data movement. Performance and scalability are dependent on your network and platform; Diyotta is never a bottleneck.
Architecture “Future Proofing” – Diyotta supports the native functionality of many MPP and Hadoop platforms. Upgrading a vendor’s platform to the next version is often zero impact on Diyotta or simply involves a minor upgrade process ensuring seamless operations.
Unified View of Data Integration – All transformation logic and control is centralized providing end-to-end data lineage and impact analysis. Metaview and Monitor give a complete picture of the objects, attributes and flows along with operational logs and metrics.
Take a test drive with Diyotta Register at www.diyotta.com/testdrive Contact Us Diyotta.com/contact 1-888-365-4230