Data lakes & data warehouses, whether on-premises or in the cloud promise to provide a centralized, cost-effective and scalable foundation for modern analytics. However, organisations continue to struggle to deliver accurate, current and analytics-ready data sets in a timely fashion. Traditional ingestion tools weren’t designed to handle hundreds or even thousands of data sources and the lack of lineage forces data consumers to manually aggregate information from sources they trust. In this session, you’ll learn how to future-proof your modern data environment to meet the needs of the business for the long term. We'll examine how to overcome common challenges, the related must-have technology solutions in the data lake/ data warehousing world, using real-world success stories and even a few architecture tips from industry experts.
The Attunity solution generates real time data streams, at scale and with low impact, from heterogeneous sources that include production databases, data warehouses, SAP and mainframe systems, as well as flat files and SaaS applications. We deliver data to all major target platforms, then refine it for analytics.
Our solution enables three data delivery options.
In the first option, we replicate committed transactional data, either in bulk or via real-time change data capture (CDC), to relational databases, ranging from Oracle to SQL Server to PostgreSQL, on premises or in the cloud. We also can replicate to or from flat files. This enables use cases such as migrations, reporting and analytics.
The second scenario supports data warehouse modernization initiatives. We deliver the transactional data streams to modern data warehouses such as Snowflake and Azure SQL DW, using automated data delivery and modelling methods to enable your reporting and analytics activities. We automate model creation, data warehouse creation, data mart creation, table creation, data instantiation and source/target mappings. You can manage all these tasks as an integrated workflow.
Third, we take relational transaction streams and stitch them together into a common format that can be readily consumed for analytics on Big Data platforms such as Amazon EMR, Azure HDInsight and Google Dataproc. Our solution automatically creates, loads and updates data stores, and accelerates dataset readiness for analytics. You can then process the datasets we refine alongside non-relational and unstructured data from other sources.
Because all these capabilities are native to the Attunity data integration solution, you are able to prepare data for analytics with fewer software components.
[Internal note: we support structured and relational data. We do not support unstructured and/or non-relational data.]