OAC stands for Oracle Analytics Cloud Services, and it’s another cloud solution offered by Oracle. It provides you a lot of analytic tools for your data. The question is, do you need to be 100% cloud to use OAC services?
Well, with ODI we always have options, and for OAC that is not an exception.
In this presentation we’ll take a look at three different ways to use ODI to integrate all your data with OAC, ranging from using your existing on-premises environment to a 100% cloud solution (no ODI/DB footprint in your environment).
This document summarizes a presentation about Oracle Analytics Cloud (OAC) given by Mike Killeen of Edgewater Ranzal. The presentation provides an overview of OAC and its capabilities, including standard and enterprise editions. It demonstrates OAC's ability to integrate business analytics solutions like EPM, BI and big data technologies to help improve business performance. The document also discusses the growing need for business analytics and how OAC can help organizations better analyze data and gain actionable insights.
The document provides an overview of Oracle Data Integrator (ODI):
- ODI uses a declarative design approach to simplify data integration development and maintenance.
- Its Extract-Load-Transform (E-LT) architecture leverages database engines for high performance data transformations.
- The document reviews the key ODI components including repositories, Studio interfaces, agents, and consoles.
An introduction to self-service data with Dremio. Dremio reimagines analytics for modern data. Created by veterans of open source and big data technologies, Dremio is a fundamentally new approach that dramatically simplifies and accelerates time to insight. Dremio empowers business users to curate precisely the data they need, from any data source, then accelerate analytical processing for BI tools, machine learning, data science, and SQL clients. Dremio starts to deliver value in minutes, and learns from your data and queries, making your data engineers, analysts, and data scientists more productive.
Azure Synapse Analytics is Azure SQL Data Warehouse evolved: a limitless analytics service, that brings together enterprise data warehousing and Big Data analytics into a single service. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources, at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate business intelligence and machine learning needs. This is a huge deck with lots of screenshots so you can see exactly how it works.
This document summarizes a presentation about Oracle Analytics Cloud (OAC) given by Mike Killeen of Edgewater Ranzal. The presentation provides an overview of OAC and its capabilities, including standard and enterprise editions. It demonstrates OAC's ability to integrate business analytics solutions like EPM, BI and big data technologies to help improve business performance. The document also discusses the growing need for business analytics and how OAC can help organizations better analyze data and gain actionable insights.
The document provides an overview of Oracle Data Integrator (ODI):
- ODI uses a declarative design approach to simplify data integration development and maintenance.
- Its Extract-Load-Transform (E-LT) architecture leverages database engines for high performance data transformations.
- The document reviews the key ODI components including repositories, Studio interfaces, agents, and consoles.
An introduction to self-service data with Dremio. Dremio reimagines analytics for modern data. Created by veterans of open source and big data technologies, Dremio is a fundamentally new approach that dramatically simplifies and accelerates time to insight. Dremio empowers business users to curate precisely the data they need, from any data source, then accelerate analytical processing for BI tools, machine learning, data science, and SQL clients. Dremio starts to deliver value in minutes, and learns from your data and queries, making your data engineers, analysts, and data scientists more productive.
Azure Synapse Analytics is Azure SQL Data Warehouse evolved: a limitless analytics service, that brings together enterprise data warehousing and Big Data analytics into a single service. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources, at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate business intelligence and machine learning needs. This is a huge deck with lots of screenshots so you can see exactly how it works.
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...Neo4j
AstraZeneca share their experience of share their experience of building a knowledge graph platform and central service, to power the next generation of insights and analytics at AstraZeneca.
This session provides an introduction to using SSIS. This is an update to my older presentation on the topic: http://www.slideshare.net/rmaclean/sql-server-integration-services-2631027
The document provides an overview of Oracle BI EE (Business Intelligence Enterprise Edition), including its components, advantages, and architecture. It describes Oracle BI EE as an analytical tool that helps users view and analyze data to gain insights. The key components of Oracle BI EE are the Oracle BI Client, Presentation Services, Server, Repository, and Answers. It also discusses interactive dashboards, report parameters, and best practices for Oracle BI EE.
The document introduces Cypher, the declarative query language for Neo4j. It explains that Cypher uses ASCII art syntax to represent graph patterns and identify patterns in graph data. Nodes represent entities and can have labels and properties, relationships connect nodes and have types and properties. Examples show how to write Cypher queries to create, read, and match patterns in a movie database graph.
SAP BusinessObjects Web Intelligence Rich Client is a full-client reporting tool offered with Business Objects XI R3. This reporting tool is very similar to the Webi Java version that most end users are used to seeing in XI R2; however it offers a very important functionality of being able to work on reports offline without being connected to a CMS. It also provides equivalent report creation, editing, formatting, printing, and saving functionality that is found in Business Object’s original full-client reporting tool, Desktop Intelligence.
Slides for the Usergroup meeting for the Manchester Power BI User Group on June 27th, 2019.
Subject: Power BI for Developers about Power BI Embedded and Power BI Custom Visuals
Oracle Office Hours - Exposing REST services with APEX and ORDSDoug Gault
This document provides an overview and agenda for exposing RESTful services using Oracle Application Express (APEX) and Oracle REST Data Services (ORDS). It begins with a brief introduction to REST concepts and then discusses the history of supporting REST in APEX and ORDS. The document outlines the key components and APIs available in ORDS for enabling schemas and defining REST modules, templates and handlers to expose database objects and custom services via REST. It also provides examples of enabling the schema and using auto-REST to expose database tables through REST.
QlikSense est une plate forme d’analyse Qui permet de créer des visualisations, des tableaux de bord et des applications pour répondre aux questions les plus pertinentes relatives à des entreprises
An application server is software that hosts web applications and provides additional services for them. Oracle uses WebLogic Server as its application server for Oracle Fusion Middleware. The document discusses deploying WebLogic Server on Oracle Database Appliance (ODA) hardware, which provides an integrated and automated setup of WebLogic Server and Oracle Real Application Clusters.
Should I move my database to the cloud?James Serra
So you have been running on-prem SQL Server for a while now. Maybe you have taken the step to move it from bare metal to a VM, and have seen some nice benefits. Ready to see a TON more benefits? If you said “YES!”, then this is the session for you as I will go over the many benefits gained by moving your on-prem SQL Server to an Azure VM (IaaS). Then I will really blow your mind by showing you even more benefits by moving to Azure SQL Database (PaaS/DBaaS). And for those of you with a large data warehouse, I also got you covered with Azure SQL Data Warehouse. Along the way I will talk about the many hybrid approaches so you can take a gradual approve to moving to the cloud. If you are interested in cost savings, additional features, ease of use, quick scaling, improved reliability and ending the days of upgrading hardware, this is the session for you!
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...Neo4j
AstraZeneca share their experience of share their experience of building a knowledge graph platform and central service, to power the next generation of insights and analytics at AstraZeneca.
This session provides an introduction to using SSIS. This is an update to my older presentation on the topic: http://www.slideshare.net/rmaclean/sql-server-integration-services-2631027
The document provides an overview of Oracle BI EE (Business Intelligence Enterprise Edition), including its components, advantages, and architecture. It describes Oracle BI EE as an analytical tool that helps users view and analyze data to gain insights. The key components of Oracle BI EE are the Oracle BI Client, Presentation Services, Server, Repository, and Answers. It also discusses interactive dashboards, report parameters, and best practices for Oracle BI EE.
The document introduces Cypher, the declarative query language for Neo4j. It explains that Cypher uses ASCII art syntax to represent graph patterns and identify patterns in graph data. Nodes represent entities and can have labels and properties, relationships connect nodes and have types and properties. Examples show how to write Cypher queries to create, read, and match patterns in a movie database graph.
SAP BusinessObjects Web Intelligence Rich Client is a full-client reporting tool offered with Business Objects XI R3. This reporting tool is very similar to the Webi Java version that most end users are used to seeing in XI R2; however it offers a very important functionality of being able to work on reports offline without being connected to a CMS. It also provides equivalent report creation, editing, formatting, printing, and saving functionality that is found in Business Object’s original full-client reporting tool, Desktop Intelligence.
Slides for the Usergroup meeting for the Manchester Power BI User Group on June 27th, 2019.
Subject: Power BI for Developers about Power BI Embedded and Power BI Custom Visuals
Oracle Office Hours - Exposing REST services with APEX and ORDSDoug Gault
This document provides an overview and agenda for exposing RESTful services using Oracle Application Express (APEX) and Oracle REST Data Services (ORDS). It begins with a brief introduction to REST concepts and then discusses the history of supporting REST in APEX and ORDS. The document outlines the key components and APIs available in ORDS for enabling schemas and defining REST modules, templates and handlers to expose database objects and custom services via REST. It also provides examples of enabling the schema and using auto-REST to expose database tables through REST.
QlikSense est une plate forme d’analyse Qui permet de créer des visualisations, des tableaux de bord et des applications pour répondre aux questions les plus pertinentes relatives à des entreprises
An application server is software that hosts web applications and provides additional services for them. Oracle uses WebLogic Server as its application server for Oracle Fusion Middleware. The document discusses deploying WebLogic Server on Oracle Database Appliance (ODA) hardware, which provides an integrated and automated setup of WebLogic Server and Oracle Real Application Clusters.
Should I move my database to the cloud?James Serra
So you have been running on-prem SQL Server for a while now. Maybe you have taken the step to move it from bare metal to a VM, and have seen some nice benefits. Ready to see a TON more benefits? If you said “YES!”, then this is the session for you as I will go over the many benefits gained by moving your on-prem SQL Server to an Azure VM (IaaS). Then I will really blow your mind by showing you even more benefits by moving to Azure SQL Database (PaaS/DBaaS). And for those of you with a large data warehouse, I also got you covered with Azure SQL Data Warehouse. Along the way I will talk about the many hybrid approaches so you can take a gradual approve to moving to the cloud. If you are interested in cost savings, additional features, ease of use, quick scaling, improved reliability and ending the days of upgrading hardware, this is the session for you!
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...Insight Technology, Inc.
[db tech showcase Tokyo 2018] #dbts2018 #B31
『1,2,3 and Done! 3 easy ways to migrate to the cloud!』
Data Intensity - Director of Innovation Francisco Munoz Alvarez 氏
Whats new in Oracle Database 12c release 12.1.0.2Connor McDonald
This document provides an overview of new features in Oracle Database 12c Release 1 (12.1.0.2). It discusses Oracle Database In-Memory for accelerating analytics, improvements for developers like support for JSON and RESTful services, capabilities for accessing big data using SQL, enhancements to Oracle Multitenant for database consolidation, and other performance improvements. The document also briefly outlines features like Oracle Rapid Home Provisioning, Database Backup Logging Recovery Appliance, and Oracle Key Vault.
Oracle RAC provides high availability, scalability and performance for databases across clustered servers with no application changes required. It uses a shared cache architecture to overcome limitations of traditional shared-nothing and shared-disk approaches. iONE provides Oracle RAC implementation and maintenance services to deliver continuous uptime for database applications through server pool management, datacenter HA, and scaling to 100 nodes.
The document discusses Oracle Database Cloud Service, which allows users to quickly create databases using automated provisioning and easily move data and workloads between on-premise and cloud environments. It highlights the unified management capabilities of Enterprise Manager to manage databases across on-premise and cloud environments using the same architecture, software, and skills.
The document discusses database architectures and Oracle Cloud. It describes three database architectures - 1st tier with all components on one machine, 2nd tier with presentation on the client and data on a server, and 3rd tier with an additional application server layer. It then discusses service-oriented architecture and using information as a service. Finally, it outlines advantages of Oracle ERP Cloud over the on-premise version, including lower costs, easier accessibility, automatic upgrades, and improved scalability and integration.
MV2ADB - Move to Oracle Autonomous Database in One-clickRuggero Citton
Move to Autonomous Database (MV2ADB) is a new tool is permitting the load data and migration from “on premises” to Autonomous Database Cloud leveraging on Oracle Data Pump and within one command. You can save your data to your Cloud Object Store and to load them to Autonomous Database Cloud using “mv2adb”.
The document provides an overview of database migration options using AWS Database Migration Service (DMS) and AWS Schema Conversion Tool (SCT). It discusses how DMS can be used to migrate databases across different database platforms with minimal downtime. It also outlines how SCT can be used to convert schemas from commercial databases to open-source databases like PostgreSQL. The document shares customer examples and benefits of using DMS and SCT for heterogeneous, scale-up, and split migrations. It also lists available resources for customers on DMS and SCT.
Autonomous Database is Oracle's fully managed cloud database service. It provides automated operations including provisioning, tuning, patching and backup. Autonomous Database can be deployed in serverless or dedicated modes. Serverless provides elastic scaling on shared infrastructure, while dedicated runs on a customer's dedicated Exadata cloud service. Both support Autonomous Data Warehouse and Autonomous Transaction Processing databases. Autonomous Database handles all database administration tasks, allowing users to focus on running SQL queries without managing infrastructure.
This document provides an overview of Docker and cloud native training presented by Brian Christner of 56K.Cloud. It includes an agenda for Docker labs, common IT struggles Docker can address, and 56K.Cloud's consulting and training services. It discusses concepts like containers, microservices, DevOps, infrastructure as code, and cloud migration. It also includes sections on Docker architecture, networking, volumes, logging, and monitoring tools. Case studies and examples are provided to demonstrate how Docker delivers speed, agility, and cost savings for application development.
Whats new in Autonomous Database in 2022Sandesh Rao
This session covers the new features and happenings in the autonomous database world and will help answer more questions DBAs and Developers will have on the Autonomous Database, from provisioning to backups, troubleshooting, tips and tricks, security and HA. This is a good introduction for on-prem DBAs who want to learn how this works quickly without spending too much time on it. Questions like what does the free tier cover, how do I do backup or if it's automated, how do I manage it, how to scale up and down, how to secure their environment, how to use mtls, how to use tools like SQLDeveloper and SQLModeler, performance tuning all in a quick 45-minute session which might take weeks to pick up reading documentation or spanning several presentations
AWS re:Invent 2016: Workshop: Using the Database Migration Service (DMS) for ...Amazon Web Services
It can help you do much more. You can use DMS to consolidate multiple databases into a single database or split a single database into multiple databases. You can also use DMS for data distribution to multiple systems. For both of these use cases your source database can be outside of AWS (on premises) or in AWS (EC2 or RDS). DMS can also be used for near real-time replication of data. Replication can be done to one or more targets within AWS, in the same region or across regions. You can also replicate data from databases within AWS to databases outside of AWS. In this session we will discuss all these usage patterns and help you try them out yourselves.
Prerequisites:
You should have good database knowledge and at least some experience with Amazon RDS or Amazon Aurora.
Participants should have an AWS account established and available for use during the workshop.
Please bring your own laptop.
This document provides an overview of how to successfully migrate Oracle workloads to Microsoft Azure. It begins with an introduction of the presenter and their experience. It then discusses why customers might want to migrate to the cloud and the different Azure database options available. The bulk of the document outlines the key steps in planning and executing an Oracle workload migration to Azure, including sizing, deployment, monitoring, backup strategies, and ensuring high availability. It emphasizes adapting architectures for the cloud rather than directly porting on-premises systems. The document concludes with recommendations around automation, education resources, and references for Oracle-Azure configurations.
SOA & WebLogic - Lift & Shift to the CloudSimon Haslam
A presentation about moving SOA and WebLogic java workloads to the Oracle Cloud. First delivered by myself & Bruno Neves Alves at the UKOUG Middleware & Integration Special Interest Group in London on 28 September 2017.
Exploring All options to move your Oracle Databases to the Oracle CloudAlex Zaballa
This document discusses various options for migrating Oracle databases to the Oracle Cloud. It begins with an introduction to Alex Zaballa and his background and experience. It then discusses Accenture Enkitec Group's capabilities in Oracle Engineered Systems implementations and Oracle technologies. The remainder of the document discusses specific methods for migrating databases to the Oracle Cloud, including using Oracle Database Cloud Service, choosing appropriate migration methods based on factors like database version and downtime tolerance, and techniques like using Oracle Database Cloud Backup Module or Data Pump to perform the migration.
Optymalizacja środowiska Open Source w celu zwiększenia oszczędności i kontroliEDB
The document discusses optimizing the Open Source environment to increase savings and control. It covers evolving database infrastructure models in enterprises to get more for less. Key areas discussed include where Postgres can be most easily implemented, Postgres advances that enable new data types and challenges, and how to assess whether and how to implement Postgres. Case studies are presented that demonstrate cost savings and performance benefits organizations achieved by adopting Postgres.
Similar to OAC and ODI! A Match Made in…the cloud? (20)
Oracle Cloud services products, including Planning and Budget Cloud Service (PBCS), enables companies to focus on their own business instead of spending money and resources on maintaining big IT infrastructures. It also gives them the possibility to be connected 24x7 from any place in the world.
But what happens if this company already has an ODI on-premise infrastructure and they want to integrate the new PBCS with it? Can we use our existing ODI on-premise? How hard is to accomplish this?
This session will show how to use your ODI on-premise to integrate and orchestrate your PBCS seamlessly.
Essbase Statistics DW: How to Automatically Administrate Essbase Using ODIRodrigo Radtke de Souza
In order to have a performatic Essbase cube, we must keep vigilance and follow up its growth and its data movements so we can distribute caches and adjust the database parameters accordingly. But this is a very difficult task to achieve, since Essbase statistics are not temporal and only tell you the cube statistics is in that specific time frame.
This session will present how ODI can be used to create a historical statistical DW containing Essbase cube’s information and how to identify trends and patterns, giving us the ability for programmatically tune our Essbase databases automatically.
EPM environments are generally supported by a Data Warehouse, however, we often see that those DWs are not optimized for the EPM tools. During the years, we have witnessed that modeling a DW thinking about the EPM tools may greatly increase the overall architecture performance.
The most common situation found in several projects is that the people that develops the data warehouse does not have a great knowledge about EPM tools and vice-versa. This may create a big gap between those two concepts which may severally impact performance.
This session will show a lot of techniques to model the right Data Warehouse for EPM tools. We will discuss how to improve performance using partitioned tables, create hierarchical queries with “Connect by Prior”, the correct way to use Multi-Period tables for block data load using Pivot/Unpivot and more. And if you want to go ever further, we will show you how to leverage all those techniques using ODI, which will create the perfect mix to perform any process between your DW and EPM environments.
In a fast-moving business environment, finance leaders are successfully leveraging technology advancements to transform their finance organizations and generate value for the business.
Oracle’s Enterprise Performance Management (EPM) applications are an integrated, modular suite that supports a broad range of strategic and financial performance management tools that help business to unlock their potential.
Dell’s global financial environment contains over 10,000 users around the world and relies on a range of EPM tools such as Hyperion Planning, Essbase, Smart View, DRM, and ODI to meet its needs.
This session shows the complexity of this environment, describing all relationships between those tools, the techniques used to maintain such a large environment in sync, and meeting the most varied needs from the different business and laws around the world to create a complete and powerful business decision engine that takes Dell to the next level.
Incredible ODI tips to work with Hyperion tools that you ever wanted to knowRodrigo Radtke de Souza
ODI is an incredible and flexible development tool that goes beyond simple data integration. But most of its development power comes from outside-the-box ideas.
* Did you ever want to dynamically run any number of “OS” commands using a single ODI component?
* Did you ever want to have only one data store and loop different sources without the need of different ODI contexts?
* Did you ever want to have only one interface and loop any number of ODI objects with a lot of control?
* Did you ever need to have a “third command tab” in your procedures or KMs to improve ODI powers?
* Do you still use an old version of ODI and miss a way to know the values of the variables in a scenario execution?
* Did you know ODI has four “substitution tags”? And do you know how useful they are?
* Do you use “dynamic variables” and know how powerful they can be?
* Do you know how to have control over you ODI priority jobs automatically (stop, start, and restart scenarios)?
In some Hyperion Planning projects, security becomes so complex that it takes more than just putting some security groups on the high-level members of the dimensions. Global companies often have the necessity to create multiple planning applications to meet the diverse regions of the globe. However, what happens when the business requires a single application with a single plan type that contains cost center from different regions around the entity hierarchy? Moreover, that data is restricted according to the region's security group using only one attribute dimension. Furthermore, each user can see aggregated values correctly for your region only. This case study will show how to generate and maintain leaf-level member security settings based on physical geography attribute dimension on one of Dell's global Planning applications using only ODI and planning application metadata repository information.
No more unknown members! Smart data load validation for Hyperion Planning usi...Rodrigo Radtke de Souza
Usually, ODI data load interfaces for Essbase are simple and fast to be developed. But, depending on the data source quality, those interfaces may become a performance challenge. Essbase demands that all POV members in which we are trying to insert data to exist in the Essbase outline and when this is not true, Essbase switches its load method from Block Mode to Cell Mode. When this situation happens, one data load that would take only five minutes to complete may take several hours, degrading the Hyperion environment performance. Join us in this session to discover how we solved this problem in Dell's Computers in a dynamic way for any number of Hyperion Planning applications only using ODI data constraints and Hyperion Planning metadata repository to validate all POV members that will be used in the data load, guaranteeing the best performance and data quality on the Hyperion Planning environment.
Are you a young professional who just got out of college and unsure which career path to follow? Are you thinking about changing your career to something completely new and looking for options? Either way, this webinar is the right one for you. It’s the first in a series that the new ODTUG Career Track Community will bring you to show what Oracle careers look like and where/how to start with them.
During this webinar, we will talk about what an ETL developer career looks like, what the expectations are, challenges, rewards, and which steps are needed to be successful. We will discuss a wide range of topics, such as tools used on the job, certification paths, the importance of social media, user groups, and more. This webinar will be presented by Rodrigo Radtke de Souza, who has been working in the Oracle ETL world for quite some time now and has achieved great accomplishments as an ETL developer, such as Oracle ACE nomination, frequent Kscope speaker, ODTUG Leadership Program participant, and a successful career at Dell.
End-to-end pipeline agility - Berlin Buzzwords 2024Lars Albertsson
We describe how we achieve high change agility in data engineering by eliminating the fear of breaking downstream data pipelines through end-to-end pipeline testing, and by using schema metaprogramming to safely eliminate boilerplate involved in changes that affect whole pipelines.
A quick poll on agility in changing pipelines from end to end indicated a huge span in capabilities. For the question "How long time does it take for all downstream pipelines to be adapted to an upstream change," the median response was 6 months, but some respondents could do it in less than a day. When quantitative data engineering differences between the best and worst are measured, the span is often 100x-1000x, sometimes even more.
A long time ago, we suffered at Spotify from fear of changing pipelines due to not knowing what the impact might be downstream. We made plans for a technical solution to test pipelines end-to-end to mitigate that fear, but the effort failed for cultural reasons. We eventually solved this challenge, but in a different context. In this presentation we will describe how we test full pipelines effectively by manipulating workflow orchestration, which enables us to make changes in pipelines without fear of breaking downstream.
Making schema changes that affect many jobs also involves a lot of toil and boilerplate. Using schema-on-read mitigates some of it, but has drawbacks since it makes it more difficult to detect errors early. We will describe how we have rejected this tradeoff by applying schema metaprogramming, eliminating boilerplate but keeping the protection of static typing, thereby further improving agility to quickly modify data pipelines without fear.
Learn SQL from basic queries to Advance queriesmanishkhaire30
Dive into the world of data analysis with our comprehensive guide on mastering SQL! This presentation offers a practical approach to learning SQL, focusing on real-world applications and hands-on practice. Whether you're a beginner or looking to sharpen your skills, this guide provides the tools you need to extract, analyze, and interpret data effectively.
Key Highlights:
Foundations of SQL: Understand the basics of SQL, including data retrieval, filtering, and aggregation.
Advanced Queries: Learn to craft complex queries to uncover deep insights from your data.
Data Trends and Patterns: Discover how to identify and interpret trends and patterns in your datasets.
Practical Examples: Follow step-by-step examples to apply SQL techniques in real-world scenarios.
Actionable Insights: Gain the skills to derive actionable insights that drive informed decision-making.
Join us on this journey to enhance your data analysis capabilities and unlock the full potential of SQL. Perfect for data enthusiasts, analysts, and anyone eager to harness the power of data!
#DataAnalysis #SQL #LearningSQL #DataInsights #DataScience #Analytics
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Round table discussion of vector databases, unstructured data, ai, big data, real-time, robots and Milvus.
A lively discussion with NJ Gen AI Meetup Lead, Prasad and Procure.FYI's Co-Found
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Discussion on Vector Databases, Unstructured Data and AI
https://www.meetup.com/unstructured-data-meetup-new-york/
This meetup is for people working in unstructured data. Speakers will come present about related topics such as vector databases, LLMs, and managing data at scale. The intended audience of this group includes roles like machine learning engineers, data scientists, data engineers, software engineers, and PMs.This meetup was formerly Milvus Meetup, and is sponsored by Zilliz maintainers of Milvus.
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataKiwi Creative
Harness the power of AI-backed reports, benchmarking and data analysis to predict trends and detect anomalies in your marketing efforts.
Peter Caputa, CEO at Databox, reveals how you can discover the strategies and tools to increase your growth rate (and margins!).
From metrics to track to data habits to pick up, enhance your reporting for powerful insights to improve your B2B tech company's marketing.
- - -
This is the webinar recording from the June 2024 HubSpot User Group (HUG) for B2B Technology USA.
Watch the video recording at https://youtu.be/5vjwGfPN9lw
Sign up for future HUG events at https://events.hubspot.com/b2b-technology-usa/
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
2. OAC and ODI! A match
made in the.... cloud?
Ricardo Giampaoli
Rodrigo Radtke
3. About the Speakers
Giampaoli, Ricardo
• Oracle Ace
• Master in Business
Administration and IT
management
• EPM training instructor
• Essbase/Planning/OBIEE/ODI
Certified Specialist
• Blogger @ devepm.com
Radtke, Rodrigo
• Oracle Ace
• Graduated in Computer
Engineering
• Solution Architect at Innive Inc
• ODI, Oracle and Java Certified
• Blogger @ devepm.com
4. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
What we'll learn
• What’s OCI
• What's OAC and Types of OAC
• What's DBCS and Types of DBCS
• Possible Architectures
• DBCS as OAC Source
• DBCS with ODI on it
• DBCS with ODI on premises
• On Premises as OAC Source
• DB/ODI on premise with Remote Connect/Data Gatway
• DB/ODI on premise with VPNaaS
• DB/ODI on premise with FastConnect
• Conclusion
6. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
What’s OCI and Types of OCI
• OCI Classic:
• Oracle Cloud Infrastructure Classic (OCI-C) is IaaS offering to provide Compute & Network
(Shared & IP Networks)
• OCI Classic is based on Nimbula Director (Xen based Hypervisor)
• OCI Classic provides only Virtual Machines (whereas OCI can also provide Bare Metal)
• OCI Classic can be deployed as a) Elastic Compute b) Dedicated Compute c) Sparc Model 300
• OCI
• Oracle Cloud Infrastructure (OCI) like OCI-C is also IaaS offering that provides Compute,
Network but as Virtual Cloud Network, Availability Domain and additionally Edge Services
like Email, DNS, Load Balancer etc.
• OCI provides both Bare Metal & Virtual Machines (whereas OCI-C provides only Virtual
Machine) Hypervisor in VM option of OCI is based on KVM (whereas on OCI-C this is Xen
based Hypervisor)
7. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
What's OAC and Types of OAC
• Oracle Analytics Cloud (OAC) is a scalable and secure public cloud service that
provides a full set of capabilities to explore and perform collaborative analytics
for you, your workgroup, and your enterprise
• OAC is available in three editions: Standard, Enterprise, and Essbase
• Each of this editions are available on Oracle Analytics Cloud, Oracle Analytics
Cloud Subscription, and Oracle Analytics Cloud - Classic
Edition Oracle Analytics Cloud
(Managed by Oracle)
Oracle Analytics Cloud Subscription
(Managed by Oracle)
Oracle Analytics Cloud – Classic
(Managed by You (Oracle User))
Standard Data Visualization Data Visualization Data Visualization
Essbase
Essbase Data Visualization
Essbase
Essbase Data Visualization
Essbase
Enterprise Data Visualization
Essbase
Business Intelligence
Business Intelligence (with Data
Visualization)
Data Visualization
Essbase
Business Intelligence
8. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
What's OAC and Types of OAC
• OAC instances are not self-containing and require some additional OCI services.
• The absolute minimum configuration is the following:
• Oracle Cloud Storage (OCS) - is used for backups, log files, etc.
• Oracle Cloud Database Instance (DBC) - is used for RCU schemas.
• Oracle Analytics Cloud Instance (OAC) - is our ultimate target.
• If you want to provide a public IP to you OAC you also need:
• Creating an IP Network
• Provisioning Load Balancer on an IP Network
9. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
What's DBCS and Types of DBCS
• Oracle Database Cloud Service provides you the ability to deploy
Oracle databases in the Cloud, with each database deployment
containing a single Oracle database or an Oracle Data Guard
Service Ideal Customer
Oracle Compute Cloud
Service
For customers who need a Cloud environment with complete control of Oracle software
installation and setup. This service also allows for “Bring Your Own License” for any Oracle
product.
Oracle Database Cloud -
Database as a Service -
Virtual Image
For customers who need pre-installed Oracle Database software with complete control over the
environment and do not require a running Oracle Database.
Oracle Database Cloud -
Database as a Service
For customers who need a pre-configured Oracle Database with complete control over the
environment, new Oracle Cloud automation tools and require a running Oracle Database.
Oracle Database Cloud -
Database Schema Service
For customers who need a development and deployment platform for Oracle Database and/or
browser based applications without SQL*Net access.
10. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Possible Architectures
• Since we must have a DBCS before we can install/config our OAC
instance, we should think about how we want our architecture to
look like
• We can have 2 different approaches for that:
OAC OAC
DBCS as OAC Source On Premises as OAC Source
On
Premise
On
Premise
V
P
N
RCU
OAC Sources
DW*
ETL Process*
ETL Process*
RCU
OAC Sources
ETL Process*
DBCS
DBCS
11. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DBCS as OAC Source
• DBCS will be the source of OAC
data
• DBCS needs to be powerful
enough to handle the work load
• We need to have a VPN between
the DBCS and our on premise DB
• If we choose to have the
“Compute” version of DBCS we
can use any VPN you may want
to install
• Use VPNaaS to integrate the
entire OCI with our data center
12. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DBCS with ODI on it
• If we want a 100% cloud solution we can choose the DBCS compute
solution and bring our own ODI license to it.
• Since we have a VPN between our DBCS and our on premises we
just need to install our ODI Agent on it and use it normally
• We can also install the ODI client to make the access faster
• With this approach we can:
• Not have a DB on premises*
• Not have a ODI on premises
• Connect in different source around the world (Different VPNs for each)
• Shared folder accessible from on premises
• FTPs to send file to and from it
13. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DBCS with ODI on it
• This solution moves the internet latency from the
data retrieval in OAC to the data load
• This means the end user experience would be
better
• Also it decreases the infra footprint
• Since the DBCS will be administrated by us, we still
need a DBA and an admin to handle the backups,
patches, ODI and everything else.
• All benefits to have a scalable architecture
provided by the cloud solutions are still present
OAC
On
Premise
ODI Agent
ODI Client
ETL Process
OAC RCU
DWs
DBCS
On
Premise
V
P
N
On
Premise
ODI
14. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DBCS with ODI on premises
• This solution is ideal to companies that already has a big
infra footprint and want to keep control over it
• It is basically the same solution as before but all the ETL
process were handle on premises and then loaded the
final DW data to DBCS
• Remove the need to have the Compute license for DBCS
• As well the possible need of DBA or anyone to handle
the DBCS admin tasks (Depending of the chosen service)
• Also moves the internet latency from the data retrieval
in OAC to the data load improving the user experience
OAC
On
Premise
OAC RCU
DWsDBCS
DW
V
P
N
On
Premise
ODI
15. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
On Premises as OAC Source
• On Premise DB will be the source of OAC data
• On Premise DB needs to be powerful enough to handle the work
load
• We can have 3 different “Tunnels” options between the On Premise
DB and OAC
• The internet needs to be very fast and stable
• The latency will be in the data retrieval instead of on the data load
16. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DB/ODI on Premise with Remote Connect
/Data Gatway
• Remote Data Connector works with the BI
Server Data Gateway running in the Oracle BI
Cloud Service environment to provide secure
access to on-premises data using private/public
key pairs and SSL communication.
• Remote Data Connector supports these on-
premises database types:
• Oracle, SQL Server, Teradata
• Each Oracle BI Cloud Service instance is
provisioned with a unique private key
• A public key is available for download from
Oracle BI Cloud Service Console
• This public key when deployed on Weblogic on-
premises will make the DB visible from the
Cloud
17. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
On
Premise
DB/ODI on Premise with Remote
Connect/Data Gatway
• OAC will request data from your on-premise databases using
the Remote Connect Weblogic Plugin (Webservice-like
service)
• That means our on-premise environment can continue the
same as before and no data needs to be replicated
• ODI will continue to load our data warehouse
• On OAC Version 105.3 (June release) Oracle introduced Data
Gateway that will replace Remote Connect.
• Remote Connect will still be available but oracle
recommend replace it in the next 6 months.
• Data Gateway basically replaces the Weblogic requirement
from remote connect.
OAC
RCU
DBCS
On
Premise
DW
ODI
Remote
Connect
18. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DB/ODI on Premise with VPNaaS
• We can use VPNaaS to create a
tunnel between our OCI
environment and our data
center
• With this we can have anything
inside our OCI accessing our on
premises databases (or other
services)
• These can be use in the DBCS
as Source architecture as well
19. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DB/ODI on Premise with VPNaaS
• After the VPN is set, anything that is in OCI will be able
to access our on premises environment
• That means if we already have a star schema set in our
on premises, we just need to point OAC to this schema
and use it as is
• This is ideal to companies that already has a big BI
infrastructure and want to make use of the cloud
capabilities without losing the existing architecture
• The internet needs to be very fast and stable
• The latency will be in the data retrieval instead of on
the data load
On
Premise
OAC
RCU
DBCS
On
Premise
DW
ODI
VPNaaS
20. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DB/ODI on Premise with FastConnect
• Oracle FastConnect is a network connectivity alternative to using
the public internet for connecting your network with Oracle Cloud
Infrastructure and other Oracle Cloud services
• FastConnect provides an easy, elastic, and economical way to
create a dedicated and private connection with higher bandwidth
options, and a more reliable and consistent networking experience
when compared to internet-based connections.
• With FastConnect we create a direct link between our data center
and the data center where your Oracle Cloud resources are
provisioned
22. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
DB/ODI on Premise with FastConnect
On
Premise
• With FastConnect we have a direct and exclusive link
outside the internet to connect our on-premise
environment with the datacenter where your Oracle
Cloud resources are provisioned
• We’ll have a secure and guarantee bandwidth
between our servers.
• ODI will continue to load our data warehouse
• OAC will access the on-premise DB directly
• No internet latency just the link latency
OAC
RCU
DBCS
On
Premise
DW
ODI
Fast
Connect
23. DevEpm.com
@RZGiampaoli
@RodrigoRadtke
@DEVEPM
Conclusion
• There’s no right or wrong architecture, but the best fit to our case
• As we can see there’re a range of solutions to integrate on
premises environments with OAC
• We can go full cloud, migrating our on premises architecture to
cloud, including ODI, and we can manage from there all data
needed
• Or we can leverage what we have on premises and just uses the
OAC analytics capability to work the data
• We also have a range of ways to link or environments
• You just need to find out what is the best one for you