O.co implemented Teradata Express on VMware to create virtual development and sandbox environments. This provided isolation for testing new technologies with minimal impact to production. Benefits included increased flexibility and the ability to more closely mimic production. Challenges included data size limitations, maintaining referential integrity across images, and performance on shared hardware. Initial projects showed success in validating new features ahead of upgrades. Next steps include improving access controls and automating image management.
Blue Medora Oracle Enterprise Manager (EM12c) Plug-in for PostgreSQLBlue Medora
This document describes a plugin developed by Blue Medora for monitoring PostgreSQL databases in Oracle Enterprise Manager 12c. The plugin extends the database monitoring capabilities of EM12c to PostgreSQL. It connects to PostgreSQL instances via remote JDBC connections without requiring an agent. The plugin provides dashboards, diagnostics, and nearly 200 metrics for monitoring PostgreSQL performance and configurations.
This document provides an overview and introduction to SQL Server 2012 high availability and disaster recovery features including log shipping, database mirroring, AlwaysOn availability groups, and SQL Server clustering. It begins with background about the author and an outline of the topics to be covered. The document then goes on to explain each high availability technology individually, providing details on how each works, when they should be used, and the configuration process. Business cases and recommendations for when to use each technology are also provided.
This document provides an overview of implementing failover clustering in Windows Server 2012. It discusses key concepts of failover clustering including high availability, cluster components, quorum, and storage. It also describes how to validate and configure a failover cluster, including hardware, software, and network requirements. Finally, it discusses configuring applications and services on a failover cluster through clustering roles and managing cluster resources.
If SQL Server is heart of our environment, his health should be very important, right? If SQL Server is important, his availability for our businesses (internal and external) is important to. For our customers doesn't matter where data are stored, how are stored and what we do with those data. Especially for our managers. The data must be available on demand, on time, at he moment of request. High Availability is our responsibility. How we can prepare our environment for HA? How HA is connected for with SLA? And why Service Level Agreement are important for us? In this session I want to discuss about HA options for SQL Server (2008, 2012), about our different customers, and about Service Level Agreement (formal or not).
This document discusses backup and recovery strategies for Oracle Exadata systems. It outlines the fundamental principles of backups including having multiple copies of data stored on different media with one copy offsite. It then describes the various backup options for Exadata, including using additional Exadata storage cells for the fastest backups, using a ZFS storage appliance for flexibility, or backing up to tape for economical long-term storage with removable offline copies. Key metrics like backup and restore speeds are provided for each option.
Dell efficiency through convergence - Dell Active InfrastructureKenneth de Brucq
Dell's Active Infrastructure aims to simplify IT infrastructure provisioning through convergence. It allows customers to build modular, integrated systems from compute, storage, networking and management blocks. Dell's Active System Manager provides automated workload and infrastructure deployment through a single pane of glass, simplifying service delivery. It also aims to accelerate delivering IT services with workload-optimized, automated infrastructure to lower costs and speed time to value.
CSD-2881 - Achieving System Production Readiness for IBM PureApplication SystemHendrik van Run
IBM IMPACT 2014 presentation
In this session we will take you through a number of best practices on how to achieve system production readiness. We will look at how to best configure the system, including key aspects such as Environment Profiles, Cloud Groups, IP Groups and Networking. We will also cover security such as integrating with LDAP, setting up appropriate authorisations, and auditing. And we will address monitoring, backup of the system and integration with IBM Endpoint Manager. We will show how a solid security setup facilitates the consolidation of production and non-production applications on the same system.
This document summarizes an SQL Server 2008 training course on implementing high availability features. It discusses database snapshots that allow querying from a point-in-time version of a database. It also covers configuring database mirroring, which provides redundancy by synchronizing a principal database to a mirror. Other topics include partitioned tables for improved concurrency, using SQL Agent proxies for job security, performing online index operations for minimal locking, and setting up mirrored backups.
Blue Medora Oracle Enterprise Manager (EM12c) Plug-in for PostgreSQLBlue Medora
This document describes a plugin developed by Blue Medora for monitoring PostgreSQL databases in Oracle Enterprise Manager 12c. The plugin extends the database monitoring capabilities of EM12c to PostgreSQL. It connects to PostgreSQL instances via remote JDBC connections without requiring an agent. The plugin provides dashboards, diagnostics, and nearly 200 metrics for monitoring PostgreSQL performance and configurations.
This document provides an overview and introduction to SQL Server 2012 high availability and disaster recovery features including log shipping, database mirroring, AlwaysOn availability groups, and SQL Server clustering. It begins with background about the author and an outline of the topics to be covered. The document then goes on to explain each high availability technology individually, providing details on how each works, when they should be used, and the configuration process. Business cases and recommendations for when to use each technology are also provided.
This document provides an overview of implementing failover clustering in Windows Server 2012. It discusses key concepts of failover clustering including high availability, cluster components, quorum, and storage. It also describes how to validate and configure a failover cluster, including hardware, software, and network requirements. Finally, it discusses configuring applications and services on a failover cluster through clustering roles and managing cluster resources.
If SQL Server is heart of our environment, his health should be very important, right? If SQL Server is important, his availability for our businesses (internal and external) is important to. For our customers doesn't matter where data are stored, how are stored and what we do with those data. Especially for our managers. The data must be available on demand, on time, at he moment of request. High Availability is our responsibility. How we can prepare our environment for HA? How HA is connected for with SLA? And why Service Level Agreement are important for us? In this session I want to discuss about HA options for SQL Server (2008, 2012), about our different customers, and about Service Level Agreement (formal or not).
This document discusses backup and recovery strategies for Oracle Exadata systems. It outlines the fundamental principles of backups including having multiple copies of data stored on different media with one copy offsite. It then describes the various backup options for Exadata, including using additional Exadata storage cells for the fastest backups, using a ZFS storage appliance for flexibility, or backing up to tape for economical long-term storage with removable offline copies. Key metrics like backup and restore speeds are provided for each option.
Dell efficiency through convergence - Dell Active InfrastructureKenneth de Brucq
Dell's Active Infrastructure aims to simplify IT infrastructure provisioning through convergence. It allows customers to build modular, integrated systems from compute, storage, networking and management blocks. Dell's Active System Manager provides automated workload and infrastructure deployment through a single pane of glass, simplifying service delivery. It also aims to accelerate delivering IT services with workload-optimized, automated infrastructure to lower costs and speed time to value.
CSD-2881 - Achieving System Production Readiness for IBM PureApplication SystemHendrik van Run
IBM IMPACT 2014 presentation
In this session we will take you through a number of best practices on how to achieve system production readiness. We will look at how to best configure the system, including key aspects such as Environment Profiles, Cloud Groups, IP Groups and Networking. We will also cover security such as integrating with LDAP, setting up appropriate authorisations, and auditing. And we will address monitoring, backup of the system and integration with IBM Endpoint Manager. We will show how a solid security setup facilitates the consolidation of production and non-production applications on the same system.
This document summarizes an SQL Server 2008 training course on implementing high availability features. It discusses database snapshots that allow querying from a point-in-time version of a database. It also covers configuring database mirroring, which provides redundancy by synchronizing a principal database to a mirror. Other topics include partitioned tables for improved concurrency, using SQL Agent proxies for job security, performing online index operations for minimal locking, and setting up mirrored backups.
This module discusses securing Windows servers using Group Policy Objects. It covers configuring security settings like templates, user rights, options and auditing. It also discusses restricting software using AppLocker and configuring the Windows Firewall. The lessons include demonstrations and labs on implementing these security configurations and restrictions.
VMworld 2013: IBM Solutions for VMware Virtual SAN VMworld
VMworld 2013
Eric Deadwyler, IBM
Joseph Russell, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Skylark aims to provide a generic platform which enables cloud applications to be easily deployed and accessed.
In the front-end, Skylark ports Spice to Xen and customizes Spice for application window delivery and display. Skylark users can start any application subscribed from Skylark application store and does not need to know whether it runs in Linux or Windows.
In the back-end, by providing Xen Image File System (Xen-IFS), multiple VMs are allowed to start up simultaneously from the same snapshot or the same disk image. Xen-IFS will automatically keep and isolate the private data produced by each VM.
Skylark makes it possible for Multiple User Single Installation (MUSI) among VMs, and also makes it easy for application delivery through remote VM access.
The document provides an introduction to SQL Azure, Microsoft's relational database service. It discusses how SQL Azure leverages existing SQL Server skills and tools while providing new cloud capabilities. Key points include SQL Azure being highly scaled and secure, providing a database as a service, and targeting scenarios such as departmental apps, web apps, and ISVs that need simple deployment and self-management. Architecturally, SQL Azure uses a shared infrastructure with scalable high availability technology.
Exadata provides fast, reliable backups using RMAN. However, challenges include shrinking backup windows and growing data sizes. The document discusses Exadata backup options like using additional Exadata storage cells or a ZFS Storage Appliance for the fastest and most flexible backups respectively. It covers various considerations for choosing a backup option like recovery time objectives and recovery point objectives. The ZFS Storage Appliance provides benefits like simplified management and integration with RMAN to ensure data integrity when backing up Exadata databases.
VMworld 2013: Automated Management of Tier-1 Applications on VMware VMworld
VMworld 2013
Jeremy Kuhnash, VMware
Scott Salyer, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
This document provides an overview of the DB2 10.1 Basic Database Administration Workshop for Linux, Unix and Windows. It introduces the instructor, Iqbal Goralwalla, who has extensive experience developing and working with DB2. The document discusses DB2 editions and key features, tools replaced in DB2 10 like Control Center, the new IBM Data Studio tool, and the DB2 instance and process models.
Microsoft Azure zmienia się. Jego częśc poświęcona bazie danych (Windows Azure SQL Database) zmienia się jeszcze szybciej. Podczas tej sesji chciałbym pokazac tym, którzy nie widzieli, oraz przypomniec tym, którzy już coś wiedzą - o co chodzi z WASD, jakie zmiany nastapiły i czego możemy po tej bazie oczekiwać. Dla odważnych będzie okazja podłączenia się do konta w chmurze i przetestowania ych rozwiązań samemu.
Solving the DB2 LUW Administration DilemmaRandy Goering
As a DB2 LUW Database Administrator you are probably reluctant to or prohibited from granting your users* these permissions because doing so gives them permission to other DB2 administrations tasks like stopping the database. If your users are not allowed to do these tasks then who is? Most likely, you, as the DBA will perform these and other administrative functions for your users. Would you like a way to eliminate these tasks from your daily to-do list? This presentation will discuss how to externalize specific administrative tasks with Stored Procedures, Federated procedures, Administrative SQL routines, and views.
The document discusses best practices for preparing for and surviving a disaster involving IT systems. It emphasizes the importance of being prepared through thorough backup and recovery procedures. Key aspects of preparation include having documented procedures for backup and restore of SQL and SharePoint environments, understanding roles and responsibilities, maintaining service level agreements, keeping an encrypted envelope of credentials, and ensuring necessary hardware, software, and support contracts are accounted for. The overall message is that with proper planning through documented policies and procedures, the impact of a disaster can be minimized.
VMWARE Professionals - Storage and ResourcesPaulo Freitas
This document provides an overview and comparison of virtualization capabilities in Windows Server 2012 Hyper-V and VMware vSphere 5.1. It discusses features related to storage, networking, high availability, scalability and performance. Key areas covered include virtual hard disk formats, live migration, quality of service, dynamic memory and more. Charts are provided comparing specific features between Hyper-V and vSphere. The document aims to help organizations evaluate virtualization options for their datacenter needs.
Planning For Catastrophe with IBM WAS and IBM BPMWASdev Community
This document discusses planning for disaster recovery of WebSphere Application Server and IBM Business Process Manager applications across multiple data centers. It covers various disaster recovery architecture options including active/passive and different active/active models. Key considerations for recovering WebSphere Application Server and IBM BPM applications are discussed such as using backup/restore of configuration files, transaction log replay, and message queue recovery. The importance of having independent cells aligned with data center boundaries is emphasized to avoid a single failure impacting both sites.
VMworld 2013: Demystifying VMware Mirage: Tips and Tricks for Success VMworld
VMworld 2013
Simon Long, VMware
Justin Venezia, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Citrix CloudGateway 2.5 Technical Overview and TroubleshootingDavid McGeough
This is part of the Citrix Support Secrets Webinar Series.
CloudGateway is an enterprise mobility management solution that securely delivers mobile, web and Windows apps and data. This webinar will cover an overview of the features in CloudGateway 2.5, different options for deploying CloudGateway and troubleshooting. Join this webinar to learn about CloudGateway.
What you will learn:
- What is CloudGateway
- What’s new on CloudGateway 2.5
- Deployment scenarios
- Troubleshooting
This webinar took place on January 24th 2013, recording here
https://www1.gotomeeting.com/register/683430680
The document provides information about three Microsoft resources for technical training and software evaluation: the TechNet Evaluation Center, IT Camps, and Microsoft Virtual Academy. The TechNet Evaluation Center allows downloading free trials of Microsoft software. IT Camps are free, hands-on technical training events led by Microsoft experts. Microsoft Virtual Academy provides free online technical courses on Microsoft technologies.
Living with the Oracle Database ApplianceSimon Haslam
A presentation about real world experiences of running Oracle Database Appliances (ODA VP) in production for nearly 2 years. Given by Simon Haslam and Peter Moore, Principal DBA at Simplyhealth (a long time Veriton customer), at the UKOUG Systems Event in London on 20 May 2015.
Sql Server High Availability & DR TechnologiesRockSolid SQL
There are many different disaster recovery and high availability options for SQL Server. Making decisions on the most effective DR & HA strategies can be complex, especially when you throw into the mix various SAN and network topologies.
This presentation is focused on the management and operational decisions that are made when planning DR and HA for production SQL Server environments. It is targeted towards Senior DBAs, CIO, IT Manager, database services managers.
Topics include:
Log Shipping
Database Mirroring
Always On High Availability groups
Replication
Clustering
Licensing
The document discusses strategies for transitioning from monolithic architectures to microservice architectures. It outlines some of the challenges with maintaining large monolithic applications and reasons for modernizing, such as handling more data and needing faster changes. It then covers microservice design principles and best practices, including service decomposition, distributed systems strategies, and reactive design. Finally it introduces Lagom as a framework for building reactive microservices on the JVM and outlines its key components and development environment.
VMworld 2013: Virtualizing Databases: Doing IT Right VMworld
VMworld 2013
Michael Corey, Ntirety, Inc
Jeff Szastak, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
This module discusses securing Windows servers using Group Policy Objects. It covers configuring security settings like templates, user rights, options and auditing. It also discusses restricting software using AppLocker and configuring the Windows Firewall. The lessons include demonstrations and labs on implementing these security configurations and restrictions.
VMworld 2013: IBM Solutions for VMware Virtual SAN VMworld
VMworld 2013
Eric Deadwyler, IBM
Joseph Russell, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Skylark aims to provide a generic platform which enables cloud applications to be easily deployed and accessed.
In the front-end, Skylark ports Spice to Xen and customizes Spice for application window delivery and display. Skylark users can start any application subscribed from Skylark application store and does not need to know whether it runs in Linux or Windows.
In the back-end, by providing Xen Image File System (Xen-IFS), multiple VMs are allowed to start up simultaneously from the same snapshot or the same disk image. Xen-IFS will automatically keep and isolate the private data produced by each VM.
Skylark makes it possible for Multiple User Single Installation (MUSI) among VMs, and also makes it easy for application delivery through remote VM access.
The document provides an introduction to SQL Azure, Microsoft's relational database service. It discusses how SQL Azure leverages existing SQL Server skills and tools while providing new cloud capabilities. Key points include SQL Azure being highly scaled and secure, providing a database as a service, and targeting scenarios such as departmental apps, web apps, and ISVs that need simple deployment and self-management. Architecturally, SQL Azure uses a shared infrastructure with scalable high availability technology.
Exadata provides fast, reliable backups using RMAN. However, challenges include shrinking backup windows and growing data sizes. The document discusses Exadata backup options like using additional Exadata storage cells or a ZFS Storage Appliance for the fastest and most flexible backups respectively. It covers various considerations for choosing a backup option like recovery time objectives and recovery point objectives. The ZFS Storage Appliance provides benefits like simplified management and integration with RMAN to ensure data integrity when backing up Exadata databases.
VMworld 2013: Automated Management of Tier-1 Applications on VMware VMworld
VMworld 2013
Jeremy Kuhnash, VMware
Scott Salyer, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
This document provides an overview of the DB2 10.1 Basic Database Administration Workshop for Linux, Unix and Windows. It introduces the instructor, Iqbal Goralwalla, who has extensive experience developing and working with DB2. The document discusses DB2 editions and key features, tools replaced in DB2 10 like Control Center, the new IBM Data Studio tool, and the DB2 instance and process models.
Microsoft Azure zmienia się. Jego częśc poświęcona bazie danych (Windows Azure SQL Database) zmienia się jeszcze szybciej. Podczas tej sesji chciałbym pokazac tym, którzy nie widzieli, oraz przypomniec tym, którzy już coś wiedzą - o co chodzi z WASD, jakie zmiany nastapiły i czego możemy po tej bazie oczekiwać. Dla odważnych będzie okazja podłączenia się do konta w chmurze i przetestowania ych rozwiązań samemu.
Solving the DB2 LUW Administration DilemmaRandy Goering
As a DB2 LUW Database Administrator you are probably reluctant to or prohibited from granting your users* these permissions because doing so gives them permission to other DB2 administrations tasks like stopping the database. If your users are not allowed to do these tasks then who is? Most likely, you, as the DBA will perform these and other administrative functions for your users. Would you like a way to eliminate these tasks from your daily to-do list? This presentation will discuss how to externalize specific administrative tasks with Stored Procedures, Federated procedures, Administrative SQL routines, and views.
The document discusses best practices for preparing for and surviving a disaster involving IT systems. It emphasizes the importance of being prepared through thorough backup and recovery procedures. Key aspects of preparation include having documented procedures for backup and restore of SQL and SharePoint environments, understanding roles and responsibilities, maintaining service level agreements, keeping an encrypted envelope of credentials, and ensuring necessary hardware, software, and support contracts are accounted for. The overall message is that with proper planning through documented policies and procedures, the impact of a disaster can be minimized.
VMWARE Professionals - Storage and ResourcesPaulo Freitas
This document provides an overview and comparison of virtualization capabilities in Windows Server 2012 Hyper-V and VMware vSphere 5.1. It discusses features related to storage, networking, high availability, scalability and performance. Key areas covered include virtual hard disk formats, live migration, quality of service, dynamic memory and more. Charts are provided comparing specific features between Hyper-V and vSphere. The document aims to help organizations evaluate virtualization options for their datacenter needs.
Planning For Catastrophe with IBM WAS and IBM BPMWASdev Community
This document discusses planning for disaster recovery of WebSphere Application Server and IBM Business Process Manager applications across multiple data centers. It covers various disaster recovery architecture options including active/passive and different active/active models. Key considerations for recovering WebSphere Application Server and IBM BPM applications are discussed such as using backup/restore of configuration files, transaction log replay, and message queue recovery. The importance of having independent cells aligned with data center boundaries is emphasized to avoid a single failure impacting both sites.
VMworld 2013: Demystifying VMware Mirage: Tips and Tricks for Success VMworld
VMworld 2013
Simon Long, VMware
Justin Venezia, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Citrix CloudGateway 2.5 Technical Overview and TroubleshootingDavid McGeough
This is part of the Citrix Support Secrets Webinar Series.
CloudGateway is an enterprise mobility management solution that securely delivers mobile, web and Windows apps and data. This webinar will cover an overview of the features in CloudGateway 2.5, different options for deploying CloudGateway and troubleshooting. Join this webinar to learn about CloudGateway.
What you will learn:
- What is CloudGateway
- What’s new on CloudGateway 2.5
- Deployment scenarios
- Troubleshooting
This webinar took place on January 24th 2013, recording here
https://www1.gotomeeting.com/register/683430680
The document provides information about three Microsoft resources for technical training and software evaluation: the TechNet Evaluation Center, IT Camps, and Microsoft Virtual Academy. The TechNet Evaluation Center allows downloading free trials of Microsoft software. IT Camps are free, hands-on technical training events led by Microsoft experts. Microsoft Virtual Academy provides free online technical courses on Microsoft technologies.
Living with the Oracle Database ApplianceSimon Haslam
A presentation about real world experiences of running Oracle Database Appliances (ODA VP) in production for nearly 2 years. Given by Simon Haslam and Peter Moore, Principal DBA at Simplyhealth (a long time Veriton customer), at the UKOUG Systems Event in London on 20 May 2015.
Sql Server High Availability & DR TechnologiesRockSolid SQL
There are many different disaster recovery and high availability options for SQL Server. Making decisions on the most effective DR & HA strategies can be complex, especially when you throw into the mix various SAN and network topologies.
This presentation is focused on the management and operational decisions that are made when planning DR and HA for production SQL Server environments. It is targeted towards Senior DBAs, CIO, IT Manager, database services managers.
Topics include:
Log Shipping
Database Mirroring
Always On High Availability groups
Replication
Clustering
Licensing
The document discusses strategies for transitioning from monolithic architectures to microservice architectures. It outlines some of the challenges with maintaining large monolithic applications and reasons for modernizing, such as handling more data and needing faster changes. It then covers microservice design principles and best practices, including service decomposition, distributed systems strategies, and reactive design. Finally it introduces Lagom as a framework for building reactive microservices on the JVM and outlines its key components and development environment.
VMworld 2013: Virtualizing Databases: Doing IT Right VMworld
VMworld 2013
Michael Corey, Ntirety, Inc
Jeff Szastak, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Cloud Hosting for Government Agencies: Drupal Platform as a ServiceAcquia
This document provides an overview of Acquia Managed Cloud, a Platform as a Service for hosting Drupal applications. It discusses how Acquia Managed Cloud handles the full lifecycle of Drupal applications, including setup, deployment, updates, operations, and diagnosing and resolving issues. Acquia Managed Cloud provides automated configuration management, optimization services, monitoring, development practices, and expert support to ensure Drupal applications are secure, scalable and high-performance. The document also discusses how Acquia Managed Cloud achieves compliance with US government standards like FISMA and FedRAMP for federal agencies through a shared responsibility model and extensive security documentation.
The document provides best practices for deploying SUSE CaaS Platform. It discusses requirements like hardware needs, software subscriptions required, and support options. It covers planning and sizing considerations like cluster topology and disk space needs. Deployment best practices include steps like preparing the infrastructure, installing base software, verifying the infrastructure, installing CaaS Platform, and deploying Kubernetes addons. Testing and operations topics like monitoring, logging, backups are also covered.
VMworld Europe 2014: Virtualizing Databases Doing IT Right – The SequelVMworld
This document provides disclaimers and information about upcoming product features that may change. It states that any new features discussed are not commitments and are subject to change based on technical feasibility and market demand. Pricing and packaging for new technologies have not been determined. The document then introduces two speakers and their backgrounds working with databases and virtualization.
VMworld 2013: Three Advantages of Running Cloud Foundry in a VMware Private C...VMworld
VMworld 2013
Tarik Dwiek, EMC
Steve Flanders, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
How does Apache Pegasus (incubating) community develop at SensorsDataacelyc1112009
A presentation in ApacheCon Asia 2022 from Dan Wang and Yingchun Lai.
Apache Pegasus is a horizontally scalable, strongly consistent and high-performance key-value store.
Know more about Pegasus https://pegasus.apache.org, https://github.com/apache/incubator-pegasus
Data Lake and the rise of the microservicesBigstep
By simply looking at structured and unstructured data, Data Lakes enable companies to understand correlations between existing and new external data - such as social media - in ways traditional Business Intelligence tools cannot.
For this you need to find out the most efficient way to store and access structured or unstructured petabyte-sized data across your entire infrastructure.
In this meetup we’ll give answers on the next questions:
1. Why would someone use a Data Lake?
2. Is it hard to build a Data Lake?
3. What are the main features that a Data Lake should bring in?
4. What’s the role of the microservices in the big data world?
The document summarizes new features in JBoss Operations Network (JBoss ON), including:
1) New chart types have been added to visualize metrics data. Storage nodes using Cassandra have also been added to improve scalability of storing large volumes of metrics data in a distributed manner.
2) Finer-grained bundle permissions allow restricting bundle creation, deployment and management based on resource groups and roles.
3) The REST API is now fully supported for both retrieving and inputting configuration data to enable out-of-band processing.
4) Upcoming versions of JBoss ON aim to reduce the agent footprint, improve support for EAP 6, and integrate with the Red Hat Access portal.
Oracle offers several database cloud services including Oracle Database Cloud Service, Oracle Exadata Cloud Service, Oracle Database Backup Service, and Oracle Database Schema Service. These services provide automated infrastructure, database administration, and tools for application development, testing database applications, testing database upgrades, disaster recovery, and a hybrid cloud environment with the same database software both on-premises and in the cloud.
Running database infrastructure on containersMariaDB plc
This document discusses running MariaDB databases on containers and Kubernetes. It begins with an agenda and overview of the promise of containers in providing consistency, control and addressing challenges with existing deployment models. It then covers Kubernetes for orchestration and management of containers. Specifics are provided around running MariaDB databases within containers, including using StatefulSets and services for high availability clusters. Challenges with databases in containers are also addressed, along with directions for using YAML templates and a Kubernetes operator to simplify deployment of MariaDB topologies at scale.
Adding Value in the Cloud with Performance TestRodolfo Kohn
This document discusses the importance of performance testing cloud applications and outlines best practices for defining performance requirements, testing methodology, and identifying issues. It provides examples of performance problems found in databases, applications, operating systems, and networks. The key goals of performance testing are to understand system behavior under load, find bottlenecks and hidden bugs, and verify that requirements are met.
"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009eLiberatica
This is a presentation held at eLiberatica 2009.
http://www.eliberatica.ro/2009/
One of the biggest events of its kind in Eastern Europe, eLiberatica brings community leaders from around the world to discuss about the hottest topics in FLOSS movement, demonstrating the advantages of adopting, using and developing Open Source and Free Software solutions.
The eLiberatica organizational committee together with our speakers and guests, have graciously allowed media representatives and all attendees to photograph, videotape and otherwise record their sessions, on the condition that the photos, videos and recordings are licensed under the Creative Commons Share-Alike 3.0 License.
This document summarizes lessons learned from migrating a Department of Defense application to Oracle Exadata. Key points include:
1) Exadata provided significantly better performance than the legacy configuration for data exports, maintenance processes, and reporting.
2) Thorough testing is required due to Exadata's unique architecture and configuration best practices.
3) Communication with the hosting center is important to ensure they can support Exadata's size and power requirements.
4) Smart scan and other Exadata optimizations like enhanced hybrid columnar compression provide substantial performance benefits if properly configured.
Sql Start! 2020 - SQL Server Lift & Shift su AzureMarco Obinu
Slide of the session delivered during SQL Start! 2020, where I illustrate different approaches to determine the best landing zone for you SQL Server workloads.
Video (ITA): https://youtu.be/1hqT_xHs0Qs
Henry Huang proposes a quick solution to deploy development and QA environments using automation. Current efforts face problems with partial setups, unique resources, and resource cleanup. Huang demonstrates a prototype that allows one-click deployment of services using templates for configuration, dependencies, and resource prefixes/suffixes. The prototype brings automation to efforts around service learning, partial setups, and resource cleanup. Huang discusses lessons learned around seamless upgrades, configuration formats, CloudFormation issues, and instance bootstrapping scalability. The goal is to develop drag-and-drop deployment of services.
Similar to Teradata Partners 2011 - Utilizing Teradata Express For Development And Sandboxing (20)
2. Agenda
• Company Background and EDW Configuration
• Why Virtualize?
• Virtual Environment Details
• Benefits
• Challenges
• Results
• Next Steps
• Questions
3. About O.co
• Initial focus on liquidating excess inventory and currently
focus on offering brand-name merchandise at discount prices
• Products offering has grown from less than 100 in 1999 to
over 700,000 currently
• Customer Service – Currently ranked #4 by National Retail
Federation and American Express
• O.co, also known as Overstock.com, is Your Savings Engine offering
brand-name products. The company offers its customers an
opportunity to shop for bargains conveniently, while offering its
suppliers an alternative inventory distribution channel. O.co,
headquartered in Salt Lake City, is a publicly traded company listed on
the NASDAQ Global Market System and can be found online at
www.overstock.com and www.o.co.
6. Abstract & Motives
• Test system currently functions as both development and test
environments
• Creates inconsistent object names between environments
• Evaluating the limits and boundaries of new technology
offerings
• Enable Test system to more closely resemble production
• Functional testing and development
7. Other Considerations for Virtualization
• Performance
• Decreased load and demands on EDW systems
• Availability
• Additional flexibility for scheduling system maintenance
• Isolation & Sandbox
• Budget
• Commodity hardware
9. VMware ESXi
• Installs directly on physical servers and partitions into
multiple virtual machines that can be run simultaneously
• Currently utilizing ESXi 4.0 cluster
• Can clone and deploy additional images from master
templates
• Requires administrator interaction to clone and perform
basic configuration steps
• Provides workload management and automatic migration
between hosts on cluster
• “Plug & Play” install of new TD Express images
• SAN Storage
• Tier 2 SAN Storage (10K RPM SAS)
10. TD Express
• Free developer version of the Teradata Database
• 1 TB Teradata Express 13.10 for VMware Player
• Provided configuration includes
• SLES 10 64-bit Linux
• Teradata Database
• Teradata Tools and Utilities (TTU)
• Load & Unload Tools
• Teradata’s EasyLoader tool
• SQL Assistant Java Edition
• Provided AS IS (Unsupported)
12. Benefits
• Secure
• Data never outside corporate datacenters
• Testing
• Uncertified software ahead of upgrades
• New features
• BAR/Disaster Recovery
• Able to connect externally using existing TTU
• Developer Isolation & Sandboxes
13. Additional Benefits
• Educational playground
• Additional exposure to internal processes and programs
• New features & functionality
• Growth & capacity planning
• Additional hardware (Nodes)
• Additional storage
14. Environment Isolation
• Allows for greater flexibility in testing and development
• Reduces contention on frequently updated and accessed
objects
• Experimentation
• New processes, programs & functionality
• UDF’s
• Safe
• Snapshot functionality
• Regression testing
16. Database Administration Challenges
• Synchronizing and Migrating DDL
• TSET
• Data Movement
• BAR (Arcmain)
• Data Mover
• ETL (Fastload, TPT, Multiload, etc..)
• Performance
• Limited to 2 AMP’s
• Hardware configuration
• Shared hardware
• Data Distribution/Skew
17. Security & Access
• Maintain an environment representative of the enterprise
Teradata systems
• Simplify roles and rights to limit maintenance overhead on
multiple virtual machines
• Consolidate users on virtual machines
• Corporate security considerations (SSO, etc…)
18. 1 TB Perm Space Limitation
• Try to minimize base image size to limit disk space overhead
• Allow developers to load larger datasets as needed
• Varying projects require vastly different data sets
19. Perm Space Limitation – Solution 1
Limited Data Set
• Seed smaller base objects (Lookup/Dimensions) in full
• Larger tables can be seeded partially or left empty (DDL only)
• Maintaining referential integrity can be challenging
• Still may not be able to provide enough data for functional
testing in very large environments
• May enable limited integration testing in DEV environment
• Larger storage footprint
20. Perm Space Limitation – Solution 2
Break Virtual Images into Subject Areas
• Can be difficult to identify and maintain objects
• Duplicate Objects
• Same objects required across multiple subject areas (3NF)
• Not feasible for all subject areas
• Referential integrity across subject areas
• Merging DDL changes back to trunk
• Integration testing may not be possible
21. Perm Space Limitation – Solutions 3 & 4
Ad hoc – Self Service
• Allows for greater flexibility in data size
• Requires self service options to limit administrative overhead
• Additional work involved for developers to prepare environment
• Unit testing only - Integration testing not possible
Materialize Queries – BI/Reporting Only
• Limited to report development only
• Better performance for multiple query executions during
reporting development (Cube, Grid & Report refreshes)
• SQL would not be consistent between environments
• Requires self service options to be implemented
22. Other Challenges
• Development & Deployment Lifecycle
• Image Management
• Version Control
• Library (Check in/out)
• Refresh Interval
• Migration and Project Planning
23. Support Considerations
• DBA
• Architecture
• Self Service
• External Groups
• VMware systems
• Storage
• Network
25. Achievements
• Testing new features and functionality ahead of 13.10 upgrade
• Conduct proof of concept testing with minimal impact to
enterprise systems
• Ability to perform preliminary process validation
• Currently rolling out to ETL Developers
• Endpoint Testing
• Integration into ETL infrastructure
• TTU Tools Validation
26. Successful Projects
• Oracle Data Integrator (ODI/Sunopsis )
• Hadoop UDFs – Full Development Lifecycle
• Proof of Concept
• Development
• Testing & Validation
• GoldenGate Testing & Validation
27. Lessons Learned and Takeaways
• Security & Access Controls
• Decide early on how to simplify roles and consolidate users
• Mixed response from end users and developers
• Perform limited Beta testing with mixed selection of users
• Data seeding challenges
• Perm Space Limitations
• Refresh Method
• Throughput
• Refresh Intervals
• System Requirements
• IP Addresses
• Hosts file entries
• Keep it simple!
28. Hardware Resource Allocation
• 2 Core Minimum (x64 CPU)
• 2 GB Memory Minimum
• 4 GB suggested for acceptable performance
• Static IP Addresses
• Encountered issues with VMware dynamically assigning IP
addresses as images migrated between hosts
• Physical Network Connections
• Ensure adequate bandwidth for all Virtual Machines on the
physical host
• Storage
• Tier 2 SAN (10K Serial Attached SCSI)
• Workload Management
• Disk I/O
• Concurrent Users
• Dedicated Virtual Environment
29. End User/Developer Considerations
• Deployment procedures and processes
• Well defined image life cycle & refresh interval
• Training
• Best Practices Guide
• Constraints
• Perm space
• Limited Data Set
• Storage
• Performance
• 2 Amps
• Shared Hardware
• Skew
• Unit Testing Only
31. Data Discovery
(Source)
Refresh
Checkout and
Development
Configure
Images (Virtual
Virtual Machine
Machine)
Development Lifecycle
Production Development &
Deployment Unit Testing
(Enterprise (Virtual
Systems) Machine)
Integration
Testing & QA
(Enterprise
Systems)
33. Next Steps
• Developer and End user Access Levels
• System Level
• Database Level
• Automation
• Master Image Updates
• Viewpoint
• Data Mover -> Self Service
• Full Deployment
• Decommission existing DEV environment
34. Next Steps – VMware Environment
• SAN Storage
• NetApp Storage Solution
• Enables the ability to quickly clone Virtual Machines
without consuming additional space
• Capacity Planning
• Thin Provisioning
• VMware Lab Manager
• Reduced administration
• Self service portal
• Better support for high turnover machines
• Linked machines (de-duplication)
36. Virtual Self Service Environment
Developers
Image 1 Users select an available
image from library
Image 2
Image 3
Image 4
Image 5 Image is copied from
Image 6 library and place in
Image is started in
an available slot on
virtual environment
VMware Cluster
and ready for use
Image Library
Image 1 Image 2 Image 4
Image 3 Image 1 Image 1
Administrator Image 2 Image 6
Image 5
Creates and Maintains Library
Snapshot
VMware Cluster
37. Summary
• Provides isolated sandbox for testing and development
• Safe and secure environment
• Provided by Teradata
• Supports Teradata Tools and Utilities (TTU)
• Works with existing Teradata infrastructure
• Scales easily with additional users & projects
• 1 TB perm space constraint can be challenging
• Cannot be used for performance testing or tuning
• Decreases loads on enterprise systems
• Budget considerations
• Runs on commodity hardware & disk