CERN Agile Infrastructure, Road to ProductionSteve Traylen
This document summarizes CERN's efforts to implement an agile infrastructure using open source configuration tools like Puppet, Foreman, and OpenStack. It describes CERN's motivation to adopt these tools to better manage their increasing server needs. It provides details on the implementation of the Puppet and OpenStack components and outlines next steps to expand use and scale of the agile infrastructure project.
Solaris cluster roadshow day 2 technical presentationxKinAnx
The document summarizes Solaris Cluster solutions for Oracle deployments. It discusses the Data Service Configuration Wizard which provides wizards to simplify configuration of highly available services like Oracle, Apache, NFS, and SAP. It also covers Solaris Cluster for Oracle RAC, including the Oracle RAC configuration wizard and manageability features in Solaris Cluster 3.2. Finally, it presents the benefits of Solaris Cluster Advanced Edition for Oracle RAC which provides a shared file system and clustered volume manager for RAC deployments.
This document discusses using the Data Distribution Service (DDS) middleware for video streaming in an unmanned aerial vehicle (UAV) image exploitation system. It outlines how DDS enables location transparency and redundancy for transmitting sensor data like video over topics with quality of service guarantees. Specifically, it proposes encapsulating MPEG-2 transport stream packets within DDS data types and topics to stream live and recorded UAV video footage in a decentralized manner using DDS.
This document compares Oracle Exadata and Teradata architectures. It summarizes that Exadata uses a two-tier architecture with shared memory and disk, while Teradata uses a shared-nothing architecture. It notes several advantages of Teradata including unconditional parallelism, linear scalability, and more automatic workload management compared to Exadata which requires more manual workload separation and resource tuning. The document also discusses higher support costs and a steeper learning curve for Exadata compared to Teradata.
Engineered Systems: Oracle’s Vision for the FutureBob Rhubart
Oracle’s Exadata and Exalogic are impressive products in their own right. But working in combination they deliver unparalleled transaction processing performance with up to a 30x increase over existing legacy systems, with the lowest cost of ownership over a 3 or 5 year basis than any other hardware. In this session you’ll learn how to leverage Oracle’s Engineered Systems within your enterprise to deliver record-breaking performance at the lowest TCO.
(As presented by Kelly Goetsch at
The document describes the OGCE WorkflowSuite, which provides tools for composing and executing scientific workflows. It includes the Generic Service Toolkit for wrapping applications as web services, the XRegistry for information sharing, and XBaya for graphical workflow composition and monitoring. Workflows can integrate various resources and be made flexible, dynamic, and interoperable. Example applications discussed are weather forecasting, genome analysis, and computational evaluation.
The document discusses various aspects of configuring and managing high availability applications in an Oracle RAC environment. It covers creating an application VIP, registering an application as a cluster resource, defining dependencies, and scheduling methods. Specific examples provided include configuring HP Data Protector for high availability and creating an HA instance of Apache Tomcat.
This document discusses Oracle TimesTen In-Memory Database 11g. It provides three examples of how TimesTen is used: for prepaid mobile rating, electronic trading, and dynamic personalization. TimesTen provides an in-memory database with full relational capabilities that is optimized for extremely fast performance. It can be deployed either as an in-memory "cache" for an online transactional processing (OLTP) application or as a standalone database. TimesTen delivers lightning fast response times measured in microseconds rather than milliseconds, along with linear scalability on multi-processor hardware.
CERN Agile Infrastructure, Road to ProductionSteve Traylen
This document summarizes CERN's efforts to implement an agile infrastructure using open source configuration tools like Puppet, Foreman, and OpenStack. It describes CERN's motivation to adopt these tools to better manage their increasing server needs. It provides details on the implementation of the Puppet and OpenStack components and outlines next steps to expand use and scale of the agile infrastructure project.
Solaris cluster roadshow day 2 technical presentationxKinAnx
The document summarizes Solaris Cluster solutions for Oracle deployments. It discusses the Data Service Configuration Wizard which provides wizards to simplify configuration of highly available services like Oracle, Apache, NFS, and SAP. It also covers Solaris Cluster for Oracle RAC, including the Oracle RAC configuration wizard and manageability features in Solaris Cluster 3.2. Finally, it presents the benefits of Solaris Cluster Advanced Edition for Oracle RAC which provides a shared file system and clustered volume manager for RAC deployments.
This document discusses using the Data Distribution Service (DDS) middleware for video streaming in an unmanned aerial vehicle (UAV) image exploitation system. It outlines how DDS enables location transparency and redundancy for transmitting sensor data like video over topics with quality of service guarantees. Specifically, it proposes encapsulating MPEG-2 transport stream packets within DDS data types and topics to stream live and recorded UAV video footage in a decentralized manner using DDS.
This document compares Oracle Exadata and Teradata architectures. It summarizes that Exadata uses a two-tier architecture with shared memory and disk, while Teradata uses a shared-nothing architecture. It notes several advantages of Teradata including unconditional parallelism, linear scalability, and more automatic workload management compared to Exadata which requires more manual workload separation and resource tuning. The document also discusses higher support costs and a steeper learning curve for Exadata compared to Teradata.
Engineered Systems: Oracle’s Vision for the FutureBob Rhubart
Oracle’s Exadata and Exalogic are impressive products in their own right. But working in combination they deliver unparalleled transaction processing performance with up to a 30x increase over existing legacy systems, with the lowest cost of ownership over a 3 or 5 year basis than any other hardware. In this session you’ll learn how to leverage Oracle’s Engineered Systems within your enterprise to deliver record-breaking performance at the lowest TCO.
(As presented by Kelly Goetsch at
The document describes the OGCE WorkflowSuite, which provides tools for composing and executing scientific workflows. It includes the Generic Service Toolkit for wrapping applications as web services, the XRegistry for information sharing, and XBaya for graphical workflow composition and monitoring. Workflows can integrate various resources and be made flexible, dynamic, and interoperable. Example applications discussed are weather forecasting, genome analysis, and computational evaluation.
The document discusses various aspects of configuring and managing high availability applications in an Oracle RAC environment. It covers creating an application VIP, registering an application as a cluster resource, defining dependencies, and scheduling methods. Specific examples provided include configuring HP Data Protector for high availability and creating an HA instance of Apache Tomcat.
This document discusses Oracle TimesTen In-Memory Database 11g. It provides three examples of how TimesTen is used: for prepaid mobile rating, electronic trading, and dynamic personalization. TimesTen provides an in-memory database with full relational capabilities that is optimized for extremely fast performance. It can be deployed either as an in-memory "cache" for an online transactional processing (OLTP) application or as a standalone database. TimesTen delivers lightning fast response times measured in microseconds rather than milliseconds, along with linear scalability on multi-processor hardware.
This document discusses database cloning using copy-on-write technologies like thin cloning to minimize storage usage. It describes how traditional cloning requires fully copying database files versus thin cloning which only writes modified blocks. Methods covered include CloneDB, Snap Manager Utility, ZFSSAADM, and cloning pluggable databases using ZFS and ACFS snapshots. Direct NFS is highlighted as an optimal network storage solution for database cloning.
The document summarizes the keynote presentation by Hubert Yoshida, VP and CTO of Hitachi Data Systems, given at the Sun Storage Academy in August 2007. It discusses the growth of storage capacity needs and costs, issues with outdated storage architectures, and benefits of the Hitachi storage virtualization platform including non-disruptive data migration between storage tiers, reduced costs through thin provisioning and backup optimization, and consolidation of different storage systems and applications on a common platform.
The document describes Oracle Exadata Version 2, which is positioned as the world's fastest machine for online transaction processing (OLTP). Version 2 features faster CPUs, networking, disks, and flash storage compared to Version 1. It provides extreme performance for random I/O workloads through its use of solid-state drive (SSD) flash memory caches. Customers saw performance improvements of 10-72x on their queries with Exadata compared to previous systems.
This document discusses Greenplum Database on HDFS (GOH). It provides an introduction and overview of GOH's architecture, features, and performance. Key points include that GOH allows Greenplum to use HDFS for storage, provides pluggable storage support, and full transaction support for tables on HDFS. It also notes challenges around supporting many concurrent queries due to limitations of the current Java-based HDFS client, and possibilities for addressing this.
Deep dive storage networking the path to performanceInterop
The document discusses storage networking performance. It outlines key performance elements like bit rate, bandwidth, latency and throughput. It explains different networking technologies like circuit switching, packet switching, TCP/IP offload engines and virtualization. Disk technologies and their impact on performance are also covered. The document compares different protocols like iSCSI, Fibre Channel and FCoE and analyzes their overhead and effective data rates.
Strata + Hadoop World 2012: HDFS: Now and FutureCloudera, Inc.
Hadoop 1.0 is a significant milestone in being the most stable and robust Hadoop release tested in production against a variety of applications. It offers improved performance, support for HBase, disk-fail-in-place, Webhdfs, etc over previous releases. The next major release, Hadoop 2.0 offers several significant HDFS improvements including new append-pipeline, federation, wire compatibility, NameNode HA, further performance improvements, etc. We describe how to take advantages of the new features and their benefits. We also discuss some of the misconceptions and myths about HDFS.
Eclipse Swordfish is an open source SOA runtime framework based on Eclipse Equinox. It provides a framework for integrating additional open source components like a service registry, messaging system, and process engine to form a comprehensive SOA runtime environment. Swordfish supports relevant SOA standards including SCA, JBI, and OSGi. It adds functionality like policies, monitoring, and configuration to complement components like ServiceMix. The project has 5 committers working on it and version 1.0M3 has been released with the goal of inclusion in Eclipse Galileo in June 2009.
[NetPonto] Arquitectura dos Serviços da plataforma Windows AzureVitor Tomaz
The document summarizes the architecture of Windows Azure services. It discusses how Windows Azure provides scalable and reliable cloud services through its datacenter infrastructure and platform services. Key points include:
- Windows Azure uses a multi-tenant datacenter architecture with fault domains and update domains to provide high availability.
- The storage architecture uses a partitioned and replicated design to store and access blobs, tables, queues and files in a reliable manner.
- SQL Azure provides a scalable relational database service running on top of the Windows Azure infrastructure, with automatic replication and failover.
Innovations in Apache Hadoop MapReduce Pig Hive for Improving Query PerformanceDataWorks Summit
Apache Hadoop and its ecosystem projects Hive and Pig support interactions with data sets of enormous sizes. Hadoop always excelled at large-scale data processing; however, running smaller queries has been problematic due to the batch-oriented nature of the system. This talk will cover the enhancements we have made to YARN, MapReduce, Pig and Hive. We will also walk through the future enhancements we have planned.
The HDFS NameNode is a robust and reliable service as seen in practice in production at Yahoo and other customers. However, the NameNode does not have automatic failover support. A hot failover solution called HA NameNode is currently under active development (HDFS-1623). This talk will cover the architecture, design and setup. We will also discuss the future direction for HA NameNode.
The document discusses Oracle's SPARC Supercluster, an engineered system comprising SPARC T4 servers, Exadata storage cells, and other components. It can replace legacy systems at a fraction of the cost while providing 3x higher database performance, 10x faster Java applications, and a 4x reduced time to production. The SPARC Supercluster offers extreme performance for Java, database and internet applications through optimized hardware and software design.
SQL Server 2008 Fast Track Data Warehouse 2.0
This was a presentation to the Silicon Valley SQL Server User Group in February 2010.
Speaker: Phil Hummel of WinWire Technologies
Presentation developed by Bruce Campbell
Western Region Data Warehouse Specialist, Microsoft
For more information about the SQL Server User Group, contact Mark Ginnebaugh, President of DesignMind, at mark@designmind.com
Apresentação do Vitor Tomaz sobre a Arquitectura dos Serviços da plataforma Windows Azure na 4a Reunião Presencial da Comunidade NetPonto em Coimbra (http://netponto.org).
The document discusses two remedies for system outages and data corruption: Real Application Clusters (RAC) and Data Guard. It provides information on the structure, architecture, and concepts of RAC and Data Guard. It also notes that RAC and Data Guard are complementary and provides an overview of high availability and disaster recovery.
Oracle GoldenGate is Oracle's strategic solution for real-time data integration. It provides low-impact capture, routing, and delivery of transactional data across heterogeneous environments in real time. GoldenGate supports data replication between various database platforms for scenarios such as real-time reporting, zero-downtime migrations and upgrades, and data consolidation.
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...Benoit Hudzia
This document summarizes research on enhancing the live migration process for CPU and memory intensive virtual machines running enterprise applications. It discusses using warm up periods to increase flexibility, delta compression to limit the impact of resending pages, prioritizing page transfers, and optimizing the compression algorithm. Experimental results show these techniques can reduce downtime and migration impact for applications like SAP ERP. Future work is proposed to further optimize compression and page prioritization.
How to Modernize Your Database Platform to Realize Consolidation SavingsIsaac Christoffersen
This document discusses migrating a legacy database platform to an Oracle Exadata platform to realize consolidation savings and modernize the database environment. It provides background on the existing legacy environment, alternatives considered, factors in selecting Exadata, planning and operational considerations for the Exadata migration, lessons learned, and references. The key outcome was migrating from a 5-node Oracle RAC environment on aging hardware to a quarter rack Exadata configuration, which significantly improved performance.
Brendan Kearns is a senior network engineer at Eircom who provides technical leadership for Eircom's IMS tender and heads up related initiatives like an RCS trial. He previously led the replacement of Eircom's intelligent network platform with an open Java-based service creation environment. Brendan also works on Eircom's service network strategy and sees potential in reusing Internet APIs for telecom products, having previously worked as a business consultant and engineer in other industries.
- The concept : Retro and the City
- The competitors
- The tourism market in Brussels
- The Target
- The positioning
- The communication
- The catchment area
- The location
- The turnover figures
The presentation was Friday 22/10/2010 in London (University of East London)
This document discusses database cloning using copy-on-write technologies like thin cloning to minimize storage usage. It describes how traditional cloning requires fully copying database files versus thin cloning which only writes modified blocks. Methods covered include CloneDB, Snap Manager Utility, ZFSSAADM, and cloning pluggable databases using ZFS and ACFS snapshots. Direct NFS is highlighted as an optimal network storage solution for database cloning.
The document summarizes the keynote presentation by Hubert Yoshida, VP and CTO of Hitachi Data Systems, given at the Sun Storage Academy in August 2007. It discusses the growth of storage capacity needs and costs, issues with outdated storage architectures, and benefits of the Hitachi storage virtualization platform including non-disruptive data migration between storage tiers, reduced costs through thin provisioning and backup optimization, and consolidation of different storage systems and applications on a common platform.
The document describes Oracle Exadata Version 2, which is positioned as the world's fastest machine for online transaction processing (OLTP). Version 2 features faster CPUs, networking, disks, and flash storage compared to Version 1. It provides extreme performance for random I/O workloads through its use of solid-state drive (SSD) flash memory caches. Customers saw performance improvements of 10-72x on their queries with Exadata compared to previous systems.
This document discusses Greenplum Database on HDFS (GOH). It provides an introduction and overview of GOH's architecture, features, and performance. Key points include that GOH allows Greenplum to use HDFS for storage, provides pluggable storage support, and full transaction support for tables on HDFS. It also notes challenges around supporting many concurrent queries due to limitations of the current Java-based HDFS client, and possibilities for addressing this.
Deep dive storage networking the path to performanceInterop
The document discusses storage networking performance. It outlines key performance elements like bit rate, bandwidth, latency and throughput. It explains different networking technologies like circuit switching, packet switching, TCP/IP offload engines and virtualization. Disk technologies and their impact on performance are also covered. The document compares different protocols like iSCSI, Fibre Channel and FCoE and analyzes their overhead and effective data rates.
Strata + Hadoop World 2012: HDFS: Now and FutureCloudera, Inc.
Hadoop 1.0 is a significant milestone in being the most stable and robust Hadoop release tested in production against a variety of applications. It offers improved performance, support for HBase, disk-fail-in-place, Webhdfs, etc over previous releases. The next major release, Hadoop 2.0 offers several significant HDFS improvements including new append-pipeline, federation, wire compatibility, NameNode HA, further performance improvements, etc. We describe how to take advantages of the new features and their benefits. We also discuss some of the misconceptions and myths about HDFS.
Eclipse Swordfish is an open source SOA runtime framework based on Eclipse Equinox. It provides a framework for integrating additional open source components like a service registry, messaging system, and process engine to form a comprehensive SOA runtime environment. Swordfish supports relevant SOA standards including SCA, JBI, and OSGi. It adds functionality like policies, monitoring, and configuration to complement components like ServiceMix. The project has 5 committers working on it and version 1.0M3 has been released with the goal of inclusion in Eclipse Galileo in June 2009.
[NetPonto] Arquitectura dos Serviços da plataforma Windows AzureVitor Tomaz
The document summarizes the architecture of Windows Azure services. It discusses how Windows Azure provides scalable and reliable cloud services through its datacenter infrastructure and platform services. Key points include:
- Windows Azure uses a multi-tenant datacenter architecture with fault domains and update domains to provide high availability.
- The storage architecture uses a partitioned and replicated design to store and access blobs, tables, queues and files in a reliable manner.
- SQL Azure provides a scalable relational database service running on top of the Windows Azure infrastructure, with automatic replication and failover.
Innovations in Apache Hadoop MapReduce Pig Hive for Improving Query PerformanceDataWorks Summit
Apache Hadoop and its ecosystem projects Hive and Pig support interactions with data sets of enormous sizes. Hadoop always excelled at large-scale data processing; however, running smaller queries has been problematic due to the batch-oriented nature of the system. This talk will cover the enhancements we have made to YARN, MapReduce, Pig and Hive. We will also walk through the future enhancements we have planned.
The HDFS NameNode is a robust and reliable service as seen in practice in production at Yahoo and other customers. However, the NameNode does not have automatic failover support. A hot failover solution called HA NameNode is currently under active development (HDFS-1623). This talk will cover the architecture, design and setup. We will also discuss the future direction for HA NameNode.
The document discusses Oracle's SPARC Supercluster, an engineered system comprising SPARC T4 servers, Exadata storage cells, and other components. It can replace legacy systems at a fraction of the cost while providing 3x higher database performance, 10x faster Java applications, and a 4x reduced time to production. The SPARC Supercluster offers extreme performance for Java, database and internet applications through optimized hardware and software design.
SQL Server 2008 Fast Track Data Warehouse 2.0
This was a presentation to the Silicon Valley SQL Server User Group in February 2010.
Speaker: Phil Hummel of WinWire Technologies
Presentation developed by Bruce Campbell
Western Region Data Warehouse Specialist, Microsoft
For more information about the SQL Server User Group, contact Mark Ginnebaugh, President of DesignMind, at mark@designmind.com
Apresentação do Vitor Tomaz sobre a Arquitectura dos Serviços da plataforma Windows Azure na 4a Reunião Presencial da Comunidade NetPonto em Coimbra (http://netponto.org).
The document discusses two remedies for system outages and data corruption: Real Application Clusters (RAC) and Data Guard. It provides information on the structure, architecture, and concepts of RAC and Data Guard. It also notes that RAC and Data Guard are complementary and provides an overview of high availability and disaster recovery.
Oracle GoldenGate is Oracle's strategic solution for real-time data integration. It provides low-impact capture, routing, and delivery of transactional data across heterogeneous environments in real time. GoldenGate supports data replication between various database platforms for scenarios such as real-time reporting, zero-downtime migrations and upgrades, and data consolidation.
Enhancing Live Migration Process for CPU and/or memory intensive VMs running...Benoit Hudzia
This document summarizes research on enhancing the live migration process for CPU and memory intensive virtual machines running enterprise applications. It discusses using warm up periods to increase flexibility, delta compression to limit the impact of resending pages, prioritizing page transfers, and optimizing the compression algorithm. Experimental results show these techniques can reduce downtime and migration impact for applications like SAP ERP. Future work is proposed to further optimize compression and page prioritization.
How to Modernize Your Database Platform to Realize Consolidation SavingsIsaac Christoffersen
This document discusses migrating a legacy database platform to an Oracle Exadata platform to realize consolidation savings and modernize the database environment. It provides background on the existing legacy environment, alternatives considered, factors in selecting Exadata, planning and operational considerations for the Exadata migration, lessons learned, and references. The key outcome was migrating from a 5-node Oracle RAC environment on aging hardware to a quarter rack Exadata configuration, which significantly improved performance.
Brendan Kearns is a senior network engineer at Eircom who provides technical leadership for Eircom's IMS tender and heads up related initiatives like an RCS trial. He previously led the replacement of Eircom's intelligent network platform with an open Java-based service creation environment. Brendan also works on Eircom's service network strategy and sees potential in reusing Internet APIs for telecom products, having previously worked as a business consultant and engineer in other industries.
- The concept : Retro and the City
- The competitors
- The tourism market in Brussels
- The Target
- The positioning
- The communication
- The catchment area
- The location
- The turnover figures
The presentation was Friday 22/10/2010 in London (University of East London)
Track rf link corporate profile & productsKaran Patel
TRFL is an IoT solution provider that offers diverse smart device solutions using its proprietary Linux-based platform for rapid development. It provides RFID/NFC readers, attendance and access readers, handheld attendance readers, UHF readers, a follow-me printer, micro-ATMs, a gold vending machine, and solutions for assembly line automation. TRFL has served large clients across various industries and works with R&D partners to develop customized solutions for asset tracking, warehouse automation, and other uses of embedded technology.
I analysed 5 economic indicators (GDP, BOP, Inflation rate, Unemployment and Exchange rate) of Canada and compare them to those from Argentina.
The presentation was Monday 20/12/2010 in Brussels (EPHEC)
The document discusses PrivateWave's mobile voice encryption solutions. It describes PrivateGSM software that provides encryption for phone calls on smartphones using VoIP over mobile data. PrivateGSM uses the ZRTP standard to provide end-to-end encryption with human authentication and key agreement. It can also use SRTP and provide end-to-site encryption when integrated with telephony infrastructure. The document emphasizes that PrivateWave's solutions use open standards like ZRTP and SRTP to ensure the technologies are politically neutral and not subject to backdoors.
At the 9th Annual Global LambdaGrid Workshop Nortel's Rod Wilson announced Dynamic Resource Allocation Control utility was being released under an Open Source Licence.
Distributed application usecase on dockerHiroshi Miura
1) The document discusses using Docker containers and the Hinemos monitoring system to automate operations for a distributed application running on container clusters.
2) Key benefits outlined include automated rebalancing of containers for performance and cost reduction, reduced downtime through automated fallback from failures, and consolidation of platforms through wrapping differences in container images.
3) Challenges addressed include complex data distribution management and inability to integrate environments for applications with different dependencies, which Docker containers help solve.
CERN's IT infrastructure is reaching its limits and needs to expand to support increasing computing capacity demands while maintaining a fixed staff size. CERN is addressing this by expanding its data center capacity through a new remote facility in Budapest, Hungary, and by adopting new open source configuration, monitoring and infrastructure tools to improve efficiency. Key projects include deploying OpenStack for infrastructure as a service, Puppet for configuration management, and integrating monitoring across tools. The transition will take place between 2012-2014 alongside LHC upgrades.
1) The document discusses optimizing NFV placement in OpenStack clouds through efficient resource placement strategies.
2) It proposes extending the OpenStack scheduler to implement a "smart scheduler" using analytics and constraints-based optimization to jointly schedule compute, storage, and networking resources in an energy-efficient manner.
3) A demo showed placing NFV service VMs with affinity constraints for specific storage volumes on nearby physical servers in an optimal way using the proposed smart scheduler approach.
The document summarizes Oracle's SuperCluster engineered system. It provides consolidated application and database deployment with in-memory performance. Key features include Exadata intelligent storage, Oracle M6 and T5 servers, a high-speed InfiniBand network, and Oracle VM virtualization. The SuperCluster enables database as a service with automated provisioning and security for multi-tenant deployment across industries.
This document discusses Oracle Database in the cloud and Oracle's cloud strategy. It provides an overview of cloud computing concepts like computing resources residing on the internet and being billed by consumption. It then discusses Oracle's goals of making cloud computing relevant to enterprises by providing the right products and services and developing cloud standards. It summarizes Oracle's strategy of making its products licensable and supported in the cloud, creating cloud offerings and services, and providing a cloud framework to allow enterprises to set up their own private clouds using Oracle products.
This document summarizes Charles Severance's presentation on collaborative eScience given at Rutgers CyberInfrastructure Meeting on April 4, 2006. It discusses the evolution of collaborative eScience tools over the past 15 years from projects like SPARC to current tools like Sakai, CHEF, WorkTools, and portals. It reflects on lessons learned regarding collaboration software, middleware, and authentication. It also presents a potential future eScience case study integrating various applications, repositories, and portals through a centralized gateway.
The document discusses how Oracle aims to simplify IT operations and drive innovation through engineered systems. It notes that typically 70% of IT costs are spent on operations and only 30% on innovation. Oracle's strategy is to deliver engineered systems that are tested and certified to work together, simplifying deployment, operations, and support. This allows customers to reduce IT costs and refocus resources on innovation. A case study shows how a retail customer was able to deploy an Oracle Database Appliance in just 2 weeks, significantly faster than standard servers.
Eudat user forum-london-11march2013-biovel-v3Alex Hardisty
The document discusses the Biodiversity Virtual e-Laboratory (BioVeL), which provides an e-infrastructure and e-science environment to support biodiversity research. It offers web services and workflows to allow researchers to process large amounts of biodiversity data. Researchers can access libraries of existing workflows and services from databases like GBIF and the Catalogue of Life. The BioVeL aims to foster collaboration between biodiversity and information and communications technology researchers.
Tail-f Webinar OpenFlow Switch Management Using NETCONF and YANGTail-f Systems
This Webinar is on the OF-CONFIG specification and how it applies to large scale OpenFlow switch management.
If you are interested in the management of OpenFlow switches and want to find out more about available specifications and tools to build and deploy such solutions, this webinar provides a useful overview.
Webinar Agenda:
-Step-by-step walkthrough of the OpenFlow Management and Configuration Protocol
-Demonstration of how to use of the YANG language to define the structure and semantics of OpenFlow switch configurations
-The role of NETCONF in implementing OF-CONFIG
Advantages of this approach to network device manufacturers and network operations teams needing to quickly develop and deploy state-of-the-art management solutions
-Short overview of Tail-f Systems’ applicable products and tools
http://www.tail-f.com
Engineered Systems: Oracle's Vision for the FutureBob Rhubart
Oracle's Exadata and Exalogic are impressive products in their own right. But working in combination they deliver unparalleled transaction processing performance with up to a 30x increase over existing legacy systems, with the lowest cost of ownership over a 3 or 5 year basis than any other hardware. In this session you'll learn how to leverage Oracle's Engineered Systems within your enterprise to deliver record-breaking performance at the lowest TCO.
Lessons learned running a container cloud on YARNDataWorks Summit
Apache Hadoop YARN is the resource and application manager for Apache Hadoop. In the past, YARN only supported launching containers as processes. However, as containerization has become extremely popular, more and more users wanted support for launching Docker containers. With recent changes, YARN now supports running Docker containers alongside process containers. Coupled with the newly added support for long-running services on YARN, this allows a host of new possibilities.
In this talk, we'll present how to run a container cloud on YARN. Leveraging the support in YARN for Docker and long-running services, we can allow users to easily spin up sets of Docker containers for their applications. These containers can be self contained or wired up to form more complex applications. We will go over some of the lessons we learned as part of our experiences handling issues such as resource management, debugging application failures, running Docker, service discovery, etc.
Speaker
Billie Rinaldi, Principal Software Engineer I, Hortonworks
Lessons Learned Running a Container Cloud on Apache Hadoop YARNBillie Rinaldi
The document discusses lessons learned from running a container cloud on Apache Hadoop YARN. Some key points include:
- Running over 5.8 million containers and 1.1 million tests on the container cloud with improved hardware utilization and test speed.
- Challenges involved issues like IP management, Docker storage drivers causing kernel panics, user namespacing limitations, and image management.
- Solutions involved allocating IP addresses, testing storage configurations, running containers as a common user, and managing a private image registry for cleanup.
Engineered Systems: Oracle's Vision for the FutureBob Rhubart
The document outlines Oracle's vision for engineered systems and their benefits over standard platforms. It introduces several pre-configured and optimized engineered systems including Exadata, Exalogic, Oracle Database Appliance, and Big Data Appliance. These systems are designed to provide extreme performance, high availability, and lower costs through hardware and software integration and optimization. The systems can be deployed faster with less risk and maintenance than standard platforms.
Efficient Test Environments with Infrastructure as Code (IaC)Knoldus Inc.
In the rapidly evolving landscape of software development, the need for efficient and scalable test environments has become more critical than ever. This session, "Streamlining Development: Unlocking Efficiency through Infrastructure as Code (IaC) in Test Environments," is designed to provide an in-depth exploration of how leveraging IaC can revolutionize your testing processes and enhance overall development productivity.
The document outlines an infrastructure 2.0 approach based on cloud native technologies. It advocates for infrastructure as code, test-driven deployments, open source tools, and seamless developer workflows. The approach uses microservices, containers, service meshes, and orchestration with Kubernetes. It recommends tools like Terraform, Jenkins, Kubernetes, Istio, Prometheus, Elasticsearch and Airflow for infrastructure provisioning, CI/CD, container management, service mesh, monitoring, logging, and job scheduling. It also discusses Docker, data pipelines, and processes for onboarding new applications.
Swimming upstream: OPNFV Doctor project case studyOPNFV
Based on the lifecycle of the OPNFV Doctor project, this case study shows how operator requirements “on paper” have successfully been realized step-by-step and in close cooperation with upstream community projects into a mature fault management framework. A demo of the solution had been presented in a keynote at the last OpenStack Summit. The talk will describe how we have worked in the OPNFV Doctor project and will provide some lessons learned on this journey. With significant experience now of working OPNFV requirements upstream to OpenStack, we’ll share best practices for submitting contributions upstream, how to best communicate, and how to overcome the primary challenges.
Oracle offers several database cloud services including Oracle Database Cloud Service, Oracle Exadata Cloud Service, Oracle Database Backup Service, and Oracle Database Schema Service. These services provide automated infrastructure, database administration, and tools for application development, testing database applications, testing database upgrades, disaster recovery, and a hybrid cloud environment with the same database software both on-premises and in the cloud.
This document provides an overview and strategy for Oracle systems. It outlines challenges customers face with increasing costs, resource constraints, time to value, and outdated infrastructure. It then summarizes Oracle's engineered systems approach which provides extreme performance, low risk deployment, and breakthrough efficiency through fully integrated hardware and software solutions. The document reviews several Oracle engineered systems like Exadata, Exalogic, Exalytics, and Oracle servers that are designed to work together.
Similar to Access to Open Test Infrastructures using Panlab2 - Anastasius Gavras (Eurescom) (20)
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Full-RAG: A modern architecture for hyper-personalizationZilliz
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIVladimir Iglovikov, Ph.D.
Presented by Vladimir Iglovikov:
- https://www.linkedin.com/in/iglovikov/
- https://x.com/viglovikov
- https://www.instagram.com/ternaus/
This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation.
Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners.
This case study covers various aspects, including:
People: The contributors and community that have supported Albumentations.
Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions.
Challenges: The hurdles in monetizing open-source projects and measuring user engagement.
Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration.
Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community.
Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations.
Mental Health: Maintaining balance and not feeling pressured by user demands.
Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth.
Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects.
Explore more about Albumentations and join the community at:
GitHub: https://github.com/albumentations-team/albumentations
Website: https://albumentations.ai/
LinkedIn: https://www.linkedin.com/company/100504475
Twitter: https://x.com/albumentations
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.
20 Comprehensive Checklist of Designing and Developing a WebsitePixlogix Infotech
Dive into the world of Website Designing and Developing with Pixlogix! Looking to create a stunning online presence? Look no further! Our comprehensive checklist covers everything you need to know to craft a website that stands out. From user-friendly design to seamless functionality, we've got you covered. Don't miss out on this invaluable resource! Check out our checklist now at Pixlogix and start your journey towards a captivating online presence today.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
How to Get CNIC Information System with Paksim Ga.pptxdanishmna97
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
UiPath Test Automation using UiPath Test Suite series, part 6DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfMalak Abu Hammad
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
2. About Panlab
• Creates a large scale testing and
experimentation facility by integrating
existing and emerging testbeds
• Achieves scale and maintains
independence through federation
• that enables end-to-end interoperability
testing of platforms, networks and services
• that helps reducing the risks and costs of
large-scale network infrastructure testing
• Panlab has build the glue
4. Value proposition
• For the testbed owners and operators
• Help find “customers”
• Increase utilisation
• Compensate for the investments in building
• For the customer (e.g. researcher, application
developer)
• Help find suitable target environment
• Configure a custom experimental environment
• … friendly users
• A win-win-win situation for the
• testbed owner/operator,
• testbed customer and
• testbed broker (Teagle)
• Open to all collaborations that adhere to the principles
for building Federated, Open, and Trusted research
and experimentation environments
5. Testbed and Experimental Facility
Federation
• Heterogeneous resources are offered by
several network domains
• Domains engage in federation and share
resources
• Federation Organization represents the
federation to 3rd parties
• The federation control tool called Teagle
executes management operations via a control
framework
• Supports broad Future Internet research
• Re-use resources across the boundaries of
domains and communities instead of re-building
infrastructure
• Infrastructure as a Service (IaaS)
6. Panlab Mechanisms - Enablers
• Organisational aspects
• Considered in Panlab SSA
• Panlab Organisation
• (Legal) entity “owning” the testbed federation
• Financing (membership model, etc.)
• Panlab Office
• Operational entity of the federation – adopted in PII
• Frameworks in development – PII project
• Concepts defined in Panlab SSA
• Legal
• Operational
• Technical
7. Panlab Legal Framework
• Target
• Regulation of all related legal issues
• Efficient conclusion of contracts
• Applying of contract templates
• Ensuring individual negotiations
• Federation contracts
• For testbed providers and customers
• For individual testbeds and testing sessions
• Addressed issues
• IPR, Confidentiality, Access rights, etc.
8. Operational Panlab Framework
• Testbed specification and integration
• Panlab repository
• Search for testing configuration
• Customers’ requirements
• Set-up of testing sessions
• Execution of tests
• Configuration and validation
• Collection and evaluation of results
• Usage of existing results and configurations
10. Federation Architecture
§ Registry & Repository
TEAGLE
U1 § Creation Environment
End User Customer
§ Request Processor
Domain Domain
§ Orchestration Engine
§ Web Portal
U2 U3
T1
Domain Domain
Manager Manager
RA RA RA RA RA RA
T2 T2
Domain B
Domain A
IGW IGW
T2 I2 T2
B1 A1
I1
11. How does it work?
search,request & describe & configure
configure infrastructure resources
Panlab Customer Panlab Partner
Panlab Office
TEAGLE
install, configure &
manipulate resources
control
Panlab
resources
Repository
3G
Testbed Resources
18. TEAGLE
A deployed VCT
VPN
VOIP user
agent
Customer
Octo
PTM Oulu, Finland
UoP B.CR
PTM 1
Echo
LINUX
IGW
IGW
Asterisk
config
A.RC
1
Dialtone
EICT
PTM
Patras, Greece IGW
C.CR
3
Berlin, Germany
19. Experimental Facility Resource
Federation with Teagle
• We have developed a Resource Federation Framework
• Different administrative domains provide testbed resources
• Administrative domains can be existing and upcoming
testbeds or other organizations that want to offer resources
• Heterogeneous resource federation allows cross-domain
experiments using heterogeneous resources (e.g. sensors,
CPU, memory, services) from different testbeds
• Open Framework
• Any provider
• Any resource
• Recursive domain / federation model
• Easy integration of resources following a generic resource
adaptor (device driver) concept
• Building upon our existing work will speed up the
integration process and leverage previous investments
www.fire-teagle.org/tutorials.jsp
20. What Exists? How to Join?
• Existing Prototypes:
• Federation Portal
http://www.fire-teagle.org/
• Design Environment (access is currently
limited to selected testers)
http://www.fire-teagle.org/tutorials.jsp
• Domain Manager to federate resources
from an administrative domain
http://trac.panlab.net/trac/wiki/CorePTM
• Resource Adaptors (RA) to allow
remote configuration. For specialized
resources RAs need to be developed.
Different implementation options are reg set
available such as Java, OSGI, Python.
Howtows are available. m m
• In addition to the prototypes,
r r r r r r
conceptual work such as a federation
model, resource models, etc. is also Domain A Domain B
available Sebastian Wahle, Thomas Magedanz, and Anastasius Gavras. Towards the
Future Internet - Emerging Trends from European Research, chapter
Conceptual Design and Use Cases for a FIRE Resource Federation
Framework. IOS Press, 2010. To appear.
21. Future directions
• Management and security
• Monitoring, Fault management, Policy based
management
• Reach out to other European and international
testbed communities
• Serve academic communities
• Through easy and free access
• Serve business customers
• Through service guarantees
• Open in various directions