AWS Community Day | Midwest 2018
Track 2
Elastic.co's ELK Stack - Platform Agnostic Immutable Infrastructure & Analysis through Configuration - Dan Morgan, Chicago burbs
Evolution of Geospatial Workloads on AWS - AWS PS Summit Canberra Amazon Web Services
Geospatial workloads are often amongst the first to move to AWS in government. This session will cover some common topics in GIS, including optimizing for license costs, leveraging native cloud capabilities and running GIS “desktop" software on AWS cloud.
Speaker: Herman Coomans, Solutions Architect, Amazon Web Services
Level: 200
Orchestrating Network with Web Services Session Sponsored by Megaport – Camer...Amazon Web Services
AWS Direct Connect and VPCs allow for a fully private and stable backhaul between your private assets and cloud services without the need for significant encryption, tunneling, or other methods. While these components can be created on the fly with an API, the network component itself cannot. Megaport demonstrates a method of creating the network components in tandem with your AWS components so that the full solution is created in a single API call to a group of endpoints.
Evolution of Geospatial Workloads on AWS - AWS PS Summit Canberra Amazon Web Services
Geospatial workloads are often amongst the first to move to AWS in government. This session will cover some common topics in GIS, including optimizing for license costs, leveraging native cloud capabilities and running GIS “desktop" software on AWS cloud.
Speaker: Herman Coomans, Solutions Architect, Amazon Web Services
Level: 200
Orchestrating Network with Web Services Session Sponsored by Megaport – Camer...Amazon Web Services
AWS Direct Connect and VPCs allow for a fully private and stable backhaul between your private assets and cloud services without the need for significant encryption, tunneling, or other methods. While these components can be created on the fly with an API, the network component itself cannot. Megaport demonstrates a method of creating the network components in tandem with your AWS components so that the full solution is created in a single API call to a group of endpoints.
How Can I Plan for Security, Risk, & Compliance Before Migrating to AWS? | A...Amazon Web Services
Learn how the security and compliance work stream for the Migration Readiness & Planning (MRP) program helps customers build a structured approach that will accelerate a customer’s readiness and planning for migrating to AWS. Learn More: https://aws.amazon.com/government-education/
Integrating Infrastructure as Code into a Continuous Delivery Pipeline | AWS ...Amazon Web Services
Ansible is a simple, but powerful automation tool with an agentless footprint that allows for the definition of architecture, intent, and policy as code that can be deployed across both on-prem and cloud infrastructure. This enables customers to extend their enterprise and applications into AWS in a way that maintains a consistent, secure posture as part of a continuous delivery pipeline. Customers can then natively integrate with AWS to seamlessly configure and deploy a range of AWS services such as Amazon Aurora, Amazon Redshift, Amazon EMR, Amazon Athena, Amazon CloudFront, Amazon Route 53, and Elastic Load Balancing from within Red Hat OpenShift across a secure, consistent hybrid cloud infrastructure. In this session, we will demonstrate how infrastructure can be instantiated with code as part of a continuous delivery pipeline and describe how that integrates with an OpenShift hybrid cloud deployment. Learn More: https://aws.amazon.com/government-education/
Convert and Migrate Your NoSQL Database or Data Warehouse to AWS - May 2017 A...Amazon Web Services
Learning Objectives:
- Understand the use cases for migrating or replicating databases to the cloud
- Learn about the benefits of cloud-native databases for performance and costs reduction
- See how AWS Database Migration Service helps with your migration
- See how AWS Schema Conversion Tool makes conversions simple and quick
Moving or replicating your databases to the cloud should be simple and inexpensive. AWS has recently enhanced the AWS Database Migration Service and the AWS Schema Conversion Tool with new data sources to increase your migration options. You can now export from MongoDB databases and Greenplum, IBM Netezza, HPE Vertica, Teradata, Oracle DW and Microsoft SQL Server data warehouses to AWS. Learn how to export and migrate your data and procedural code with minimal downtime to the cloud database of your choice, including cloud-native offerings such as Amazon Aurora, Amazon DynamoDB and Amazon Redshift.
Seamless Migration of Public Sector Data and Workloads to the AWS Cloud - AWS...Amazon Web Services
Efficiently migrating data and workloads to the cloud is one of the most significant technology challenges currently facing organisations. Veritas has a unique perspective on solving this dilemma, and brings to the table a wide range of enterprise-grade solutions capable of effortlessly migrating large-scale data and workloads to the AWS Cloud. Learn from relevant global scenarios spanning the public sector and corporate landscapes.
Speaker: Dave Hamilton, Distinguished Engineer, Veritas.
Level: 200
Did you know 52% of today’s organizations are planning to leverage a hybrid-cloud approach? With eight years’ experience running Windows workloads in the cloud, AWS provides the perfect platform to modernize your Microsoft applications.
This webinar will demonstrate how AWS ensures customization, high availability and scalability for most of your Microsoft applications on a hybrid-cloud model and learn how to reduce cost. We will also offer you an understanding of how these workloads are licensed and monitored, and share best practice reference architectures.
Key Outcomes:
• How to get the most out of your Microsoft Applications
• How do you start Migrating Applications to AWS?
• Hybrid cloud deployments using AWS
• Licensing Considerations
Session is suitable for
• Technical Decision Makers
• Senior IT Managers and Specialist
• DBA’s
• Solution Architects and Engineers
Real-world High Performance & High Throughput Computing on AWS - AWS PS Summi...Amazon Web Services
This session will give you practical approaches to efficiently and securely manage your data using AWS, including ready-made HPC tools and services to quickly get started analyzing that data. We will demonstrate using Alces Flight to interact with and process aerial imagery data to build geographic data sets. We’ll also point to the future of new serverless architectures like AWS Lambda to compute at massive scale.
Speakers: Adrian White – Technical Business Development Lead, Research & Technical Computing, Asia Pacific, AWS
Dr Matthew Berryman – Managing Director, Across the Cloud Pty Ltd and Chair, University of Wollongong High Performance Steering Committee
Level: 300
Many enterprise leaders have similar questions when considering a move to the cloud: How should I optimize my cloud strategy to support the business? How do I help the organization become faster, better and cheaper? How do I increase business agility and drive more and better business analytics and insight? In this webinar you will learn about best practices for optimizing your cloud for better business agility and cost.
Migrating On-Premises Databases to Cloud - AWS PS Summit CanberraAmazon Web Services
Migrating On-Premises Databases to Cloud
The benefits of running databases in the cloud are compelling but how do you get the data there? In this session we will explore how to use the AWS Database Migration Service and the AWS Schema Conversion Tool to help you migrate, or continuously replicate, your on-premises databases to AWS.
Speaker: Craig Roach, Solutions Architect, Amazon Web Services
Level: 200
Session Sponsored by Tableau: Transforming Data Into Valuable InsightsAmazon Web Services
Session Sponsored by Tableau: Transforming Data Into Valuable Insights
Want to transform your data into valuable insights that can help make your business more productive, profitable and secure? Come learn about Splunk Cloud which delivers Operational Intelligence as a cloud service, enabling you to gain critical insights from your machine data without the need to manage any infrastructure.
Speaker: Jason Oakes, Sales Consultant, Tableau
Modernize Legacy and Enterprise Application Through Implementation of Cloud N...Amazon Web Services
Many Federal agencies are taking on initiatives to consolidate datacenters, modernize legacy and enterprise applications, and transform the digital portfolio to enable agility and other advantageous through cloud based delivery models. Deloitte provides a breadth of services to help federal government agencies select the right cloud solutions to accelerate their missions and derive value while helping agencies to be at the forefront of technology and innovation. Join us as we demonstrate specific client use cases where we have successfully assisted clients in selecting a cloud service model for migrating and transforming current data center to the cloud, enabling agility by taking advantage of Agile, DevOps, and continuous delivery, and modernized legacy and enterprise application through the implementation of cloud native solutions on AWS infrastructure to deliver value at the speed of your mission. Learn More: https://aws.amazon.com/government-education/
Building Complex Workloads in Cloud - AWS PS Summit CanberraAmazon Web Services
In this session we will explore technologies & solutions to deploy ever increasing complex workload like High Performance Computing, Big Data and AI seamlessly to the cloud. You will hear from two strategic partners on how they have used AWS cloud and Intel technologies to accelerate innovation for their customers.
Speaker: Jason Jacobs, Industry Manager, ANZ Public Sector, Intel Corporation with Aileen Gemma Smith CEO, Vizalytics and Zack Levy, DevOps Partner, Deloitte Consulting
AWS Greengrass Technical Deep Dive - AWS Online Tech TalksAmazon Web Services
Learn how the technology behind AWS Greengrass works and how it fits into your IoT strategy. Let us guide you through all the technical aspects and requirements for getting AWS Greengrass setup and provide details on how to incorporate other key services such as AWS IoT, AWS Lambda, and Amazon API Gateway. The tech talk will walk through our LoRa Nano Gateway demo with AWS IoT and AWS Greengrass to see these services in action.
FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel AvivAmazon Web Services
Saving thousands on AWS by implementing 4 simple steps: identify and terminate unused resources, leverage the cloud to reduce costs, design for cost optimization and implement governance policies and rules.
Optimizing Data Management Using AWS Storage and Data Migration Products | AW...Amazon Web Services
DigitalGlobe, Inc., the world’s leading provider of high-resolution Earth imagery, data, and analysis, is migrating its IT infrastructure, supporting imagery production and storage as well as satellite flight operations, to AWS with plans to close its commercial data centers within four years. DigitalGlobe has utilized AWS Snowmobile to move its 100PB image archive to the cloud. DigitalGlobe built its Geospatial Big Data platform, GBDX, natively on AWS. GBDX utilizes the image archive and combines geospatial big data and analytic tools, partner and customer data and tools, and dynamic cloud compute all in one place. This session will explore cost optimization for data management on AWS, highlighting various storage tiers and data import opportunities. We will focus on cost optimal usage of S3, S3-IA, Glacier, Snowball Edge and Snowmobile – balancing imagery access time with storage costs. Hear how DigitalGlobe utilized some of the newest features of the AWS platform to minimize their costs from storage. Learn More: https://aws.amazon.com/government-education/
Demystifying Storage on AWS | AWS Public Sector Summit 2017Amazon Web Services
You wouldn't use a scooter to help someone move; likewise, there is no one-size-fits-all data storage solution. AWS provides a wide variety of storage services to address the spectrum of needs, from casual users saving photos to mission-critical, specialized databases utilized at the largest private and public sector entities. This session will give you an overview of these storage offerings, provide you with the groundwork to match these to your use cases. Learn More: https://aws.amazon.com/government-education/
Migrate and Govern Applications on Cloud InfrastructureManuj Bawa
An Object Oriented Approach to thinking Infrastructure on the cloud. This slide deck walks through some daily challenges we face in migrating and operating applications on the cloud.
Today, data lakes are widely used and have become extremely affordable as data volumes have grown. However, they are only meant for storage and by themselves provide no direct value. With up to 80% of data stored in the data lake today, how do you unlock the value of the data lake? The value lies in the compute engine that runs on top of a data lake.
Join us for this webinar where Ahana co-founder and Chief Product Officer Dipti Borkar will discuss how to unlock the value of your data lake with the emerging Open Data Lake analytics architecture.
Dipti will cover:
-Open Data Lake analytics - what it is and what use cases it supports
-Why companies are moving to an open data lake analytics approach
-Why the open source data lake query engine Presto is critical to this approach
How Can I Plan for Security, Risk, & Compliance Before Migrating to AWS? | A...Amazon Web Services
Learn how the security and compliance work stream for the Migration Readiness & Planning (MRP) program helps customers build a structured approach that will accelerate a customer’s readiness and planning for migrating to AWS. Learn More: https://aws.amazon.com/government-education/
Integrating Infrastructure as Code into a Continuous Delivery Pipeline | AWS ...Amazon Web Services
Ansible is a simple, but powerful automation tool with an agentless footprint that allows for the definition of architecture, intent, and policy as code that can be deployed across both on-prem and cloud infrastructure. This enables customers to extend their enterprise and applications into AWS in a way that maintains a consistent, secure posture as part of a continuous delivery pipeline. Customers can then natively integrate with AWS to seamlessly configure and deploy a range of AWS services such as Amazon Aurora, Amazon Redshift, Amazon EMR, Amazon Athena, Amazon CloudFront, Amazon Route 53, and Elastic Load Balancing from within Red Hat OpenShift across a secure, consistent hybrid cloud infrastructure. In this session, we will demonstrate how infrastructure can be instantiated with code as part of a continuous delivery pipeline and describe how that integrates with an OpenShift hybrid cloud deployment. Learn More: https://aws.amazon.com/government-education/
Convert and Migrate Your NoSQL Database or Data Warehouse to AWS - May 2017 A...Amazon Web Services
Learning Objectives:
- Understand the use cases for migrating or replicating databases to the cloud
- Learn about the benefits of cloud-native databases for performance and costs reduction
- See how AWS Database Migration Service helps with your migration
- See how AWS Schema Conversion Tool makes conversions simple and quick
Moving or replicating your databases to the cloud should be simple and inexpensive. AWS has recently enhanced the AWS Database Migration Service and the AWS Schema Conversion Tool with new data sources to increase your migration options. You can now export from MongoDB databases and Greenplum, IBM Netezza, HPE Vertica, Teradata, Oracle DW and Microsoft SQL Server data warehouses to AWS. Learn how to export and migrate your data and procedural code with minimal downtime to the cloud database of your choice, including cloud-native offerings such as Amazon Aurora, Amazon DynamoDB and Amazon Redshift.
Seamless Migration of Public Sector Data and Workloads to the AWS Cloud - AWS...Amazon Web Services
Efficiently migrating data and workloads to the cloud is one of the most significant technology challenges currently facing organisations. Veritas has a unique perspective on solving this dilemma, and brings to the table a wide range of enterprise-grade solutions capable of effortlessly migrating large-scale data and workloads to the AWS Cloud. Learn from relevant global scenarios spanning the public sector and corporate landscapes.
Speaker: Dave Hamilton, Distinguished Engineer, Veritas.
Level: 200
Did you know 52% of today’s organizations are planning to leverage a hybrid-cloud approach? With eight years’ experience running Windows workloads in the cloud, AWS provides the perfect platform to modernize your Microsoft applications.
This webinar will demonstrate how AWS ensures customization, high availability and scalability for most of your Microsoft applications on a hybrid-cloud model and learn how to reduce cost. We will also offer you an understanding of how these workloads are licensed and monitored, and share best practice reference architectures.
Key Outcomes:
• How to get the most out of your Microsoft Applications
• How do you start Migrating Applications to AWS?
• Hybrid cloud deployments using AWS
• Licensing Considerations
Session is suitable for
• Technical Decision Makers
• Senior IT Managers and Specialist
• DBA’s
• Solution Architects and Engineers
Real-world High Performance & High Throughput Computing on AWS - AWS PS Summi...Amazon Web Services
This session will give you practical approaches to efficiently and securely manage your data using AWS, including ready-made HPC tools and services to quickly get started analyzing that data. We will demonstrate using Alces Flight to interact with and process aerial imagery data to build geographic data sets. We’ll also point to the future of new serverless architectures like AWS Lambda to compute at massive scale.
Speakers: Adrian White – Technical Business Development Lead, Research & Technical Computing, Asia Pacific, AWS
Dr Matthew Berryman – Managing Director, Across the Cloud Pty Ltd and Chair, University of Wollongong High Performance Steering Committee
Level: 300
Many enterprise leaders have similar questions when considering a move to the cloud: How should I optimize my cloud strategy to support the business? How do I help the organization become faster, better and cheaper? How do I increase business agility and drive more and better business analytics and insight? In this webinar you will learn about best practices for optimizing your cloud for better business agility and cost.
Migrating On-Premises Databases to Cloud - AWS PS Summit CanberraAmazon Web Services
Migrating On-Premises Databases to Cloud
The benefits of running databases in the cloud are compelling but how do you get the data there? In this session we will explore how to use the AWS Database Migration Service and the AWS Schema Conversion Tool to help you migrate, or continuously replicate, your on-premises databases to AWS.
Speaker: Craig Roach, Solutions Architect, Amazon Web Services
Level: 200
Session Sponsored by Tableau: Transforming Data Into Valuable InsightsAmazon Web Services
Session Sponsored by Tableau: Transforming Data Into Valuable Insights
Want to transform your data into valuable insights that can help make your business more productive, profitable and secure? Come learn about Splunk Cloud which delivers Operational Intelligence as a cloud service, enabling you to gain critical insights from your machine data without the need to manage any infrastructure.
Speaker: Jason Oakes, Sales Consultant, Tableau
Modernize Legacy and Enterprise Application Through Implementation of Cloud N...Amazon Web Services
Many Federal agencies are taking on initiatives to consolidate datacenters, modernize legacy and enterprise applications, and transform the digital portfolio to enable agility and other advantageous through cloud based delivery models. Deloitte provides a breadth of services to help federal government agencies select the right cloud solutions to accelerate their missions and derive value while helping agencies to be at the forefront of technology and innovation. Join us as we demonstrate specific client use cases where we have successfully assisted clients in selecting a cloud service model for migrating and transforming current data center to the cloud, enabling agility by taking advantage of Agile, DevOps, and continuous delivery, and modernized legacy and enterprise application through the implementation of cloud native solutions on AWS infrastructure to deliver value at the speed of your mission. Learn More: https://aws.amazon.com/government-education/
Building Complex Workloads in Cloud - AWS PS Summit CanberraAmazon Web Services
In this session we will explore technologies & solutions to deploy ever increasing complex workload like High Performance Computing, Big Data and AI seamlessly to the cloud. You will hear from two strategic partners on how they have used AWS cloud and Intel technologies to accelerate innovation for their customers.
Speaker: Jason Jacobs, Industry Manager, ANZ Public Sector, Intel Corporation with Aileen Gemma Smith CEO, Vizalytics and Zack Levy, DevOps Partner, Deloitte Consulting
AWS Greengrass Technical Deep Dive - AWS Online Tech TalksAmazon Web Services
Learn how the technology behind AWS Greengrass works and how it fits into your IoT strategy. Let us guide you through all the technical aspects and requirements for getting AWS Greengrass setup and provide details on how to incorporate other key services such as AWS IoT, AWS Lambda, and Amazon API Gateway. The tech talk will walk through our LoRa Nano Gateway demo with AWS IoT and AWS Greengrass to see these services in action.
FinOps - AWS Cost and Operational Efficiency - Pop-up Loft Tel AvivAmazon Web Services
Saving thousands on AWS by implementing 4 simple steps: identify and terminate unused resources, leverage the cloud to reduce costs, design for cost optimization and implement governance policies and rules.
Optimizing Data Management Using AWS Storage and Data Migration Products | AW...Amazon Web Services
DigitalGlobe, Inc., the world’s leading provider of high-resolution Earth imagery, data, and analysis, is migrating its IT infrastructure, supporting imagery production and storage as well as satellite flight operations, to AWS with plans to close its commercial data centers within four years. DigitalGlobe has utilized AWS Snowmobile to move its 100PB image archive to the cloud. DigitalGlobe built its Geospatial Big Data platform, GBDX, natively on AWS. GBDX utilizes the image archive and combines geospatial big data and analytic tools, partner and customer data and tools, and dynamic cloud compute all in one place. This session will explore cost optimization for data management on AWS, highlighting various storage tiers and data import opportunities. We will focus on cost optimal usage of S3, S3-IA, Glacier, Snowball Edge and Snowmobile – balancing imagery access time with storage costs. Hear how DigitalGlobe utilized some of the newest features of the AWS platform to minimize their costs from storage. Learn More: https://aws.amazon.com/government-education/
Demystifying Storage on AWS | AWS Public Sector Summit 2017Amazon Web Services
You wouldn't use a scooter to help someone move; likewise, there is no one-size-fits-all data storage solution. AWS provides a wide variety of storage services to address the spectrum of needs, from casual users saving photos to mission-critical, specialized databases utilized at the largest private and public sector entities. This session will give you an overview of these storage offerings, provide you with the groundwork to match these to your use cases. Learn More: https://aws.amazon.com/government-education/
Migrate and Govern Applications on Cloud InfrastructureManuj Bawa
An Object Oriented Approach to thinking Infrastructure on the cloud. This slide deck walks through some daily challenges we face in migrating and operating applications on the cloud.
Today, data lakes are widely used and have become extremely affordable as data volumes have grown. However, they are only meant for storage and by themselves provide no direct value. With up to 80% of data stored in the data lake today, how do you unlock the value of the data lake? The value lies in the compute engine that runs on top of a data lake.
Join us for this webinar where Ahana co-founder and Chief Product Officer Dipti Borkar will discuss how to unlock the value of your data lake with the emerging Open Data Lake analytics architecture.
Dipti will cover:
-Open Data Lake analytics - what it is and what use cases it supports
-Why companies are moving to an open data lake analytics approach
-Why the open source data lake query engine Presto is critical to this approach
Comment choisir entre Parse, Heroku et AWS ?TheFamily
Par Laurent Cerveau, CTO at Zen.ly (https://twitter.com/laurentc27)
Inscrivez-vous au prochain meetup! — http://www.meetup.com/StartupWorkshop
Pour ne pas rater les prochains évènements, c'est ici : http://www.thefamily.co/education/
Entreprendre n’est pas inné et 80% des erreurs peuvent être évitées. Ne perds pas de temps, offre-toi Koudetat : http://bit.ly/koudetat-youtube
So you have finally this great product in mind with all its variations. It will be cool, slick, social have notification and million of people will use it! One problem : it all works because there is a server behind this great future client. But the more you talk with people around, the more you are confused on what to use to develop your server technology, how much investment (both in money and work) will be required, and how long will this investment last. Here we’ll talk about three possible ways (Facebook Parse , use of Heroku and do everything directly on AWS) and how they compare to each other.
Deep Dive Into Elasticsearch: Establish A Powerful Log Analysis System With E...Tyler Nguyen
We will have a deep view of the Elastic Stack - which is the next evolution of ELK Stack, learn how to build the powerful log analysis system with Elastic Stack and have an overview of specifications and comparison details between the self-managed cluster vs Elastic stack provided as SaaS from cloud providers.
For our next ArcReady, we will explore a topic on everyone’s mind: Cloud computing. Several industry companies have announced cloud computing services . In October 2008 at the Professional Developers Conference, Microsoft announced the next phase of our Software + Services vision: the Azure Services Platform. The Azure Services Platforms provides a wide range of internet services that can be consumed from both on premises environments or the internet.
Session 1: Cloud Services
In our first session we will explore the current state of cloud services. We will then look at how applications should be architected for the cloud and explore a reference application deployed on Windows Azure. We will also look at the services that can be built for on premise application, using .NET Services. We will also address some of the concerns that enterprises have about cloud services, such as regulatory and compliance issues.
Session 2: The Azure Platform
In our second session we will take a slightly different look at cloud based services by exploring Live Mesh and Live Services. Live Mesh is a data synchronization client that has a rich API to build applications on. Live services are a collection of APIs that can be used to create rich applications for your customers. Live Services are based on internet standard protocols and data formats.
Database automation guide - Oracle Community Tour LATAM 2023Nelson Calero
The tasks of the DBA role are in permanent evolution. There are new and changed functionalities in database versions, cloud services, integrations, and new tools. Automation has been always a big portion of the DBA work, and is constantly challenging our processes. This presentation explore these automation changes using examples from experience of supporting hundreds of Oracle installations of varying size and complexity, including the process of choosing the right tool for the task, implementation, and subsequent maintenance, mainly using Ansible.
AWS Glue is a fully managed, serverless extract, transform, and load (ETL) service that makes it easy to move data between data stores. AWS Glue simplifies and automates the difficult and time consuming tasks of data discovery, conversion mapping, and job scheduling so you can focus more of your time querying and analyzing your data using Amazon Redshift Spectrum and Amazon Athena. In this session, we introduce AWS Glue, provide an overview of its components, and share how you can use AWS Glue to automate discovering your data, cataloging it, and preparing it for analysis.
in this slide i have tried to explain what an data engineer does and what is the difference between a data engineer and a data analytics and data scientist
AZUG.BE - Azure User Group Belgium - First public meetingMaarten Balliauw
- What is AZUG? Who is who?
- An overview of the Azure platform
- .NET Services
- Enterprise reasons to adopt the cloud
- Getting started with Azure
- Open discussion
OHECC 2014 KSU Cloud Integrated DatacenterTodd Ryan
See how Kent State University made their journey from a typical IT datacenter to a cloud-enabled enterprise. We discuss the decision points, economics, and objectives that guided us through each stage of the process. We also look at the technical steps that got us there and what the final state looks like. Lastly, we talk about best practices and recommendations for your own cloud initiatives.
JDD2015: Sustainability Supporting Data Variability: Keeping Core Components ...PROIDEA
SUSTAINABILITY SUPPORTING DATA VARIABILITY: KEEPING CORE COMPONENTS CLEAN WHILE DEALING WITH DATA VARIABILITY
A big challenge in building complex, data-intensive systems is how to sustainably support data variation, schema, and feature evolution. This talk examines strategies, practices, and patterns drawn from real experiences that support new and evolving data-processing requirements while keeping the core architecture clean. As complex systems evolve to meet varying data formats, they can devolve into poorly architected Big Balls of Mud filled with special-case logic and one-off processing. Alternatively, you can isolate core components of your system and protect them from entanglements and unnecessary complexity by designing them to operate on common data formats while providing extension mechanisms that enable processing variations.
JDD2015: Sustainability Supporting Data Variability: Keeping Core Components ...PROIDEA
SUSTAINABILITY SUPPORTING DATA VARIABILITY: KEEPING CORE COMPONENTS CLEAN WHILE DEALING WITH DATA VARIABILITY
A big challenge in building complex, data-intensive systems is how to sustainably support data variation, schema, and feature evolution. This talk examines strategies, practices, and patterns drawn from real experiences that support new and evolving data-processing requirements while keeping the core architecture clean. As complex systems evolve to meet varying data formats, they can devolve into poorly architected Big Balls of Mud filled with special-case logic and one-off processing. Alternatively, you can isolate core components of your system and protect them from entanglements and unnecessary complexity by designing them to operate on common data formats while providing extension mechanisms that enable processing variations.
Join us for a deep dive into Windows Azure. We’ll start with a developer-focused overview of this brave new platform and the cloud computing services that can be used either together or independently to build amazing applications. As the day unfolds, we’ll explore data storage, SQL Azure™, and the basics of deployment with Windows Azure. Register today for these free, live sessions in your local area.
Geek Sync | Deployment and Management of Complex Azure EnvironmentsIDERA Software
You can watch the replay of this Geek Sync webinar in the IDERA Resource Center: http://ow.ly/pg7N50A4svf.
Today's data management professional is finding their landscape changing. They have multiple database platforms to manage, multi-OS environments and everyone wants it now.
Join IDERA and Kellyn Pot’Vin-Gorman as she discusses the power of auto deployment in Azure when faced with complex environments and tips to increase the knowledge you need at the speed of light. Kellyn will cover scripting basics, advanced Portal features, opportunities to lessen the learning curve and how multi-platform and tier doesn't have to mean multi-cloud.
Attendees can expect to learn how to build automation scripts efficiently, even if you have little scripting experience, and how to work with Azure automation deployments. This session will allow you to begin building a repository of multi-platform development scripts to use as needed.
About Kellyn: Kellyn Pot’Vin-Gorman is a member of the Oak Table Network and an IDERA ACE and Oracle ACE Director alumnus. She is the newest Technical Solution Professional in Power BI with AI in the EdTech group at Microsoft. Kellyn is known for her extensive work with multi-database platforms, DevOps, cloud migrations, virtualization, visualizations, scripting, environment optimization tuning, automation, and architecture design. She has spoken at numerous technical conferences for Oracle, Big Data, DevOps, Testing and SQL Server. Her blog, http://dbakevlar.com and social media activity under her handle, DBAKevlar is well respected for her insight and content.
Similar to Elastic.co's ELK Stack - Platform Agnostic Immutable Infrastructure & Analysis through Configuration - Dan Morgan, Chicago burbs (20)
AWS reInvent 2023 recaps from Chicago AWS user groupAWS Chicago
Chicago AWS Solutions Architect Scott Hewitt recaps the non-GenAI updates from AWS re:Invent 2023. Updates range from storage, networking, compute and developer tools.
MARK GAMBLE_ASC For Really Remote Edge Computing - AWS Community Day Chicago ...AWS Chicago
Mark Gamble
AWS Communtity Day Midwest 2023
ASC For Really Remote Edge Computing: How AWS Snowball + SpaceX Starlink + Couchbase Capella = more uptime, lower latency and better bandwidth usage for apps at the edge
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Neuro-symbolic is not enough, we need neuro-*semantic*
Elastic.co's ELK Stack - Platform Agnostic Immutable Infrastructure & Analysis through Configuration - Dan Morgan, Chicago burbs
1. Elastic.co's ELK Stack - Platform Agnostic
Immutable Infrastructure & Analysis through
Configuration
DAN MORGAN - SOLUTION ARCHITECT – PAYFORMANCE SOLUTIONS
2. About Payformance
u Payformance Solutions’ mission is to establish a smooth “handshake” between Insurance
Companies and Doctors that deliver efficiency, predictability and consistency in value-based
care programs
u Doctors make more money by keeping you healthy
u TrustHub assists Insurance Companies and Doctors with the design, measurement, and
collaboration of value-based reimbursement programs as an independent, transparent, and
neutral third party
u What are they spending their time, money and resources on
3. About me
u 20 years of experience in the industry, mostly in e-commerce & security
u Background is as a F.E.D and Full Stack Developer
u Solutions Architect / Engineering Manager
u 8th startup
u linkedin.com/in/morganize
u twitter.com/morgan_graphics
4. About this talk
u The ELK Stack (Elasticsearch, Logstash & Kibana) is a NoSQL search
engine and DataStore used to normalize, centralize, analyze and
visualize ALL THE THINGS in your environment via configuration and
very little programming. This talk focuses on a platform agnostic
version of Elasticsearch, as compared to AWS Elasticsearch Service,
the pros and cons of both, and walks through a practical approach
to setting up a P.O.C. cluster to visualize the security file on a
CentOS bastion host.
5. About this talk
u The ELK Stack (Elasticsearch, Logstash & Kibana) is a NoSQL search
engine and DataStore used to normalize, centralize, analyze and
visualize ALL THE THINGS in your environment via configuration and
very little programming. This talk focuses on a platform agnostic
version of Elasticsearch, as compared to AWS Elasticsearch Service,
the pros and cons of both, and walks through a practical approach
to setting up a P.O.C. cluster to visualize the security file on a
CentOS bastion host.
This talk would have taken 50+ minutes to present
6. About this talk now
u Payformance uses the E.L.K. stack /w Beats to normalize, centralize,
analyze, and visualize ALL THE THINGS in our environment via
configuration for:
u HIPAA compliance auditing
u Environment monitoring
u Above and Beyond Cloudtrail
u Instance monitoring
u Security monitoring
u Application monitoring
u Process monitoring
7. No deep dives
u No Sharding Strategy’s
u No Groking Examples
u No Schema Design
u No DML Walkthrough
8. Why this matters to Payformance
u We’re a startup
u Small team of talented people, limited resources
u Cash strapped
u Open source vs. paid when it makes sense
u D.I.Y. most things with off the shelf technologies
u Most of our AWS work is done in batch
u Using CF Templates we spin up and provision an AWS environment when we need it and shut
it down when we’re done
u Metrics about all aspects of the environment and the people
accessing the environment are dictated by HIPAA compliance
regulations
9. Why you should consider E.L.K.
u You may have many or even just a few disparate systems that you
need to get information from (monitoring, logging, auditing, status,
etc.)
u Some of which may need augmented data e.g. geo ip data
u But I already have …
u Datadog, New Relic, Nagios, Icinga, Cisco, Tableau, Splunk, Sumo Logic, SQL database, or
any number of other tools designed to monitor, analyze, and display any aspect of an app,
system or network
u A custom built solution L
u No worries, that is great, keep using those tools
u ! except the custom built solution (why do that to yourself?)
10. Why consider the E.L.K. Stack? (cont.)
u Works well with a 3 node setup
u Can scale as needed, just add another node
u E.L.K. Stack is great when you need a single pane of glass
u One Interface to rule them all via Kibana
u Someone else is working on the code
u Logstash eliminates the need for separate processing pipelines to
augment/transform/clean data
u Elasticsearch is a Search Engine
u 95% of setup is done with configuration alone
u You enjoy a challenge
11. What the E.L.K stack does well
u It’s Free
u The E.L.K stack is a robust pipeline that allows you to get insights very quickly into whatever it
is you’re working on without having to do everything from scratch (hours vs. weeks or months)
u Elasticsearch is a search engine first
u Uses an Inverted Index for full-text searches
u Significant advantages over a traditional ANSI SQL database like relevancy, range queries,
fuzzy logic queries and Geo Point/Shape queries
u Logstash = Data Normalization through Configuration = No coding
u n inputs to n outputs
u Kibana is worth it’s code in Gold
u Being able to quickly build a customized dashboard in a few hours vs. weeks is fantastic
12. What the E.L.K stack doesn’t do well
u It’s only Free if you don’t value your time
u It’s Search Engine moonlighting as a Datastore
u Many things that are defaults in normal datastores e.g. security are
expensive paid add-on’s (X-pack)
u Steep learning curve
u Schema maintenance is painful
u Reindexing is a painful and expensive process
u Better at reading than writing (can take up to 1 sec for a write)
u ETL processes are not automated out of the box resulting in a lot of
custom workflows to manage things
14. Options (cont.)
u AWS Elasticsearch Service
u Pros (this is an AWS conference after all):
u Handles some of the PITA qualities of Elasticsearch
u Kibana is automatically integrated with the service
u AWS manages security through network segmentation VPC, IAM, Roles etc.
u Automates node management easily
u Integrates with a ton of AWS services, S3, EBS, Snapshots etc.
u Cons:
u No automation for the PITA qualities of Elasticsearch
u Sharding, Index Rollup, ETL, reindexing etc. (this is not exclusive to AWS)
u Logstash isn’t part of the stack out of the box
u Other AWS services require manual intervention
15. Options (cont.)
u Elastic Cloud
u Pros:
u Multi platform, multi environment, public, private, hybrid, bare metal
u AWS, GCE, Azure etc.
u X-Pack
u Security, Alerting
u Managed by the people who built it
u Centralized management of your complete environment
u single pane of glass
u Swiftype integration GUI for search tuning
u Cons:
u It’s no longer free and can be quite expensive depends on your use case
16. Options (cont.)
u D.I.Y.
u Pros:
u Build exactly what you need, when you need it
u Customize the dashboards the way you want
u Once you figure it out, configuration becomes immutable infrastructure,
infrastructure as code, automation
u Cons:
u Figuring it out can take some time
u Steep learning curve
u As mentioned before, some of the PITA qualities of Elasticsearch require
expensive add-ons or custom workflows to handle some things
17. Use case:
u Monitoring an AWS bastion host for activity (HIPAA)
u Access, Security, Files, Commands, Auditing, Status
u Install
u Filebeat
u Monitor What files are being created, copied, deleted, manipulated
u Read log files of X applications, processes, services
u Metricbeat
u Monitor things like CPU, Memory, Networking throughput
u Auditbeat
u File integrity
u Heartbeat
u Instance Status e.g. ping