This document provides an overview and summary of ActiveMQ features for message-oriented middleware including messaging domains, durability vs persistence, message acknowledgement vs transactions, synchronous vs asynchronous message consumption, broker clustering, master/slave configurations, security options, wire formats for non-Java clients, handling disconnected producers/consumers, consumer options, slow consumer strategies, monitoring broker statistics, and an introduction to Apache Camel for integration.
Running and managing large scale applications with microservices architectures can be difficult and often requires operating complex container management infrastructure. Amazon EC2 Container Service (ECS) is a highly scalable, high performance service for running and managing Docker applications. In this session, we will walk through a number of patterns and tools used by our customers to run their applications on Amazon ECS. We will show you how to setup, manage, and scale your Amazon ECS resources, and keep them secure. We will also discuss how to monitor your containerized application running on Amazon ECS and we'll provide best practices for logging and service discovery.
AWS DevDay San Francisco, June 21, 2016.
Presenter: Konstantin Williams, Solutions Architect
Amazon Route 53 is a highly available, scalable, and easy to use cloud Domain Name System (DNS) web service. With an SLA of 100% availability, Route 53 is designed to give developers and businesses an extremely reliable and cost effective way to route end users to Internet applications. By using Route 53 as your DNS provider, you can ensure your application’s up-time, run architecture that delivers better performance, and provide your end users with a better experience through lower latency and faster load times, all at the fraction of the cost of other DNS providers. Learning Objective: In this webinar, you will learn the following: - General overview of DNS, and how Route 53 is built to provide reliable and secure DNS - Using the Route 53 console to manage your DNS, easily and seamlessly - Utilizing health checks and failover to ensure high availability - Configuring advanced routing policies, including running your application in multiple regions with LBR and Geo for better performance for your end users. - Saving costs by using Route 53 - Registering or transferring your domains into Route 53 to manage all of your domain resources from one place - How to start using Route 53, including migrating your DNS without experiencing any downtime.
An overview of the Amazon ElastiCache managed service, with examples of how it can be used to increase performance, lower costs and augment other database services and databases to make things faster, easier and less expensive.
Running and managing large scale applications with microservices architectures can be difficult and often requires operating complex container management infrastructure. Amazon EC2 Container Service (ECS) is a highly scalable, high performance service for running and managing Docker applications. In this session, we will walk through a number of patterns and tools used by our customers to run their applications on Amazon ECS. We will show you how to setup, manage, and scale your Amazon ECS resources, and keep them secure. We will also discuss how to monitor your containerized application running on Amazon ECS and we'll provide best practices for logging and service discovery.
AWS DevDay San Francisco, June 21, 2016.
Presenter: Konstantin Williams, Solutions Architect
Amazon Route 53 is a highly available, scalable, and easy to use cloud Domain Name System (DNS) web service. With an SLA of 100% availability, Route 53 is designed to give developers and businesses an extremely reliable and cost effective way to route end users to Internet applications. By using Route 53 as your DNS provider, you can ensure your application’s up-time, run architecture that delivers better performance, and provide your end users with a better experience through lower latency and faster load times, all at the fraction of the cost of other DNS providers. Learning Objective: In this webinar, you will learn the following: - General overview of DNS, and how Route 53 is built to provide reliable and secure DNS - Using the Route 53 console to manage your DNS, easily and seamlessly - Utilizing health checks and failover to ensure high availability - Configuring advanced routing policies, including running your application in multiple regions with LBR and Geo for better performance for your end users. - Saving costs by using Route 53 - Registering or transferring your domains into Route 53 to manage all of your domain resources from one place - How to start using Route 53, including migrating your DNS without experiencing any downtime.
An overview of the Amazon ElastiCache managed service, with examples of how it can be used to increase performance, lower costs and augment other database services and databases to make things faster, easier and less expensive.
Actor Model is a general model of concurrent computation developed by Carl Hewitt in 1973. It provides a flexible mechanism for building parallel and distributed software systems. In recent years the advent of multi-core architecture and massive cloud-based concurrent applications renewed the interest in Actor-based programming, as it helps in development of reliable, scalable and massively-concurrent computer systems. Therefore actor frameworks are available for every programming language and their implementations are currently used by the major web service competitors such as Linkedin, Twitter, Amazon, Yahoo!, Facebook and Microsoft.
스타트업 얼라이언스 화요일 테헤란로 런치클럽에서는 AWS(Amazon Web Services)에 대해 알아보는 시간을 갖고자합니다. AWS가 제공하는 다양한 프로그램들에는 무엇이 있는지, 국내 스타트업은 과연 어떻게 AWS를 활용하고 있는지에 대해 AWS의 테크에반젤리스트 윤석찬님이 자세히 그리고 꼼꼼히 설명해주신다고 합니다. 또한 국내 스타트업들이 AWS를 가장 잘, 멋지게 활용하기 위해서는 어떻게 해야 하는지 실제로 AWS를 활용하고 있는 스타트업인 HB Smith가 경험을 공유해주신다고 하는데요.
AWS의 윤석찬님, HB Smith 한종원 대표님, 윤제상 CTO와 함께 스타트업 성공을 위한 AWS 첫걸음은 어떻게 내딛어야 할지 만나보세요.
Storage Requirements and Options for Running Spark on KubernetesDataWorks Summit
In a world of serverless computing users tend to be frugal when it comes to expenditure on compute, storage and other resources. Paying for the same when they aren’t in use becomes a significant factor. Offering Spark as service on cloud presents very unique challenges. Running Spark on Kubernetes presents a lot of challenges especially around storage and persistence. Spark workloads have very unique requirements of Storage for intermediate data, long time persistence, Share file system and requirements become very tight when it same need to be offered as a service for enterprise to mange GDPR and other compliance like ISO 27001 and HIPAA certifications.
This talk covers challenges involved in providing Serverless Spark Clusters share the specific issues one can encounter when running large Kubernetes clusters in production especially covering the scenarios related to persistence.
This talk will help people using Kubernetes or docker runtime in production and help them understand various storage options available and which is more suitable for running Spark workloads on Kubernetes and what more can be done
This session will give attendees an overview of the new testing features in Spring 3.1 as well the new Spring MVC test support. Sam Brannen will demonstrate how to use the Spring TestContext Framework to write integration tests for Java-based Spring configuration using @Configuration classes. He'll then compare and contrast this approach with XML-based configuration and follow up with a discussion of the new testing support for bean definition profiles. Next, Rossen Stoyanchev will show attendees how testing server-side code with annotated controllers and client-side code with the RestTemplate just got a whole lot easier with the new Spring MVC test support. Come to this session to see these new Spring testing features in action and learn how you can get involved in the Spring MVC Test Support project.
Amazon Aurora is a relational database built for the cloud and is compatible with MySQL and PostgreSQL. It combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open-source databases. In this session, we cover some of the key innovations in the Aurora database engine and storage layers. We explain recently announced features, such as Aurora Serverless, Aurora Multi-Master, and Aurora Parallel Query, and we discuss best practices and optimal configurations. See why Aurora is a great fit for new application development and for migrations from overpriced, restrictive commercial databases.
최고의 속도와 미션 크리티컬 업무를 수행하기 위한, 'In-Memory-Computing 글로벌 리더 GridGain 솔루션' 을 소개합니다. 그리드 게인은 데이터 집약적인 애플리케이션을 분산 컴퓨팅을 통해 가속화하고 확장하는 인메모리 컴퓨팅 플랫폼 솔루션입니다. www.all-dt4u.com/
[주요 특성]
1.속도 : 메모리에 데이터를 로드(Load)하여 최대 백만배 빠른 속도
2.확장성 : 분산 및 병렬 처리로 비즈니스 로직 전체 실행 시간 감소
3. 디지털 트렌스포메이션 : 메모리 집약적인 아키텍쳐 기반으로 신속한 접근과 처리 가능
4. 중앙 집중식 관리 : 클러스터 실시간 모니터링 및 특정 이벤트 발생 시 알림 기능
5. 고객에 최적화된 통합 : RDBMS, NoSQL, 하둡 등 데이터베이스와 통합 가능
"GridGain은 오픈소스 Apache Ignite 기반의 In-Memory Computing 플랫폼으로, 웹 규모 애플리케이션, SaaS 및 클라우드 Conputing, 모바일 및 IoT 백엔드, 실시간 데이터 처리, 빅데이터 분석 등 분야에 성능 향상을 지원 합니다. "
OpenSearch는 배포형 오픈 소스 검색과 분석 제품군으로 실시간 애플리케이션 모니터링, 로그 분석 및 웹 사이트 검색과 같이 다양한 사용 사례에 사용됩니다. OpenSearch는 데이터 탐색을 쉽게 도와주는 통합 시각화 도구 OpenSearch와 함께 뛰어난 확장성을 지닌 시스템을 제공하여 대량 데이터 볼륨에 빠르게 액세스 및 응답합니다. 이 세션에서는 실제 동작 구조에 대한 설명을 바탕으로 최적화를 하기 위한 방법과 운영상에 발생할 수 있는 이슈에 대해서 알아봅니다.
Redis has exploded in popularity to become the de-facto standard for in-memory key-value store used by customers for fast data storage to accelerate databases and applications. In this talk, we will discuss how to leverage Redis to achieve blazing fast performance in a variety of use cases – from database caching, to messaging, queuing, IoT and more. Both high-level architecture considerations and implementation (with code snippets) will be covered. We will also see how using Amazon ElastiCache makes it easy to power your Redis workloads in a robust, secure and fully managed way.
EKS에서 Opentelemetry로 코드실행 모니터링하기 - 신재현 (인덴트코퍼레이션) :: AWS Community Day Online...AWSKRUG - AWS한국사용자모임
EKS환경에서 Opentelemetry와 Jaeger를 활용하여 서버의 코드가 잘 동작하는지 어떤로직에서 문제가 발생했는지 모니터링 하는 방법을 알아봅니다. 마지막으로 Grafana를 이용해 쉽게 원하는 코드를 조회 하는 방법도 실습해볼 예정입니다. K8S를 모르셔도 참석할 수 있습니다.
Floating on a RAFT: HBase Durability with Apache RatisDataWorks Summit
In a world with a myriad of distributed storage systems to choose from, the majority of Apache HBase clusters still rely on Apache HDFS. Theoretically, any distributed file system could be used by HBase. One major reason HDFS is predominantly used are the specific durability requirements of HBase's write-ahead log (WAL) and HDFS providing that guarantee correctly. However, HBase's use of HDFS for WALs can be replaced with sufficient effort.
This talk will cover the design of a "Log Service" which can be embedded inside of HBase that provides a sufficient level of durability that HBase requires for WALs. Apache Ratis (incubating) is a library-implementation of the RAFT consensus protocol in Java and is used to build this Log Service. We will cover the design choices of the Ratis Log Service, comparing and contrasting it to other log-based systems that exist today. Next, we'll cover how the Log Service "fits" into HBase and the necessary changes to HBase which enable this. Finally, we'll discuss how the Log Service can simplify the operational burden of HBase.
Actor Model is a general model of concurrent computation developed by Carl Hewitt in 1973. It provides a flexible mechanism for building parallel and distributed software systems. In recent years the advent of multi-core architecture and massive cloud-based concurrent applications renewed the interest in Actor-based programming, as it helps in development of reliable, scalable and massively-concurrent computer systems. Therefore actor frameworks are available for every programming language and their implementations are currently used by the major web service competitors such as Linkedin, Twitter, Amazon, Yahoo!, Facebook and Microsoft.
스타트업 얼라이언스 화요일 테헤란로 런치클럽에서는 AWS(Amazon Web Services)에 대해 알아보는 시간을 갖고자합니다. AWS가 제공하는 다양한 프로그램들에는 무엇이 있는지, 국내 스타트업은 과연 어떻게 AWS를 활용하고 있는지에 대해 AWS의 테크에반젤리스트 윤석찬님이 자세히 그리고 꼼꼼히 설명해주신다고 합니다. 또한 국내 스타트업들이 AWS를 가장 잘, 멋지게 활용하기 위해서는 어떻게 해야 하는지 실제로 AWS를 활용하고 있는 스타트업인 HB Smith가 경험을 공유해주신다고 하는데요.
AWS의 윤석찬님, HB Smith 한종원 대표님, 윤제상 CTO와 함께 스타트업 성공을 위한 AWS 첫걸음은 어떻게 내딛어야 할지 만나보세요.
Storage Requirements and Options for Running Spark on KubernetesDataWorks Summit
In a world of serverless computing users tend to be frugal when it comes to expenditure on compute, storage and other resources. Paying for the same when they aren’t in use becomes a significant factor. Offering Spark as service on cloud presents very unique challenges. Running Spark on Kubernetes presents a lot of challenges especially around storage and persistence. Spark workloads have very unique requirements of Storage for intermediate data, long time persistence, Share file system and requirements become very tight when it same need to be offered as a service for enterprise to mange GDPR and other compliance like ISO 27001 and HIPAA certifications.
This talk covers challenges involved in providing Serverless Spark Clusters share the specific issues one can encounter when running large Kubernetes clusters in production especially covering the scenarios related to persistence.
This talk will help people using Kubernetes or docker runtime in production and help them understand various storage options available and which is more suitable for running Spark workloads on Kubernetes and what more can be done
This session will give attendees an overview of the new testing features in Spring 3.1 as well the new Spring MVC test support. Sam Brannen will demonstrate how to use the Spring TestContext Framework to write integration tests for Java-based Spring configuration using @Configuration classes. He'll then compare and contrast this approach with XML-based configuration and follow up with a discussion of the new testing support for bean definition profiles. Next, Rossen Stoyanchev will show attendees how testing server-side code with annotated controllers and client-side code with the RestTemplate just got a whole lot easier with the new Spring MVC test support. Come to this session to see these new Spring testing features in action and learn how you can get involved in the Spring MVC Test Support project.
Amazon Aurora is a relational database built for the cloud and is compatible with MySQL and PostgreSQL. It combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open-source databases. In this session, we cover some of the key innovations in the Aurora database engine and storage layers. We explain recently announced features, such as Aurora Serverless, Aurora Multi-Master, and Aurora Parallel Query, and we discuss best practices and optimal configurations. See why Aurora is a great fit for new application development and for migrations from overpriced, restrictive commercial databases.
최고의 속도와 미션 크리티컬 업무를 수행하기 위한, 'In-Memory-Computing 글로벌 리더 GridGain 솔루션' 을 소개합니다. 그리드 게인은 데이터 집약적인 애플리케이션을 분산 컴퓨팅을 통해 가속화하고 확장하는 인메모리 컴퓨팅 플랫폼 솔루션입니다. www.all-dt4u.com/
[주요 특성]
1.속도 : 메모리에 데이터를 로드(Load)하여 최대 백만배 빠른 속도
2.확장성 : 분산 및 병렬 처리로 비즈니스 로직 전체 실행 시간 감소
3. 디지털 트렌스포메이션 : 메모리 집약적인 아키텍쳐 기반으로 신속한 접근과 처리 가능
4. 중앙 집중식 관리 : 클러스터 실시간 모니터링 및 특정 이벤트 발생 시 알림 기능
5. 고객에 최적화된 통합 : RDBMS, NoSQL, 하둡 등 데이터베이스와 통합 가능
"GridGain은 오픈소스 Apache Ignite 기반의 In-Memory Computing 플랫폼으로, 웹 규모 애플리케이션, SaaS 및 클라우드 Conputing, 모바일 및 IoT 백엔드, 실시간 데이터 처리, 빅데이터 분석 등 분야에 성능 향상을 지원 합니다. "
OpenSearch는 배포형 오픈 소스 검색과 분석 제품군으로 실시간 애플리케이션 모니터링, 로그 분석 및 웹 사이트 검색과 같이 다양한 사용 사례에 사용됩니다. OpenSearch는 데이터 탐색을 쉽게 도와주는 통합 시각화 도구 OpenSearch와 함께 뛰어난 확장성을 지닌 시스템을 제공하여 대량 데이터 볼륨에 빠르게 액세스 및 응답합니다. 이 세션에서는 실제 동작 구조에 대한 설명을 바탕으로 최적화를 하기 위한 방법과 운영상에 발생할 수 있는 이슈에 대해서 알아봅니다.
Redis has exploded in popularity to become the de-facto standard for in-memory key-value store used by customers for fast data storage to accelerate databases and applications. In this talk, we will discuss how to leverage Redis to achieve blazing fast performance in a variety of use cases – from database caching, to messaging, queuing, IoT and more. Both high-level architecture considerations and implementation (with code snippets) will be covered. We will also see how using Amazon ElastiCache makes it easy to power your Redis workloads in a robust, secure and fully managed way.
EKS에서 Opentelemetry로 코드실행 모니터링하기 - 신재현 (인덴트코퍼레이션) :: AWS Community Day Online...AWSKRUG - AWS한국사용자모임
EKS환경에서 Opentelemetry와 Jaeger를 활용하여 서버의 코드가 잘 동작하는지 어떤로직에서 문제가 발생했는지 모니터링 하는 방법을 알아봅니다. 마지막으로 Grafana를 이용해 쉽게 원하는 코드를 조회 하는 방법도 실습해볼 예정입니다. K8S를 모르셔도 참석할 수 있습니다.
Floating on a RAFT: HBase Durability with Apache RatisDataWorks Summit
In a world with a myriad of distributed storage systems to choose from, the majority of Apache HBase clusters still rely on Apache HDFS. Theoretically, any distributed file system could be used by HBase. One major reason HDFS is predominantly used are the specific durability requirements of HBase's write-ahead log (WAL) and HDFS providing that guarantee correctly. However, HBase's use of HDFS for WALs can be replaced with sufficient effort.
This talk will cover the design of a "Log Service" which can be embedded inside of HBase that provides a sufficient level of durability that HBase requires for WALs. Apache Ratis (incubating) is a library-implementation of the RAFT consensus protocol in Java and is used to build this Log Service. We will cover the design choices of the Ratis Log Service, comparing and contrasting it to other log-based systems that exist today. Next, we'll cover how the Log Service "fits" into HBase and the necessary changes to HBase which enable this. Finally, we'll discuss how the Log Service can simplify the operational burden of HBase.
Solving the C20K problem: Raising the bar in PHP Performance and ScalabilityZendCon
How do you configure and tune your PHP applications to handle 20,000
or more concurrent connections to your database on your desktop? This technical session describes how to implement and tune PHP's OCI8 extension with Oracle's Database Resident Connection Pool (DRCP).
Instant J Chem: one-stop information hub for medicinal chemists: US UGM 2008ChemAxon
Instant JChem is ChemAxon's desktop solution for chemistry. We will present the recent developments which have been primarily in improving the ability to deploy Instant JChem to a large community of users, and for those users to share information. We will also describe the functionality that is currently under development.
A presentation on how applying Cloud Architecture Patterns using Docker Swarm as orchestrator is possible to create reliable, resilient and scalable FIWARE platforms.
JavaOne 2016
JMS is pretty simple, right? Once you’ve mastered topics and queues, the rest can appear trivial, but that isn’t the case. The queuing system, whether ActiveMQ, OpenMQ, or WebLogic JMS, provides many more features and settings than appear in the Java EE documentation. This session looks at some of the important extended features and configuration settings. What would you need to optimize if your messages are large or you need to minimize prefetching? What is the best way to implement time-delayed messages? The presentation also looks at dangerous bugs that can be introduced via simple misconfigurations with pooled beans. The JMS APIs are deceptively simple, but getting an implementation into production and tuned correctly can be a bit trickier.
Gear6 and Scaling Website Performance: Caching Session and Profile Data with...Gear6
This is a presentation given on April 14, 2009 to a select group of current memcached users. It includes survey results of how the dynamic web has given rise to the distributed caching tier, describes the growing popularity of memcached, provides poll results from memcached users and offers overview of the Gear6 Web Cache solution. Gear6 will be at the 2009 MySQL Conference at booth #218. Or visit us at Gear6.com.
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
8. Common Trade-Offs
• Messaging Domain
• Durability v. Persistence
• Message acks v. transactions
• Message consumption types
8
9. Messaging Domains
• Do all consumers need a copy of the
messages?
• What if consumers are disconnected?
• Can consumers deal with missing
messages?
• Do you need request/reply messaging?
9
10. Durability v. Persistence
• What quality of service do you need?
– Durability - should messages be held while
consumer is offline?
– Persistence - used to preserve messages in
the event of a JMS provider failure
10
11. Message Acks v.
Transactions
• When messages are received, the
consumer must acknowledge the
message
– There is no unacknowledge!
• Transactions allow for:
– Rollback for error handling
– Batching for speed
11
12. Synchronous Message
Consumption
public class MyConsumer {
...
public void doCreateConsumer() {
Destination destination =
consumer.getSession().createQueue(quot;JOBS.quot; + job);
MessageConsumer messageConsumer =
consumer.getSession().createConsumer(destination);
while ((message = consumer.receive(timeout)) != null) {
processMessage(message);
}
}
...
}
12
13. Asynchronous Message
Consumption
public class MyConsumer {
...
public void doCreateConsumer() {
Destination destination =
consumer.getSession().createQueue(quot;JOBS.quot; + job);
MessageConsumer messageConsumer =
consumer.getSession().createConsumer(destination);
messageConsumer.setMessageListener(new MyMessageListener(job));
}
...
}
13
14. How can the broker be
clustered to improve
scalability or guarantee
availability?
• Let’s talk about two features
– Network of brokers
– Master/slave
14
17. Transport Connectors
• Client-to-broker connections
– Similar to JDBC connections to a database
• Various protocols are supported:
– VM
– TCP
– NIO
– UDP
– SSL
– HTTP/S
17
18. Clients Should Be
Configured For Failover
• Use the failover protocol:
failover:(tcp://broker1:61616,tcp://broker2:61616,
tcp://broker3:61616)?initialReconnectDelay=100
18
20. Networks of Brokers
• Provides large scalability
• ActiveMQ store-and-forward allows
messages to traverse brokers
– Demand-based forwarding
– Some people call this distributed queues
• Many possible configurations or
topologies are supported
20
27. Three Types of
Master/Slave
• Pure master/slave
• Shared filesystem master/slave
• JDBC master/slave
27
28. Pure Master/Slave
• Shared nothing, fully replicated topology
– Does not depend on shared filesystem or
database
• A Slave broker consumes all message
states from the Master broker
(messages, acks, tx states)
• Slave does not start any networking or
transport connectors
28
29. Pure Master/Slave
• Master broker will only respond to client
when a message exchange has been
successfully passed to the slave broker
29
30. Pure Master/Slave
• If the master fails, the slave optionally
has two modes of operation:
– Start up all it’s network and transport
connectors
• All clients connected to failed Master resume
on Slave
– Close down completely
• Slave is simply used to duplicate state from
Master
30
31. Shared Filesystem
Master/Slave
• Utilizes a directory on a shared
filesystem
• No restriction on number of brokers
• Simple configuration (point to the data
dir)
• One master selected at random
31
32. JDBC Master/Slave
• Recommended when using a shared
database
• No restriction on the number of brokers
• Simple configuration
• Clustered database negates single
point of failure
• One master selected at random
32
33. Client Connectivity
With Master/Slave
• Clients should use failover transport:
failover://(tcp://masterhost:61616,
tcp://slavehost:61616)?randomize=false
33
34. How can the broker be
clustered to improve
scalability or guarantee
availability?
• Create a network of brokers
• Use master/slave for broker failover
34
35. High Availability and
Fault Tolerance
• RAIDed disks
• A Storage Area Network
• Clustered relational databases
• Clustered JDBC via C-JDBC
– http://c-jdbc.objectweb.org/
35
36. What's the real difference
between message
persistence strategies?
36
37. AMQ Message Store
• Transactional message storage solution
• Fast and reliable
• Composed of two parts:
– Data Store - holds messages in a transactional
journal
– Reference store - stores message locations for
fast retrieval
• The default message store in ActiveMQ 5
37
39. Journaled JDBC
• Transactional message storage solution
• Reliable and faster than non-journaled
• Two-piece store
– Journal - A high-performance, transactional
journal
– Database - A relational database of your
choice
• Default database in ActiveMQ 4.x is
Apache Derby
39
40. Message Cursors
• Messages are no longer stored in
memory
– Previous to 5.1, message references were
stored in memory
• Messages are paged in from storage
when space is available in memory
40
41. What security options are
available?
• Authentication
– I.e., are you allowed to connect to ActiveMQ?
• Authorization
– I.e., do you have permission to use that
ActiveMQ resource?
41
44. What's the best way to
connect non-Java clients?
• Let’s talk about wire formats
44
45. Wire Formats
• OpenWire
– The default in ActiveMQ; a binary protocol
• STOMP
– Simple Text Oriented Messaging Protocol; a text based protocol
• XMPP
– The Jabber XML protocol
• REST
– HTTP POST and GET
• AMQP
– Not yet fully supported
45
46. OpenWire
• A binary wire level protocol for
marshaling objects to/from byte arrays
• Designed for performance
– Sacrificed some ease of implementation
• Clients for C++, Java and .NET
– The default is Java
46
47. STOMP
• A text-based wire level protocol
• Designed to be very easy to understand
– Encourages implementation in additional
languages
• Can be easily demonstrated via telnet
• Clients for C, Javascript, Perl, PHP,
Python, Ruby and more
47
48. What's the best approach if
a producer or consumer
may be down for
some time?
48
49. Use the failover Protocol
• Utilize the failover options
– initialReconnectDelay - wait before reconnect
– maxReconnectDelay - max time between reconnects
– useExponentialBackOff - exponentially grow time between
reconnects
– backOffMultiplier - multiplier for backoff
– maxReconnectAttempts - max number of reconnects
– randomize - randomly choose from list of brokers
– backup - start and hold a hot standby connection
49
50. Use Producer Flow Control
• Prevents slow consumers from being
flooded
...
<destinationPolicy>
<policyMap>
<policyEntries>
<policyEntry topic=quot;FOO.>quot;
producerFlowControl=quot;falsequot;
memoryLimit=quot;128mbquot;>
</policyEntries>
</policyMap>
</destinationPolicy>
...
50
53. Message Prefetch
• Used for slow consumer situations
– Consumer is flooded by messages from the broker
• FIFO buffer on the consumer side
53
54. Async Dispatch
• Asynchronous message delivery to
consumers
– Default is true
• Useful for slow consumers
– Incurs a bit of overhead
54
55. Exclusive Consumers
• Anytime more than one consumer is consuming
from a queue, message order is lost
• Allows a single consumer to consume all
messages on a queue to maintain message
ordering
55
56. Consumer Priority
• Just like it sounds
– Gives a consumer priority for message delivery
– Allows for the weighting of consumers to optimize
network traversal for message delivery
56
57. Message Groups
• Uses the JMSXGroupID property to define which
message group a message belongs
– Guarantees ordered processing of related messages across a
single destination
– Load balancing of message processing across multiple
consumers
– HA/failover if consumer goes down
57
58. Redelivery Policy
• Messages are redelivered to a client
when:
– A transacted session is rolled back
– A transacted session is closed before commit
– A session is using CLIENT_ACKNOWLEDGE
and Session.recover() is explicitly called
58
59. Retroactive Consumer
• Message replay at start of a subscription
– At the start of every subscription, send any old
messages that the consumer may have missed
– Configurable via policies
59
61. Selectors
• Used to attach a filter to a subscription
• Defined using a subset SQL 92 syntax
• JMS selectors
– Filters only message properties
• JMSType = ‘stock’ and trader = ‘bob’ and price < ‘105’
• XPath selectors
– Filters message bodies that contain XML
• ‘/message/cheese/text() = 'swiss'’
61
63. Slow Consumer Strategies
• Various configurable strategies for handling
slow consumers
• Slow consumer situations are very common
• Caused by:
– Slow network connections
– Unreliable network connections
– Busy network situations
– Busy JVM situations
– Half disconnects with sockets
63
64. Use Message Limit
Strategies
• PendingMessageLimitStrategy
– Calculates the max number of pending messages
to be held in memory for a consumer above its
prefetch size
• ConstantPendingMessageLimitStrategy
– A constant limit for all consumers
• PrefetchRatePendingMessageLimitStrategy
– Calculates the max number of pending messages
using a multiplier of the consumers prefetch size
64
65. Use Prefetch and
an Eviction Policy
• Use the prefetch policy
– The prefetch policy has a property named
maximumPendingMessageLimit that can be used on
a per connection or per consumer basis
• Use a message eviction policy
– oldestMessageEvictionStrategy - Evict the oldest
messages first
– oldestMessageWithLowestPriorityEvictionStrategy -
Evict the oldest messages with the lowest priority first
65
66. Use Destination Policies
• Configured on the destination policies in
the ActiveMQ XML configuration file
• Combined with wildcards, this is very
powerful
66
67. Additional Tips
• Consider configuring message cursors
• The status of slow consumers can be monitored via
JMX properties
– discarded - The count of how many messages have been
discarded during the lifetime of the subscription due to it being a
slow consumer
– matched - The current number of messages matched and to be
dispatched to the subscription as soon as some capacity is
available in the prefetch buffer. So a non-zero value implies that
the prefetch buffer is full for this subscription
67
68. How to monitor individual
messages, queue depths,
or other broker statistics?
• JMX
• ActiveMQ web console
• Additional consumers
– Camel routes
• SpringSource AMS
– Based on Hyperic
• IONA FuseHQ
68
– Based on Hyperic