This document provides an overview of IBM MQ's latest features including 64-bit buffer pools, 8-byte log RBAs, channel initiator statistics and accounting data, and the use of storage class memory (flash storage) with coupling facilities. The key points discussed are:
- 64-bit buffer pools allow larger buffer pools above the 2GB bar with up to 999,999,999 buffers per pool for improved performance.
- 8-byte log RBAs increase the log RBA range from 255TB to over 5000 years, avoiding disruptive queue manager restarts.
- New SMF records provide visibility into channel initiator performance and accounting data for monitoring, capacity planning, and issue diagnosis.
- Coupling
Hhm 3479 mq clustering and shared queues for high availabilityPete Siddall
we review clustering and shared queue technologies, their differences and synergies, as a foundation for building a highly available messaging service with resilience during both planned and unplanned outages of z Systems components.
This document discusses IBM MQ clustering and how it provides availability, scalability, and workload balancing. It describes how to set up a basic two node cluster with full repository queue managers and cluster receiver and sender channels. It then discusses more advanced clustering capabilities like supporting multiple applications and global deployments spanning different regions.
IBM WebSphere MQ: Managing Workloads, Scaling and Availability with MQ ClustersDavid Ware
IBM WebSphere MQ Clustering can be used to solve many problems, from simplified administration and workload management in an MQ network, to horizontal scalability and continuous availability of messaging applications. This session will show the full range of uses of MQ Clusters to solve real problems, highlighting the underlying technology being used.
This has been superseded by http://www.slideshare.net/DavidWare1/ame-2273-mq-clustering-pdf
IBM MQ - better application performanceMarkTaylorIBM
Presented in Feb 2015 at Interconnect
This presentation is aimed at helping application developers understand how to best use MQ features for higher performance.
IBM MQ - High Availability and Disaster RecoveryMarkTaylorIBM
IBM MQ provides capabilities to keep data safe and businesses running in the event of failures. This includes solutions for high availability (HA) and disaster recovery (DR) whether running on-premises or in hybrid cloud environments. HA aims to keep systems running through failures while DR focuses on recovering after an HA failure. Key HA technologies in IBM MQ include queue manager clusters, queue sharing groups, multi-instance queue managers, and HA clusters. These solutions provide redundancy to prevent single points of failure and enable fast failover. DR requires replicating data to separate sites which IBM MQ supports through various backup and replication features.
Hhm 3479 mq clustering and shared queues for high availabilityPete Siddall
we review clustering and shared queue technologies, their differences and synergies, as a foundation for building a highly available messaging service with resilience during both planned and unplanned outages of z Systems components.
This document discusses IBM MQ clustering and how it provides availability, scalability, and workload balancing. It describes how to set up a basic two node cluster with full repository queue managers and cluster receiver and sender channels. It then discusses more advanced clustering capabilities like supporting multiple applications and global deployments spanning different regions.
IBM WebSphere MQ: Managing Workloads, Scaling and Availability with MQ ClustersDavid Ware
IBM WebSphere MQ Clustering can be used to solve many problems, from simplified administration and workload management in an MQ network, to horizontal scalability and continuous availability of messaging applications. This session will show the full range of uses of MQ Clusters to solve real problems, highlighting the underlying technology being used.
This has been superseded by http://www.slideshare.net/DavidWare1/ame-2273-mq-clustering-pdf
IBM MQ - better application performanceMarkTaylorIBM
Presented in Feb 2015 at Interconnect
This presentation is aimed at helping application developers understand how to best use MQ features for higher performance.
IBM MQ - High Availability and Disaster RecoveryMarkTaylorIBM
IBM MQ provides capabilities to keep data safe and businesses running in the event of failures. This includes solutions for high availability (HA) and disaster recovery (DR) whether running on-premises or in hybrid cloud environments. HA aims to keep systems running through failures while DR focuses on recovering after an HA failure. Key HA technologies in IBM MQ include queue manager clusters, queue sharing groups, multi-instance queue managers, and HA clusters. These solutions provide redundancy to prevent single points of failure and enable fast failover. DR requires replicating data to separate sites which IBM MQ supports through various backup and replication features.
HHM-2833: Where is My Message?: Using IBM MQ Tools to Work Out What Applicati...Matt Leming
Every MQ infrastructure team member has been asked this question, and most developers who have worked with MQ have asked it:
"Where is my message?" In this session, we look into the tools that MQ provides to find your messages.
We demonstrate how to analyze the MQ recovery log on distributed platforms to find out what happened to your persistent messages,
with the assistance of a new tool. We also look at how to trace the route messages take through your MQ infrastructure, and how to generate
and analyze activity reports showing the behavior of MQ applications.
IBM MQ Version 8.0.0.4 includes new features such as message expiry caps, event formatting samples, command and configuration events for security changes, and integration of MQLight. It also improves SSL/TLS configuration verification and provides a relocatable MQ client. Future plans include more frequent delivery of incremental changes.
IBM MQ: Managing Workloads, Scaling and Availability with MQ ClustersDavid Ware
MQ Clustering can be used to solve many problems, from simplified administration and workload management in an MQ network, to horizontal scalability and continuous availability of messaging applications. This session will show the full range of uses of MQ Clusters to solve real problems, highlighting the underlying technology being used. A basic understanding of IBM MQ clustering would be beneficial.
IBM MQ: Using Publish/Subscribe in an MQ NetworkDavid Ware
The publish/subscribe model can be used across a network of MQ queue managers, whether in a manually configured topology or in an MQ cluster. This session looks in-depth at designing such systems, covering a wide range of requirements from availability to scalability, and explaining how they can be addressed. A basic understanding of publish/subscribe in MQ would be beneficial for attendees.
For an introduction to MQ publish/subscribe, first see this presentation: http://www.slideshare.net/DavidWare1/ame-2271-mq-publish-subscribe-pdf
IBM MQ High Availabillity and Disaster Recovery (2017 version)MarkTaylorIBM
This document discusses high availability and disaster recovery strategies for IBM MQ. It describes technologies like queue manager clusters, multi-instance queue managers, and HA clusters that can be used to provide high availability when failures occur across datacenters and clouds. Multi-instance queue managers provide basic failover of a queue manager between two systems without an HA cluster. HA clusters coordinate failover of resources like the queue manager, shared storage, and IP address across multiple machines for increased reliability. The IBM MQ Appliance also supports high availability between two appliances.
IBM MQ - Monitoring and Managing Hybrid Messaging EnvironmentsMarkTaylorIBM
This presentation was given at Interconnect 2016. It starts by showing the interfaces within MQ for management and monitoring, and then shows how these are used within a cloud environment to control the delivery of a service-based messaging system.
HHM 6887 Managing Your Scalable Applications in an MQ Hybrid Cloud Worldmatthew1001
This document provides an overview of IBM MQ sessions at the InterConnect 2017 conference, including:
- A schedule of MQ sessions occurring each day of the conference across topics like the MQ Appliance, hybrid cloud, and security.
- A brief description of each session including titles and speakers.
- A notice that the information provided is subject to change and limitations on warranties and liability.
Where is My Message?: Use MQ Tools to Work Out What Applications Have DoneMorag Hughson
Every MQ infrastructure team member has been asked this question, and most developers who have worked with MQ have asked it: "Where is my message?" In this session, we look into the tools that MQ provides to find your messages. We show how to analyze the MQ recovery log on distributed platforms to find out what happened to your persistent messages, with the assistance of a new tool. We also look at how to trace the route messages take through your MQ infrastructure, and how to generate and analyze activity reports showing the behavior of MQ applications.
Presentation from Robin Wiley.
DataPower can connect to MQ as a client, sending and receiving messages to and from queues. Unlike traditional MQ client programming, the DataPower client interface has certain predefined functions that limit the scope of activities that can be performed. This session will explain what you can and can't do when integrating DataPower into your MQ infrastructure. Topics covered will include syncpoint processing, message grouping, message properties, JMS considerations, connec-tion options, and many more.
The document provides an overview of the fundamentals of Websphere MQ including:
- The key MQ objects like messages, queues, channels and how they work
- Basic MQ administration tasks like defining, displaying, altering and deleting MQ objects using MQSC commands
- Hands-on exercises are included to demonstrate programming with MQ and administering MQ objects
Secure Messages with IBM WebSphere MQ Advanced Message SecurityMorag Hughson
In some scenarios, securing access to a messaging infrastructure is not enough - teams must also secure access to message content. Come to this session to learn how to provide end-to-end message protection where message contents are secure from the point they are sent to the point they are received, including while at rest on queues. This session starts by describing the theory and capabilities of the product. Then CSX provides a real-world customer example in which it presents its experiences and recommendations for securing messages across distributed and z/OS platforms. Topics covered include an overview of message level security, when it is appropriate to deploy this level of protection, how the message protection is applied, how it can be administered, and the new features available in the latest version of IBM WebSphere MQ.
Choosing the right high availability strategyMariaDB plc
This document discusses different high availability strategies for MariaDB databases. It covers asynchronous and semi-synchronous replication, which provide redundancy and failover capabilities but can have data loss risks. Synchronous replication with Galera Cluster is also described, which guarantees no data loss but has higher latency. Other topics include terminology, data redundancy approaches, and how features can be combined for resilient configurations.
IBM WebSphere MQ for z/OS V8 - Latest Features Deep DiveDamon Cross
WebSphere MQ for z/OS V8 makes use of many system features and facilities to provide a very
high level of availability and performance for your messages. Come along to this session to learn
the detail behind all the new features and enhancements in the latest release of WebSphere MQ
for z/OS.
Training Slides: Basics 102: Introduction to Tungsten ClusteringContinuent
This document provides an introduction to Continuent Tungsten clustering. It discusses key benefits like high availability, multi-site deployment, and ease of use. It examines the clustering architecture including topologies, automatic and manual failover, and rolling maintenance procedures. Commands for monitoring and managing the cluster are also reviewed, including cctrl and tpm diag. A demo shows using cctrl to perform a manual failover by promoting a slave to master.
Keeping track of your messaging infrastructure is essential to be able to rapidly respond to your changing business demands whilst complying with your constantly changing audit demands. This session will provide illustrations and insight on the techniques and capabilities available in IBM MQ to help you meet these monitoring and auditing demands.
The document discusses the benefits of meditation for reducing stress and anxiety. Regular meditation practice can help calm the mind and body by lowering heart rate and blood pressure. Studies have shown that meditating for just 10-20 minutes per day can have significant positive impacts on both mental and physical health over time.
Monitoring and problem determination of your mq distributed systemsmatthew1001
The document discusses various tools for monitoring MQ distributed systems over time, including accounting and statistics messages, and system topics. Accounting and statistics messages provide overlapping information and are written to dedicated queues when enabled. System topics do not require enabling and provide more granular data on MQ resources as well as broader system metrics, making them better for multiple concurrent consumers.
Building a Highly available messaging hub using the IBM MQ ApplianceAnthony Beardsmore
The MQ Appliance includes two key facilities for maintaining the availability of your messaging infrastructure across expected and unexpected outages. This session looks in depth at the HA and DR capabilities of the MQ Appliance and application considerations when using them.
The document discusses new features in IBM MQ for z/OS Version 8 including 64-bit buffer pools that allow for larger pool sizes and more buffers to improve performance, an increase from 6 to 8 bytes for the log relative byte address to support higher throughput and prevent queue managers from terminating early due to log space issues, and enhancements to channel initiator statistics and accounting data.
In this presentation from the DDN User Meeting at SC13, Tommy Minyard from the Texas Advanced Computing Center describes TACC's new Corral data storage system.
Watch the video presentation: http://insidehpc.com/2013/11/13/ddn-user-meeting-coming-sc13-nov-18/
HHM-2833: Where is My Message?: Using IBM MQ Tools to Work Out What Applicati...Matt Leming
Every MQ infrastructure team member has been asked this question, and most developers who have worked with MQ have asked it:
"Where is my message?" In this session, we look into the tools that MQ provides to find your messages.
We demonstrate how to analyze the MQ recovery log on distributed platforms to find out what happened to your persistent messages,
with the assistance of a new tool. We also look at how to trace the route messages take through your MQ infrastructure, and how to generate
and analyze activity reports showing the behavior of MQ applications.
IBM MQ Version 8.0.0.4 includes new features such as message expiry caps, event formatting samples, command and configuration events for security changes, and integration of MQLight. It also improves SSL/TLS configuration verification and provides a relocatable MQ client. Future plans include more frequent delivery of incremental changes.
IBM MQ: Managing Workloads, Scaling and Availability with MQ ClustersDavid Ware
MQ Clustering can be used to solve many problems, from simplified administration and workload management in an MQ network, to horizontal scalability and continuous availability of messaging applications. This session will show the full range of uses of MQ Clusters to solve real problems, highlighting the underlying technology being used. A basic understanding of IBM MQ clustering would be beneficial.
IBM MQ: Using Publish/Subscribe in an MQ NetworkDavid Ware
The publish/subscribe model can be used across a network of MQ queue managers, whether in a manually configured topology or in an MQ cluster. This session looks in-depth at designing such systems, covering a wide range of requirements from availability to scalability, and explaining how they can be addressed. A basic understanding of publish/subscribe in MQ would be beneficial for attendees.
For an introduction to MQ publish/subscribe, first see this presentation: http://www.slideshare.net/DavidWare1/ame-2271-mq-publish-subscribe-pdf
IBM MQ High Availabillity and Disaster Recovery (2017 version)MarkTaylorIBM
This document discusses high availability and disaster recovery strategies for IBM MQ. It describes technologies like queue manager clusters, multi-instance queue managers, and HA clusters that can be used to provide high availability when failures occur across datacenters and clouds. Multi-instance queue managers provide basic failover of a queue manager between two systems without an HA cluster. HA clusters coordinate failover of resources like the queue manager, shared storage, and IP address across multiple machines for increased reliability. The IBM MQ Appliance also supports high availability between two appliances.
IBM MQ - Monitoring and Managing Hybrid Messaging EnvironmentsMarkTaylorIBM
This presentation was given at Interconnect 2016. It starts by showing the interfaces within MQ for management and monitoring, and then shows how these are used within a cloud environment to control the delivery of a service-based messaging system.
HHM 6887 Managing Your Scalable Applications in an MQ Hybrid Cloud Worldmatthew1001
This document provides an overview of IBM MQ sessions at the InterConnect 2017 conference, including:
- A schedule of MQ sessions occurring each day of the conference across topics like the MQ Appliance, hybrid cloud, and security.
- A brief description of each session including titles and speakers.
- A notice that the information provided is subject to change and limitations on warranties and liability.
Where is My Message?: Use MQ Tools to Work Out What Applications Have DoneMorag Hughson
Every MQ infrastructure team member has been asked this question, and most developers who have worked with MQ have asked it: "Where is my message?" In this session, we look into the tools that MQ provides to find your messages. We show how to analyze the MQ recovery log on distributed platforms to find out what happened to your persistent messages, with the assistance of a new tool. We also look at how to trace the route messages take through your MQ infrastructure, and how to generate and analyze activity reports showing the behavior of MQ applications.
Presentation from Robin Wiley.
DataPower can connect to MQ as a client, sending and receiving messages to and from queues. Unlike traditional MQ client programming, the DataPower client interface has certain predefined functions that limit the scope of activities that can be performed. This session will explain what you can and can't do when integrating DataPower into your MQ infrastructure. Topics covered will include syncpoint processing, message grouping, message properties, JMS considerations, connec-tion options, and many more.
The document provides an overview of the fundamentals of Websphere MQ including:
- The key MQ objects like messages, queues, channels and how they work
- Basic MQ administration tasks like defining, displaying, altering and deleting MQ objects using MQSC commands
- Hands-on exercises are included to demonstrate programming with MQ and administering MQ objects
Secure Messages with IBM WebSphere MQ Advanced Message SecurityMorag Hughson
In some scenarios, securing access to a messaging infrastructure is not enough - teams must also secure access to message content. Come to this session to learn how to provide end-to-end message protection where message contents are secure from the point they are sent to the point they are received, including while at rest on queues. This session starts by describing the theory and capabilities of the product. Then CSX provides a real-world customer example in which it presents its experiences and recommendations for securing messages across distributed and z/OS platforms. Topics covered include an overview of message level security, when it is appropriate to deploy this level of protection, how the message protection is applied, how it can be administered, and the new features available in the latest version of IBM WebSphere MQ.
Choosing the right high availability strategyMariaDB plc
This document discusses different high availability strategies for MariaDB databases. It covers asynchronous and semi-synchronous replication, which provide redundancy and failover capabilities but can have data loss risks. Synchronous replication with Galera Cluster is also described, which guarantees no data loss but has higher latency. Other topics include terminology, data redundancy approaches, and how features can be combined for resilient configurations.
IBM WebSphere MQ for z/OS V8 - Latest Features Deep DiveDamon Cross
WebSphere MQ for z/OS V8 makes use of many system features and facilities to provide a very
high level of availability and performance for your messages. Come along to this session to learn
the detail behind all the new features and enhancements in the latest release of WebSphere MQ
for z/OS.
Training Slides: Basics 102: Introduction to Tungsten ClusteringContinuent
This document provides an introduction to Continuent Tungsten clustering. It discusses key benefits like high availability, multi-site deployment, and ease of use. It examines the clustering architecture including topologies, automatic and manual failover, and rolling maintenance procedures. Commands for monitoring and managing the cluster are also reviewed, including cctrl and tpm diag. A demo shows using cctrl to perform a manual failover by promoting a slave to master.
Keeping track of your messaging infrastructure is essential to be able to rapidly respond to your changing business demands whilst complying with your constantly changing audit demands. This session will provide illustrations and insight on the techniques and capabilities available in IBM MQ to help you meet these monitoring and auditing demands.
The document discusses the benefits of meditation for reducing stress and anxiety. Regular meditation practice can help calm the mind and body by lowering heart rate and blood pressure. Studies have shown that meditating for just 10-20 minutes per day can have significant positive impacts on both mental and physical health over time.
Monitoring and problem determination of your mq distributed systemsmatthew1001
The document discusses various tools for monitoring MQ distributed systems over time, including accounting and statistics messages, and system topics. Accounting and statistics messages provide overlapping information and are written to dedicated queues when enabled. System topics do not require enabling and provide more granular data on MQ resources as well as broader system metrics, making them better for multiple concurrent consumers.
Building a Highly available messaging hub using the IBM MQ ApplianceAnthony Beardsmore
The MQ Appliance includes two key facilities for maintaining the availability of your messaging infrastructure across expected and unexpected outages. This session looks in depth at the HA and DR capabilities of the MQ Appliance and application considerations when using them.
The document discusses new features in IBM MQ for z/OS Version 8 including 64-bit buffer pools that allow for larger pool sizes and more buffers to improve performance, an increase from 6 to 8 bytes for the log relative byte address to support higher throughput and prevent queue managers from terminating early due to log space issues, and enhancements to channel initiator statistics and accounting data.
In this presentation from the DDN User Meeting at SC13, Tommy Minyard from the Texas Advanced Computing Center describes TACC's new Corral data storage system.
Watch the video presentation: http://insidehpc.com/2013/11/13/ddn-user-meeting-coming-sc13-nov-18/
This document describes the architecture and instruction set of a custom digital signal processor (DSP). The DSP contains a signal processing controller (SPC) that fetches and executes instructions. It has two multiplier-accumulator-RAM (MAR) units - one for real parts and one for imaginary parts - to perform complex arithmetic operations on digital signals. The SPC uses registers to address locations in the MARs and store complex numbers by separating the real and imaginary parts. Assembly code examples show how instructions implement operations like complex multiplication by manipulating data in the MARs.
Technical sales education enterprise- svc and ibm flash best practices updatesolarisyougood
- The document provides best practices for implementing IBM FlashSystem storage arrays behind an IBM SVC storage virtualization appliance.
- It covers SVC and FlashSystem updates, switch zoning, cabling considerations, basic SVC guidelines including supported release levels and port masking examples.
- The goal is to optimize performance when using FlashSystem with SVC by leveraging all SVC and FlashSystem ports and features like Real-time Compression and Easy Tier.
This document summarizes the Texas Advanced Computing Center's (TACC) experience using DDN's Infinite Memory Engine (IME) as a burst buffer for three HPC applications on the Stampede supercomputer. Initial testing showed I/O bottlenecks that were addressed by improving the InfiniBand topology. Performance testing found the IME provided significant acceleration over the Lustre parallel file system, with speedups ranging from 3.7x to 28x for the HACC cosmology code, 6.8x to 22.3x for the S3D combustion code, and 6.2x to 10.1x for the MADBench mini-app. The IME demonstrated its ability to scale and improve
The document outlines Oracle's announcement of enhancements to the SPARC Enterprise M-Series servers, including a new SPARC64 VII+ processor upgrade that will provide a 10-30% performance improvement over prior generations. The SPARC64 VII+ will be available starting in December 2011 for the M4000-M9000 servers and allows customers to preserve their investment in existing M-Series frames through another system upgrade.
Advanced High-Performance Computing Features of the OpenPOWER ISAGanesan Narayanasamy
Power ISA processors have a long history of offering superior features for HPC applications. Well known examples include POWER3, used in the ASCI White supercomputer, various PowerPC processors used in the Blue Gene family of massively parallel computers, and POWER9, present in the leading supercomputers of today, Summit and Sierra. OpenPOWER ISA has enabled open access to many of these features. IBM's most recent contribution to OpenPOWER ISA, in the form of Power ISA Version 3.1, includes the Matrix-Multiply Assist (MMA) instructions. The MMA instructions are designed to deliver additional performance both for classical high-performance computing, in the space of scientific and technical computing, and for the increasingly important space of business analytics. In addition, the Open Memory Interface (OMI), also developed by IBM, opens new levels of memory bandwidth and capacity for the most demanding applications. Our goal is to raise awareness of and interest in these new features, which we believe can lead to further research in processor architecture and programming environments. Some of the most promising application areas include graph algorithms, classical machine learning and deep learning.
The document provides an overview of MIPS 64-bit processors. It discusses that MIPS 64-bit architecture is backward compatible with MIPS32 and adds 64-bit addressing. Key features include 64-bit virtual addresses, instruction pointer and registers. It has separate integer and floating point units for high performance. The block diagram shows it has on-chip instruction and data caches, a write buffer, and dual issue superscalar pipelined architecture for high efficiency.
Larry Lawler from Unicom Global presented on their experience using CICS TS v5.1. Their system includes a z114 mainframe with 1 IFL processor and 1 zIIP processor, running z/OS 1.13 as a z/VM guest with 1.5GB memory. They run 15+ CICS regions at once supporting releases from TS 3.1 to 5.1. Key points from the presentation include: CICS TS 5.1 provides 64-bit addressing support for assembler programs; control blocks like the CPE, APE, and CSECT lists are now stored in 64-bit addressable storage; and areas like the TCA and AICB saw changes in v
VMworld 2013
Peter Boone, VMware
Seongbeom Kim, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
MAT 510 – Homework AssignmentHomework Assignment 6 Due.docxjessiehampson
MAT 510 – Homework Assignment
Homework Assignment 6
Due in Week 9 and worth 30 points
Suppose the number of equipment sales and service contracts that a store sold during the last six (6) months for treadmills and exercise bikes was as follows:
Equipment Sales and Service Contracts Sold
Treadmill
Exercise Bike
Total Sold
185
123
Service Contracts
67
55
The store can only sell a service contract on a new piece of equipment. Of the 185 treadmills sold, 67 included a service contract and 118 did not.
Complete the following questions in the space provided below:
1. Construct a 95 percent confidence interval for the difference between the proportions of service contracts sold on treadmills versus exercise bikes.
2. Is there a major difference between the two pieces of equipment? Why or why not?
Type your answers below and submit this file in Week 9 of the online course shell:
802.11 THROUGHPUT
comp40660 Assignment 1, February 2020
This assignment is worth 18% of the overall grade
Motivation
• Build a simple model of 802.11 frame exchange for TCP
and UDP, using OFDM of 802.11a and 802.11g
• The model will approximate the actual throughput of the
network
• RTS/CTS mechanism is enabled
• No contention
• Demonstration of the calculation for 802.11a – UDP case;
work on TCP case in lab.
• Assignment will be to modify for the .11g/n/ac/ax case for
both TCP and UDP.
802.11 Model
• Basic transactional model – 2 different transaction types, namely
UDP and TCP.
• Any 802.11 transmission of data (from higher layer) requires an
acknowledgement (ACK) by the .11 MAC.
• Each TCP / UDP packet is encapsulated in a single 802.11 frame.
Transport
Network
Data Link
Physical
Transport
Network
Data Link
PhysicalBits
Frame
Packet
Segment
802.11 Frame Exchange
UDP Case
• No guarantee of delivery
• Suitable for real-time applications such as VoIP, VoD
• UDP data encapsulated into 802.11 frame and
transmitted. Receiving station transmits 802.11 ACK.
Server Client
UDP
802.11 Frame Exchange
TCP Case
• Reliable delivery service guaranteeing that all bytes are
received and in correct order through TCP ACKs
• How is this different from the UDP case?
TCP
ACK
Server Client
Data Transmission
• 802.11 uses different inter-frame spaces:
• SIFS (Short Interframe Space)
• High-priority transmissions can begin once SIFS has elapsed
• ACK, RTS, CTS
• DIFS (DCF Interframe Space)
• Minimum idle time for contention-based services
• Stations can have access to the medium if it has been free for
a period longer than DIFS
Packet Headers
• 1500 bytes packet (TCP/UDP) is encapsulated:
• MAC header = 34 bytes
• SNAP LLC header = 8 bytes
• 3 bytes LLC (logical link control) header
• 5 bytes SNAP (sub-network access protocol) header
=> Total size = 1542 bytes
802.11a
• Amendment to the IEEE 802.11 specification
• 1999
• 5Ghz band
• Maximum data rate: 54 Mbps
• OFDM (Orthogonal Frequency Division.
The SCH5627P is a 3.3V PC 2001 compliant Super I/O controller with an LPC interface. All legacy drivers used for
Super I/O components are supported making this interface transparent to the supporting software. The LPC bus also
supports power management, such as wake-up and sleep modes.
Cache memory is a small, fast memory located between the CPU and main memory that temporarily stores frequently accessed data. It improves performance by providing faster access for the CPU compared to accessing main memory. There are different types of cache memory organization including direct mapping, set associative mapping, and fully associative mapping. Direct mapping maps each block of main memory to only one location in cache while set associative mapping divides the cache into sets with multiple lines per set allowing a block to map to any line within a set.
Project Slides for Website 2020-22.pptxAkshitAgiwal1
This document describes a resource efficient ternary content addressable memory (TCAM) architecture. It uses a pipelined layer architecture to increase operating frequency. The TCAM was implemented on an FPGA with a size of 64x32 and achieved a 10.52% higher speed, 7.62% lower power, and 50% lower resource utilization compared to existing designs. When implemented in ASIC using a 45nm process, the proposed TCAM achieved 121.10% higher speed, 70.12% lower power, and an 18.7x smaller area compared to existing designs.
The document discusses performance issues experienced when migrating a WebSphere MQ application from a non-IBM to IBM (AIX) platform while using confirmation on arrival (COA). Over several weeks of analysis and tuning by IBM and the customer, it was discovered that the IBM platform was using smaller TCP buffer sizes during channel negotiation than the non-IBM platform, despite tuning efforts. This explained the increasing message queue times seen on the IBM platform.
AMD and the new “Zen” High Performance x86 Core at Hot Chips 28AMD
The document summarizes a presentation about AMD's new "Zen" x86 CPU core architecture. The Zen architecture provides a 40% increase in instructions per clock compared to previous cores through improvements in the core engine, caches, floating point capabilities, and the addition of simultaneous multithreading. The Zen core was designed from the ground up to optimize performance and power efficiency across applications from notebooks to supercomputers.
The document summarizes the architecture and configuration of a large-scale data warehouse implemented at Yahoo using Oracle RAC on IBM x3850 servers. Key aspects included 16-node Oracle RAC with InfiniBand networking, EMC storage, large memory and CPU configurations to support multi-terabyte datasets and high query concurrency. Comprehensive testing was performed to validate performance and scalability requirements.
Scaling Kubernetes to Support 50000 Services.pptxthaond2
Scaling Kubernetes to Support 50,000 Services
The challenges of scaling Kubernetes include high API server load from managing a large number of services, pods and endpoints. Solutions tested include batch processing requests to reduce QPS, and restructuring iptables rules into a search tree for faster routing. IPVS was also tested and showed significantly better performance than iptables for large scale deployments, with constant latency for adding rules and higher network bandwidth. With these techniques, Kubernetes has been scaled to support over 50,000 services.
customization of a deep learning accelerator, based on NVDLAShien-Chun Luo
This document discusses customizing a deep learning accelerator. It begins with a demonstration of object detection using a Tiny YOLO v1 model on an FPGA-based prototype. It then discusses designing a high-efficiency accelerator with three steps: 1) increasing MAC processing elements and utilization, 2) increasing data supply, and 3) improving energy efficiency. Various neural network models are profiled to analyze memory bandwidth and computational power tradeoffs. The document proposes a customizable architecture and discusses solutions like layer fusion, quantization-aware training, and post-training quantization. Performance estimates using an equation-based profiler for sample models are provided to demonstrate the customized accelerator design.
The document provides an overview of updates to Juniper's MX platform, including new line cards and interface options for increased scale and performance. Key points include:
- New MPC5E and MPC6E line cards that provide increased throughput and interface flexibility with options like 100G interfaces.
- Software features for increased routing scale, virtualization support, and packet performance optimization techniques like "hypermode forwarding" and "turbo filters."
- A next generation port extender architecture for simplifying management of satellite devices connected to MX routers.
- EVPN and VXLAN support for using MX routers as data center gateways in multi-tenant cloud environments.
Similar to Hhm 3470 mq v8 and more recent new things for z os (20)
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...The Third Creative Media
"Navigating Invideo: A Comprehensive Guide" is an essential resource for anyone looking to master Invideo, an AI-powered video creation tool. This guide provides step-by-step instructions, helpful tips, and comparisons with other AI video creators. Whether you're a beginner or an experienced video editor, you'll find valuable insights to enhance your video projects and bring your creative ideas to life.
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...Paul Brebner
Closing talk for the Performance Engineering track at Community Over Code EU (Bratislava, Slovakia, June 5 2024) https://eu.communityovercode.org/sessions/2024/why-apache-kafka-clusters-are-like-galaxies-and-other-cosmic-kafka-quandaries-explored/ Instaclustr (now part of NetApp) manages 100s of Apache Kafka clusters of many different sizes, for a variety of use cases and customers. For the last 7 years I’ve been focused outwardly on exploring Kafka application development challenges, but recently I decided to look inward and see what I could discover about the performance, scalability and resource characteristics of the Kafka clusters themselves. Using a suite of Performance Engineering techniques, I will reveal some surprising discoveries about cosmic Kafka mysteries in our data centres, related to: cluster sizes and distribution (using Zipf’s Law), horizontal vs. vertical scalability, and predicting Kafka performance using metrics, modelling and regression techniques. These insights are relevant to Kafka developers and operators.
Building the Ideal CI-CD Pipeline_ Achieving Visual PerfectionApplitools
Explore the advantages of integrating AI-powered testing into the CI/CD pipeline in this session from Applitools engineer Brandon Murray. More information and session materials at applitools.com
Discover how shift-left strategies and advanced testing in CI/CD pipelines can enhance customer satisfaction and streamline development processes, including:
• Significantly reduced time and effort needed for test creation and maintenance compared to traditional testing methods.
• Enhanced UI coverage that eliminates the necessity for manual testing, leading to quicker and more effective testing processes.
• Effortless integration with the development workflow, offering instant feedback on pull requests and facilitating swifter product releases.
Just like life, our code must adapt to the ever changing world we live in. From one day coding for the web, to the next for our tablets or APIs or for running serverless applications. Multi-runtime development is the future of coding, the future is to be dynamic. Let us introduce you to BoxLang.
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdfBaha Majid
IBM watsonx Code Assistant for Z, our latest Generative AI-assisted mainframe application modernization solution. Mainframe (IBM Z) application modernization is a topic that every mainframe client is addressing to various degrees today, driven largely from digital transformation. With generative AI comes the opportunity to reimagine the mainframe application modernization experience. Infusing generative AI will enable speed and trust, help de-risk, and lower total costs associated with heavy-lifting application modernization initiatives. This document provides an overview of the IBM watsonx Code Assistant for Z which uses the power of generative AI to make it easier for developers to selectively modernize COBOL business services while maintaining mainframe qualities of service.
Superpower Your Apache Kafka Applications Development with Complementary Open...Paul Brebner
Kafka Summit talk (Bangalore, India, May 2, 2024, https://events.bizzabo.com/573863/agenda/session/1300469 )
Many Apache Kafka use cases take advantage of Kafka’s ability to integrate multiple heterogeneous systems for stream processing and real-time machine learning scenarios. But Kafka also exists in a rich ecosystem of related but complementary stream processing technologies and tools, particularly from the open-source community. In this talk, we’ll take you on a tour of a selection of complementary tools that can make Kafka even more powerful. We’ll focus on tools for stream processing and querying, streaming machine learning, stream visibility and observation, stream meta-data, stream visualisation, stream development including testing and the use of Generative AI and LLMs, and stream performance and scalability. By the end you will have a good idea of the types of Kafka “superhero” tools that exist, which are my favourites (and what superpowers they have), and how they combine to save your Kafka applications development universe from swamploads of data stagnation monsters!
Implementing Odoo, a robust and all-inclusive business management software, can significantly improve your organisation. To get the most out of it and ensure a smooth implementation, it is important to have a strategic plan. This blog shares some essential tips to help you with successful Odoo ERP implementation. From planning and customisation to training and support, this blog outlines some expert advice that will guide you through the process confidently. It is true that adopting a new software can be challenging, and hence, this post has tailored these tips to help you avoid common mistakes and achieve the best results. Whether you run a small business or a large enterprise, these tips will help you streamline operations, boost productivity, and drive growth. Whether you are new to Odoo or looking to improve your current setup, it is essential to learn the key strategies for a successful Odoo implementation. Implementing Odoo doesn’t have to be difficult. With the right approach and guidance, you can use this software to elevate your business. Read on to discover the secrets of a successful Odoo implementation.
Why is successful Odoo implementation crucial?
Implementing Odoo effectively can transform your business by making processes smoother, increasing efficiency, and providing useful insights. It helps align your operations with best practices, boosting productivity and aiding better decision-making. A well-executed implementation ensures you get the most out of your investment, while a poor one can cause disruptions, higher costs, and frustration among employees.
What is Continuous Testing in DevOps - A Definitive Guide.pdfkalichargn70th171
Once an overlooked aspect, continuous testing has become indispensable for enterprises striving to accelerate application delivery and reduce business impacts. According to a Statista report, 31.3% of global enterprises have embraced continuous integration and deployment within their DevOps, signaling a pervasive trend toward hastening release cycles.
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...kalichargn70th171
Visual testing plays a vital role in ensuring that software products meet the aesthetic requirements specified by clients in functional and non-functional specifications. In today's highly competitive digital landscape, users expect a seamless and visually appealing online experience. Visual testing, also known as automated UI testing or visual regression testing, verifies the accuracy of the visual elements that users interact with.
What’s new in VictoriaMetrics - Q2 2024 UpdateVictoriaMetrics
These slides were presented during the virtual VictoriaMetrics User Meetup for Q2 2024.
Topics covered:
1. VictoriaMetrics development strategy
* Prioritize bug fixing over new features
* Prioritize security, usability and reliability over new features
* Provide good practices for using existing features, as many of them are overlooked or misused by users
2. New releases in Q2
3. Updates in LTS releases
Security fixes:
● SECURITY: upgrade Go builder from Go1.22.2 to Go1.22.4
● SECURITY: upgrade base docker image (Alpine)
Bugfixes:
● vmui
● vmalert
● vmagent
● vmauth
● vmbackupmanager
4. New Features
* Support SRV URLs in vmagent, vmalert, vmauth
* vmagent: aggregation and relabeling
* vmagent: Global aggregation and relabeling
* vmagent: global aggregation and relabeling
* Stream aggregation
- Add rate_sum aggregation output
- Add rate_avg aggregation output
- Reduce the number of allocated objects in heap during deduplication and aggregation up to 5 times! The change reduces the CPU usage.
* Vultr service discovery
* vmauth: backend TLS setup
5. Let's Encrypt support
All the VictoriaMetrics Enterprise components support automatic issuing of TLS certificates for public HTTPS server via Let’s Encrypt service: https://docs.victoriametrics.com/#automatic-issuing-of-tls-certificates
6. Performance optimizations
● vmagent: reduce CPU usage when sharding among remote storage systems is enabled
● vmalert: reduce CPU usage when evaluating high number of alerting and recording rules.
● vmalert: speed up retrieving rules files from object storages by skipping unchanged objects during reloading.
7. VictoriaMetrics k8s operator
● Add new status.updateStatus field to the all objects with pods. It helps to track rollout updates properly.
● Add more context to the log messages. It must greatly improve debugging process and log quality.
● Changee error handling for reconcile. Operator sends Events into kubernetes API, if any error happened during object reconcile.
See changes at https://github.com/VictoriaMetrics/operator/releases
8. Helm charts: charts/victoria-metrics-distributed
This chart sets up multiple VictoriaMetrics cluster instances on multiple Availability Zones:
● Improved reliability
● Faster read queries
● Easy maintenance
9. Other Updates
● Dashboards and alerting rules updates
● vmui interface improvements and bugfixes
● Security updates
● Add release images built from scratch image. Such images could be more
preferable for using in environments with higher security standards
● Many minor bugfixes and improvements
● See more at https://docs.victoriametrics.com/changelog/
Also check the new VictoriaLogs PlayGround https://play-vmlogs.victoriametrics.com/
A neural network is a machine learning program, or model, that makes decisions in a manner similar to the human brain, by using processes that mimic the way biological neurons work together to identify phenomena, weigh options and arrive at conclusions.
Boost Your Savings with These Money Management AppsJhone kinadey
A money management app can transform your financial life by tracking expenses, creating budgets, and setting financial goals. These apps offer features like real-time expense tracking, bill reminders, and personalized insights to help you save and manage money effectively. With a user-friendly interface, they simplify financial planning, making it easier to stay on top of your finances and achieve long-term financial stability.
Secure-by-Design Using Hardware and Software Protection for FDA ComplianceICS
This webinar explores the “secure-by-design” approach to medical device software development. During this important session, we will outline which security measures should be considered for compliance, identify technical solutions available on various hardware platforms, summarize hardware protection methods you should consider when building in security and review security software such as Trusted Execution Environments for secure storage of keys and data, and Intrusion Detection Protection Systems to monitor for threats.
Ensuring Efficiency and Speed with Practical Solutions for Clinical OperationsOnePlan Solutions
Clinical operations professionals encounter unique challenges. Balancing regulatory requirements, tight timelines, and the need for cross-functional collaboration can create significant internal pressures. Our upcoming webinar will introduce key strategies and tools to streamline and enhance clinical development processes, helping you overcome these challenges.
Alluxio Webinar | 10x Faster Trino Queries on Your Data PlatformAlluxio, Inc.
Alluxio Webinar
June. 18, 2024
For more Alluxio Events: https://www.alluxio.io/events/
Speaker:
- Jianjian Xie (Staff Software Engineer, Alluxio)
As Trino users increasingly rely on cloud object storage for retrieving data, speed and cloud cost have become major challenges. The separation of compute and storage creates latency challenges when querying datasets; scanning data between storage and compute tiers becomes I/O bound. On the other hand, cloud API costs related to GET/LIST operations and cross-region data transfer add up quickly.
The newly introduced Trino file system cache by Alluxio aims to overcome the above challenges. In this session, Jianjian will dive into Trino data caching strategies, the latest test results, and discuss the multi-level caching architecture. This architecture makes Trino 10x faster for data lakes of any scale, from GB to EB.
What you will learn:
- Challenges relating to the speed and costs of running Trino in the cloud
- The new Trino file system cache feature overview, including the latest development status and test results
- A multi-level cache framework for maximized speed, including Trino file system cache and Alluxio distributed cache
- Real-world cases, including a large online payment firm and a top ridesharing company
- The future roadmap of Trino file system cache and Trino-Alluxio integration
Alluxio Webinar | 10x Faster Trino Queries on Your Data Platform
Hhm 3470 mq v8 and more recent new things for z os
1. IBM MQ for z/OS:
Latest Features Deep Dive
Pete Siddall
pete_siddall@uk.ibm.com
2. Agenda
• MQ V8 Review
– 64 Bit Buffer Pools
– 8 Byte Log Relative Byte Address (RBA)
– Channel Initiator (CHINIT) Statistics and Channel Accounting Data
– Storage Class Memory (SCM/Flash Memory)
– Other Enhancements
• Since MQ V8 GA
– Additional active logs
– JMS for CICS and IMS
– MQ family updates
• Works in progress
– z Operational Insights
– Hybrid connectivity options
5. Buffer Pools: The Problems
• Not much space below the bar for buffer pools
– Maximum 1.6GB, depending on common storage usage
• Put/Get to/from:
– Buffer pool = 'memory' speed (fast)
– Page set = 'disk' speed (slow)
• With fewer/small buffer pools, can spend a lot of time:
– Putting pages from buffer pool into page set (to free buffers)
– Getting pages from page set into buffer pool (to satisfy get requests)
– This is detrimental to performance
• A maximum of 16 buffer pools
– But up to 100 page sets, hence page sets must share buffer pools
• System programmers can spend a lot of time tuning:
– Buffer pool sizes
– Queue, buffer pool, and page set mappings
6. 64 Bit Buffer Pools: The Solution
• Buffer pools above the bar
– Buffer pools can (theoretically) make use of up to 16 EB of storage
• More buffer pools
– Up to 100 buffer pools
– Can have 1-1 mapping between page set and buffer pool
• More buffers per pool
– Above the bar
• Up to 999,999,999 4K buffers per pool
– Below the bar
• Up to 500,000 4K buffers per pool
7. Buffer Pools: Using 64 bit storage
DATA
CODE
DATA
2 GB bar
Queue Manager Address Space
Buffer Pool
Buffer Pool Buffer Pool Buffer Pool
Max 1.6GB for
buffer pools
16 EB
Buffer Pool
Move
above
bar
8. 64 Bit Buffer Pools: What has changed
• BUFFPOOL id
– 0 to 99
• BUFFERS
– Up to 500,000 if LOCATION(BELOW)
– Up to 999,999,999 if LOCATION(ABOVE)
• LOCATION
– BELOW – buffer pool is below the bar (default)
– ABOVE – buffer pool is above the bar
• PAGECLAS
– 4KB, if LOCATION(BELOW/ABOVE)
– FIXED4KB, if LOCATION(ABOVE)
• Permanent backing by real storage for life of Queue Manager
• No need to programmatically page fix/unfix when doing I/O
• Better performance
• Ensure you have enough real storage available!
DEFINE BUFFPOOL(<id>)
BUFFERS(<integer>)
PAGECLAS(4KB/FIXED4KB)
LOCATION(BELOW/ABOVE)
9. 64 Bit Buffer Pools: Migration
• To use this function version 8 new function must be
enabled using OPMODE(NEWFUNC,800)
– Otherwise behaviour is same as in version 7
– Though, LOCATION(BELOW) is valid regardless of OPMODE
• Some messages have changed regardless of the
value of OPMODE
– For example, DISPLAY USAGE PSID(*)CSQI010I !MQ21 Page set usage …
…
End of page set report
CSQI065I !MQ21 Buffer pool attributes ...
Buffer Available Stealable Stealable Page Location
pool buffers buffers percentage class
_ 0 1024 1000 99 4KB BELOW
_ 22 1024000 234561 23 FIXED4KB ABOVE
_ 88 12000 1200 10 4KB ABOVE
End of buffer pool attributes
10. 64 Bit Buffer Pools: Configuration
• CSQINP1
– DEFINE BUFFPOOL(22) LOCATION(ABOVE) BUFFERS(1024000)
REPLACE
– DEFINE BUFFPOOL(88) BUFFERS(12000) REPLACE
• CSQINP1 or dynamically
– DEFINE PSID(22) BUFFPOOL(22)
– DEFINE PSID(88) BUFFPOOL(88)
• CSQINP2 or dynamically
– ALTER BUFFPOOL(88) LOC(ABOVE)
CSQP024I !MQ21 Request initiated for buffer pool 88
CSQ9022I !MQ21 CSQPALTB ' ALTER BUFFPOOL' NORMAL COMPLETION
CSQP023I !MQ21 Request completed for buffer pool 88, now has 12000 buffers
CSQP054I !MQ21 Buffer pool 88 is now located above the bar
11. 64 Bit Buffer Pools: Performance Summary
• 16 Central Processor LPAR
• Each transaction puts and gets a random message from a pre loaded queue
• Second test requires a doubling in buffer pool size
Test Transaction rate
(per second)
Transaction cost
(CPU microsecs)
LPAR
% Busy
Channel path
% Busy
31 bit 232762 35.92 54% 56%
64 bit 235217 37.48 57% 57.4%
64 bit (enough buffers) 324213 38.12 83% 0.07%
Single requester per queue
Test Transaction rate
(per second)
Transaction cost
(CPU microsecs)
LPAR
% Busy
Channel path
% Busy
31 bit 149140 42.3 42% 75.4%
64 bit 145623 44.84 43.5% 75.9%
64 bit (enough buffers) 384062 40.65 99.59% 0.08%
Two requesters per queue
13. 6 byte log RBA: The Problem
• MQ for z/OS V7.1 (and earlier) uses a 6 byte log RBA (Relative Byte
Address) to address the log
• Gives an RBA range of 0 to x'FFFFFFFFFFFF' (= 255TB)
– Some customers reach this limit in 12 to 18 months
– At 100MB/sec, end of log range would be reached in 1 month
• The queue manager issues warning messages as it approaches the
end of the log RBA range
• If the end of the log RBA range is about to be reached the queue
manager will terminate to prevent loss of data
– A disruptive unplanned outage!
14. 6 byte log RBA: Resetting the log RBA
To avoid an unplanned outage, at regular planned intervals:
1. Stop the queue manager cleanly
2. Define new log and bootstrap data sets
3. Run CSQUTIL RESETPAGE against each page set
– This resets the log RBA in header of each page so can be take a while to run
4. Restart the queue manager
• Some customers are happy to do this, but others are not!
15. 8 byte log RBA: The Solution
• IBM MQ for z/OS V8.0 supports an 8 byte (64 bit) log RBA
– Upper limit on logical log is now 64K times bigger
– At a 100MB/sec, this would take over 5000 years to fill
• URIDs are now 8 bytes long
• Format of BSDS and log records has changed to accommodate 8 byte
RBAs
• Utilities or applications that read the following are impacted
– BSDS
– Logs
– Console messages that contain the log RBA or URID
• Queue managers use a 6 byte log RBA until 8 byte log RBA is enabled
16. Enabling 8 byte log RBAs
1. Version 8 new function must be enabled
– In a QSG new function is only enabled once ALL queue managers have been started with
OPMODE(NEWFUNC,800)
2. Stop the queue manager cleanly
3. Define new BSDS data sets
– Recommended space allocation is now RECORDS(850 60) as a version 2 format BSDS contains more
data than a version 1 format BSDS
4. Run BSDS conversion utility (CSQJUCNV) to convert the version 1 BSDS to
version 2
– Creates a copy of a version 1 format BSDS in version 2 format
– Writes converted BSDS to new data set(s)
5. Rename BSDS data sets so that the version 2 format BSDS are used
during the next queue manager restart
6. Restart the queue manager
17. Using 8 byte log RBA
• Queue manager issues message CSQJ034I during
start-up to indicate whether a 6 or 8 byte log RBA is
in use
• The print log map utility (CSQJU004) displays the BSDS version
• The messages issued to warn that the queue manager is approaching the end
of the log RBA range remain the same, but the thresholds have been updated
11.25.05 STC05120 CSQJ099I !MQ4E LOG RECORDING TO COMMENCE WITH 281
281 STARTRBA=00000000039AF000
11.25.05 STC05120 CSQJ034I !MQ4E CSQJW007 END OF LOG RBA RANGE IS 0000FFFFFFFFFFFF
22.57.53 STC13100 CSQJ099I !MQ08 LOG RECORDING TO COMMENCE WITH 811
811 STARTRBA=0000000002AA8000
22.57.53 STC13100 CSQJ034I !MQ08 CSQJW007 END OF LOG RBA RANGE IS FFFFFFFFFFFFFFFF
19. Chinit SMF: The Problem
• Prior to MQ V8 no SMF data for
– Chinit address space
– Channel activity
• Many customers have had to create their own “monitoring” jobs
– With periodic DISPLAY CHSTATUS commands
• Difficult to
– Manage historical data
– Investigate performance issues
– Perform capacity planning
20. Chinit SMF: The Solution
• New SMF data for channel initiator address space
– Collected at the same interval as the queue manager
• Channel Initiator Statistics (SMF 115, SubType 231)
– High level view of activity in the channel initiator address space
– Number of channels and TCB usage
– Dispatchers, Adapters, DNS, SSL
• Do I have spare capacity?
• Do I need more or less dispatchers/adapters?
• Channel Accounting Data (SMF 116, SubType 10)
– Detailed view of individual channels
• What work have channels been doing?
• Which channels are being heavily utilised?
– Controlled by STATCHL attribute on queue manager and channel definition
• Equivalent to ACCTQ for queues
• Data collected is a superset of that collected in the PCF messages on distributed platforms
21. Chinit SMF: The Solution
• Useful for
– Monitoring
– Capacity planning
– Tuning
• Separate controls from queue manager SMF allows “opt in”
• SupportPac MP1B updated to format new data
22. Adapter Task Statistics Report
Difference could indicate
wait for I/O due to
commit or disk read
MQI requests are processed
by first free adapter so adapters
lower in the list process less
requests
23. Channel Accounting Data
• Accounting (ACCTG) trace CLASS(4) enables collection of individual
channel information
• Channels can be included/excluded from collection
– Channel STATCHL attribute for predefined channels
– Queue manager STATACLS attribute for auto-defined cluster channels
• Controls all auto-defined channels, not individually
– Queue manager STATCHL attribute for client channels
• Generally low cost as most channels are long lived
– However, consider if you have a lot of short lived client connections
• Gives detailed information for each channel
– What has the channel done?
– What are my busy channels?
25. Channel initiator SMF controls
• You can start channel initiator statistics (STAT) trace
with
• You can display trace with
• ALTER and STOP TRACE commands have also been updated
• You can start channel initiator accounting (ACCTG) trace with
!MQ08 START TRACE(STAT) CLASS(4)
CSQW130I !MQ08 'STAT' TRACE STARTED, ASSIGNED TRACE NUMBER 05
CSQ9022I !MQ08 CSQWVCM1 ' START TRACE' NORMAL COMPLETION
!MQ08 START TRACE(ACCTG) CLASS(4)
CSQW130I !MQ08 ‘ACCTG' TRACE STARTED, ASSIGNED TRACE NUMBER 06
CSQ9022I !MQ08 CSQWVCM1 ' START TRACE' NORMAL COMPLETION
!MQ08 DISPLAY TRACE(*)
CSQW127I !MQ08 CURRENT TRACE ACTIVITY IS -
TNO TYPE CLASS DEST USERID RMID
02 STAT 01 SMF * *
05 STAT 04 SMF * *
06 ACCTG 04 SMF * *
END OF TRACE REPORT
27. Background – Shared queues
• Queue managers must
be in the same sysplex
• Create a Queue Sharing
Group (QSG)
• Define shared queues in
the Coupling Facility
(CF)
Shared
QueueCoupling Facility (CF)
Application Application
QMgr QMgr
28. Background – Offloading shared queue messages
• Messages larger than 63KB cannot be stored in the CF
– Message body is offloaded to SMDS or DB2
– Reference to message is stored in the CF
• CFSTRUCT OFFLOAD rules allow conditional offloading of messages
smaller than 63KB
– OFFLD1TH(70), OFFLD1SZ(32K) – offload messages >32KB if 70% full
– OFFLD2TH(80), OFFLD2SZ(4K) – offload messages >4KB if 80% full
– OFFLD3TH(90), OFFLD3SZ(0K) – offload all message data if 90% full
– Progressively smaller messages written to SMDS as the structure fills
29. CF Flash storage
• z/OS 2.1 and zEC12 GA2 introduce Coupling Facility Flash storage
• Use of CF Flash storage
– Can provide additional shared queue capacity for maintenance windows or consumer outages
– When structure is 90% full, the CF Flash algorithm starts moving the middle of the queue out to flash
storage, keeping the faster “real” storage for messages most likely to be got next
– Offload rules can allow even more messages to be stored by offloading data to SMDS (or DB2)
30. CF Flash: Planned emergency storage scenario
• Default CFSTRUCT offload
rules cause progressively
smaller messages to be
written to SMDS as the
structure starts to fill.
• Once 90% threshold is
reached
– the queue manager stores the
minimum data in the CF for each
message
– CF Flash pre-staging algorithm
starts to move reference messages
for new messages arriving into the
CF structure into SCM.
• Increases capacity of the
CF structure, but offloading
messages to SMDS will
affect performance
Note: Assume all messages < 63KB
Flash
CFStruct
70%
80%
90%
Offload > 32KB
offload > 0KB
offload > 4KB
SMDS
REF REF
REF REF
REF REF
31. CF Flash: Maximum Speed Scenario
• We want to keep high
performance messages in the
CF for most rapid access.
• CFSTRUCT offload rules are
disabled.
• Once 90% threshold is
reached, the CF Flash
algorithm starts moving new
messages to flash storage,
keeping the faster “real”
storage for messages most
likely to be got next.
• As messages are got and
deleted, the CF flash algorithm
attempts to pre-stage the next
messages from flash into the
CFSTRUCT so they are
rapidly available for MQGET.
• In this scenario the flash
storage acts like an extension
to “real” CFSTRUCT storage.
However it will be consumed
more rapidly since all message
data is stored in it.
Flash
CFStruct
70%
80%
90%
Offload = 64KB => disabled
Offload = 64KB => disabled
SMDS
Offload = 64KB => disabled
Note: Assume all messages < 63KB
MSG MSG
MSG MSG
32. CF Flash: Storage
Scenario Offload
Rule
Msg
Size
Total
Msgs
# in 'real' SMDS
space
# in 200 GB
flash
Augmented
(limit 30GB)
No SMDS
No Flash
1kB 3M 3M
4kB 900,000 900,000
16kB 250,000 250,000
SMDS
No Flash
MQ 90% 1kB 3.2M 3.2M 800MB
MQ 80% 4kB 1.8M 1.8M 5GB
MQ 80% 16kB 1.3M 1.3M 20GB
“Emergency”
Scenario
MQ 90% 1kB 190M 2M 270GB 188M 30GB
MQ 80% 4kB 190M 600,000 850GB 189M 30GB
MQ 80% 16kB 190M 150,000 3TB 189M 30GB
“Speed”
Scenario
CF 90% 1kB 150M 2M 148M 26GB
CF 90% 4kB 48M 600,000 47M 8GB
CF 90% 16kB 12M 150,000 11M 2GB
CF Structure size = 4GB
Significant increase in the number
that can be put to the CF
33. CFLEVEL(4) using 8KB Messages
• Saw-tooth effect
– Occurs when putting task goes into retry mode due to MQRC_STORAGE_MEDIUM_FULL
– Results in 5 sec pauses
• Non-SCM workload still completes in 90% of the time of SCM workload
• CPU cost of non-SCM v's SCM workload in MVS differs by less than 2% (hence, insignificant)
• Get rate once the putting task has completed
– Non-SCM – 21100 x 8K messages/second ~ 164MB/sec
– SCM – 19000 x 8K messages/second ~ 148MB/sec
1
4
7
10
13
16
19
22
25
28
31
34
37
40
43
46
49
52
55
58
61
64
67
70
73
76
79
82
85
88
91
94
0
100000
200000
300000
400000
500000
600000
700000
800000
900000
1000000
CFLEVEL(4) 8K Messages - XMIT Queue depth
No SCM available SCM available Depth that SCM used
Time (seconds)
QueueDepth
35. Channel Compression using zEDC Express
• zEC12 zEnterprise Data Compression (zEDC) Express
– Hardware compression
• Channel Compression
– Typically used on high latency/low-bandwidth networks
– Reduces amount of data being flowed
– Reduces CPU cost per message
– Can yield higher reduction in CPU costs for SSL channels (data is compressed before being encrypted)
– Performed by Dispatcher tasks in the Channel Initiator address space
• Channel attribute COMPMSG(ZLIBFAST)
– Message data compressed using the zlib compression technique
– Compression can be offloaded to zEDC Express
36. Channel Compression – ZLIBHIGH v ZLIBFAST
• Dispatcher tasks
– 7 has 1 channel using ZLIBHIGH for compression
– 8 has 1 channel using ZLIBHIGH for decompression
98.5% Busy!
17 microsecs spent waiting for hardware compression
But, overall cost much cheaper than ZLIBHIGH!
• Dispatcher tasks
– 7 has 1 channel using ZLIBFAST for compression
– 8 has 1 channel using ZLIBFAST for decompression
39. MQ platform and product updates
• Split Cluster Transmit Queue availability in MQ for z/OS
– Ability to separate workloads
– Reduce load on SYSTEM.CLUSTER.TRANSMIT.QUEUE
• Advanced Message Security (AMS)
– Now integrated into the base MQ for z/OS product
– Offers improved performance and usability
• MFT has been updated to reduce reliance on USS
42. Additional Active Logs
• Improve resilience to issues affecting log archiving
• Maximum active log capacity increased 10x
• Now up to 310 x 4GB active logs.
• Requires:
– MQ V8 in NewFunc mode
– V2 format BSDS (introduced in V8 for 64bit wide RBA)
– APAR PI46853
85
43. Enhanced Java SE support for MQ JMS
• CICS TS
CICS java programs san use the IBM MQ classes for JMS in the CICS® Open Services Gateway
initiative (OSGi) Java™ Virtual Machine (JVM) server
– JMS 1.1 if using MQ for z/OS V7.1
– JMS 2.0 (requires Java 7) if using MQ for z/OS V8.0
– CICS TS
• V5.2 + PI32151
• V5.3
– MQ
• V7.1 – JMS PI29770 (supersedes 7.1.0.6) or later CSD
• V8 – JMS 8.0.0.2 PI33038 or later CSD + MQ base PI28482
– For more details, see http://ibm.biz/MQCICSJMS
• IMS
IMS java programs can use the IBM MQ classes for JMS, JMS 2.0 spec
– IMS V13 MPR, BMP, IFP, JMP, JBP regions
– MQ V8
• V8 – JMS 8.0.0.4 PI41909 + MQ base PI45236
– For more details, see http://ibm.biz/MQIMSJMS
44. Capped Expiry
• New Queue and Topic attribute enforces a maximum lifetime for
messages
• Added to the CUSTOM attribute, CAPEXPRY(value) limits or adds the
expiry interval for the message, ‘as if an application change’ had been
made.
• Admin control of application behaviour
– use QALIAS for fine-grained, per application, control
– Minimum value of all objects on resolution path used, eg QALIAS->QREMOTE->XMITQ
• APAR PI50761 (also in 8.0.0.4)
89
45. Client or Channel partner audit and control
• During initialization, channels exchange code version levels (Version,
Release, Modification, Fixpac)
• New fields in MQCXP to pass RemoteProduct and RemoteVersion to
exits, values match DISPLAY CHSTATUS RPRODUCT RVERSION
• Sample security exit logs this information – see below. Trivial change
could be used to reject ‘down level’ connections.
• APAR PI51495 (also in 8.0.0.2)
91
05/08/2015,09:41:05,SYSTEM.ADMIN.SVRCONN,SVRCONN,9.20.237.15,MARKW1,MQJB,8.0.0.4,13
05/08/2015,09:55:19,SYSTEM.DEF.SVRCONN,SVRCONN,9.20.237.15,MARKW1,MQCC,8.0.0.4,13
05/08/2015,09:56:22,ZOS.TO.ZOS,RECEIVER,9.20.138.161,MQ26,MQMV,8.0.0.0,13
05/08/2015,09:57:20,DISTRIBUTED.TO.ZOS,RECEIVER,9.20.237.15,DISTRIBUTED.QMGR,MQMM,8.0.0.4,13
05/08/2015,10:09:34,SYSTEM.DEF.SVRCONN,SVRCONN,9.20.237.15,FredBloggs,Unknown,Unknown,7
05/08/2015,10:13:17,SYSTEM.DEF.SVRCONN,SVRCONN,9.20.230.14,SIDDALP,MQCC,7.1.0.0,11
05/08/2015,10:13:45,SYSTEM.ADMIN.SVRCONN,SVRCONN,9.20.230.14,SIDDALP,MQJB,7.1.0.0,10
46. IBM z Operational Insights
• Cloud based service from IBM which analyses operational data to
identify inefficiencies
• Added an MQ ‘tile’ to help tune buffer pools
93
47. IBM z Operational Insights
A New Way to Optimize your z Systems
Rapid, cloud-based analytics enable you to:
see quantified savings upfront
identify what actions to take next
compare your performance to
others
Try the open beta today, for free! ibm.biz/try-zoi
Cut costs. Save time. No installation necessary.
Actionable insights for CICS, MQ , IMS & WAS in minutes, not hours.
Just add operational data.
48. MQ Self Service
Digital IT Enterprise IT
Cloud
On-
Prem
Cloud
On-
Prem
Bluemix
Message Hub
Based on Apache Kafka
MQ Light Cloud Service API REST Kafka
Cloud Data
Services
Apache
Spark
Bluemix
Local
MQ Light Software
(Local stand-alone Server)
Watson
As-a-service
on-prem
management
of MQ
PureApp
Cloud
PureApp SW
PureApp HW
Dev-ops
CI/CD
Monthly
App AccessPartner
Traditional Data Centre
Enterprise Integration and Messaging
MQ
Light
API
HGateway
In the works: New Connectivity Options
49. Monday
10:30-11:30 3592 New MQ features
3452 Managing applications
12:00-13:00 2835 MQ on z/OS and Distributed
15:00-16:00 3470 Latest MQ z/OS features
2833 Where is my message?
3544 MQ Light in an MQ infrastructure
16:30-17:30 3573 Hybrid cloud messaging
2941 MQ Advanced
Tuesday
08:30-09:30 3540 The MQ Light API
12:00-13:00 3456 The IBM MQ Appliance
13:15-14:15 3499 Introducing Message Hub
3458 MQ Appliance administration
14:30-15:30 6432 MQ updates and futures (InnerCircle)
2849 Messaging feedback roundtable
16:00-17:00 3544 MQ Light in an MQ infrastructure
3513 MQ hands on lab
Wednesday
08:30-09:30 3602 Managing your MQ environment
12:00-13:00 3613 Designing MQ self service
6408 Hybrid messaging roadmap (InnerCircle)
13:15-14:00 3416 HA and DR with MQ
3433 Why secure your messaging?
15:45-16:30 3429 Securing MQ
2847 Meet the messaging experts
16:00-17:00 3508 MQ Light hands on lab
16:45-17:30 2275 Migrating to the IBM MQ Appliance
Thursday
08:30-09:15 3420 MQ Clustering
2931 Business agility with self service MQ
09:30-10:15 3479 MQ z/OS clusters and shared queue
3450 Optimising MQ applications
2849 Messaging feedback roundtable
10:30-11:15 3465 MQ Appliance high availability
3481 MQ z/OS messaging connectivity
11:30-12:15 3474 Active-active messaging
3537 Monitoring and managing MQ
3425 MQ publish/subscribe
Find us at the EXPO:
Hybrid Integration peds 65-68
Check out the Hybrid Messaging sub topic under the
Hybrid Integration topic for further customer and business
partner sessions
Hybrid Messaging from the IBM experts at InterConnect 2016
Sunday
14:30-15:30 6408 Hybrid messaging roadmap (InnerCircle)
50. Where can I get more information?
IBM Messaging developerWorks
developer.ibm.com/messaging
IBM Messaging Youtube
https://www.youtube.com/IBMmessagingMedia
LinkedIn
Ibm.biz/ibmmessaging
Twitter
@IBMMessaging
IBM MQ Facebook
Facebook.com/IBM-MQ-8304628654/
52. Notices and Disclaimers Con’t.
99
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not
tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products.
Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the
ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.
The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual
property right.
IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®,
FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG,
Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®,
PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®,
StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business
Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM
trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.
53. Thank You
Your Feedback is Important!
Access the InterConnect 2016 Conference Attendee
Portal to complete your session surveys from your
smartphone,
laptop or conference kiosk.