The document describes guidelines for building web services middleware to achieve predictable service execution times. It presents five guidelines: 1) the development platform and OS must guarantee predictability; 2) schedule requests based on deadlines; 3) select requests based on laxity; 4) introduce fine-grained differentiation in request processing; and 5) minimize priority inversions. It then describes a case study implementing these guidelines in Apache Axis2 and Synapse, including enhancements like real-time scheduling and priority models. Empirical results show the real-time middleware better meets deadlines than an unmodified version.
(APP303) Lightning Fast Deploys with Docker Containers and AWS | AWS re:Inven...Amazon Web Services
"Docker is an open platform for developers to build, ship, and run distributed applications in Linux containers. In this session, Nathan LeClaire, a Solutions Engineer at Docker Inc., will be demonstrating workflows that can dramatically accelerate the development and deployment of distributed applications with Docker containers.
Through in-depth demos, this session will show how to achieve painless deployments that are both readily scalable and highly available by combining AWS's strengths as an infrastructure platform with those of Docker's as a platform that transforms the software development lifecycle."
EXPERTALKS: Nov 2012 - Web Application ClusteringEXPERTALKS
This presentation was part of EXPERTALKS: Nov 2012 conducted at Equal Experts India on 24th Nov 2012. Visit http://meetup.com/expertalks to know more...
-------------------------------------------------------------------------------------
Ever wondered how Facebook is able to support user requests growing at thousands per second without ever crashing ?
Any enterprise application that we use today; whether it’s a banking website or an eCommerce app; uses Clustering.
Clustering addresses some of the most crucial demands of today’s ever-growing user base; including scalability and 24/7 availability amongst others.
This presentation discusses the concept of web application clustering.
FOCUS AREAS:
* Why clustering
* Clustering Types
* Load Balancing Algorithms
* Fault Tolerance
It also has a guide workshop on how to build a Vertical Cluster using Tomcat.
(APP303) Lightning Fast Deploys with Docker Containers and AWS | AWS re:Inven...Amazon Web Services
"Docker is an open platform for developers to build, ship, and run distributed applications in Linux containers. In this session, Nathan LeClaire, a Solutions Engineer at Docker Inc., will be demonstrating workflows that can dramatically accelerate the development and deployment of distributed applications with Docker containers.
Through in-depth demos, this session will show how to achieve painless deployments that are both readily scalable and highly available by combining AWS's strengths as an infrastructure platform with those of Docker's as a platform that transforms the software development lifecycle."
EXPERTALKS: Nov 2012 - Web Application ClusteringEXPERTALKS
This presentation was part of EXPERTALKS: Nov 2012 conducted at Equal Experts India on 24th Nov 2012. Visit http://meetup.com/expertalks to know more...
-------------------------------------------------------------------------------------
Ever wondered how Facebook is able to support user requests growing at thousands per second without ever crashing ?
Any enterprise application that we use today; whether it’s a banking website or an eCommerce app; uses Clustering.
Clustering addresses some of the most crucial demands of today’s ever-growing user base; including scalability and 24/7 availability amongst others.
This presentation discusses the concept of web application clustering.
FOCUS AREAS:
* Why clustering
* Clustering Types
* Load Balancing Algorithms
* Fault Tolerance
It also has a guide workshop on how to build a Vertical Cluster using Tomcat.
WSO2Con ASIA 2016: Building Web Apps Using Web-Oriented ArchitectureWSO2
Web-oriented architecture (WOA) or SOA + WWW + REST takes you several steps further by filling the blanks of SOA and helping you build an end-to-end complete web application. In addition to APIs, WOA identifies user interfaces and application states as first-class components of an architecture. Most of what we build today is actually WOA, though the abbreviation might not be that popular. This session will discuss the changes to WOA over the years, today’s trends, and how you can leverage WOA to build web apps.
I gave this talk at Krakow/Poland DevOPS meetup. It was a lightning talk covering subject of High Availability solutions, architecture, planning and deploying.
Découvrez pour le cinquième #PortraitDeCDO, avec le portrait de Juliette De Maupeou Digital Officer Industry de Total. Vous allez pouvoir découvrir les enjeux du numérique pour son entreprise, ses contraintes au quotidien ou encore son rôle au sein de sa société pour faire bouger les lignes du digital. Des insights précieux que vous pourrez comparer au fur et à mesure que les portraits s'égraineront dans les semaines à venir.
Since the manageability of RMAN backup, restore and recovery operations are nearly identical for nonclustered and clustered databases, the objective of this presentation is summarize you how RMAN can be best utilized in a RAC database.
Building a Scalable Architecture for web appsDirecti Group
Visit http://wiki.directi.com/x/LwAj for the video. This is a presentation I delivered at the Great Indian Developer Summit 2008. It covers a wide-array of topics and a plethora of lessons we have learnt (some the hard way) over the last 9 years in building web apps that are used by millions of users serving billions of page views every month. Topics and Techniques include Vertical scaling, Horizontal Scaling, Vertical Partitioning, Horizontal Partitioning, Loose Coupling, Caching, Clustering, Reverse Proxying and more.
Oracle RAC 12c (12.1.0.2) Operational Best Practices - A result of true colla...Markus Michalewicz
This is the latest version of the Oracle RAC 12c (12.1.0.2) Operational Best Practices presentation as shown during IOUG / Collaborate15. As best practices are a result of true collaboration this will probably be the last version before OOW 2015.
WSO2Con ASIA 2016: Building Web Apps Using Web-Oriented ArchitectureWSO2
Web-oriented architecture (WOA) or SOA + WWW + REST takes you several steps further by filling the blanks of SOA and helping you build an end-to-end complete web application. In addition to APIs, WOA identifies user interfaces and application states as first-class components of an architecture. Most of what we build today is actually WOA, though the abbreviation might not be that popular. This session will discuss the changes to WOA over the years, today’s trends, and how you can leverage WOA to build web apps.
I gave this talk at Krakow/Poland DevOPS meetup. It was a lightning talk covering subject of High Availability solutions, architecture, planning and deploying.
Découvrez pour le cinquième #PortraitDeCDO, avec le portrait de Juliette De Maupeou Digital Officer Industry de Total. Vous allez pouvoir découvrir les enjeux du numérique pour son entreprise, ses contraintes au quotidien ou encore son rôle au sein de sa société pour faire bouger les lignes du digital. Des insights précieux que vous pourrez comparer au fur et à mesure que les portraits s'égraineront dans les semaines à venir.
Since the manageability of RMAN backup, restore and recovery operations are nearly identical for nonclustered and clustered databases, the objective of this presentation is summarize you how RMAN can be best utilized in a RAC database.
Building a Scalable Architecture for web appsDirecti Group
Visit http://wiki.directi.com/x/LwAj for the video. This is a presentation I delivered at the Great Indian Developer Summit 2008. It covers a wide-array of topics and a plethora of lessons we have learnt (some the hard way) over the last 9 years in building web apps that are used by millions of users serving billions of page views every month. Topics and Techniques include Vertical scaling, Horizontal Scaling, Vertical Partitioning, Horizontal Partitioning, Loose Coupling, Caching, Clustering, Reverse Proxying and more.
Oracle RAC 12c (12.1.0.2) Operational Best Practices - A result of true colla...Markus Michalewicz
This is the latest version of the Oracle RAC 12c (12.1.0.2) Operational Best Practices presentation as shown during IOUG / Collaborate15. As best practices are a result of true collaboration this will probably be the last version before OOW 2015.
The Indo American Journal of Life Sciences and Bio Technology is a scholarly publication dedicated to advancing research and knowledge at the intersection of life sciences and biotechnology. With a focus on fostering collaboration between Indian and American scientific communities, the journal serves as a platform for high-quality articles, reviews, and original research contributions. Covering a broad spectrum of topics, from molecular biology to bioprocessing, the journal facilitates the exchange of cutting-edge information and promotes innovation in these crucial fields. Published regularly, it provides a valuable resource for researchers, academicians, and professionals seeking to stay abreast of the latest developments in life sciences and biotechnology.
The International Journal of Pharmacetical Sciences Letters is an international online journal in English published monthly. The aim of this is to publish peer reviewed research and review articles without delay in the developing field of engineering and science Research.
ISSN 2347-2243
Indo-American Journal of Life Sciences and Biotechnology. is an international online journal in English published Quarterly. Our journal is to publish manuscripts relating to Botany, Zoology, Marine Biology, Health and Nutrition, Cell Biology, Neurobiology, Biochemistry, All articles published in this journal represent the opinion of the authors and not reflect the official policy of the Journal of Indo-American Journal of Life Sciences and Biotechnology .
ISSN 2347-2243
Indo-American Journal of Life Sciences and Biotechnology. is an international online journal in English published Quarterly. Our journal is to publish manuscripts relating to Botany, Zoology, Marine Biology, Health and Nutrition, Cell Biology, Neurobiology, Biochemistry, All articles published in this journal represent the opinion of the authors and not reflect the official policy of the Journal of Indo-American Journal of Life Sciences and Biotechnology
ISSN 2347-2243
The Indo-American Journal of Life Sciences and Biotechnology is an international online journal in English published Quarterly. The delivery expedites the process. All submitted the research articles are subjected to immediate rapid screening by the editors, in consultation with the Editorial Board or others working in the field as appropriate, to ensure they are likely to be journal.
The Indo American Journal of Life Sciences and Bio Technology is a leading scholarly publication that serves as a platform for cutting-edge research at the intersection of life sciences and biotechnology. This peer-reviewed journal showcases high-quality articles and scientific advancements, providing a comprehensive perspective on the latest developments in these fields. With a focus on Indo-American collaborations, the journal fosters international dialogue and knowledge exchange among researchers, academicians, and industry professionals. Through its rigorous editorial process, the journal contributes to the dissemination of innovative ideas and discoveries, making it an invaluable resource for the scientific community. Explore the forefront of life sciences and biotechnology through the insightful pages of the Indo American Journal of Life Sciences and Bio Technology.
The Indo American Journal of Life Sciences and Bio Technology is a leading scholarly publication that serves as a platform for cutting-edge research at the intersection of life sciences and biotechnology. This peer-reviewed journal showcases high-quality articles and scientific advancements, providing a comprehensive perspective on the latest developments in these fields. With a focus on Indo-American collaborations, the journal fosters international dialogue and knowledge exchange among researchers, academicians, and industry professionals. Through its rigorous editorial process, the journal contributes to the dissemination of innovative ideas and discoveries, making it an invaluable resource for the scientific community. Explore the forefront of life sciences and biotechnology through the insightful pages of the Indo American Journal of Life Sciences and Bio Technology.
The Indo-American Journal of Life Sciences and BioTechnology is a premier online platform that serves as a nexus for cutting-edge research at the intersection of life sciences and biotechnology. Our site fosters the exchange of innovative ideas, scholarly articles, and breakthrough discoveries in these dynamic fields. With a commitment to promoting scientific excellence, the journal provides a global forum for researchers, academics, and industry professionals to share their insights and advancements. Navigate through a wealth of diverse content, ranging from molecular biology to bioprocess engineering, as we strive to advance knowledge and propel the frontiers of life sciences and biotechnology. Join us in the pursuit of scientific excellence and stay abreast of the latest developments in this ever-evolving landscape.
The Indo American Journal of Life Sciences and Biotechnology is a leading scholarly publication dedicated to advancing research at the intersection of life sciences and biotechnology. With a focus on fostering interdisciplinary collaboration, this journal provides a platform for cutting-edge research and innovations in areas such as molecular biology, genetics, bioinformatics, and bioprocessing. Featuring rigorous peer-reviewed articles, the journal serves as a valuable resource for scientists, researchers, and professionals in the field, promoting the dissemination of knowledge and the development of groundbreaking technologies that contribute to the advancement of life sciences and biotechnology.
In this paper, we have proposed a hybrid push-pull protocol for peer-to-peer live video streaming. The
main goal of this research is to minimize the network end-to-end delay in comparison to pure mesh
networks. Hybrid protocols, in most cases, suffer from complex construction and maintenance. Therefore,
our proposed protocol uses a pure mesh topology and a single layer video coding. In summary, our pushpull
protocol has two parts. The pull-based part which is done on the mesh network, and the push-based
part which consists of two phases: parent selection and tree construction. When a push procedure appears,
it is very important to prevent data redundancy. To satisfy this condition, we have introduced a parent
selection method. In this method, by parent selection based on the minimum arrival time, the most stable
node will be selected. This node has the advantage of maximizing the expected service time of the tree.
Using this method, there is no need for maintaining any extra information and topology control data.
Finally, we do performance evaluation using OMNeT++ simulator. The simulation results show that the
proposed architecture has better performance in start-up delay, end-to-end delay, and distortion than pure
mesh-based network.
Recently with the increasing development of distributed computer systems (DCSs) in networked
industrial and manufacturing applications on the World Wide Web (WWW) platform, including service-oriented
architecture and Web of Things QoS-aware systems, it has become important to predict the Web performance.
In this paper, we present Web performance prediction in time by making a forecast of a Web resource
downloading using the Efficient Turning Bands (TB) geostatistical simulation method. Real-life data for the
research were obtained from our own website named "Distributed forecasting system". Generation of log file
form website and performing monitoring of a group of Web clients from connected LAN. For better web
prediction we used spatio temporal prediction method with time utility for downloading particular file from
website and calculate forecasting result using Turning bands method but improving more forecasting
accuracy use the efficient turning band method basically efficient turning band use Naive bays algorithm and
calculate efficient result and that result is compared with Turning band and efficient turning band method.
The efficient turning band method result show good forecasting quality of Web performance prediction and
forecasting.
Cloud-enabled Performance Testing vis-à-vis On-premise- Impetus White PaperImpetus Technologies
For Impetus’ White Papers archive, visit- http://www.impetus.com/whitepaper
In this white paper we talk about how you can integrate on-premise and cloud-based options to build an effective performance testing strategy.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Building Web Services Middleware with Predictable Service Execution
1. Building Web Services Middleware with
Predictable Service Execution
Vidura Gamini Abhaya
Prof. Zahir Tari and Assoc. Prof. Peter Bertok
Distributed Systems and Networking Group
School of Computer Science and IT
RMIT University
Melbourne, Australia
December 13, 2010
[WISE 2010 - pages 23-37 in proceedings]
2. Intro. Guidelines Case Study Results Conclusion
Presentation Structure
1 Introduction
2 Guidelines for Predictability
3 Case Study
4 Empirical Results
5 Conclusion
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
3. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
1 Introduction
2 Guidelines for Predictability
3 Case Study
4 Empirical Results
5 Conclusion
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
4. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Motivation
Web Services enable communication between Distributed
Heterogeneous Systems.
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
5. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Motivation
Web Services enable communication between Distributed
Heterogeneous Systems. It is the foundation for...
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
6. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Motivation
Web Services enable communication between Distributed
Heterogeneous Systems. It is the foundation for...
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
7. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Motivation
Web Services enable communication between Distributed
Heterogeneous Systems. It is the foundation for...
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
8. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Motivation - QoS in the Cloud
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
9. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Motivation - QoS in the Cloud
Increased the importance of QoS
Lack of attempts in achieving Execution-time QoS
On achieving consistent and predictable Execution times
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
10. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Web Services Middleware
WS-Middleware are optimised for throughput by design
Requests are accepted unconditionally
Uses thread-pools to execute them in a best-effort manner
Processes multiple requests in-parallel in a processor sharing
manner
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
11. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
ThreadPool Pattern
Increases throughput
At the increase of the mean execution time of a web service
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
12. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
ThreadPool Pattern
Increases throughput
At the increase of the mean execution time of a web service
No. of requests served in-parallel ∝ Mean time to service a request
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
13. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Web Services Software Stack
The execution of a web service request goes through multiple
layers of software
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
14. Intro. Guidelines Case Study Results Conclusion Motive. QoS in the Cloud ThreadPools WS Stack
Web Services Software Stack
Predictability at the upper layers can only be achieved if it is
supported at the lower levels
Thread priority level mismatches between dev platform and OS
Service invocations can be interrupted by a process/thread with higher priority
Delays in resource reservations at OS level
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
15. Intro. Guidelines Case Study Results Conclusion Guidelines
1 Introduction
2 Guidelines for Predictability
3 Case Study
4 Empirical Results
5 Conclusion
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
16. Intro. Guidelines Case Study Results Conclusion Guidelines
Guidelines for Predictability in Service Execution
- Enable Web Service Middleware to achieve Predictability in Service Execution.
- Can be followed in building new middleware or to enhance existing.
- Applicable for both SOAP and REST based services
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
17. Intro. Guidelines Case Study Results Conclusion Guidelines
Guidelines for predictability in service execution
G1. Dev platform and OS used must guarantee predictability of execution
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
18. Intro. Guidelines Case Study Results Conclusion Guidelines
Guidelines for predictability in service execution
G1. Dev platform and OS used must guarantee predictability of execution
G2. Schedule requests based on their deadlines
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
19. Intro. Guidelines Case Study Results Conclusion Guidelines
Guidelines for predictability in service execution
G1. Dev platform and OS used must guarantee predictability of execution
G2. Schedule requests based on their deadlines
G3. Select requests based on their laxity
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
20. Intro. Guidelines Case Study Results Conclusion Guidelines
Guidelines for predictability in service execution
G1. Dev platform and OS used must guarantee predictability of execution
G2. Schedule requests based on their deadlines
G3. Select requests based on their laxity
G4. Introduce fine-grain differentiation in request processing
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
21. Intro. Guidelines Case Study Results Conclusion Guidelines
Guidelines for predictability in service execution
G1. Dev platform and OS used must guarantee predictability of execution
G2. Schedule requests based on their deadlines
G3. Select requests based on their laxity
G4. Introduce fine-grain differentiation in request processing
G5. Minimise priority inversions
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
22. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
1 Introduction
2 Guidelines for Predictability
3 Case Study
4 Empirical Results
5 Conclusion
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
23. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Case Study - Overview
Infrastructure
Common enhancements made
Schedulability Check
Priority Model
Real-time Scheduler
Stand-alone web service engine
Apache Axis2
Web service cluster
Dispatcher - Apache Synapse
Executors - Apache Axis2
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
24. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Infrastructure
Dev Platform and OS
Following G1,
Solaris 10 08/05 is used as the Real-time OS
Sun Real-time Java Specification is used as the Dev Platform
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
25. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Schedulability Check
Following G3, every incoming request is subject
to a Schedulability Check (Ref: Algorithm 1 on
paper and mathematical model in [5]).
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
26. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Schedulability Check
Following G3, every incoming request is subject
to a Schedulability Check (Ref: Algorithm 1 on
paper and mathematical model in [5]).
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
27. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Priority Model
Following G4, three priority levels are introduced (used by Real-time scheduler
following Algorithm 3 on paper)
High - Cannot be interrupted by GC
Mid - Can be interrupted by the GC
Low - Can be interrupted by the GC, Highest priority level available on Standard
Java
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
28. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Real-time Scheduler
Schedules requests based on their deadlines
Follows Earliest Deadline First (EDF) technique
Uses the priority model on threads to decide which request is
executed at what time
..and follows G2 in doing so.
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
29. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Enhancements made to Axis2
Details
Thread-pools have been replaced with RT-Thread
pools
A Real-time scheduler has been introduced
Multiple execution lanes are used
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
30. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Enhancements made to Synapse
Details
RT-Axis2 instances used as Executors
Enhanced version of Synapse used for dispatching
Thread-pools have been replaced with RT-Thread pools
A Real-time scheduler has been introduced
Multiple execution lanes are used
Request processing happens at Dispatcher, Service Invocation at Executors
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
31. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Minimising Priority Inversions
Can be caused by, I/O activities such as reading/writing to files and sockets.
To prevent priority inversions (following G5),
Avoid outputs resulting in on-screen messages or log file writes
Use in-memory logging and delayed writes
Use offline debugging techniques/tools
e.g. Oracle Thread Scheduling Visualizer (TSV) [16]
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
32. Intro. Guidelines Case Study Results Conclusion Overview Infra. Commons Standalone Cluster PI
Minimising Priority Inversions - TSV
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
33. Intro. Guidelines Case Study Results Conclusion Stand Alone Cluster
1 Introduction
2 Guidelines for Predictability
3 Case Study
4 Empirical Results
5 Conclusion
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
34. Intro. Guidelines Case Study Results Conclusion Stand Alone Cluster
Stand-alone Engine performance
Comparison of Unmod. Axis2 vs RT-Axis2 - Deadline Achievement Rates
100
90
Percentage of deadlines met off percentage accepted
80
70
60
50
40
30
20
10
Unmod. Axis2
RT-Axis2
0.1s - 0.25s 0.1s - 0.5s 0.25s - 1s 0.25s - 2s
Inter-arrival times
RT-Axis2 accepts between 18.1% (fastest) and 96.7% (slowest) of the requests.
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
36. Intro. Guidelines Case Study Results Conclusion Stand Alone Cluster
RT-RoundRobin vs Round-Robin
Comparison of Round-robin vs. RT-RoundRobin - Deadline Achievement Rates
100
RR - 2 Execs.
RR - 3 Execs.
90 RR - 4 Execs.
RT-RR - 2 Execs.
RT-RR - 3 Execs.
80 RT-RR - 4 Execs.
Percentage of deadlines met
70
60
50
40
30
20
10
0.05s 0.1s 0.1s 0.25s 0.1s - 0.5s 0.25s - 1s
Inter-arrival times
RT-RR accepts between 20.5% (2 Exec. - fastest) and 99.9% (4 Exec. -
slowest) of the requests.
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
37. Intro. Guidelines Case Study Results Conclusion Stand Alone Cluster
RT-RoundRobin vs Round-Robin
Comparison of execution times (1 - 5000000 (Uniform); 0.1sec - 0.25sec (Uniform) roundrobin 3 exec) Task Size distribution between 3 Executors (1 - 5000000 (Uniform); 0.1sec - 0.5sec (Uniform) roundrobin 3 exec)
120000 12000
RT-RoundRobin Executor 1
Simple Round-Robin Executor 2
Executor 3
100000 10000
80000 8000
Execution Time (ms)
Execution Time (ms)
60000 6000
40000 4000
20000 2000
0 0
0 500000 1e+06 1.5e+06 2e+06 2.5e+06 3e+06 3.5e+06 4e+06 4.5e+06 5e+06 0 500000 1e+06 1.5e+06 2e+06 2.5e+06 3e+06 3.5e+06 4e+06 4.5e+06 5e+06
Task Size Task Size
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
38. Intro. Guidelines Case Study Results Conclusion Future Work Recap
1 Introduction
2 Guidelines for Predictability
3 Case Study
4 Empirical Results
5 Conclusion
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
39. Intro. Guidelines Case Study Results Conclusion Future Work Recap
Future Work
Further analysis of cluster behaviour with mix of tasks
Advanced dispatching and re-dispatching models
Predictability in the networking layer
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
40. Intro. Guidelines Case Study Results Conclusion Future Work Recap
1 Introduction
2 Guidelines for Predictability
3 Case Study
4 Empirical Results
5 Conclusion
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
41. Intro. Guidelines Case Study Results Conclusion Future Work Recap
Conclusion
With the growing popularity of Cloud Computing and it’s
service offerings, Execution level QoS has become an
important aspect
Existing WS-Middleware are optimized for throughput thereby
lacks predictability of execution
Presented Guidelines for WS-Middleware to achieve
predictability of execution
Discussed 2 case studies as examples
Presented empirical data, on evaluating the two
implementations
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings
42. Intro. Guidelines Case Study Results Conclusion Future Work Recap
Thank You !
&
Questions or Comments ?
V. Gamini Abhaya et. al. WISE 2010 - pages 23-37 in proceedings