This document provides advice for scaling applications from a monolithic architecture to a microservices architecture delivered as a service. Some key points include:
- Scale out by splitting work across many stateless workers rather than scaling up a single heavyweight instance to avoid bottlenecks.
- Use an event-driven architecture with an event broker like RabbitMQ to modularize applications.
- Store data in multiple data stores suited to the usage like databases, files or object storage. Avoid using the file system or memory as the primary data store.
- Automate deployments and use containers to easily deploy modularized code.
- Innovate by rewriting parts of applications as smaller, independent services using different technologies best suited to problems.
Security Meetup
Олексій Лунков
Project Manager у компанії Atwix. Основна спеціалізація – Magento (e-commerce). Cпівавтор та викладач курсу IT Project Management.
Тези доповіді:
1. Тренди в безпеці даних у 2018. Як ми повинні адаптуватись?
2. Специфіка роботи в компанії. Як працювати з даними, які належать компанії?
3. Почни з заліза. Веб-камера, жорсткий диск, екран — як їх захистити?
4. Кращі практики роботи з паролями. Додатки, поради, ризики.
5. Що таке “двухфакторка”? Як її правильно налаштувати? Чого варто уникати?
6. Social engineering, безпека данних на мобільних пристроях.
7. Професійні інструменти.
Security Meetup
Олексій Лунков
Project Manager у компанії Atwix. Основна спеціалізація – Magento (e-commerce). Cпівавтор та викладач курсу IT Project Management.
Тези доповіді:
1. Тренди в безпеці даних у 2018. Як ми повинні адаптуватись?
2. Специфіка роботи в компанії. Як працювати з даними, які належать компанії?
3. Почни з заліза. Веб-камера, жорсткий диск, екран — як їх захистити?
4. Кращі практики роботи з паролями. Додатки, поради, ризики.
5. Що таке “двухфакторка”? Як її правильно налаштувати? Чого варто уникати?
6. Social engineering, безпека данних на мобільних пристроях.
7. Професійні інструменти.
PHP deployment, 2016 flavor - cakefest 2016Quentin Adam
PHP runtime have been controversial for years; because hosting is very important due to dynamic and modularity of PHP. So, what’s about opcode cacher? atomic deployment? file system usage? session management? code/data split? PHP VM or built in http server? Or maybe HHVM? So many question we have to answer building php support at Clever Cloud (managing A LOT of php apps on hosting PaaS), and many war stories to share about our choices.
Wordpress security best practices - WordCamp Waukesha 2017vdrover
As a popular CMS, WordPress is a common target for hackers and bots alike. In this session, Victor discusses a host of best-practice techniques and corporate security policies that will harden your website against intruders.
Your website is your business lifeline to profitability and sustainability. Your website has to be found (SEO). It has to be secure. And it needs to be engaging, mobile friendly, and fast (UX, or user experience). Here are some simple tips to a profitable website that can be found by your customers and prospects.
Understand Immutable infrastructure - at Build Stuff Kiev 2016Quentin Adam
Why everybody is speaking about Immutability? Immutable infrastructure? The All IT automation ecosystem need to rely on the append only, remove historical management of servers. This talk explain what is immutable infrastructure, how to build it, and how to manage data in this infrastructure pattern. It will cover pattern to use it on containers or virtual machine world.
PHP deployment, 2016 flavor - cakefest 2016Quentin Adam
PHP runtime have been controversial for years; because hosting is very important due to dynamic and modularity of PHP. So, what’s about opcode cacher? atomic deployment? file system usage? session management? code/data split? PHP VM or built in http server? Or maybe HHVM? So many question we have to answer building php support at Clever Cloud (managing A LOT of php apps on hosting PaaS), and many war stories to share about our choices.
Wordpress security best practices - WordCamp Waukesha 2017vdrover
As a popular CMS, WordPress is a common target for hackers and bots alike. In this session, Victor discusses a host of best-practice techniques and corporate security policies that will harden your website against intruders.
Your website is your business lifeline to profitability and sustainability. Your website has to be found (SEO). It has to be secure. And it needs to be engaging, mobile friendly, and fast (UX, or user experience). Here are some simple tips to a profitable website that can be found by your customers and prospects.
Understand Immutable infrastructure - at Build Stuff Kiev 2016Quentin Adam
Why everybody is speaking about Immutability? Immutable infrastructure? The All IT automation ecosystem need to rely on the append only, remove historical management of servers. This talk explain what is immutable infrastructure, how to build it, and how to manage data in this infrastructure pattern. It will cover pattern to use it on containers or virtual machine world.
Understand immutable infrastructure, what? Why? how? - devops d day Marseill...Quentin Adam
Why everybody is speaking about Immutability? Immutable infrastructure? The All IT automation ecosystem need to rely on the append only, remove historical management of servers. This talk explain what is immutable infrastructure, how to build it, and how to manage data in this infrastructure pattern. It will cover pattern to use it on containers or virtual machine world.
[DevDay 2016] The way to success - Speaker: Markus Baur - CEO at Axon Active ...DevDay.org
Everyone wants to become successful – but what does it mean to be successful? How “being successful” is qualified?
In this speech I give you some hints and thoughts about the way to become a ‘Certified Successful Person’!
Our inspirational speech for the attendees of Django Girls Ensenada, Mexico, to encourage everyone to continue with their programming journey.
Special thanks to DjangoGirlsMX, the US Consulate General of Tijuana, and Hala Ken for inviting us.
While Atlassian users get excited when they see the most popular add-ons in the marketplace, few see the potential of a custom built add-on tailored to their business. In our cloud-based products, the Connect platform makes it easier than ever to craft solutions that drastically reduce the number of manual tasks your workers have to do. In this talk, I give insider tips on how we do automation at Atlassian, and tell a story that shows how some businesses can automate their entire workflow with Atlassian tools.
Products covered:
JIRA Service Desk, Confluence, HipChat
Internet of Things (IoT) Past, Present, and FutureLosant
A look at the state of the Internet of Things in the world today. This includes a brief history of how the term came to be and how we got to our present place.
Today, in the world of IoT there are a number of industries that are taking advantage of the technology. This includes manufacturing, logistics, retail, and more.
Finally, this includes a brief description of Losant, https://losant.com. Losant is an IoT developer platform for building connected solutions.
This was originally presented to The Circuit in Cincinnati on May 19, 2016.
10 Sincere Ways To Show Your Employees LoveOfficevibe
Show your employees how much you care and boost engagement within your company. Spread the love!
Content by Officevibe, the simplest tool for a greater workplace!
Download your FREE GUIDE on Employee Recognition:
http://bit.ly/2lo7ShO
Learn more on Officevibe:
https://www.officevibe.com/
Why postgres SQL deserve noSQL fan respect - Riga dev day 2016Quentin Adam
Postgres SQL is a plain old SQL DB. Very powerful and very consistent, in some case, project needs an ACID database, but schemaless… With JSON support, postgres is a very interesting tool to provide ACID and some very interesting function (time management, localisation function and data types...) and the schemaless noSQL point of view with json and indexed json. This talk show some great usage and some insigth to build some great application with postgres.
Immutability: from code to infrastructure, the way of scalability - snowcamp ...Quentin Adam
The all functional programming world, Docker, Clever Cloud, micro service architecture, logs append only DB… All of this rely on the immutability at some point: infrastructure immutability, data immutability, append only.
This is the way we now build some of the best scalable applications and infrastructure.
The talk is made to understand why Immutability rules the scalability and why it’s important.
PHP deploy 2015 flavor - talk from php tour 2015 luxembourgQuentin Adam
Lorsque j'ai commencé à déployer du PHP, aux alentours de 2002, la mise en place de cache d'opcode, de reverse proxy pour assets statiques et de déploiement atomiques était encore rare et peu documentée. Le monde a évolué, PHP a beaucoup évolué et c'est l'occasion de faire le point sur les bonnes pratiques de déploiement PHP (en particulier sur une architecture cloud): - déploiement immutables - séparation code / données - cache opcode - séparation serveur HTTP / VM PHP - gestion des sessions - gestion des assets Le but de la présentation est de présenter (et de justifier, en les contextualisant) ces bonnes pratiques.
Immutability: from code to infrastructure, the way to scalability - Voxxed Da...Quentin Adam
The all functional programming world, Docker, Clever Cloud, micro service architecture, logs append only DB… All of this rely on the immutability at some point: infrastructure immutability, data immutability, append only. This is the way we now build some of the best scalable applications and infrastructure. The talk is made to understand why Immutability rules the scalability and why it’s important.
Immutability: from code to infrastructure, the way to scalability - Breizhca...Quentin Adam
The all functional programming world, Docker, Clever Cloud, micro service architecture, logs append only DB… All of this rely on the immutability at some point: infrastructure immutability, data immutability, append only. This is the way we now build some of the best scalable applications and infrastructure. The talk is made to understand why Immutability rules the scalability and why it’s important.
A talk through the journey we've been through at Snowplow thinking about event data, starting with our focus on web and then mobile analytics, and exploring our current and future technical and analytic approaches
In this webinar AWS Technical Evangelist, Ian Massingham, discusses the role that AWS services can play in helping you to derive value from your data, from stream processing with Amazon Kinesis, techniques for managing ingest of large data sets, through to processing data with Amazon Elastic MapReduce (EMR) and its ecosystem of tools and running large scale data warehouses on AWS with Redshift.
View the recording: http://youtu.be/7bkqopn19WY
How to manage large amounts of data with Iteratee - ScalaDays Berlin 2014Quentin Adam
How to manage a large file with HTTP? Is it possible to manage data stream when you are in a HTTP POST request? How to be relax when managing data stream (ie : not use while(true) hack or something I/O block)?
This talk is about Play! iteratee and how to use it on real project : what is an iteratee? why it's useful? how to use it? how to manage it? is it clean? is your code readable or not?
http://scaladays.org/#schedule/How-to-manage-large-amounts-of-data-with-Iteratee
Everybody has something about streams on the Scala platform: iteratee, scalaz.streams, reactive streams, akka.io, and so on.
But are they useful for the day to day developer job? Are they only for database drivers? What are the differences between all this technologies?
You will understand what are streams, why you need them and how to use them in real world scenarios
My presentation about WordPress and caching from WordCamp Baltimore 2013.
See it with funny animated GIFs at http://kingkool68.com/wp-cream/
Fork my slides on GitHub https://github.com/kingkool68/WP-Cache-Rules-Everything-Around-Me
https://devoxx.be/talk/?id=52363
CQRS, Event streaming, Event sourced, log management, Kafka, RabbitMQ... The all ecosystem is now working on event management, event sourcing, and CQRS. Kafka trend is growing, in a king of modern style ESB. This all trned now allow the emergence of new software. One of the new event log, stream and storage, is Apache Pulsar, a great Apache project, using Zookeeper and Bookeeper, coming from Yahoo! team.
This talk will help to understand the architecture, the good points, the differences, and compare it with SQS, Kafka, RabbitMQ Iron or Redis listen. There will be example using java code.
The two speakers are coming from two different companies, using Pulsar on production.
Traversing hyper driven developpement to do great technical choices and make ...Quentin Adam
On this era of industrial changes, we all know that software is eating the world, and the world is small, or at least, not so big. So how to manage to make great technical choices on this era where giants apply the marketing of the Shame on us? How do we keep best developper in our organisation when it's a furious competition on hiring out there? More important, how do we make sure people we work with are both happy and productive? Beyond marketing, we will try to figure out how we do to compete and create value for us and our users.
Remove centralization on Authorization - API Days Paris 2018 (announcement fo...Quentin Adam
talk with @gcouprie
First time we talk about biscuit
Authentication is one of the main pain points in distributed and microservices systems. We want it to be scalable, work on all nodes without too much coupling. We want it to be safe and decentralized.
That space has seen some exciting work recently, with people deploying systems based on JWT or macaroons, but those come with shortcomings as well.
We will show you how authentication systems are built, what to watch out for, how current solutions are integrated, and where we can go from there.
PostgreSQL is the new NoSQL - at Devoxx 2018Quentin Adam
Have you seen the latest updates for traditional RDBNS lately? It's insane. They are all catching up and won't be left out. While all NoSQL stores are proposing SQL, all RDMS are proposing top notch JSON support. And it does not stop there.
Latest PostgreSQL version have added new scalability features like table partitioning, query parallelism, pub/sub framework, a new quorum system for data sync. They have also improved their window functions for better time series queryability.
And as it happens, we are using some of these new functionalities at Clever Cloud. In this talk I will showcase some of them to try to convince you that PostgreSQL is the new NoSQL.
talk is recorded here: https://www.youtube.com/watch?v=t8-BQjWJFKw
https://dvbe18.confinabox.com/talk/BLA-3308/PostgreSQL_is_the_new_NoSQL
Monitorer l'inconnu, 1000 * 100 series par jour - talk avec @clementd à #devo...Quentin Adam
Slide créé sur google slides https://docs.google.com/presentation/d/1pZvS5BEFfXceS3xXIePKkeAx-aZpxhloNInaIHD5eTw/edit?usp=sharing
Comment monitorer ce qu’on ne connait pas? Un des défis technique chez Clever CLoud, à part la scalabilité, c’est de monitorer automatiquement toutes les stacks techniques de nos clients, sans que l’on sache quoi que ce soit. Notre premier but quand nous avons reconstruit notre plateforme de monitoring était de supporter notre pattern Imutable Infrastructure qui génère quantité de hosts éphémères chaque minute. L’approche traditionel est de se concentrer sur les VMs et les Hosts, pas les applications?
Il fallait changer de paradigme pour avoir une approche de découverte automatique des métriques à monitorer, permettre à du code tiers de publier ses propres métriques. Ce talk décrit le chemin qui nous a ammené à construire Clever Cloud Metrics, basé sur Warp10 ( basé sur Kafka/Hadoop/Storm) pour améliorer les conditions de travail de nos utilisateurs et la stabilité de nos applications.
Comment les contrôleurs de gestion ont fuck up mon IT - Lean Kanban France 2017Quentin Adam
http://2017.leankanban.fr/sessions/comment-les-controleurs-de-gestion-ont-fuck-up-mon-it/
Speaker’s pitch
This talk is about how financially minded management of companies lead to split the IT management into several business units, each with its own goals and management.
This split creates misalignment and conflicts between teams that were supposed to work together.
This keynote is a toolbox designed to help you bring proper implementation of devops and to make people work together on a common goal: efficient automatisation and use of the human brain power geared towards making IT an asset instead of a cost center.
Le mot de l’organisation
Le pitch est en anglais, mais la conférence sera bien en français. Ca parle de tech et de budget, une conférence comme on les aime. C’est mieux de savoir ce qu’est DevOps, mais cela n’est pas obligatoire.
Monitoring the unknown, 1000*100 series a day - Big Data Vilnius 2017Quentin Adam
How to monitor unknown third party code? One of the hardest challenges we face running Clever Cloud, apart from the impressive scale we face with hundreds of new applications per week, is the monitoring of unknown tech stacks. The first goal of rebuilding the monitoring platform was to accommodate the immutable infrastructure pattern that generates lots of ephemeral hosts every minute. The traditional approach is to focus on VMs or hosts, not applications. We needed to shift this into an approach of auto-discovery of metrics to monitor, allowing third party code to publish new items. This talk explains our journey in building Clever Cloud Metrics stack, heavily based on Warp10 (Kafka/Hadoop/Storm based) to deliver developer efficiency and trustability to our clients applications.
Problems you’ll face in the Microservices World: Configuration, Authenticatio...Quentin Adam
Okay, Microservices are cool. But, as all the new trendy buzzword, it’s not a silver bullet, and there are several problems to manage. One is the authentication, distributed authentication is hard, and there is many ways to achieve it. Configuration is the second issue to be managed when dealing with distributed micro application strategy. This talk is a concrete return of experience to build a strategy on microservice and problems we will have to deal on this occasion.
MONITORING THE UNKNOWN, 1000*100 SERIES A DAY - DEVOXX MOROCCO 2017Quentin Adam
How to monitor unknown third party code? One of the hardest challenges we face running Clever Cloud, apart from the impressive scale we face with hundreds of new applications per week, is the monitoring of unknown tech stacks. The first goal of rebuilding the monitoring platform was to accommodate the immutable infrastructure pattern that generates lots of ephemeral hosts every minute. The traditional approach is to focus on VMs or hosts, not applications. We needed to shift this into an approach of auto-discovery of metrics to monitor, allowing third party code to publish new items. This talk explains our journey in building Clever Cloud Metrics stack, heavily based on Warp10 (Kafka/Hadoop/Storm based) to deliver developer efficiency and trustability to our clients applications.
Understand immutable infrastructure, what? Why? How? - Meta-Meetup DEVOPS NIGHT Quentin Adam
Why everybody is speaking about Immutability? Immutable infrastructure? The All IT automation ecosystem need to rely on the append only, remove historical management of servers. This talk explain what is immutable infrastructure, how to build it, and how to manage data in this infrastructure pattern. It will cover pattern to use it on containers or virtual machine world.
What is systemd? Why use it? how does it work? - breizhcampQuentin Adam
Après la grande guerre initd et systemd, il est clair que maintenant systemd s'est imposé. Pourquoi ? Quels sont les intérêts ? Est ce difficile de faire un fichier de configuration systemd ? Comment ça marche ? Comment écrire un fichier de conf ? Comment gérer des CRONs avec ?
What is systemd? Why use it? how does it work? - devoxx france 2017Quentin Adam
Talk with @clementd.
The great war is ended, systemd won over initd (the old), upstart and the other, and now it's the mainstream choice. But Why? What is the interest? How difficult is it to do a configuration on the systemd world? How does it work? Can I replace CRON on it?
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
Why React Native as a Strategic Advantage for Startup Innovation.pdfayushiqss
Do you know that React Native is being increasingly adopted by startups as well as big companies in the mobile app development industry? Big names like Facebook, Instagram, and Pinterest have already integrated this robust open-source framework.
In fact, according to a report by Statista, the number of React Native developers has been steadily increasing over the years, reaching an estimated 1.9 million by the end of 2024. This means that the demand for this framework in the job market has been growing making it a valuable skill.
But what makes React Native so popular for mobile application development? It offers excellent cross-platform capabilities among other benefits. This way, with React Native, developers can write code once and run it on both iOS and Android devices thus saving time and resources leading to shorter development cycles hence faster time-to-market for your app.
Let’s take the example of a startup, which wanted to release their app on both iOS and Android at once. Through the use of React Native they managed to create an app and bring it into the market within a very short period. This helped them gain an advantage over their competitors because they had access to a large user base who were able to generate revenue quickly for them.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Modern design is crucial in today's digital environment, and this is especially true for SharePoint intranets. The design of these digital hubs is critical to user engagement and productivity enhancement. They are the cornerstone of internal collaboration and interaction within enterprises.
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...Juraj Vysvader
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I didn't get rich from it but it did have 63K downloads (powered possible tens of thousands of websites).
Strategies for Successful Data Migration Tools.pptxvarshanayak241
Data migration is a complex but essential task for organizations aiming to modernize their IT infrastructure and leverage new technologies. By understanding common challenges and implementing these strategies, businesses can achieve a successful migration with minimal disruption. Data Migration Tool like Ask On Data play a pivotal role in this journey, offering features that streamline the process, ensure data integrity, and maintain security. With the right approach and tools, organizations can turn the challenge of data migration into an opportunity for growth and innovation.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
12. SO WE NEED TO BE ABLE
TO DISPATCH THE WORK
SCALE OUT
• Many workers
doing the same
thing
• No SPOF
• Growing is more
easy
• Introduce best
practice
SCALE UP
• 1 Fat instance
• 1 Fat application
• SPOF (single point
of failure)
• Hard to maintain
• Always has a limit
• Short term
meaning
13. IF YOU ONLY SCALE UP,
YOU GONNA HAVE A BAD TIME
21. USE AN EVENT BROKER
TO MODULARIZE YOUR
APP
• AMQP
• Celery
• 0MQ
• Redis
• JMS
• Even some http chunk or websocket
• Some case : hadoop, akka…
• …
My talk about rabbitMQ: https://www.youtube.com/watch?v=15mzY2MfDgM&t=3s
22. My talk about rabbitMQ: https://www.youtube.com/watch?v=15mzY2MfDgM&t=3s
CRON + FS IS NEITHER AN EVENT
QUEUE NOR A JOB SCHEDULER
23. BIG CHANGE IN
SOFTWARE INDUSTRY
One instance
One organization
One data repository
One instance
(distributed)
Multiple organization
+ a lot of users
One data repository
YESTEDAY NOW
Multi-tenant
24. INSTANCE FOR ONE
ORGANIZATION
ACID
• Atomicity
• Consistency
• Isolation
• Durability
Powerful
data
management
• Transaction
• User
management
• One above one
Take advantage of ACID
database
27. EXAMPLE : E-SHOP ON
CLASSIC MODE
User A buy a
hdd
Database Transaction :
• Stock management
• Order management
• Invoice generation
• Customer Account reward
• …
Transaction
user A is
processed
Stock &
Order are just
perfectly
synchronize
28. EXAMPLE : E-SHOP ON
CLASSIC MODE
User A buy a
hdd
Database Transaction :
• Stock management
• Order management
• Invoice generation
• Customer Account reward
• …
Transaction
user A is
processed
Stock &
Order are just
perfectly
synchronize
User B buy a
hdd Transaction
user B is
processed
then
29. EXAMPLE : E-SHOP ON
MULTI-TENANT MODE
i.e. : Multiple shop of various sellers on the same instance
30. EXAMPLE : E-SHOP ON
MULTI-TENANT MODE
User A buy a
hdd on seller A
Database Transaction :
• Stock management
• Order management
• Invoice generation
• Customer Account reward
• …
Transaction
user A is
processed
Stock &
Order are just
perfectly
synchronize
User B buy a
book on seller B Transaction
user B is
processed
then
33. DATASTORE CHOICES
ARE DRIVEN BY USAGE
Make
decisions
based on
needs
Do I need
atomicity of
requests ?
Do I need
concurrent
access ?
Do I mostly
read or
write ?
Do I need
relational ?
Do I need
big storage
capacity ?
Do I need
high
availability
?
34. USE ONLINE
DATABASE / BE
READY TO TEST
IN JUST A FEW
MINUTES
NO NEED TO TRASH YOUR COMPUTER
35. {P, DB, S} aaS
USE OPS FREE SOLUTION TO LEARN
AND START
37. DO NOT USE THE FILE
SYSTEM AS A DATASTORE
File system are POSIX compliant
• POSIX is ACID
• POSIX is powerful but is a bottleneck
• File System is the nightmare of ops
• File System creates coupling (host provider/OS/language)
• SPOF-free multi tenant File System is a unicorn
STORE IN DATABASE, OR IN A DATASTORE LIKE
S3/RIAKCS DEDICATED TO FILE MANAGEMENT
40. USE STREAMING I/O TO
STREAM DATA DIRECTLY
TO DATABASE
HTTP Post data
Temporarily
store as file
or in memory
Store it into
your storage
backend
Say OK to
client
41. USE STREAMING I/O TO
STREAM DATA DIRECTLY
TO DATABASE
HTTP Post data
Directly stream
your data to
Storage
backend
Say OK to
client
42. DO NOT USE
MEMORY AS
DATABASE
LIKE : SHARED / GLOBAL VARIABLE,
CACHE “IN THE CODE”, INTENSIVE
SESSION USAGE…
43. DO NOT USE A VARIABLE
FOR MORE THAN ONE
REQUEST
44. F(X) = X * 2
F(2) = 4
^ WE ASSUME THAT
FOR SAME INPUT, SAME OUTPUT