Zero to One - Notes on functional monitoring for startups

•

1 like•86 views

Yann Person

Software

1
ZERO TO ONE
NOTES AND IDEAS ON FUNCTIONAL
MONITORING OFYOUR APPLICATION
Yann Person - I’m hiring, ping me @troblous

2
who I am & what I do
Yann Person
@troblous
Lead QA 
Manomano

6
what QA usually means
functional tests 
non-regression tests 
performance tests
continuous integration
functional monitoring 
technical monitoring
& many more topics
I’m hiring, ping me @troblous

7
what QA usually means
functional tests 
non-regression tests 
performance tests
continuous integration
functional monitoring 
technical monitoring
& many more topics
I’m hiring, ping me @troblous

8
the pitch
“mmm lots of people are calling us 
complaining of being unable to do X”
 
 
a huge issue started in production 
and you aren’t aware
I’m hiring, ping me @troblous

9
where to start
I’m hiring, ping me @troblous

10
focus on your business
from what do you make $$$?
where are your weaknesses?
I’m hiring, ping me @troblous

11
focus on your business
we take fees from $$$ that comes in (= payins)
we have external dependencies to process payins
I’m hiring, ping me @troblous

12
metric choice
if you had to choose, what metric would it be?
I’m hiring, ping me @troblous

13
choose one key metric
number of successful payins
I’m hiring, ping me @troblous

14
work with devs to get it
check what you currently store
check what you could easily store
check if you have an easy way to access it
I’m hiring, ping me @troblous

15
work with devs to get it
we log every API calls: 
what comes in, what comes out
we use Elasticsearch/Logstash/Kibana
I’m hiring, ping me @troblous

16
ELK
Logstash 
collect & transform
Elasticsearch 
store
Kibana 
visualize
I’m hiring, ping me @troblous

17
make a MVP
MVP = Minimum Viable Product
 
 
one metric displayed to a few people
I’m hiring, ping me @troblous

18
make a MVP
a Kibana visualization of the 
number of successful payins
 
 
shared to the Product/QA teams
I’m hiring, ping me @troblous

19
make a MVP
I’m hiring, ping me @troblous

20
“done is better
than perfect”
I’m hiring, ping me @troblous

21
how to improve
I’m hiring, ping me @troblous

22
iterate on your needs
now that you have one metric, what happens 
when this metric abruptly changes?
what do you do?
what information do you look for?
I’m hiring, ping me @troblous

23
iterate on your needs
when we notice a drop in 
successful payins, we check:
which currencies are impacted
which clients are impacted
which types of payins are involved
I’m hiring, ping me @troblous

24
iterate on your needs
I’m hiring, ping me @troblous

25
iterate on your needs
another important metric when you work with APIs:
the response time
I’m hiring, ping me @troblous

26
iterate on your needs
I’m hiring, ping me @troblous

27
iterate how you measure
does the average really reﬂect the reality?
I’m hiring, ping me @troblous

28
iterate how you measure
I’m hiring, ping me @troblous

30
step up your game
other tools exist to visualize your data
they can be better for beautiful dashboards
Grafana for example
I’m hiring, ping me @troblous

31
step up your game
Logstash 
collect & transform
Elasticsearch 
store
Kibana 
visualize
Grafana
I’m hiring, ping me @troblous

32
step up your game
I’m hiring, ping me @troblous

33
in real life
I’m hiring, ping me @troblous

34
go even further
setup alerts based on your dashboards
ElastAlert or Watcher (X-Pack) for example
I’m hiring, ping me @troblous

35
alerts in Slack
I’m hiring, ping me @troblous

36
what an alert looks like
Rule Name
Failed payins (eur)
Query
urlPattern:payins AND httpMethod:POST AND status:FAILED AND
currency:EUR
Alert Type
Frequency
Number of events
40
Timeframe
5min
I’m hiring, ping me @troblous

37
best good practices
log errors
check them regularly & look for patterns
observe your trafﬁc
I’m hiring, ping me @troblous

38
what next
keep learning and contributing
share your experiences
join me, i’m recruiting

39
the end
have questions, need info & advices on tools, share
experiences, discuss automation & performance,
recommend candidates or recruiters…
ping me @troblous
Yann Person

Similar to Zero to One - Notes on functional monitoring for startups

Do you ever wonder how some startups seem to figure out customer acquisition so easily? It seems like one second, you’ve never heard of them and the next second, they’re everywhere you turn. Asia Matos, CEO and Founder of DemandMaven, walks you through the exact go-to-market process for winning your first 100 customers and discovering your absolute best marketing strategies and channels in the early days.

Asia Orangio - How to acquire your first 100 customers

Joe Glover

Top 10 Tips for Your Split Test Program by Justin Rondeau

Utah Digital Marketing Collective

Aligning impact from boardrooms to pixels

Michael Le

Meaningful Metrics for Startups

GoSquared

Measurement for success - #SASCON 2014

Neil Walker

Business Growth Engineering

Dan Russell

30 Sales Tips to Build and Grow your Startup by Jon Woodroof and Enoch Pakanati

Enoch James

Culture of Optimization

Nikki Johnson

What We Learned from Four Years of Sciencing the Crap Out of DevOps - Nicole ...

SeniorStoryteller

The Latest: What We Learned from the 2016 State of DevOps Report Dr. Nicole Forsgren, CEO and Chief Scientist, DevOps Research & Assessment LLC Jez Humble, CTO, DevOps Research & Assessment LLC Four years and 25,000 respondents later, and we have learned a lot about what makes IT and organizational performance awesome. This year we include insights into security, containers, trunk-based development, and lean product management. Tune in for practical take-aways to make your teams' technology transformations even better. DevOps Enterprise Summit San Francisco 2016

DOES16 San Francisco - Nicole Forsgren & Jez Humble - The Latest: What We Lea...

Gene Kim

DOES 2016 Sciencing the Crap Out of DevOps

Nicole Forsgren

Digital Mornings Copenhagen - Mathew Sweezey presentation

Bård Buan

Digital Mornings Copenhagen - Mathew Sweezey presentation

Bård Buan

Prioritization and validation are key activities for successful product management. As a product manager, how will you succeed if you are not able to prioritize correctly? How do you determine what feature to release next and if it is the correct feature to build in the first place? This talk will cover principle methods and frameworks for feature validation and prioritization and is recommended for product managers and people working in product.

Validation and hypothesis based product management by Abdallah Al-Khalidi

Abdallah Al-Khalidi

Digital morning, Stockholm, 23 of March

Eva-Lotta Laurin

Digital Marketing ROI at Blogworld NYC

Christopher Penn

Unlocking the 4 Gateways of Growth

Kissmetrics on SlideShare

Personalization Strategy Workshop - Los Angeles

Optimizely

In a world that has a million different options for every creative element, CTA, form fields, and more... where do you even start? How do you know that element is where you'll see an impact big enough to make a difference for your bottom line? This is the #1 question I get as a CRO strategist, and my answer every time is: it depends! This session will walk you through how to understand your testing opportunities, generate test ideas, and measure your results with scientific accuracy Key Takeaways: +How to spot opportunities for testing+How to evaluate competitors and other sites for inspiration+Ways to organize and prioritize ideas based on your goals+How to use tools to evaluate test results (that don't require a stats degree)

Beyond the Button: Tests that actually move the needle - Karen Hopper, Razorfish

DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions

Being a Data-Driven Communicator

James Valentine, MSC

Similar to Zero to One - Notes on functional monitoring for startups (20)

Asia Orangio - How to acquire your first 100 customers

Top 10 Tips for Your Split Test Program by Justin Rondeau

Aligning impact from boardrooms to pixels

Meaningful Metrics for Startups

Measurement for success - #SASCON 2014

Business Growth Engineering

30 Sales Tips to Build and Grow your Startup by Jon Woodroof and Enoch Pakanati

Culture of Optimization

What We Learned from Four Years of Sciencing the Crap Out of DevOps - Nicole ...

DOES16 San Francisco - Nicole Forsgren & Jez Humble - The Latest: What We Lea...

DOES 2016 Sciencing the Crap Out of DevOps

Digital Mornings Copenhagen - Mathew Sweezey presentation

Validation and hypothesis based product management by Abdallah Al-Khalidi

Digital morning, Stockholm, 23 of March

Digital Marketing ROI at Blogworld NYC

Unlocking the 4 Gateways of Growth

Personalization Strategy Workshop - Los Angeles

Beyond the Button: Tests that actually move the needle - Karen Hopper, Razorfish

Being a Data-Driven Communicator

Recently uploaded

InShot proinshot.com stands tall among its peers as the ultimate video editing app, offering simplicity, versatility, and power in one package. With its intuitive interface and comprehensive feature set, InShot caters to both beginners and seasoned editors alike. Whether you're creating content for social media, YouTube, or personal projects, InShot empowers you to unleash your creativity and transform your videos into captivating masterpieces. Join the millions of users who trust InShot https://www.proinshot.com/ for all their video editing needs and discover the difference for yourself!

Exploring the Best Video Editing App.pdf

proinshot.com

Foundation models are machine learning models which are easily capable of performing variable tasks on large and huge datasets. FMs have managed to get a lot of attention due to this feature of handling large datasets. It can do text generation, video editing to protein folding and robotics. In case we believe that FMs can help the hospitals and patients in any way, we need to perform some important evaluations, tests to test these assumptions. In this review, we take a walk through Fms and their evaluation regimes assumed clinical value. To clarify on this topic, we reviewed no less than 80 clinical FMs built from the EMR data. We added all the models trained on structured and unstructured data. We are referring to this combination of structured and unstructured EMR data or clinical data.

Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...

harshavardhanraghave

A great deal of attention in medical devices has shifted towards cybersecurity with the ratification of section 524B of the FD&C act. This new law enables the FDA to enforce cybersecurity controls in any medical device that is capable of networked communications or that has software. In this webinar we will recap the process for managing vulnerabilities, identify categories of vulnerabilities and solutions and more.

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...

ICS

Looking to embark on a digital project in New York City? Choosing the ideal Laravel development partner is pivotal. Begin by defining your project requirements clearly. Assess potential partners' experience, expertise, and technical proficiency, checking portfolios and client testimonials. Effective communication and collaboration are paramount, so evaluate partners' communication styles and project management approaches. Consider long-term scalability and support options, and discuss pricing and contracts transparently. Lastly, trust your instincts when selecting a partner aligned with your vision and values.

How to Choose the Right Laravel Development Partner in New York City_compress...

software pro Development

VTU technical seminar 8Th Sem on Scikit-learn

AmarnathKambale

Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live Booking Contact Details :- WhatsApp Chat :- [+91-9999965857 ] The Best Call Girls Delhi At Your Service Russian Call Girls Delhi Doing anything intimate with can be a wonderful way to unwind from life's stresses, while having some fun. These girls specialize in providing sexual pleasure that will satisfy your fetishes; from tease and seduce their clients to keeping it all confidential - these services are also available both install and outcall, making them great additions for parties or business events alike. Their expert sex skills include deep penetration, oral sex, cum eating and cum eating - always respecting your wishes as part of the experience (29-April-2024(PSS)

Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live

Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure

10 Trends Likely to Shape Enterprise Technology in 2024

Mind IT Systems

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

In the past six months, the AI landscape has undergone a massive transformation, ushering in a new era of productivity with the latest in Large Language Models (LLMs) and AI technology. This deep dive unlocks how to: Create CustomGPT Models: No coding needed to tailor AI for your unique projects. Integrate your own data, including PDFs and Excel sheets, making information handling a breeze. Plus, discover how to call your own actions/integrations for even more personalized utility. Navigate Advanced Prompting: Overcome AI's memory limits and utilize Retrieval-Augmented Generation for accessing your personalized data, streamlining how you interact with AI. Stay Ahead with AI Trends: Peek into the evolving world of LLMs, featuring newcomers like Google Gemini, Anthropic Claude, Open Sora, and Twitter Grok, and understand what their advancements mean for your productivity. Witness Real-Life Transformations: Through examples and prompt demonstrations, see firsthand how these AI strategies revolutionize routine tasks, from data analysis to content creation. Learn to leverage image output and input for advanced practical use cases, adding a new dimension to your productivity toolkit. No previous coding or AI experience is needed for this talk. Stay ahead in the fast-evolving world of work. Embrace the AI revolution and transform your workflow with advanced LLM techniques. Join us to ensure you're not left behind in the productivity race.

AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques

VictorSzoltysek

Investing in AI transformation today The modern business advantage: Uncovering deep insights with AI Organizations around the world have come to recognize AI as the transformative technology that enables them to gain real business advantage. AI’s ability to organize vast quantities of data allows those who implement it to uncover deep business insights, augment human expertise, drive operational efficiency, transform their products, and better serve their customers

Microsoft AI Transformation Partner Playbook.pdf

Willy Marroquin (WillyDevNET)

HR Software Buyers Guide in 2024 - HRSoftware.com

Fatema Valibhai

Many specialized tools cater to distinct stages within the software development lifecycle (SDLC). These tools target various aspects of development, delivery, and operations, each with its unique strengths. Uniting these diverse testing needs into a single continuous testing platform presents several challenges. Such a platform must seamlessly integrate with various development tools and environments, accommodate different testing methodologies, and remain flexible to adapt to organizational processes and quality standards.

The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...

kalichargn70th171

How To Use Server-Side Rendering with Nuxt.js

Andolasoft Inc

Conference: Engage2024 in Antwerp Type: Workshop Speakers: Florian Vogler, Henning Kunz, Christoph Adler Title: Navigating the Future with The Hitchhiker's Guide to Notes and Domino 14 Abstract: Embark on an exhilarating journey with industry trailblazers Florian Vogler, Henning Kunz, and Christoph Adler in this not-to-be-missed workshop at the forefront of the tech universe. Get ready for a thrilling kick-off as we navigate the current state of the HCL universe, setting the stage for an exploration of the groundbreaking Notes and Domino 14. Discover the latest enhancements and revolutionary features that will redefine your experience. In this interactive session, unlock a treasure trove of tips and tricks to elevate your utilization of version 14, both with and without the game-changing panagenda MarvelClient. Brace yourself for also diving into Nomad, Nomad Web, and VoltMX, expanding your horizons in the expansive HCL landscape. Be a part of this exclusive opportunity to stay ahead in the ever-evolving world of HCL technologies. Your journey to mastering Notes and Domino 14 begins here. And remember, in the spirit of intergalactic exploration, don't forget to bring your towel!

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

panagenda

Diamond Application Development Crafting Solutions with Precision

SolGuruz

At TECUNIQUE, we're a stable and steadily growing Indian software services company with over 14 years of industry experience. Specializing in offshore software development and quality assurance services, we've built a reputation for delivering unique and effective solutions to start-ups, software development companies, enterprises, and digital agencies. We pride ourselves on our commitment to excellence and innovation. By blending insightful business domain knowledge with exceptional technical prowess, we craft tailor-made solutions that meet the unique needs of our clients. Our dedicated teams are adept in specific technologies, ensuring seamless integration of skills and delivering reliable, scalable, and high-quality software solutions aligned with our clients' preferences. Bespoke Dedicated Teams: Crafted to meet your specific needs and technology preferences, our dedicated teams are committed to delivering top-notch software solutions. Offshore Software Development: Accelerate your software development and scale up quickly with our 12+ years of expertise in offshore development. Quality Assurance Services: Ensure the quality of your software products with our dedicated teams of experienced QA professionals. IT Staff Augmentation: Overcome skill gaps with our client-centric software team, offering staff augmentation services. Expert Software Services: Unlock our capabilities in custom software development, product development, and quality assurance. Mission and Vision: Our mission at TECUNIQUE is to be the catalyst for our clients' success in the dynamic domain of software development. Rooted in our core values of respect, authenticity, and responsibility, we strive to ease the software outsourcing experience, reducing both time and cost to market for our clients. We envision ourselves as the leading Indian software services company, renowned for our unwavering commitment to excellence and innovation. www.tecunique.com

TECUNIQUE: Success Stories: IT Service provider

mohitmore19

In the realm of real-time applications, Large Language Models (LLMs) have long dominated language-centric tasks, while tools like OpenCV have excelled in the visual domain. However, the future (maybe) lies in the fusion of LLMs and deep learning, giving birth to the revolutionary concept of Large Action Models (LAMs). Imagine a world where AI not only comprehends language but mimics human actions on technology interfaces. For example, the Rabbit r1 device presented at CES 2024, driven by an AI operating system and LAM, brings this vision to life. It executes complex commands, leveraging GUIs with unprecedented ease. In this presentation, join me on a journey as a software engineer tinkering with WebRTC, Janus, and LLM/LAMs. Together, we’ll evaluate the current state of these AI technologies, unraveling the potential they hold for shaping the future of real-time applications.

Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications

Alberto González Trastoy

In an era where security concerns are paramount, the integration of artificial intelligence (AI) into CCTV cameras has revolutionized surveillance capabilities. One of the most significant advancements is the ability to achieve real-time threat detection, enabling immediate responses to potential security breaches. This blog explores how AI is reshaping surveillance through real-time threat detection and the implications of this technology.

Optimizing AI for immediate response in Smart CCTV

shikhaohhpro

Looking for an efficient way to manage your finances? Look no further than our money management app. With easy-to-use features, you can track your expenses, create budgets, and monitor your savings goals all in one place. Our app provides real-time updates on your spending habits and helps you make smarter financial decisions. Take control of your finances today with our user-friendly money management app.

Right Money Management App For Your Financial Goals

Jhone kinadey

Craft an AI & Machine Learning Pitch with our Editable Professional PowerPoint Template. Ignite your AI & Machine Learning pitch with our cutting-edge PowerPoint template tailored for the industry. Perfect for AI conferences, investor presentations, sales pitches to tech-focused companies, training sessions, and educational programs. - 20+ editable slides: Get a variety of options to choose from for your presentation. - Time-saving solution: Download, replace text/images with a few clicks. - User-friendly customization: Easy to use and personalize. - Modern and attractive design: Captivating visuals, sleek layout. - Tailored to your requirements: Fully alterable for customization. - Well-organized slides: Complete control over content. - Thematic specificity: Reflects healthcare industry with relevant graphics. - Showcase your business idea: Communicate value proposition effectively.

AI & Machine Learning Presentation Template

Presentation.STUDIO

Recently uploaded (20)

Exploring the Best Video Editing App.pdf

Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...

The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...

How to Choose the Right Laravel Development Partner in New York City_compress...

VTU technical seminar 8Th Sem on Scikit-learn

Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live

10 Trends Likely to Shape Enterprise Technology in 2024

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques

Microsoft AI Transformation Partner Playbook.pdf

HR Software Buyers Guide in 2024 - HRSoftware.com

The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...

How To Use Server-Side Rendering with Nuxt.js

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

Diamond Application Development Crafting Solutions with Precision

TECUNIQUE: Success Stories: IT Service provider

Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications

Optimizing AI for immediate response in Smart CCTV

Right Money Management App For Your Financial Goals

AI & Machine Learning Presentation Template

Zero to One - Notes on functional monitoring for startups

1. 1 ZERO TO ONE NOTES AND IDEAS ON FUNCTIONAL MONITORING OFYOUR APPLICATION Yann Person - I’m hiring, ping me @troblous

2. 2 who I am & what I do Yann Person @troblous Lead QA  Manomano

3. 3 I’m hiring, ping me @troblous

4. 4 I’m hiring, ping me @troblous

5. 5 I’m hiring, ping me @troblous

6. 6 what QA usually means functional tests  non-regression tests  performance tests continuous integration functional monitoring  technical monitoring & many more topics I’m hiring, ping me @troblous

7. 7 what QA usually means functional tests  non-regression tests  performance tests continuous integration functional monitoring  technical monitoring & many more topics I’m hiring, ping me @troblous

8. 8 the pitch “mmm lots of people are calling us  complaining of being unable to do X”     a huge issue started in production  and you aren’t aware I’m hiring, ping me @troblous

9. 9 where to start I’m hiring, ping me @troblous

10. 10 focus on your business from what do you make $$$? where are your weaknesses? I’m hiring, ping me @troblous

11. 11 focus on your business we take fees from $$$ that comes in (= payins) we have external dependencies to process payins I’m hiring, ping me @troblous

12. 12 metric choice if you had to choose, what metric would it be? I’m hiring, ping me @troblous

13. 13 choose one key metric number of successful payins I’m hiring, ping me @troblous

14. 14 work with devs to get it check what you currently store check what you could easily store check if you have an easy way to access it I’m hiring, ping me @troblous

15. 15 work with devs to get it we log every API calls:  what comes in, what comes out we use Elasticsearch/Logstash/Kibana I’m hiring, ping me @troblous

16. 16 ELK Logstash  collect & transform Elasticsearch  store Kibana  visualize I’m hiring, ping me @troblous

17. 17 make a MVP MVP = Minimum Viable Product     one metric displayed to a few people I’m hiring, ping me @troblous

18. 18 make a MVP a Kibana visualization of the  number of successful payins     shared to the Product/QA teams I’m hiring, ping me @troblous

19. 19 make a MVP I’m hiring, ping me @troblous

20. 20 “done is better than perfect” I’m hiring, ping me @troblous

21. 21 how to improve I’m hiring, ping me @troblous

22. 22 iterate on your needs now that you have one metric, what happens  when this metric abruptly changes? what do you do? what information do you look for? I’m hiring, ping me @troblous

23. 23 iterate on your needs when we notice a drop in  successful payins, we check: which currencies are impacted which clients are impacted which types of payins are involved I’m hiring, ping me @troblous

24. 24 iterate on your needs I’m hiring, ping me @troblous

25. 25 iterate on your needs another important metric when you work with APIs: the response time I’m hiring, ping me @troblous

26. 26 iterate on your needs I’m hiring, ping me @troblous

27. 27 iterate how you measure does the average really reﬂect the reality? I’m hiring, ping me @troblous

28. 28 iterate how you measure I’m hiring, ping me @troblous

29. 29 I’m hiring, ping me @troblous

30. 30 step up your game other tools exist to visualize your data they can be better for beautiful dashboards Grafana for example I’m hiring, ping me @troblous

31. 31 step up your game Logstash  collect & transform Elasticsearch  store Kibana  visualize Grafana I’m hiring, ping me @troblous

32. 32 step up your game I’m hiring, ping me @troblous

33. 33 in real life I’m hiring, ping me @troblous

34. 34 go even further setup alerts based on your dashboards ElastAlert or Watcher (X-Pack) for example I’m hiring, ping me @troblous

35. 35 alerts in Slack I’m hiring, ping me @troblous

36. 36 what an alert looks like Rule Name Failed payins (eur) Query urlPattern:payins AND httpMethod:POST AND status:FAILED AND currency:EUR Alert Type Frequency Number of events 40 Timeframe 5min I’m hiring, ping me @troblous

37. 37 best good practices log errors check them regularly & look for patterns observe your trafﬁc I’m hiring, ping me @troblous

38. 38 what next keep learning and contributing share your experiences join me, i’m recruiting

39. 39 the end have questions, need info & advices on tools, share experiences, discuss automation & performance, recommend candidates or recruiters… ping me @troblous Yann Person

Zero to One - Notes on functional monitoring for startups

Recommended

Recommended

More Related Content

Similar to Zero to One - Notes on functional monitoring for startups

Similar to Zero to One - Notes on functional monitoring for startups (20)

Recently uploaded

Recently uploaded (20)

Zero to One - Notes on functional monitoring for startups