As a product manager or a startup founder, you know you need to talk to your customers; Everyone talks about it enough! There are endless articles, books, blogs and talks from well respected experts that repeat that same message: "Talk to your customers". And yet, products still fail because we're so focused on talking to our customers, we forget to listen and understand them.
How to See the Best in the Worst by PureFacts VP ProductProduct School
Main takeaways:
- Identifying the worst in your product is power
- How "the worst" is the biggest opportunity and can become "the best"
- Crafting products with "the worst" not worth solving for
How to Break Down PM in Startups vs. Big Companies by WeWork PMProduct School
Main takeaways:
- Know the difference in roles and responsibilities of a product manager at a large company vs a startup
- Learn the skills necessary to succeed in a large company vs a startup, and where the similarities are
- Leave with a better understanding of both, and an idea of which environment might be better for you
If you work in digital products you've probably recognized the rapid rate of innovation and change that is needed to keep up with technology and competitors. Clearly we can no longer track and manage to a 2 year roadmap; a new paradigm to plan & manage products is needed. Agile helped us respond and adapt to change along the way but Lean helps us pivot in completely new directions. In this talk Natalie will explain tools and techniques for managing a continuously evolving roadmap of customer and product hypotheses.
Sachin Rekhi shares the 4 dimensions of product management (vision, strategy, design, execution), discusses where product managers fit in the R&D organization, and how product management roles differ across and within companies.
2017 Workshop at Stanley Black & Decker Digital Summit on how to de-risk product development using rapid prototyping and real world testing with customers early in the product development lifecycle
How to See the Best in the Worst by PureFacts VP ProductProduct School
Main takeaways:
- Identifying the worst in your product is power
- How "the worst" is the biggest opportunity and can become "the best"
- Crafting products with "the worst" not worth solving for
How to Break Down PM in Startups vs. Big Companies by WeWork PMProduct School
Main takeaways:
- Know the difference in roles and responsibilities of a product manager at a large company vs a startup
- Learn the skills necessary to succeed in a large company vs a startup, and where the similarities are
- Leave with a better understanding of both, and an idea of which environment might be better for you
If you work in digital products you've probably recognized the rapid rate of innovation and change that is needed to keep up with technology and competitors. Clearly we can no longer track and manage to a 2 year roadmap; a new paradigm to plan & manage products is needed. Agile helped us respond and adapt to change along the way but Lean helps us pivot in completely new directions. In this talk Natalie will explain tools and techniques for managing a continuously evolving roadmap of customer and product hypotheses.
Sachin Rekhi shares the 4 dimensions of product management (vision, strategy, design, execution), discusses where product managers fit in the R&D organization, and how product management roles differ across and within companies.
2017 Workshop at Stanley Black & Decker Digital Summit on how to de-risk product development using rapid prototyping and real world testing with customers early in the product development lifecycle
How to Effectively Lead a Focus Group by nexTier Product ManagerProduct School
Talking to users can be challenging or intimidating, and running a focus group is one of those tasks which most Product Managers would say is essential in getting real user insights. Traditionally, UX designers and Product Managers have relied on a combination of quantitative data and qualitative insights from focus groups and interviews.
Whether you want to test your user group's response to a new product or changes to modules or features within an existing product, as a product person you need to have a creative set of analytical skills and strategies for how to steer the group toward productive discussions.
Tremis Skeete talked about how focus groups can truly work well for you, and how you can organize, coordinate, and effectively lead focus group sessions.
How to Work with Teams as a Product Manager by fmr NY Magazine PMProduct School
One of the most important parts of product management is how you work with other people - whether it is communicating with stakeholders or managing a cross-functional team.
In this talk Morgan Cohn talked about experiences driving the product cycle in various work environments and the challenges that you can encounter during the process - from disagreements to scope creep to burn out. He explored how her role and approach as a Product Manager has changed in this respect and hopefully empower others with tools to successfully drive cross-functional teams and build great products.
2016 talk from Lean Product Innovation event at The HUB in Singapore. Stories from the trenches about building successful products: product design & testing, pivoting the product strategy, and building an org culture of continuous testing & learning.
So the purpose of product discovery is to make sure we have some evidence that when we ask the engineers to build production-quality software, it won’t be a wasted effort.
CMO Digital Summit - Exceeding customer expectations through digital product ...Natalie Hollier
Today's revolutionary customer experiences are driven by technology. 2017 workshop for traditional enterprises to think about innovating at startup speed to create differentiated customer experiences leveraging emerging technologies like voice, chatbots, AI. Examples of where this is happening today.
Presentation at FlowCon by Natalie Hollier and Joe Mclean.
Tools and techniques for doing lean product development, and how to scale from a small team to large and distributed teams building multiple products.
Product Manager 101: What Does A Product Manager Actually Do?Chris Cummings
This is an expanded and updated version of the original Product Manager 101. The purpose is to explain the role of the product manager and product management to new and prospective PMs as well as those who will interact with PMs.
Working together: Agile teams, developers, and product managersDanielle Martin
I spoke to students at Ada Developer Academy in Seattle, WA about how product managers and software engineers work together. In the presentation I cover: what's an agile team and how do they work; case studies of real work by my agile product development team; advice about behaviors that create successful product manager and developer working relationships; and other career/life advice for students starting their careers as software engineers.
How to Think Big as a Product Manager by Amazon Sr PMProduct School
Main Takeaways:
- The problem you think you are solving for customers might not be the right problem
- When there is a ton of ambiguity and complexity, finding the product/market fit often involves trial and error
Finding Product / Market Fit: Introducing the PMF Matrix - Presentation by Ri...Rishi Dean
These slides were used to facilitate a discussion of entrepreneurial MIT alums, mainly from the MIT Sloan business school. My intention was to introduce many of the newer, leaner concepts of early stage start-up development to a group that often sees "technology first" businesses.
This presentation centers on the concept of Product / Market Fit: what it is, why it's important, and how to achieve it. I propose my "Product Market Fit Matrix" that helps to characterize the issues of the start-up and presents various frameworks that can help guide development. In a sense the Product / Market Fit Matrix is a meta-framework.
For more information please visit: http://www.rishidean.com
Design Thinking vs. Lean Startup: Friends or Foes?Tathagat Varma
My talk at #AgileIndia2017 on what are the similarities and strengths of Design Thinking and Lean Startup, and where and how we could use them more effectively.
Lean Product Management: The Art of Known UnknownsNatalie Hollier
(This presentation was given at the Lean Strategy + Design Salon meetup in New York: http://www.meetup.com/LeanStrategyPlusDesign/events/200913392/)
"Innovate or die” is the mantra of successful companies. So how can we build innovation into our product development process? By combining design thinking, lean startup and agile we get a recipe for repeatable innovation: lean UX. Lean UX and lean startup methods are being used today by many startups and innovation labs to take a learning approach to discovering and building the best product for customers.
But what does repeatable innovation look like scaled across an enterprise? This talk will share how to apply lean product practices as a continuous process across multiple products and agile development teams in an organization. With real examples and artifacts you will learn how to manage - and thrive - in uncertainty to create awesome products.
Webinar: Why/How Zappos Democratizes PM by Zappos Head of ProductProduct School
Main Takeaways:
- Learn what worked well (and what didn’t) for Product Management in a self-managed, self-organized world.
- Understand the benefits of democratizing Product Management with tips on how.
- Discover how you can empower others and build a better product together.
Think About New Products & Measure Their Success by Amazon Sr PMProduct School
Main takeaways:
- Find your north star to develop great products
- The best strategies needed for a Product Manager to launch a successful product or feature
- Funnels, cohorts, and other fascinating and exciting measures of success
Leaner and Smarter: How Enterprises Can Develop Better Digital Products (v2)Natalie Hollier
This talk was given at the Product Innovation Summit in Boston, September 2016. It provides an overview of how Lean UX teams (applying Design thinking, Lean Startup and Agile development practices) work, and some of the challenges faced by enterprises when trying to adopt and scale teams that work in this way.
Creating Irresistible Products in 4 Steps by Google Product LeaderProduct School
Main Takeaways:
- Why do some products die off and others take off?
- What are the 4 key disciplines of product management and how do they maximize the chance that your product will deliver value?
- How can you master the 4 key disciplines and become in the top 10% of PMs?
How to Effectively Lead a Focus Group by nexTier Product ManagerProduct School
Talking to users can be challenging or intimidating, and running a focus group is one of those tasks which most Product Managers would say is essential in getting real user insights. Traditionally, UX designers and Product Managers have relied on a combination of quantitative data and qualitative insights from focus groups and interviews.
Whether you want to test your user group's response to a new product or changes to modules or features within an existing product, as a product person you need to have a creative set of analytical skills and strategies for how to steer the group toward productive discussions.
Tremis Skeete talked about how focus groups can truly work well for you, and how you can organize, coordinate, and effectively lead focus group sessions.
How to Work with Teams as a Product Manager by fmr NY Magazine PMProduct School
One of the most important parts of product management is how you work with other people - whether it is communicating with stakeholders or managing a cross-functional team.
In this talk Morgan Cohn talked about experiences driving the product cycle in various work environments and the challenges that you can encounter during the process - from disagreements to scope creep to burn out. He explored how her role and approach as a Product Manager has changed in this respect and hopefully empower others with tools to successfully drive cross-functional teams and build great products.
2016 talk from Lean Product Innovation event at The HUB in Singapore. Stories from the trenches about building successful products: product design & testing, pivoting the product strategy, and building an org culture of continuous testing & learning.
So the purpose of product discovery is to make sure we have some evidence that when we ask the engineers to build production-quality software, it won’t be a wasted effort.
CMO Digital Summit - Exceeding customer expectations through digital product ...Natalie Hollier
Today's revolutionary customer experiences are driven by technology. 2017 workshop for traditional enterprises to think about innovating at startup speed to create differentiated customer experiences leveraging emerging technologies like voice, chatbots, AI. Examples of where this is happening today.
Presentation at FlowCon by Natalie Hollier and Joe Mclean.
Tools and techniques for doing lean product development, and how to scale from a small team to large and distributed teams building multiple products.
Product Manager 101: What Does A Product Manager Actually Do?Chris Cummings
This is an expanded and updated version of the original Product Manager 101. The purpose is to explain the role of the product manager and product management to new and prospective PMs as well as those who will interact with PMs.
Working together: Agile teams, developers, and product managersDanielle Martin
I spoke to students at Ada Developer Academy in Seattle, WA about how product managers and software engineers work together. In the presentation I cover: what's an agile team and how do they work; case studies of real work by my agile product development team; advice about behaviors that create successful product manager and developer working relationships; and other career/life advice for students starting their careers as software engineers.
How to Think Big as a Product Manager by Amazon Sr PMProduct School
Main Takeaways:
- The problem you think you are solving for customers might not be the right problem
- When there is a ton of ambiguity and complexity, finding the product/market fit often involves trial and error
Finding Product / Market Fit: Introducing the PMF Matrix - Presentation by Ri...Rishi Dean
These slides were used to facilitate a discussion of entrepreneurial MIT alums, mainly from the MIT Sloan business school. My intention was to introduce many of the newer, leaner concepts of early stage start-up development to a group that often sees "technology first" businesses.
This presentation centers on the concept of Product / Market Fit: what it is, why it's important, and how to achieve it. I propose my "Product Market Fit Matrix" that helps to characterize the issues of the start-up and presents various frameworks that can help guide development. In a sense the Product / Market Fit Matrix is a meta-framework.
For more information please visit: http://www.rishidean.com
Design Thinking vs. Lean Startup: Friends or Foes?Tathagat Varma
My talk at #AgileIndia2017 on what are the similarities and strengths of Design Thinking and Lean Startup, and where and how we could use them more effectively.
Lean Product Management: The Art of Known UnknownsNatalie Hollier
(This presentation was given at the Lean Strategy + Design Salon meetup in New York: http://www.meetup.com/LeanStrategyPlusDesign/events/200913392/)
"Innovate or die” is the mantra of successful companies. So how can we build innovation into our product development process? By combining design thinking, lean startup and agile we get a recipe for repeatable innovation: lean UX. Lean UX and lean startup methods are being used today by many startups and innovation labs to take a learning approach to discovering and building the best product for customers.
But what does repeatable innovation look like scaled across an enterprise? This talk will share how to apply lean product practices as a continuous process across multiple products and agile development teams in an organization. With real examples and artifacts you will learn how to manage - and thrive - in uncertainty to create awesome products.
Webinar: Why/How Zappos Democratizes PM by Zappos Head of ProductProduct School
Main Takeaways:
- Learn what worked well (and what didn’t) for Product Management in a self-managed, self-organized world.
- Understand the benefits of democratizing Product Management with tips on how.
- Discover how you can empower others and build a better product together.
Think About New Products & Measure Their Success by Amazon Sr PMProduct School
Main takeaways:
- Find your north star to develop great products
- The best strategies needed for a Product Manager to launch a successful product or feature
- Funnels, cohorts, and other fascinating and exciting measures of success
Leaner and Smarter: How Enterprises Can Develop Better Digital Products (v2)Natalie Hollier
This talk was given at the Product Innovation Summit in Boston, September 2016. It provides an overview of how Lean UX teams (applying Design thinking, Lean Startup and Agile development practices) work, and some of the challenges faced by enterprises when trying to adopt and scale teams that work in this way.
Creating Irresistible Products in 4 Steps by Google Product LeaderProduct School
Main Takeaways:
- Why do some products die off and others take off?
- What are the 4 key disciplines of product management and how do they maximize the chance that your product will deliver value?
- How can you master the 4 key disciplines and become in the top 10% of PMs?
Increasing Business Impact - Focusing on value deliveryNarek Alaverdyan
Validated Learning; handling big backlogs of ideas
Focusing on which things to get done more than how to get things done
Lean-Startup: style business analysis and product development
Increasing Business Impact: focusing on Value Delivery
Managing organisational change; balancing technology, process and culture
Delivering fast: It requires new tools, new methods
Being part of the Business through having a “Product Mindset"
Під час доповіді поговоримо про участь бізнес-аналітиків і розкриємо основні складові discovery workshop:
- Організація. Коли проведення воркшопу, окрім стартової фази, є максимально ефективним?
- Підготовка. Як почати з нічого і якісно підготуватись до воркшопу у стислі терміни?
- Проведення: Workshop Do’s and Don’ts. Приклади технік і вправ, а також приблизний план самого воркшопу.
- Оформлення кінцевих результатів або презентації, що запам’ятовуються
Workshop delivered in August 2017 for the Institute of Designers in Ireland. Contact Derek Howard derek@thecustomer.ie (+353 86 227 0283) or Niamh O'Connor (+353 87 902 1188) niamh@thecustomer.ie
21 ноября Боб Дорф - всемирно известный предприниматель, гуру Силиконовой долины и соавтор бестселлера "Стартап: настольная книга основателя", переведенного на 19 языков мира, - провел семинар-практикум в Инновационном центре "Сколково". Он рассказал о методологии «развития клиента» и о том, как создать новую компанию и продукт и успешно вывести его на рынок. Сам Боб Дорф уже вывел 7 компаний на IPO, а свой первый бизнес начал в возрасте 12 лет.
No startup business experiences the same journey to success, but there are general stages that most companies move through as they grow:
1) Validation
2) Product Development
3) Commercialization
4) Scale/Growth
The Center for Entrepreneurial Innovation (CEI) helps its clients through these stages of business development and offers best practices for each stage. Represented by an amazing lineup of speakers, including Hart Shafer (Innovation Coach / Founder, Theraspecs), Eric Miller (Principal, PADT Inc.), Nate Curran (Entrepreneur-in-Residence, CEI) and Russ Yelton (CEO, Pinnacle Transplant Technologies, "The Startup Lifecycle" presentation offers unique insights and best practices for entrepreneurs growing their business.
What Early Startup Life is Like as a PM by Zava Product OwnerProduct School
Main Takeaways:
- Get comfortable wearing many hats
- Everything is unknown/based on assumptions - question everything you, think, you know
- Re-think everything if/when you pivot
What is Product Success by Cayan Dir of Product EngineeringProduct School
In the presentation, Tcheilly Nunes, comes up with three takeaways that he believes are the key for a successful product:
-Having way fewer meetings
-Fostering healthy team debates
-Making product decisions everyone understands
Not your Grandfather's Business Plan Writing Workshop by Thadeus GieddThadeus Giedd
The questions you should be asked (or should have been) and the items that should be addressed prior to starting the business plan writing process.
A different style, but I think the correct starting approach to tackling writing a business plan.
The Importance of Product Validation by RetailMeNot Dir. of PMProduct School
Product vision and strategy are key components to empowering teams to act with any meaningful degree of autonomy. But is an inspiring vision and an intentional product strategy enough to guarantee success?
Any Product Manager worth her salt knows that product validation is critical to building a successful product. And yet, product validation may be one of the hardest things you'll ever do in your career. During her talk, Laura shared insights on a product validation framework that will help Product Managers avoid the most common hypothesis pitfalls, learn more about their customers, and improve and refine their ideas along the way.
Marty talks about the hard parts of Product Management - People, Process, Product and Culture. For more detail about the talk, see our Meetup page here:
https://www.meetup.com/ProductTank-Auckland/events/248013722/
Want to sharpen your Product Management Skills and network with awesome people from the Auckland Product Management Community? Then join us at ProductTank Auckland:
https://www.meetup.com/ProductTank-Auckland/
Similar to How to Communicate with Your Customers by Putti Cakes Founder (20)
Webinar How PMs Use AI to 10X Their Productivity by Product School EiR.pdfProduct School
Explore AI tools hands-on and smoothly integrate them into your work routine. This practical experience is here to empower you, offering insights into the mindset of successful Product Managers. Learn the skills to become a more effective Product Manager.
Main Takeaways:
Hands-On AI Integration:
Learn practical strategies for integrating AI tools into your workflow effectively.
Mindset Insights for Success:
Gain valuable insights into the mindset of successful Product Managers, unlocking the secrets to their achievements.
Skill Empowerment for Growth:
Acquire essential skills that empower your evolution toward becoming a more effective and impactful Product Manager.
Webinar: Using GenAI for Increasing Productivity in PM by Amazon PM LeaderProduct School
In this webinar, you will learn how AI can take work off your plate, allowing you to focus on deep thinking or critical work. Cut out the drudge work in Product Management and get more out of your day.
Learnings:
Improve workflows that are high frequency - "manual tasks"
Increase the quality of output that has high importance - "brainy tasks"
Put GenAI to work today
Unlocking High-Performance Product Teams by former Meta Global PMMProduct School
Main Takeaways:
- High-Performing Team Dynamics: You’ll gain insights into fostering high-performance teamwork.
- Unveiling Team Personas: You’ll learn about different personas in the team and how to foster these differences.
- Decoding the Team Needs x Productivity Equation: You’ll learn about different team needs and how they correlate with engagement and productivity.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
40. What does this look like?
DEFINE
Idea forms
Some discussion
Write up spec
BUILD
Brief dev team
Create backlog
Create project plan
DESIGN
Brief designers
Create mockups
Brief technical lead
High-level spec
40
Feedback/analytics
Market research
Problem brief
Collaborative design
User testing
Iterative releases
Hypothesis testing
56. › Understand both
› Levels of confidence
› Tailor to your situation:
› Complexity of problem
› Complexity of solution
› Engineering resource
56
Problem vs Solution
57. New Product
More unknowns
Right problem?
Harder to find “users”
Dev constraints
New Product vs New Feature
New Feature
More data/feedback
Problem details?
Existing users to draw on
Less dev constraints
57
58. Qualitative
Customer Interviews,
usability testing, etc
Understand the why
Not statistically valid
Generally not scalable
Qualitative vs Quantitative
Quantitative
Analytics, (some) surveys,
etc
Measure the what
Statistically valid
Scalable to larger numbers
58
59. › Customer Interviews
› Surveys
› Landing Page MVP
› Concierge MVP
› Wizard of Oz MVP
› Fake door MVP
› User Testing
› Core MVP
What are the techniques
59
61. › 1-1 chat with customer
› Problem focused
› Qualitative
› Key points:
› Avoid bias or leading questions
› Talk to at least 10 people
› Ask screening questions
› Reverse engineer questions
Customer Interviews
61
62. › Use at start
› Validate problem
› Existence
› Details
› Mandatory
› Use on new product or new feature
When and how to use
62
64. › Could be quant or qual
› Could be problem or solution
› In-person or digital
› Key points
› Avoid leading/biased questions
› Less suited for quant
› Keep it short! 5 questions or less
Surveys
64
65. When and how to use
65
› Problem focused
› After customer interviews
› Use above to guide questions
› Increase confidence in learnings
› Solution focused
› Get feedback on a feature
› Can target specific users
› Compliments analytics
Caution: open-ended = manual work!
70. › Do it yourself
› Problem + Solution
› Qualitative
› Key points
› Ask questions
› Be hands-on with user
› Track priority vs effort
Concierge MVP
70
71. When and how to use
71
› After problem research
› Before build
› New Products
› Complicated problems/solutions
› Know when to move on
73. › Concierge but black box
› Solution focused
› Not scalable
› Key points
› Review user sessions
› Track priority vs effort
› Step-by-step automation
Wizard of Oz MVP
73
74. When and how to use
74
› After problem understood
› After customer interviews?
› After Concierge MVP?
› Follow up with customer
interviews/surveys
› New products or new features
› Problem backog => Step-by-step
automation
77. › Validate problem by measuring “clicks”
› Very light touch solution, i.e. entry point
› For existing products
› Feature doesn’t exist
› Key points:
› Analytics are key
› Be bold!
› Appreciative tone
› Don’t be dodgy
Fake Door MVP
77
81. › Lots of “MVPs”
› Concierge MVP
› Landing page MVP
› Wizard of Oz MVP
› MVP = Viable
› MVP = Product
› Concierge experiment
› Does the product exist?
MVP Rant
81
82. › Iterating to find MVP
› Not “first version”
› Start small, i.e. alpha/beta
› Iterate towards larger release
› Build on other techniques
› Ultimate goal: prove product-market fit
“Actual” MVP
82
96. Part-time Product Management Courses in
San Francisco, Silicon Valley, Los Angeles, New York, Austin,
Boston, Seattle, Chicago, Denver, London, Toronto
www.productschool.com
Editor's Notes
notes
Clarify purpose of the talk so everyone understands up front
Bit more info on the problem so we’re clear on what we’re solving
Some key factors to consider to frame these techniques
Run through techniques
Classic Q&A
Want to understand audience
Product manager in a team of product managers?
The only product person in entire company
Looking to make a change into Product Management
Something else?
Recognise the true need and what you’re trying to achieve
Not perpetuate the usual talking points
Process is about people - so make sure people feel happy
Show of hands - who has heard this in a talk?
Been to countless talks - “talk to your customers”
What actually happens
People are biased
Most common: user testing
Tests the usability of a design of a solution
No insights into customer behaviour
Key message: customer understanding
Don’t just listen, understand
What does understanding mean?
Key message: customer understanding
Don’t just listen, understand
What does understanding mean?
Not a beginner’s guide to customer research; emphasising where people go wrong
Not a guide to techniques; more about the key points when considering whether to use
No new Navin-branded techniques;existing ones are pretty decent for most scenarios
Prob thinking - who is this guy
What makes me qualified to talk about this
My answer is… woah, what’s with the attitude
Been a developer
C++, HTML/CSS, Javascript, Perl, Java, etc
Been a technical product manager
Hands on with really technical niche products
Was a business analyst but who was also product manager
A fully fledged pure product manager
Last couple of roles have been leading product teams
Hiring new members
Training
Setting product strategy
Got to the top
What do I do now?
Gun for hire
Go where I’m needed
Usually cus things are bad
Gun for hire
Go where I’m needed
Usually cus things are bad
This is my day job now
Work at top-level to develop product strategy
Help teams that are struggling to get better
Teach at Product School
Do training and workshops
Mentor product managers, CEO, etc
Problem definition - what are we trying to do
Design - how do we solve this
Build - create product
More complicated; iterative approaches
Release and feedback also on there
Define
Idea usually comes from senior stakeholder or business “strategy”
Might be some discussion - head of product, head of engineering, etc
High-level problem spec
Design
Make sure designers understand
First pass at design
Get technical feedback
Updated spec
Build
Do Dev understand
More detailed specs
Plan of release
Bonus
Making sure problem exists w/ feedback/research
Define as problem instead of feature
Bring tech in earlier, maybe even rest of company
Check the design
Earlier release = earlier feedback
Design tests to check assumptions
Product goes out; people wait with baited breath
Big success!!!!
But what actually happens
Yeah, not quite what we expected
No-one is using the product
No-one is buying the product
Users look at it and shrug
We don’t build products for the sake of it
So what did we do or not do that led us here?
First, remember what product success
We have a list of problems that users might have
We have a list of solutions that could fix those problems
A good product brings the right solution to the right problem
Two parts to the problem
Did we identify a genuine problem for e.g. do people want to order food at night
Do we understand the details of the problem, for e.g. do people want to explore, do they just want the same stuff, convenience vs price vs quality (or both), if so, when do either happen?
Similarly two parts to the solution
Did we pick the right solution, is it an app that lets your order food
Did we target the solution to the problem (using those understandings), is it a “top rated” list with filters, is it a browse by cuisine?
Everyone focuses on solution
Easier to understand
Easier to plan; action
Less ambiguity
That’s why people jump straight to design and user testing
People make assumptions
People misunderstand what people need
I would argue that companies are getting better at knowing there’s a problem
Discount the startups that just go head first into it
I hear pitches and the top level seems reasonable
It’s when they go into the detail my product senses tingle and I cringe
Because at that point, they’re like, yes, I know what they need and go off arrogance
One startup founder, I tried to help him, but he would rather take funding and build something for 3 months before first release, rather than try one of the techniques listed. Which would cost him nothing but time
Here are some of the techniques you can use
Will run through them in more detail
Keep these in mind when deciding what to do
Use these to understand the techniques better
Need to understand both
Have to understand problem and understand how solution will fix problem
If you don’t, chances of success = low
Not a perfect science
Never going to be like, yes, I am 100% sure
Don’t take too long trying to be perfect
Consider different factors
If problem is complex, spend more time, but if easy don’t dilly dally
If solution is problem, spend more time
If easy access to devs, consider a more experimental approach of trying different things
New product
You’re starting from scratch, no data or feedback (unless you get it)
Do you even have a problem worth solving?
How do you get users? Are they even the right users? Who are your users?
Potentially no developers, or expensive outsourcing. No existing product infrastructure to “plug” into
New Feature
Existing product with analytics, customer feedback, etc so more clarity
More focus on understanding the detail of the problem
Users well understood, easier to reach out and get details
Existing team and product infrastructure
Qual
Name suggests - quality
Examples are customer interviews, usability testing
Focus on insights, i.e. why people do this
Not statistically valid so don’t assume applies to everyone
Not scalable because labour intensive
Quant
Name suggests - all about quantity of data points
Ex like analytics, surveys (in some cases, as I’ll cover later)
More about the what, doesn’t tell you why
Stat valid as there are far more data points, or rather you have to collect meaningful quantity of data
Scalable as it’s more tech based, i.e. send standard survey with options, check analytics data, etc
Here are some of the most common techniques
Let’s run through them now
Conversation with customer
Open-ended questions
Normally 1-1
Best in person
Problem focused
Usual mistake is people bring solutions
Identify whether target market has problem
If do, delve into detail
Qualitative
You get feedback you need to process
Look for insights, not stats
Applies to both new product and features (but if features, most likely exploring the details of the problem)
Key points
Don’t push people down a path; don’t use yes/no questions. Use phrases. A good way is to ask about the last time they did something, so it’s a specific story
10 people seems to be a good number. It’s not stats but gives you idea. If nobody has the problem, did you screen properly. If everyone has problem, yay! Also think about where you’re gonna find these peopel
Screen screen screen. Make sure you’re talking to the right people
Typically you have your answer, your assumption. Think about how to phrase a question that would result in that answer. And then ask it without prompting. If you’ve asked and they don’t, then can prompt, ask how it compares to what they said, why they didn’t bring it up, etc
Always use at the start, too late otherwise
You can use to validate problem and details, though you need to find the right people
Could be quant if you ask open questions gathering feedback
Could be qual if you ask multiple choice since you can collate results
Could be problem if you ask about their lives, behaviours, etc
Could be solution if you’re asking about a product they’re using
Could do it in-person or could be digital
Key points
Same principles apply; if you’re asking a question, don’t make it biased. Neutral language, not so much yes/no. Ask them to rank lists, etc
I think it loses it’s power for quant because either you’re not there or you’re not exploring why they feel that way
Don’t put too much in or you’ll never get responses!
Problem focused
Make sure you’ve collected good insights first, unless you can’t
Use this info to guide your questions
Adds some stats weight to what you’ve found so far
Solution focused
Do after a release to check perception of a feature
Can be specific with people who did some set of behaviours
Analytics doesn’t give you the why, surveys can give you that
Also called pre-order page
Fake a product
Make people think it exists
Provide whatever you need to convince them
All about whether the problem exists
Quant as you’re getting numbers
“Something” is some signal that users want this product, could be signing up, could be clicking buy now
Touches on solution because you need to describe the product, for eg app, or service, etc
Don’t have to spend time building product
Helps your marketing team
Testing your message to understand what works
Gathering future users info
Key points
Test your message, make sure people understand it. User test it
Clear signal for success, signup, book this, buy this, whatever
OK to leave your comfort zone, it’s scary. But stay true, There’s no obligation here, but don’t take money, don’t steal details and misuse them, etc. And not your final brand
Early stage
Pre-build so that you’re not wasting time
Use the learnings from customer interviews
Make sure problem exists; doesn’t tell you details of problem
It gives you an idea if the top-level description of what you’re offering is appeasing, but don’t get too caught up in it. Long way to go!
Use on new products. Could do with an existing, but doesn’t make sense since you’re not saving dev time. And new features prob fit into an existing product with your existing features. Maybe if it’s a completely new product within an eco system?
Provide the solution
You talk directly to the user
You do whatever they want for them
For e.g. food box subscription service - be their weekly shoppers
Combination of both
You still talk to customer, understand their problem in detail
You also try out the solution manually, learn the inside and out
Still gathering info on both problem and solution
You’re learning from customer
You’re learning from doing
Not scalable to large numbers
Key points
Asking questions = knowledge. You’ll see weird things and you can and should ask otherwise you’re wasting your time
You should do this, learn as much as directly as possible
Make sure you record which things are important to users, which aren’t, and understand how complicated certain things are. This all adds up to give you an idea of what you should build, when and why
Do your customer interviews first, maybe even landing page experiments
Do it before building so that you can learn about the solution, save time
Obviously. New features are a bit harder because you already have a product, though not impossible. Will come to a better technique next
If you have particularly complex problems and/or solutions, this helps flesh out a lot of the details with your focus. Otherwise you never know what to build and it fucks with you and causes stress
To learn about the problem. This doesn’t last forever, recognise you need a level of confidence and then you move on. Handily, next step could be the next technique
Same as previous technique
But you take a step back
Replace you with thin product layer
Customer interacts with product as they would
Don’t realise it’s done manually underneath
You’re looking more at the solution now
You’re still learning about how to solve need
You’re testing how the user interacts with the product
But you can’t ask questions directly about the why
Still not scalable due to manual nature of solution
Key points
Learn about how user interacts by using tools like full story that let you playback a user session. You still have small numbers so you should be looking at that data
Just as before, use your learnings about the solution to determine what you need to build next and why
Since we’re comfortable with the problem, we can start building the solution. Good approach is to think about the most painful piece and automate it. If that lets you scale out the product, even better :)
Need to be clear on problem before you go down this road
Could be immediately after customer research because problem isn’t complicated
Could be leading on from concierge MVP
If you notice something weird, don’t be afraid to go back and ask people. This is because you’re not getting the same insights as if you were talking to people
New products, obvs, but easier for new feature as you can fake the user interaction layer. For e.g. at DICE, we had new seat maps. Had no time or clue how to build a seat allocation algorithm. Did experiment for a couple of events, just faked the front-end. It just came to a spreadsheet. Interns would manually process and try to make people fit in. We learnt from it.
Want to repeat that point again. You can build the product step by step. Doesn’t mean make it a frankenstein, but with a good dev team, this is easier. You build only what you need but in a way you can extend. It might take a bit longer but at each point, you’re solving a problem. Keep in mind final goal and figure out how you get there and update as you learn.
I’ll cover other techniques for completeness, but in less detail
These are pretty well understood and for me, not as important as the others which can really improve the way you understand the problem, which is my central point
Similar to landing page, measuring whether anyone wants this
You’re kinda testing the start of the solution, i.e. the trigger that gets them there
For existing products, i.e. ties into a place that people already come to
Pre-build, you save time by checking whether anyone cares or not
Key points
You need to have your analytics sorted, that’s what tells you if it succeeded or not
Similar to landing page, be bold, don’t be afraid
Get the tone right. Be appreciative. You can be honest that this was an experiment. Most people are forgiving
Don’t try to trick people, i.e. don’t be a dick
You’re not really understanding the problem because you’re telling users what scenario
But it is good to check usability issues with the design
Everyone knows how to do this; pretty well documented
It’s still saving time so that you can avoid costly dev mistakes
Different ways to do this. Complicated paper prototypes vs static mockups vs interactive clickable prototypes
Total buzz word, potentially confusing
Personal opinion, but
Viable - means something that can stand on its own feet
Product - something that exists
Everyone just thinks of it as first iteration
Prefer the phrase experiment
That’s all it
You learn something, but you can’t make money
Best question, does something exist after you finish or is it learning?
As we talked about, MVP is more of an iterative building process to find the right point, not just the first iteration
It’s an iterative process. I don’t think you really say here’s my MVP and you build it and that’s it. It’s saying you have confidence in problem and solution, here’s your assumption, now let’s build to that release, try it out and see if it succeeds, if not we continue
Not the first version. Everyone things about it that way. That’s kinda BS. It needs to have a coherent core, not just “something”
You’re building towards a larger release in steps
You need info from other techniques. This isn’t teaching you about problem vs solution. It’s a way to derisk how you go about building things
Product Market fit - that’s your goal. Understanding that and proving it so that you can now work out how to scale.
If only one thing, remember that you need to understand the problem in more depth
Customer interviews are mandatory, if you can’t do this, it means you’re not understanding your customers
Experiments are much cheaper ways of learning. You get to see and interact with users without taking a lot of dev time.
Don’t be beholden to all these techniques. Touched apon when to use, think about what works for you and use an approach that fits your situation
Really found that this and other topics really not covered, been asked by students so running workshops
Do other things like metrics, process, product strategy, etc. This is one of them. Will run through what we discussed in more detail
But most importantly, it’s practical. For me, that’s the key. You can read this stuff, but it doesn’t settle. Have to create these things with support
I’m sorting out venues now and therefore dates, but looking like within the next couple of months
Feel free to ask me for more info; leave your email address or take a business card and email me :)
Been a developer
C++, HTML/CSS, Javascript, Perl, Java, etc
Cards are on table
Running MVT test on designs
All about delivering value
Feedback is like gold dust
Fancy an experiment