The Clear Advantage to Competitive Intelligence ApplicationsMediaPost
No question, email deliverability and marketing analytics is a data-driven decision-making process.
But how quickly your teams can make decisions with that data plays a crucial role in the revenue generated from your email programs. Does it take hours? days? or is it real-time? As the leading provider of accurate, real-time, presentable email intelligence, we will demonstrate why real-time actionable data, presented in an easy-to-use manner, has been proven to increase your monthly email marketing revenue by more than 3x. Join us as we become email “spies” for the morning and explore the tangible benefits of (the) CIA.
It may be easier than ever today to collect data, but many marketers still find themselves scratching their heads when trying to decide how best to sift through it to uncover the gems. What’s often even more difficult, however, is developing reports that incite action and encourage future investment in the right strategies and optimizations – especially when findings challenge the status quo.
In this session, Ben Magnuson, Senior Data Strategist at One North, explore how to deliver reports that your stakeholders will actually care to read. Specifically, he dives into how you can shift your reporting strategy to ensure you are:
* Establishing the right baselines and goals to help you more accurately benchmark your progress towards KPIs
* Moving beyond simply showing your work to provide the right level of context around data trends that matter
* Including stakeholders in the development of metrics to prevent surrogation, or the confusion of strategic intent with the metrics meant to represent it
* Creating an influential narrative around your results that helps you overcome bias, combat conventional thought and improve decision making
Subject line testing is the only way to stay in front of audience engagement. Check out the webinar where we share real examples of what worked and what didn’t based on results from over 5,000 different subject line tests. Now's your chance to get fresh ideas for your 2016 strategic test plan.
During this webinar we'll walk through:
• The top takeaways from over 80 million emails sent.
• Recommendations for crafting effective subject lines.
• How to utilize pre-header text to reinforce the subject line.
• Strategies for putting together a subject line test plan.
There's a new breed of digital marketers who are employing data science practices to achieve better results more efficiently. Whether it's SEO, email marketing, marketing automation, response conversion, funnel optimization, or web analytics, these hybrid data scientists / data driven digital markets are using advanced mathematics, machine learning, predictive analytics, statistical modeling, and data mining in conjunction with marketing savvy to drive better results and grow companies faster. We'll discuss some case studies, best practices, and simple pseudo-data-science actions that even the non-data scientist can put to use immediately.
Common Day-to-Day Marketing Problems: SOLVEDMediaPost
What throws you and your team off-course? A lot of times, it’s the day-to-day, common platform usage and capability frustrations that we stumble on, no matter our role. In this session, Kristin Pirazzini will share ways to alleviate many of these issues and walk you through ‘a day in the life’ of utilizing Yesmail360i to solve many common marketing problems that your teams run into throughout the year.
You'd like to be more rational and data-driven in your decision making. You know that your museum has been collecting web traffic metrics using Google Analytics, but you've never fully understood what those reports mean for you or your department. How can you use this popular software to find actionable data that helps you do your job better? In this session you will get a practical tutorial, led by two Google Analytics veterans at the Smithsonian, who will provide an overview of the current Google Analytics, including some of its newest, most powerful features. The presenters will also discuss the step-by-step process for moving beyond measurement just for measurement's sake, using real-life museum case studies as examples.
Presenters: Sara Snyder, Smithsonian American Art Museum; Brian Alpert, Smithsonian Institution.
Presented at the American Alliance of Museums 2016 Annual Meeting & MuseumExpo , 5/27/2016.
Metrics, Metrics, Everywhere! Choosing the Right Ones for Your Website and ...Brian Alpert
UPDATED social media and website measurement workshop as presented by Sarah Banks, Erin Blasco, Effie Kapsalis and Brian Alpert, at Museums and the Web 2016, 4/6/16, Los Angeles California.
Key Insights and Actionable Tactics from IBM Email & Mobile Benchmark ReportDavid Clemen
Actionable insights and tactics to improve open and click through rates of your email marketing.
We delve into the valuable insights in the IBM Watson Marketing 2018 Marketing Benchmark Report that analyzed email and mobile marketing messages deployed by several thousand IBM Watson Marketing clients located in more than 40 countries.
WE GO BEYOND THE STATS to actionable tips and strategies you can put into practice immediately, like:
Quick adjustments you can make to improve your data-management practices that will improve audience engagement.
The subject lines that will get you the opens.
Tweaks you can make to improve your click-through rate.
AND MUCH MORE!
Google for Nonprofits - Analytics webinarChad Leaman
This webinar was delivered on Dec 6 by Elena and Nina at Google to the Neil Squire Society and their network of disability partners, as well as to other nonprofits in Vancouver through NetSquared Vancouver. The accompanying webinar recording, hands-on workbook, and other resources can be found on Neil Squire Society's website: http://www.neilsquire.ca/latest-news/google-analytics-webinar/
Data is power. Looking at data helps us know who our audience is, how they interact with our business, where we can optimize and what to prioritize.
This presentation covers the basics of qualitative and quantitative data gathering for business insights. The best thing is it doesn't require extensive coding or any paid tools - you can start measuring today.
You will find the full story, together with a recording of the presentation, on my blog: https://valchanova.me/business-measurement-basics/
How Eye Tracking Research Helps You Run Better A/B TestsCXL
This presentation was from a webinar conducted between ConversionXL and Sticky.AI. It covers the conversion optimization research process and how eye tracking research can fit into that and make A/B testing in the enterprise cheaper and more effective.
The Clear Advantage to Competitive Intelligence ApplicationsMediaPost
No question, email deliverability and marketing analytics is a data-driven decision-making process.
But how quickly your teams can make decisions with that data plays a crucial role in the revenue generated from your email programs. Does it take hours? days? or is it real-time? As the leading provider of accurate, real-time, presentable email intelligence, we will demonstrate why real-time actionable data, presented in an easy-to-use manner, has been proven to increase your monthly email marketing revenue by more than 3x. Join us as we become email “spies” for the morning and explore the tangible benefits of (the) CIA.
It may be easier than ever today to collect data, but many marketers still find themselves scratching their heads when trying to decide how best to sift through it to uncover the gems. What’s often even more difficult, however, is developing reports that incite action and encourage future investment in the right strategies and optimizations – especially when findings challenge the status quo.
In this session, Ben Magnuson, Senior Data Strategist at One North, explore how to deliver reports that your stakeholders will actually care to read. Specifically, he dives into how you can shift your reporting strategy to ensure you are:
* Establishing the right baselines and goals to help you more accurately benchmark your progress towards KPIs
* Moving beyond simply showing your work to provide the right level of context around data trends that matter
* Including stakeholders in the development of metrics to prevent surrogation, or the confusion of strategic intent with the metrics meant to represent it
* Creating an influential narrative around your results that helps you overcome bias, combat conventional thought and improve decision making
Subject line testing is the only way to stay in front of audience engagement. Check out the webinar where we share real examples of what worked and what didn’t based on results from over 5,000 different subject line tests. Now's your chance to get fresh ideas for your 2016 strategic test plan.
During this webinar we'll walk through:
• The top takeaways from over 80 million emails sent.
• Recommendations for crafting effective subject lines.
• How to utilize pre-header text to reinforce the subject line.
• Strategies for putting together a subject line test plan.
There's a new breed of digital marketers who are employing data science practices to achieve better results more efficiently. Whether it's SEO, email marketing, marketing automation, response conversion, funnel optimization, or web analytics, these hybrid data scientists / data driven digital markets are using advanced mathematics, machine learning, predictive analytics, statistical modeling, and data mining in conjunction with marketing savvy to drive better results and grow companies faster. We'll discuss some case studies, best practices, and simple pseudo-data-science actions that even the non-data scientist can put to use immediately.
Common Day-to-Day Marketing Problems: SOLVEDMediaPost
What throws you and your team off-course? A lot of times, it’s the day-to-day, common platform usage and capability frustrations that we stumble on, no matter our role. In this session, Kristin Pirazzini will share ways to alleviate many of these issues and walk you through ‘a day in the life’ of utilizing Yesmail360i to solve many common marketing problems that your teams run into throughout the year.
You'd like to be more rational and data-driven in your decision making. You know that your museum has been collecting web traffic metrics using Google Analytics, but you've never fully understood what those reports mean for you or your department. How can you use this popular software to find actionable data that helps you do your job better? In this session you will get a practical tutorial, led by two Google Analytics veterans at the Smithsonian, who will provide an overview of the current Google Analytics, including some of its newest, most powerful features. The presenters will also discuss the step-by-step process for moving beyond measurement just for measurement's sake, using real-life museum case studies as examples.
Presenters: Sara Snyder, Smithsonian American Art Museum; Brian Alpert, Smithsonian Institution.
Presented at the American Alliance of Museums 2016 Annual Meeting & MuseumExpo , 5/27/2016.
Metrics, Metrics, Everywhere! Choosing the Right Ones for Your Website and ...Brian Alpert
UPDATED social media and website measurement workshop as presented by Sarah Banks, Erin Blasco, Effie Kapsalis and Brian Alpert, at Museums and the Web 2016, 4/6/16, Los Angeles California.
Key Insights and Actionable Tactics from IBM Email & Mobile Benchmark ReportDavid Clemen
Actionable insights and tactics to improve open and click through rates of your email marketing.
We delve into the valuable insights in the IBM Watson Marketing 2018 Marketing Benchmark Report that analyzed email and mobile marketing messages deployed by several thousand IBM Watson Marketing clients located in more than 40 countries.
WE GO BEYOND THE STATS to actionable tips and strategies you can put into practice immediately, like:
Quick adjustments you can make to improve your data-management practices that will improve audience engagement.
The subject lines that will get you the opens.
Tweaks you can make to improve your click-through rate.
AND MUCH MORE!
Google for Nonprofits - Analytics webinarChad Leaman
This webinar was delivered on Dec 6 by Elena and Nina at Google to the Neil Squire Society and their network of disability partners, as well as to other nonprofits in Vancouver through NetSquared Vancouver. The accompanying webinar recording, hands-on workbook, and other resources can be found on Neil Squire Society's website: http://www.neilsquire.ca/latest-news/google-analytics-webinar/
Data is power. Looking at data helps us know who our audience is, how they interact with our business, where we can optimize and what to prioritize.
This presentation covers the basics of qualitative and quantitative data gathering for business insights. The best thing is it doesn't require extensive coding or any paid tools - you can start measuring today.
You will find the full story, together with a recording of the presentation, on my blog: https://valchanova.me/business-measurement-basics/
How Eye Tracking Research Helps You Run Better A/B TestsCXL
This presentation was from a webinar conducted between ConversionXL and Sticky.AI. It covers the conversion optimization research process and how eye tracking research can fit into that and make A/B testing in the enterprise cheaper and more effective.
With the increasing access to big data, organizations are finding new ways to utilize this information within their talent acquisition strategy. During this Spotlight Webinar, we’ll focus on HR analytics and how organizations are leveraging this data to strengthen their recruiting strategies when identifying talent.
During this spotlight webinar, learners will:
Identify how analytics play a role in forecasting the time required to identify and hire candidates
Determine how to leverage analytics to strengthen recruiting strategy
Learn how vendor partnerships can provide HR analytics that support workforce planning.
Respondents, particularly younger generations, want to take surveys on their mobile devices, but the reality is that most surveys are either too difficult to take on a mobile device or unpleasant. It’s time to rethink design and test out changes to meet consumers on their choice of device.
SpigitEngage is a Crowd innovation Software as a Service technology platform used by large organizations including many of the Fortune 100 to tap into their "crowd" of employees, customers and partners to generate a pipeline of innovation for the business. Predictions is a new module that allows you to use the crowd to predict the value of ideas - how much revenue will it generate, how much will it cost, what's the likely time to market. Using a diverse crowd of people in your business typically yields better results than asking just the business analysts or project managers in your business. This slideshare discusses the Predictions functionality and the science behind it.
Do you find it tough to cut through the noise and reach your workforce? What about getting employees to take action? Marketers have worked on optimizing communications and results for decades, and it’s time to borrow from their playbook. More and more human resources teams are gaining access to the tools and metrics used by marketers, opening the door to new data and empowerment. You can leverage these marketing tactics and best practices within your own organization as you prepare your company for the next wave of HR innovation.
In this webinar, you’ll hear directly from marketers who spend most of their time implementing complex B2B and B2C marketing campaigns. They will share highlights of what they have learned from years of marketing and experimentation. You will learn about the tactics that work best, those that don’t and the tools that you can leverage when you put on your marketing hat.
Specifically, you will learn about:
Marketing tactics that are most useful for improving HR outcomes.
Why experimentation is crucial for marketing success and how to experiment.
How leading HR teams are leveraging marketing metrics on a daily basis.
Optimizely Connect with Localytics: The One Size Fits all Customer Experience...Optimizely
Optimizely Connect is a webinar series that we conduct with our best-in-class technology partners. The purpose is to give you some insight into how different technologies work together effectively so that anyone who is either using them already, or considering integrating these, can understand the ways that they can be used to optimize your customer’s user experience.
What is covered in this webinar:
- The challenges of an omni channel experience & the role of mobile in the customer journey
- How data and analytics can be used to understand audiences and how can we measure the impact of what versions work for which of those audiences?
- 5 reasons to use mobile app testing and how to to apply them
You can sign up for free for the remaining webinars:
http://pages.optimizely.com/optimizely-connect.html
Self Service Online Research - online communities for research and insightsStephen Thompson
In this webcast, we Stephen Thompson (EVP, Ramius) and Lenny Murphy (Chief Editor and Principal Consultant, Greenbook):
• Discuss how the online research world is shifting and how that is expected to develop in the near future. This include some (very) early stats from the Greenbook GRIT report for 2014.
• Round up some of the new software tools available for gathering insights under the categories of Surveys / Microsurveys, Crowdsourcing, Analytics, Big Data, Video, Mobile and Online Communities.
• Work through some examples of how Ramius’ new platform, Recollective, is being used by marketing and research professionals to build on-demand insight communities and conduct rapid, qualitative research online.
Ready, Set, Launch: Using Social Media to Improve Product & Service Launches Visible Technologies
Product and service launches are often the biggest marketing event of the year. Are yours as good as they can be? In this webinar, we take a look at social media trends and how marketers can move beyond listening, exploring how social media can be used as a powerful strategic asset in product launches. Watch this webcast to learn:
- Why social media is the perfect source of insights around pricing, messaging, targeting, etc.
- How social media can be used to inform and optimize the launch lifecycle
- About real-world case studies where social media greatly improved launches
To learn more, contact us: bit.ly/VisibleContact
Patient Engagement is proving to be an efficient strategy for healthcare providers to improve awareness and prescription compliance, reduce readmission's, and increase the patients’ trust.
Cause We Care - Design Thinking Project Final ReportMatthew Stuckings
This is the final report for my group Design Thinking project. It shows qualitative and quantitative data and their tests for our hypotheses, design tools and MVP.
Team: Em, Kris, Marc, Adrian, Goran and Me
Enjoy.
Matt
Guest: Serena Ehrlich, Director, Social and Evolving Media at Business Wire
What PR professionals will learn:
Simple ways to get your story noticed
Why data is your friend
How to choose the metrics that matter most
Similar to 1345 track 1 chen_using our laptop (20)
The session includes a brief history of the evolution of search before diving into the roles technology, content, and links play in developing a powerful SEO strategy in a world of Generative AI and social search. Discover how to optimize for TikTok searches, Google's Gemini, and Search Generative Experience while developing a powerful arsenal of tools and templates to help maximize the effectiveness of your SEO initiatives.
Key Takeaways:
Understand how search engines work
Be able to find out where your users search
Know what is required for each discipline of SEO
Feel confident creating an SEO Plan
Confidently measure SEO performance
It's another new era of digital and marketers are faced with making big bets on their digital strategy. If you are looking at modernizing your tech stack to support your digital evolution, there are a few can't miss (often overlooked) areas that should be part of every conversation. We'll cover setting your vision, avoiding siloes, adding a democratized approach to data strategy, localization, creating critical governance requirements and more. Attendees will walk away with actions they can take into initiatives they are running today and consider for the future.
Mastering Dynamic Web Designing A Comprehensive Guide.pdfIbrandizer
Dynamic Web Designing involves creating interactive and adaptable web pages that respond to user input and change dynamically, enhancing user experience with real-time data, animations, and personalized content tailored to individual preferences.
The Good the Bad and The Ugly of Marketing MeasurementNapierPR
We explore how B2B marketers can impress the board by measuring their PR and marketing campaigns successfully, and explore 5 metrics that will get you promoted, and 3 that will get your fired.
We cover:
-Meaningless marketing metrics
-The difference between attribution and incrementality
-The importance of the customer journey
-Why you should care about prospects that are in market
-Measuring the unmeasurable
How to Use AI to Write a High-Quality Article that Ranksminatamang0021
In the world of content creation, many AI bloggers have drifted away from their original vision, resulting in low-quality articles that search engines overlook. Don't let that happen to you! Join us to discover how to leverage AI tools effectively to craft high-quality content that not only captures your audience's attention but also ranks well on search engines.
Disclaimer: Some of the prompts mentioned here are the examples of Matt Diggity. Please use it as reference and make your own custom prompts.
janani Digital Marketer|Digital Marketing consultant|Marketing Promotion|Coim...janudm24
Myself Janani Digital marketing consultant located in coimbatore I offer all kinds of digital marketing services for your business requirements such as SEO SMO SMM SMO CAMPAIGNS content writing web design for all your business needs with affordable cost
Digital Marketing Services | Techvolt Software :
Digital Marketing is a latest method of Marketing techniques widely used across the Globe. Digital Marketing is an online marketing technique and methods used for all products and services through Search Engine and Social media advertisements. Previously the marketing techniques were used without using the internet via direct and indirect marketing strategies such as advertising through Telemarketing,Newspapers,Televisions,Posters etc.
List of Services offered in Digital Marketing |Techvolt Software :
Techvolt Software offers best Digital Marketing services for promoting your products and services through online platform on the below methods of Digital marketing
1. Search Engine Optimization (SEO)
2. Search Engine Marketing (SEM)
3. Social Media Optimization (SMO)
4. Social Media Marketing (SMM)
5. Campaigns
Importance | Need of Digital Marketing (Online Promotions) :
1. Quick Promotions through Online
2. Generation of More leads and Business Enquiries via Search Engine and Social Media Platform
3. Latest Technology development vs Business promotions
4. Creation of Social Branding
5. Promotion with less investment
Benefits Digital Marketing Services at Techvolt software :
1. Services offered with Affordable cost
2. Free Content writing
3. Free Dynamic Website design*
4. Best combo offers on website Hosting,design along with digital marketing services
5. Assured Lead Generation through Search Engine and Social Media
6. Online Maintenance Support
Free Website + Digital Marketing Services
Techvolt Software offers Free website design for all customer and clients who is availing the digital marketing services for a minimum period of 6 months.
With Regards
Janani Digital Marketer
Coimbatore,Tamilnadu.
Everyone knows the power of stories, but when asked to come up with them, we struggle. Either we second guess ourselves as to the story's relevance, or we just come up blank and can't think of any. Unlocking Everyday Narratives: The Power of Storytelling in Marketing will teach you how to recognize stories in the moment and to recall forgotten moments that your audience needs to hear.
Key Takeaways:
Understand Why Personal Stories Connect Better
How To Remember Forgotten Stories
How To Use Customer Experiences As Stories For Your Brand
Most small businesses struggle to see marketing results. In this session, we will eliminate any confusion about what to do next, solving your marketing problems so your business can thrive. You’ll learn how to create a foundational marketing OS (operating system) based on neuroscience and backed by real-world results. You’ll be taught how to develop deep customer connections, and how to have your CRM dynamically segment and sell at any stage in the customer’s journey. By the end of the session, you’ll remove confusion and chaos and replace it with clarity and confidence for long-term marketing success.
Key Takeaways:
• Uncover the power of a foundational marketing system that dynamically communicates with prospects and customers on autopilot.
• Harness neuroscience and Tribal Alignment to transform your communication strategies, turning potential clients into fans and those fans into loyal customers.
• Discover the art of automated segmentation, pinpointing your most lucrative customers and identifying the optimal moments for successful conversions.
• Streamline your business with a content production plan that eliminates guesswork, wasted time, and money.
Enhancing a Luxury Furniture E-commerce Store with Expert Shopify ManagementSunTec India
SunTec India's expertise in Shopify store management has been a game-changer for a luxury furniture e-commerce business. Through meticulous optimization of product listings, strategic SEO practices, and an enhanced user experience, this case study details the successful outcomes of their collaboration, including increased traffic, higher conversion rates, and stronger brand presence.
Read more- https://shorturl.at/yl3MU
In this presentation, Danny Leibrandt explains the impact of AI on SEO and what Google has been doing about it. Learn how to take your SEO game to the next level and win over Google with his new strategy anyone can use. Get actionable steps to rank your name, your business, and your clients on Google - the right way.
Key Takeaways:
1. Real content is king
2. Find ways to show EEAT
3. Repurpose across all platforms
What’s “In” and “Out” for ABM in 2024: Plays That Help You Grow and Ones to L...Demandbase
Delve into essential ABM ‘plays' that propel success while identifying and leaving behind tactics that no longer yield results. Led by ABM Experts, Jon Barcellos, Head of Solutions at Postal and Tom Keefe, Principal GTM Expert at Demandbase.
As 2023 proved, the next few years may be shaped by market volatility and artificial intelligence services such as OpenAI's ChatGPT and Perplexity.ai. Your brand will increasingly compete for attention with Google, Apple, OpenAI, and Amazon, and customers will expect a hyper-relevant and individualized experience from every business at any moment. New state-legislated data privacy laws and several FTC rules may challenge marketers to deliver contextually relevant customer experiences, much less reach unknown prospective buyers. Are you ready?Let's discuss the critical need for data governance and applied AI for your business rather than relying on public AI models. As AI permeates society and all industries, learn how to be future-ready, compliant, and confidentlyscaling growth.
Key Takeaways:
Primary Learning Objective
1: Grasp when artificial general intelligence (""AGI"") will arrive, and how your brand can navigate the consequences. Primary Learning Objective
2: Gain an accurate analysis of the continuously developing customer journey and business intelligence. Primary Learning Objective
3: Grow revenue at lower costs with more efficient marketing and business operations.
Mastering Local SEO for Service Businesses in the AI Era is tailored specifically for local service providers like plumbers, dentists, and others seeking to dominate their local search landscape. This session delves into leveraging AI advancements to enhance your online visibility and search rankings through the Content Factory model, designed for creating high-impact, SEO-driven content. Discover the Dollar-a-Day advertising strategy, a cost-effective approach to boost your local SEO efforts and attract more customers with minimal investment. Gain practical insights on optimizing your online presence to meet the specific needs of local service seekers, ensuring your business not only appears but stands out in local searches. This concise, action-oriented workshop is your roadmap to navigating the complexities of digital marketing in the AI age, driving more leads, conversions, and ultimately, success for your local service business.
Key Takeaways:
Embrace AI for Local SEO: Learn to harness the power of AI technologies to optimize your website and content for local search. Understand the pivotal role AI plays in analyzing search trends and consumer behavior, enabling you to tailor your SEO strategies to meet the specific demands of your target local audience. Leverage the Content Factory Model: Discover the step-by-step process of creating SEO-optimized content at scale. This approach ensures a steady stream of high-quality content that engages local customers and boosts your search rankings. Get an action guide on implementing this model, complete with templates and scheduling strategies to maintain a consistent online presence. Maximize ROI with Dollar-a-Day Advertising: Dive into the cost-effective Dollar-a-Day advertising strategy that amplifies your visibility in local searches without breaking the bank. Learn how to strategically allocate your budget across platforms to target potential local customers effectively. The session includes an action guide on setting up, monitoring, and optimizing your ad campaigns to ensure maximum impact with minimal investment.
First Things First: Building and Effective Marketing Strategy
Too many companies (and marketers) jump straight into activation planning without formalizing a marketing strategy. It may seem tedious, but analyzing the mindset of your targeted audiences and identifying the messaging points most likely to resonate with them is time well spent. That process is also a great opportunity for marketers to collaborate with sales leaders and account managers on a galvanized go-to-market approach. I’ll walk you through the methods and tools we use with our clients to ensure campaign success.
Key Takeaways:
-Recognize the critical role of strategy in marketing
-Learn our approach for building an actionable, effective marketing strategy
-Receive templates and guides for developing a marketing strategy
2. 2
Good Afternoon!
Sarah Schmalbach
Guardian Mobile Innovation Lab -
A small multidisciplinary innovation team of editors, reporters, a product manager and
engineers in the Guardian US newsroom testing new mobile storytelling formats for two
years with a grant from the John S. and James L. Knight Foundation with the goal of
accelerating innovation in newsrooms around the country.
Lynette Chen
MaassMedia -
MaassMedia is an independent, specialty analytics consultancy based in Philadelphia, PA.
We provide guidance and leadership to major global brands seeking to optimize their
investments in digital multi-channel content, marketing and customer service initiatives.
3. Slide 4-5 Slides 6-7 Slides 8-16 Slides 17-25 Slides 26-29 Slide 31
3
Agenda Overview
Introduction
The
Experiments
Measurement
Framework NLP
Putting it to Use
Closing / Q&As
4. The Guardian Mobile Innovation Lab & Maass Media team
Sarah Schmalbach
Senior Product
Manager
Sasha Koren
Editor
Alastair Coote
Developer
Dylan Greif
Product Designer
Mazin Sidhamed
Reporter
Connor Jennings
Developer
Greg Kaminski
Analytics Director
Lynette Chen
Senior Consultant
Brian Hood
Analyst
5. The team
SME
Data
Designer
Engineer
Knows which
questions to ask:
Sarah Schmalbach
Sasha Koren
Mazin Sidhamed
Dylan Greif
Knows how
to get the data:
Alastair Coote
Connor Jennings
Brian Hood
Knows how to
present the data:
Lynette Chen
Greg Kaminski
6. 6
What do our experiments look like?
Live video
notifications
Lock screen
access to live
streaming video
news coverage
without having to
open an app, or
wait
7. 7
What do our experiments look like?
Live UK election
results notifications
Lock screen access to
three types of live UK
election results:
overall, latest and by
constituency -- plus
tap-through access
to more coverage
and results
8. 8
The need for a new way to measure success
Research Study conducted by: &
Overheard
in the
industry...
The bigger thing is, how do we measure successful alerts? Because we’re not
sitting next to everyone as their phone goes off saying, ‘Now did you open
that? Did you get everything you need to get without opening that? Did you
appreciate getting it?’ It’s just sort of an impossible thing to measure
without doing a really wide ranging survey, which we’re not going to do.”
-Mobile Editor, News Agency
9. Determine which formats for delivering content are the most successful
9
Success framework
Quantitative Data Qualitative DataEngagement
Behavior
User Opinion
14. 14
Qualitative: What did users think?
User surveys
• 24 user surveys sent
• Range of 5 to 6,219 responses
15. 15
Need to automate qualitative analysis
Longform response feedback
May 2016
x5 responses
Analysis in 75 seconds
Nov. 2016
x1,116 responses
Analysis in 24,165 seconds
Q:
“Anything
else you’d like
to tell us?”
16. 16
Opportunity with sentiment NLP
• Smart manual analysis of longform feedback was no longer possible
• Needed a way to speed up the process but also keeping the scoring consistent
• Wanted to understand overall sentiment by evaluating the sentiment of each
response through identifiable keywords
• Solution: Natural Language Processing (NLP) for sentiment analysis!
17. 17
Process of Building
Create the
algorithm
Obtain a
dataset
Manually score
sentiment of
data
Feed some of the
data for the
algorithm to be
trained on
Use the trained
algorithm to
predict results of
remaining data
Review results,
identify areas of
concern, iterate
18. 18
Our original algorithm
• Inspired by various existing NLP python packages
• Negation words
• Exclude “noise” words
• Trained on 500 US Election experiment survey long form responses
• Accuracy on US Election data: 81%
• Issue: limited scope
19. 19
VADER sentiment algorithm
• Developed by Georgia Tech
• Trained on a 7,000+ word lexicon
• Takes into consideration punctuation,
emojis, and amplifier words
20. 20
VADER sentiment algorithm - valence
• Each word is assigned valence on a scale of -4 to 4
Word Valence
abusive -3.2
idk -0.4
zebra 0.0
good 1.9
☺ 2.0
great 3.1
21. 21
Adapting the VADER sentiment algorithm
• Lexicon covers a wide range but isn’t complete
• Updated, updating, up-to-date
• Vanish, vanished, vanishing
• Updated with Guardian specific words and permutations
• convenient
• “become a contributor”
• “will purchase”
• Accuracy on US Election data: 80%
• Accuracy on EU Referendum data: 88%
22. 22
VADER – positive sentiment example
“Jason is smart, handsome, and funny.”
Sentiment Score
negative 0.00
neutral 0.25
positive 0.75
overall positive
23. 23
VADER – negative sentiment example
“Jason is not smart, handsome, nor funny.”
Sentiment Score
negative 0.65
neutral 0.35
positive 0.00
overall negative
24. 24
VADER – nuanced sentiment example
“Jason is not smart, handsome, but he is funny.”
Sentiment Score
negative 0.26
neutral 0.45
positive 0.29
overall positive
25. What do users think?
25
A new KPI : net sentiment score
Number of positive responses – negative responses
Number of responses
26. 26
UK Snap Election: How did users engage?
• Positive interactions: taps and switch views
• Negative interactions: unsubscribe and stop
alerts
• Net interaction rate: 3.4%
27. 27
UK Snap Election: What did users think?
Net sentiment score: 44%
105
269
Negative
Positive
Survey Responses
28. 28
UK Snap Elections: identifying key responses
“I loved the live general elections updates, found it easy to use and loved the expandable
visualisation. It was great … I used the alert to check on the progress of the election
throughout the night. Would definitely use it again”
“I live in Australia and work as a chef. I cannot take breaks and don't have time to Google
results. It was excellent to have the live updates on my alert screen…all I had to do was
tap the screen to see updated results. It was fantastic. Thanks Guardian. Great work.”
“The alerts kept causing my Android Chrome browser to crash.”
97%
97%
-40%
29. 29
UK Snap Elections: evaluating success
• Overall success with the alerts
• High net sentiment score
• Positive net interaction rate
• Signals that alerts can provide utility on
their own and also give convenient
access to deeper coverage
44% Net Sentiment Score
3% Net Interaction Rate
30. 30
Learnings/Takeaways
Have a toolkit with both quantitative and qualitative data
1
2
3
4
Be forward thinking and flexible
Building/adapting an NLP algorithm is an investment but can provide
great utility
Need to adapt and improve NLP algorithms over time
