This document outlines Tyler Karrels' research on salient point detection. It introduces the topic, discusses previous work, and outlines Karrels' proposed framework which includes extracting features from images, clustering points in feature space, and identifying salient clusters. The document also discusses challenges including quantifying saliency and relating computer and human performance. In the results section, it suggests orientation tests and references related work on feature combination strategies, clustering algorithms, and structural saliency detection.
2024 State of Marketing Report – by HubspotMarius Sescu
https://www.hubspot.com/state-of-marketing
· Scaling relationships and proving ROI
· Social media is the place for search, sales, and service
· Authentic influencer partnerships fuel brand growth
· The strongest connections happen via call, click, chat, and camera.
· Time saved with AI leads to more creative work
· Seeking: A single source of truth
· TLDR; Get on social, try AI, and align your systems.
· More human marketing, powered by robots
ChatGPT is a revolutionary addition to the world since its introduction in 2022. A big shift in the sector of information gathering and processing happened because of this chatbot. What is the story of ChatGPT? How is the bot responding to prompts and generating contents? Swipe through these slides prepared by Expeed Software, a web development company regarding the development and technical intricacies of ChatGPT!
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
The realm of product design is a constantly changing environment where technology and style intersect. Every year introduces fresh challenges and exciting trends that mold the future of this captivating art form. In this piece, we delve into the significant trends set to influence the look and functionality of product design in the year 2024.
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
Mental health has been in the news quite a bit lately. Dozens of U.S. states are currently suing Meta for contributing to the youth mental health crisis by inserting addictive features into their products, while the U.S. Surgeon General is touring the nation to bring awareness to the growing epidemic of loneliness and isolation. The country has endured periods of low national morale, such as in the 1970s when high inflation and the energy crisis worsened public sentiment following the Vietnam War. The current mood, however, feels different. Gallup recently reported that national mental health is at an all-time low, with few bright spots to lift spirits.
To better understand how Americans are feeling and their attitudes towards mental health in general, ThinkNow conducted a nationally representative quantitative survey of 1,500 respondents and found some interesting differences among ethnic, age and gender groups.
Technology
For example, 52% agree that technology and social media have a negative impact on mental health, but when broken out by race, 61% of Whites felt technology had a negative effect, and only 48% of Hispanics thought it did.
While technology has helped us keep in touch with friends and family in faraway places, it appears to have degraded our ability to connect in person. Staying connected online is a double-edged sword since the same news feed that brings us pictures of the grandkids and fluffy kittens also feeds us news about the wars in Israel and Ukraine, the dysfunction in Washington, the latest mass shooting and the climate crisis.
Hispanics may have a built-in defense against the isolation technology breeds, owing to their large, multigenerational households, strong social support systems, and tendency to use social media to stay connected with relatives abroad.
Age and Gender
When asked how individuals rate their mental health, men rate it higher than women by 11 percentage points, and Baby Boomers rank it highest at 83%, saying it’s good or excellent vs. 57% of Gen Z saying the same.
Gen Z spends the most amount of time on social media, so the notion that social media negatively affects mental health appears to be correlated. Unfortunately, Gen Z is also the generation that’s least comfortable discussing mental health concerns with healthcare professionals. Only 40% of them state they’re comfortable discussing their issues with a professional compared to 60% of Millennials and 65% of Boomers.
Race Affects Attitudes
As seen in previous research conducted by ThinkNow, Asian Americans lag other groups when it comes to awareness of mental health issues. Twenty-four percent of Asian Americans believe that having a mental health issue is a sign of weakness compared to the 16% average for all groups. Asians are also considerably less likely to be aware of mental health services in their communities (42% vs. 55%) and most likely to seek out information on social media (51% vs. 35%).
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
This article is all about what AI trends will emerge in the field of creative operations in 2024. All the marketers and brand builders should be aware of these trends for their further use and save themselves some time!
2024 State of Marketing Report – by HubspotMarius Sescu
https://www.hubspot.com/state-of-marketing
· Scaling relationships and proving ROI
· Social media is the place for search, sales, and service
· Authentic influencer partnerships fuel brand growth
· The strongest connections happen via call, click, chat, and camera.
· Time saved with AI leads to more creative work
· Seeking: A single source of truth
· TLDR; Get on social, try AI, and align your systems.
· More human marketing, powered by robots
ChatGPT is a revolutionary addition to the world since its introduction in 2022. A big shift in the sector of information gathering and processing happened because of this chatbot. What is the story of ChatGPT? How is the bot responding to prompts and generating contents? Swipe through these slides prepared by Expeed Software, a web development company regarding the development and technical intricacies of ChatGPT!
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
The realm of product design is a constantly changing environment where technology and style intersect. Every year introduces fresh challenges and exciting trends that mold the future of this captivating art form. In this piece, we delve into the significant trends set to influence the look and functionality of product design in the year 2024.
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
Mental health has been in the news quite a bit lately. Dozens of U.S. states are currently suing Meta for contributing to the youth mental health crisis by inserting addictive features into their products, while the U.S. Surgeon General is touring the nation to bring awareness to the growing epidemic of loneliness and isolation. The country has endured periods of low national morale, such as in the 1970s when high inflation and the energy crisis worsened public sentiment following the Vietnam War. The current mood, however, feels different. Gallup recently reported that national mental health is at an all-time low, with few bright spots to lift spirits.
To better understand how Americans are feeling and their attitudes towards mental health in general, ThinkNow conducted a nationally representative quantitative survey of 1,500 respondents and found some interesting differences among ethnic, age and gender groups.
Technology
For example, 52% agree that technology and social media have a negative impact on mental health, but when broken out by race, 61% of Whites felt technology had a negative effect, and only 48% of Hispanics thought it did.
While technology has helped us keep in touch with friends and family in faraway places, it appears to have degraded our ability to connect in person. Staying connected online is a double-edged sword since the same news feed that brings us pictures of the grandkids and fluffy kittens also feeds us news about the wars in Israel and Ukraine, the dysfunction in Washington, the latest mass shooting and the climate crisis.
Hispanics may have a built-in defense against the isolation technology breeds, owing to their large, multigenerational households, strong social support systems, and tendency to use social media to stay connected with relatives abroad.
Age and Gender
When asked how individuals rate their mental health, men rate it higher than women by 11 percentage points, and Baby Boomers rank it highest at 83%, saying it’s good or excellent vs. 57% of Gen Z saying the same.
Gen Z spends the most amount of time on social media, so the notion that social media negatively affects mental health appears to be correlated. Unfortunately, Gen Z is also the generation that’s least comfortable discussing mental health concerns with healthcare professionals. Only 40% of them state they’re comfortable discussing their issues with a professional compared to 60% of Millennials and 65% of Boomers.
Race Affects Attitudes
As seen in previous research conducted by ThinkNow, Asian Americans lag other groups when it comes to awareness of mental health issues. Twenty-four percent of Asian Americans believe that having a mental health issue is a sign of weakness compared to the 16% average for all groups. Asians are also considerably less likely to be aware of mental health services in their communities (42% vs. 55%) and most likely to seek out information on social media (51% vs. 35%).
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
This article is all about what AI trends will emerge in the field of creative operations in 2024. All the marketers and brand builders should be aware of these trends for their further use and save themselves some time!
A report by thenetworkone and Kurio.
The contributing experts and agencies are (in an alphabetical order): Sylwia Rytel, Social Media Supervisor, 180heartbeats + JUNG v MATT (PL), Sharlene Jenner, Vice President - Director of Engagement Strategy, Abelson Taylor (USA), Alex Casanovas, Digital Director, Atrevia (ES), Dora Beilin, Senior Social Strategist, Barrett Hoffher (USA), Min Seo, Campaign Director, Brand New Agency (KR), Deshé M. Gully, Associate Strategist, Day One Agency (USA), Francesca Trevisan, Strategist, Different (IT), Trevor Crossman, CX and Digital Transformation Director; Olivia Hussey, Strategic Planner; Simi Srinarula, Social Media Manager, The Hallway (AUS), James Hebbert, Managing Director, Hylink (CN / UK), Mundy Álvarez, Planning Director; Pedro Rojas, Social Media Manager; Pancho González, CCO, Inbrax (CH), Oana Oprea, Head of Digital Planning, Jam Session Agency (RO), Amy Bottrill, Social Account Director, Launch (UK), Gaby Arriaga, Founder, Leonardo1452 (MX), Shantesh S Row, Creative Director, Liwa (UAE), Rajesh Mehta, Chief Strategy Officer; Dhruv Gaur, Digital Planning Lead; Leonie Mergulhao, Account Supervisor - Social Media & PR, Medulla (IN), Aurelija Plioplytė, Head of Digital & Social, Not Perfect (LI), Daiana Khaidargaliyeva, Account Manager, Osaka Labs (UK / USA), Stefanie Söhnchen, Vice President Digital, PIABO Communications (DE), Elisabeth Winiartati, Managing Consultant, Head of Global Integrated Communications; Lydia Aprina, Account Manager, Integrated Marketing and Communications; Nita Prabowo, Account Manager, Integrated Marketing and Communications; Okhi, Web Developer, PNTR Group (ID), Kei Obusan, Insights Director; Daffi Ranandi, Insights Manager, Radarr (SG), Gautam Reghunath, Co-founder & CEO, Talented (IN), Donagh Humphreys, Head of Social and Digital Innovation, THINKHOUSE (IRE), Sarah Yim, Strategy Director, Zulu Alpha Kilo (CA).
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
The search marketing landscape is evolving rapidly with new technologies, and professionals, like you, rely on innovative paid search strategies to meet changing demands.
It’s important that you’re ready to implement new strategies in 2024.
Check this out and learn the top trends in paid search advertising that are expected to gain traction, so you can drive higher ROI more efficiently in 2024.
You’ll learn:
- The latest trends in AI and automation, and what this means for an evolving paid search ecosystem.
- New developments in privacy and data regulation.
- Emerging ad formats that are expected to make an impact next year.
Watch Sreekant Lanka from iQuanti and Irina Klein from OneMain Financial as they dive into the future of paid search and explore the trends, strategies, and technologies that will shape the search marketing landscape.
If you’re looking to assess your paid search strategy and design an industry-aligned plan for 2024, then this webinar is for you.
5 Public speaking tips from TED - Visualized summarySpeakerHub
From their humble beginnings in 1984, TED has grown into the world’s most powerful amplifier for speakers and thought-leaders to share their ideas. They have over 2,400 filmed talks (not including the 30,000+ TEDx videos) freely available online, and have hosted over 17,500 events around the world.
With over one billion views in a year, it’s no wonder that so many speakers are looking to TED for ideas on how to share their message more effectively.
The article “5 Public-Speaking Tips TED Gives Its Speakers”, by Carmine Gallo for Forbes, gives speakers five practical ways to connect with their audience, and effectively share their ideas on stage.
Whether you are gearing up to get on a TED stage yourself, or just want to master the skills that so many of their speakers possess, these tips and quotes from Chris Anderson, the TED Talks Curator, will encourage you to make the most impactful impression on your audience.
See the full article and more summaries like this on SpeakerHub here: https://speakerhub.com/blog/5-presentation-tips-ted-gives-its-speakers
See the original article on Forbes here:
http://www.forbes.com/forbes/welcome/?toURL=http://www.forbes.com/sites/carminegallo/2016/05/06/5-public-speaking-tips-ted-gives-its-speakers/&refURL=&referrer=#5c07a8221d9b
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
Everyone is in agreement that ChatGPT (and other generative AI tools) will shape the future of work. Yet there is little consensus on exactly how, when, and to what extent this technology will change our world.
Businesses that extract maximum value from ChatGPT will use it as a collaborative tool for everything from brainstorming to technical maintenance.
For individuals, now is the time to pinpoint the skills the future professional will need to thrive in the AI age.
Check out this presentation to understand what ChatGPT is, how it will shape the future of work, and how you can prepare to take advantage.
A brief introduction to DataScience with explaining of the concepts, algorithms, machine learning, supervised and unsupervised learning, clustering, statistics, data preprocessing, real-world applications etc.
It's part of a Data Science Corner Campaign where I will be discussing the fundamentals of DataScience, AIML, Statistics etc.
Time Management & Productivity - Best PracticesVit Horky
Here's my presentation on by proven best practices how to manage your work time effectively and how to improve your productivity. It includes practical tips and how to use tools such as Slack, Google Apps, Hubspot, Google Calendar, Gmail and others.
The six step guide to practical project managementMindGenius
The six step guide to practical project management
If you think managing projects is too difficult, think again.
We’ve stripped back project management processes to the
basics – to make it quicker and easier, without sacrificing
the vital ingredients for success.
“If you’re looking for some real-world guidance, then The Six Step Guide to Practical Project Management will help.”
Dr Andrew Makar, Tactical Project Management
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
During this webinar, Anand Bagmar demonstrates how AI tools such as ChatGPT can be applied to various stages of the software development life cycle (SDLC) using an eCommerce application case study. Find the on-demand recording and more info at https://applitools.info/b59
Key takeaways:
• Learn how to use ChatGPT to add AI power to your testing and test automation
• Understand the limitations of the technology and where human expertise is crucial
• Gain insight into different AI-based tools
• Adopt AI-based tools to stay relevant and optimize work for developers and testers
* ChatGPT and OpenAI belong to OpenAI, L.L.C.
More than Just Lines on a Map: Best Practices for U.S Bike Routes
This session highlights best practices and lessons learned for U.S. Bike Route System designation, as well as how and why these routes should be integrated into bicycle planning at the local and regional level.
Presenters:
Presenter: Kevin Luecke Toole Design Group
Co-Presenter: Virginia Sullivan Adventure Cycling Association
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
Has your project been caught in a storm of deadlines, clashing requirements, and the need to change course halfway through? If yes, then check out how the administration team navigated through all of this, relocating 160 people from 3 countries and opening 2 offices during the most turbulent time in the last 20 years. Belka Games’ Chief Administrative Officer, Katerina Rudko, will share universal approaches and life hacks that can help your project survive unstable periods when there seem to be too many tasks and a lack of time and people.
This presentation was designed to provide strategic recommendations for a brand in decline. The deck also incorporates a situational assessment, including a brand identity, positioning, architecture, and portfolio strategy for the Brand.
Presentation originally created for NYU Stern's Brand Strategy course. Design by Erica Santiago & Chris Alexander.
A report by thenetworkone and Kurio.
The contributing experts and agencies are (in an alphabetical order): Sylwia Rytel, Social Media Supervisor, 180heartbeats + JUNG v MATT (PL), Sharlene Jenner, Vice President - Director of Engagement Strategy, Abelson Taylor (USA), Alex Casanovas, Digital Director, Atrevia (ES), Dora Beilin, Senior Social Strategist, Barrett Hoffher (USA), Min Seo, Campaign Director, Brand New Agency (KR), Deshé M. Gully, Associate Strategist, Day One Agency (USA), Francesca Trevisan, Strategist, Different (IT), Trevor Crossman, CX and Digital Transformation Director; Olivia Hussey, Strategic Planner; Simi Srinarula, Social Media Manager, The Hallway (AUS), James Hebbert, Managing Director, Hylink (CN / UK), Mundy Álvarez, Planning Director; Pedro Rojas, Social Media Manager; Pancho González, CCO, Inbrax (CH), Oana Oprea, Head of Digital Planning, Jam Session Agency (RO), Amy Bottrill, Social Account Director, Launch (UK), Gaby Arriaga, Founder, Leonardo1452 (MX), Shantesh S Row, Creative Director, Liwa (UAE), Rajesh Mehta, Chief Strategy Officer; Dhruv Gaur, Digital Planning Lead; Leonie Mergulhao, Account Supervisor - Social Media & PR, Medulla (IN), Aurelija Plioplytė, Head of Digital & Social, Not Perfect (LI), Daiana Khaidargaliyeva, Account Manager, Osaka Labs (UK / USA), Stefanie Söhnchen, Vice President Digital, PIABO Communications (DE), Elisabeth Winiartati, Managing Consultant, Head of Global Integrated Communications; Lydia Aprina, Account Manager, Integrated Marketing and Communications; Nita Prabowo, Account Manager, Integrated Marketing and Communications; Okhi, Web Developer, PNTR Group (ID), Kei Obusan, Insights Director; Daffi Ranandi, Insights Manager, Radarr (SG), Gautam Reghunath, Co-founder & CEO, Talented (IN), Donagh Humphreys, Head of Social and Digital Innovation, THINKHOUSE (IRE), Sarah Yim, Strategy Director, Zulu Alpha Kilo (CA).
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
The search marketing landscape is evolving rapidly with new technologies, and professionals, like you, rely on innovative paid search strategies to meet changing demands.
It’s important that you’re ready to implement new strategies in 2024.
Check this out and learn the top trends in paid search advertising that are expected to gain traction, so you can drive higher ROI more efficiently in 2024.
You’ll learn:
- The latest trends in AI and automation, and what this means for an evolving paid search ecosystem.
- New developments in privacy and data regulation.
- Emerging ad formats that are expected to make an impact next year.
Watch Sreekant Lanka from iQuanti and Irina Klein from OneMain Financial as they dive into the future of paid search and explore the trends, strategies, and technologies that will shape the search marketing landscape.
If you’re looking to assess your paid search strategy and design an industry-aligned plan for 2024, then this webinar is for you.
5 Public speaking tips from TED - Visualized summarySpeakerHub
From their humble beginnings in 1984, TED has grown into the world’s most powerful amplifier for speakers and thought-leaders to share their ideas. They have over 2,400 filmed talks (not including the 30,000+ TEDx videos) freely available online, and have hosted over 17,500 events around the world.
With over one billion views in a year, it’s no wonder that so many speakers are looking to TED for ideas on how to share their message more effectively.
The article “5 Public-Speaking Tips TED Gives Its Speakers”, by Carmine Gallo for Forbes, gives speakers five practical ways to connect with their audience, and effectively share their ideas on stage.
Whether you are gearing up to get on a TED stage yourself, or just want to master the skills that so many of their speakers possess, these tips and quotes from Chris Anderson, the TED Talks Curator, will encourage you to make the most impactful impression on your audience.
See the full article and more summaries like this on SpeakerHub here: https://speakerhub.com/blog/5-presentation-tips-ted-gives-its-speakers
See the original article on Forbes here:
http://www.forbes.com/forbes/welcome/?toURL=http://www.forbes.com/sites/carminegallo/2016/05/06/5-public-speaking-tips-ted-gives-its-speakers/&refURL=&referrer=#5c07a8221d9b
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
Everyone is in agreement that ChatGPT (and other generative AI tools) will shape the future of work. Yet there is little consensus on exactly how, when, and to what extent this technology will change our world.
Businesses that extract maximum value from ChatGPT will use it as a collaborative tool for everything from brainstorming to technical maintenance.
For individuals, now is the time to pinpoint the skills the future professional will need to thrive in the AI age.
Check out this presentation to understand what ChatGPT is, how it will shape the future of work, and how you can prepare to take advantage.
A brief introduction to DataScience with explaining of the concepts, algorithms, machine learning, supervised and unsupervised learning, clustering, statistics, data preprocessing, real-world applications etc.
It's part of a Data Science Corner Campaign where I will be discussing the fundamentals of DataScience, AIML, Statistics etc.
Time Management & Productivity - Best PracticesVit Horky
Here's my presentation on by proven best practices how to manage your work time effectively and how to improve your productivity. It includes practical tips and how to use tools such as Slack, Google Apps, Hubspot, Google Calendar, Gmail and others.
The six step guide to practical project managementMindGenius
The six step guide to practical project management
If you think managing projects is too difficult, think again.
We’ve stripped back project management processes to the
basics – to make it quicker and easier, without sacrificing
the vital ingredients for success.
“If you’re looking for some real-world guidance, then The Six Step Guide to Practical Project Management will help.”
Dr Andrew Makar, Tactical Project Management
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
During this webinar, Anand Bagmar demonstrates how AI tools such as ChatGPT can be applied to various stages of the software development life cycle (SDLC) using an eCommerce application case study. Find the on-demand recording and more info at https://applitools.info/b59
Key takeaways:
• Learn how to use ChatGPT to add AI power to your testing and test automation
• Understand the limitations of the technology and where human expertise is crucial
• Gain insight into different AI-based tools
• Adopt AI-based tools to stay relevant and optimize work for developers and testers
* ChatGPT and OpenAI belong to OpenAI, L.L.C.
More than Just Lines on a Map: Best Practices for U.S Bike Routes
This session highlights best practices and lessons learned for U.S. Bike Route System designation, as well as how and why these routes should be integrated into bicycle planning at the local and regional level.
Presenters:
Presenter: Kevin Luecke Toole Design Group
Co-Presenter: Virginia Sullivan Adventure Cycling Association
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
Has your project been caught in a storm of deadlines, clashing requirements, and the need to change course halfway through? If yes, then check out how the administration team navigated through all of this, relocating 160 people from 3 countries and opening 2 offices during the most turbulent time in the last 20 years. Belka Games’ Chief Administrative Officer, Katerina Rudko, will share universal approaches and life hacks that can help your project survive unstable periods when there seem to be too many tasks and a lack of time and people.
This presentation was designed to provide strategic recommendations for a brand in decline. The deck also incorporates a situational assessment, including a brand identity, positioning, architecture, and portfolio strategy for the Brand.
Presentation originally created for NYU Stern's Brand Strategy course. Design by Erica Santiago & Chris Alexander.
1. Outline
Introduction
Salient Point Detection
Challenges
Results
Salient Point Detection
Tyler Karrels
Department of Electrical and Computer Engineering
University of Wisconsin - Madison
April 22, 2009
Tyler Karrels Salient Point Detection
2. Outline
Introduction
Salient Point Detection
Challenges
Results
1 Introduction
Defining Saliency
The Saliency Experience
Human Visual System (HVS)
Psychology of Perception
Previous Work
2 Salient Point Detection
Mathematical Framework
Features
Clustering
Saliency
3 Challenges
4 Results
Tyler Karrels Salient Point Detection
3. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
What is saliency?
Definitions
1 SALIENT: “strikingly conspicuous; prominent; noticeable”
American Heritage Dictionary
Tyler Karrels Salient Point Detection
4. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
What is saliency?
Definitions
1 SALIENT: “strikingly conspicuous; prominent; noticeable”
American Heritage Dictionary
2 VISUAL SALIENCY: “. . . the distinct subjective perceptual
quality which makes some items in the world stand out from
their neighbors and immediately grab our attention.”
Laurent Itti, Scholarpedia
Tyler Karrels Salient Point Detection
5. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Tyler Karrels Salient Point Detection
6. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Popout Effect 1
Tyler Karrels Salient Point Detection
7. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Popout Effect 2
Tyler Karrels Salient Point Detection
8. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
What is salient?
Tyler Karrels Salient Point Detection
9. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Conjunction Test 1
Tyler Karrels Salient Point Detection
10. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Conjunction Test 2
Tyler Karrels Salient Point Detection
11. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
FORGET
(o.0)
Tyler Karrels Salient Point Detection
12. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Conjunction Test 3
Tyler Karrels Salient Point Detection
13. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
What is salient?
Tyler Karrels Salient Point Detection
14. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Phase Transition
Tyler Karrels Salient Point Detection
15. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
What is salient?
Tyler Karrels Salient Point Detection
16. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
The Eye: Physiology
Peripheral Vision, Wikipedia
Foveal Vision: attended location; line of sight
Peripheral Vision: surrounding locations
1-1 photoreceptor to ganglion in Foveal Vision
many-1 for Peripheral Vision (low res. compression)
50% Fovea + 50% Peripheral = 100% Data Sent to Brain!
Tyler Karrels Salient Point Detection
17. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
The Eye: Feature Detector
Bottom-Up Processing
Detects low-level features in parallel, e.g. color, orientation,
contrast, . . .
Occurs before brain perceives data
Feature detectors compete to direct attention to salient
locations
How do they compete, communicate, and cooperate?
Top-Down Processing
The brain’s expectations guide attention
Tyler Karrels Salient Point Detection
18. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Helmholtz Principle
“. . . whenever some large deviation from randomness occurs, a
structure is perceived.”
Desolneux, From Gestalt Theory to Image Analysis: A Probabilistic Approach
Tyler Karrels Salient Point Detection
19. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Gestalt Laws
Perceptual Grouping Principles
Closure
Similarity
Proximity
Symmetry
Continuity
Common Fate
Tyler Karrels Salient Point Detection
20. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Sha’asua [4]
Continuity & Closure
Detect edges
Form contours: Connect
edges
Maximize length
Minimize total curvature
Longer contours, more
salient
Disregards other gestalt laws
& image features
Tyler Karrels Salient Point Detection
21. Outline Defining Saliency
Introduction The Saliency Experience
Salient Point Detection Human Visual System (HVS)
Challenges Psychology of Perception
Results Previous Work
Itti [2]
Proximity & Similarity
Multiple scales encode
proximity
Center-surround
Measures local contrast
Fine scale ‘center’ minus
course scale ‘surround’
Normalization encodes
similarity
Feature map combination
Itti’s Biological determines success
Saliency Map Model
Tyler Karrels Salient Point Detection
22. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Salient Point Detection
Not constrained to be biologically plausible
Not image-processing; clustering/outlier detection in Rd
Pixels are salient, not objects or regions
Challenges
When is something salient? When not?
Can we quantify saliency?
Can we relate computer/human performance?
Can we improve on previous methods? Will we?
Tyler Karrels Salient Point Detection
23. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Framework
Data
Pixels {Xi }n
i=1
Xi = (yi , xi , ri , gi , bi )
Video? Include time coordinate: X = (y , x, r , g , b, t)
Feature Space
Feature Maps {Fj }m
j=1
Vi = (yi , xi , ri , gi , bi , Fi1 , . . . , Fim )
Feature Vectors {Vi }n
i=1
Feature Space Vi ∈ [0, 1]d
Tyler Karrels Salient Point Detection
24. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
The Process
Easy As 1,2,3?
1 Create feature maps
2 Cluster points in Rd
3 Choose the salient cluster
Tyler Karrels Salient Point Detection
25. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Proposed Features
Feature Maps {Fj }m
j=1
Salient Scenarios
1 Intensity
1 Intensity
2 Color
2 Colors [Red, Green, Blue]
3 Orientation
3 Edge orientations
[0 ◦ , 45 ◦ , 90 ◦ , 135 ◦ ]
4 Size
4 Scale Description
5 Location
5 Pixel Location
How does our data representation affect performance?
Tyler Karrels Salient Point Detection
26. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
2-D Example
Do we really need 2 dimensions? Is 1 sufficient?
Tyler Karrels Salient Point Detection
27. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
1-D Example
Background pixels: no
orientation?
Horizontal pixels: 0 ◦ or
180 ◦ ?
Tyler Karrels Salient Point Detection
28. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Feature Subset Selection
Choosing Salient Dimensions
Interpret variance
Projections onto feature subspaces
Projections
Pr[Vi = (v1 , . . . , vd )] empirical distribution
I = {i1 , . . . , il } index set
Project onto subset I , induce Pr[Vi = (vi1 , . . . , vil )]
Minimize the KL Divergence between Empirical and Subset
distributions
Tyler Karrels Salient Point Detection
29. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Vertical, Horizontal, Intensity, Red Example
Notice Pr[Red, VerticalBar ] ≈ Pr[RedBar ]
Tyler Karrels Salient Point Detection
30. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Clustering in Feature Space
Gaussian Mixture Clustering
Figueiredo’s algorithm determines best number of clusters [1]
Fits distribution in feature space to a mixture of Gaussians
Uses EM algorithm, results vary depending on initialization
Subspace Clustering
Ma’s algorithm provides distortion parameter [3]
Based on rate distortion theory
Deterministic, same results every time
Tight cluster requires low rate
Additional clusters increase rate
Tyler Karrels Salient Point Detection
31. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Subspace Clustering
Large → few clusters, Small → many clusters
As varies large → small, salient clusters emerge
Tyler Karrels Salient Point Detection
32. Outline
Mathematical Framework
Introduction
Features
Salient Point Detection
Clustering
Challenges
Saliency
Results
Salient Clusters
How to determine a cluster’s saliency?
Compare clusters for relative notion of saliency
Relative cluster size and variance
Small relative size indicates uniqueness
Small relative variance indicates similarity
‘Distant’ clusters have less in common.
Centroid Distance
Mahanalobis Distance
Outlier detection methods
Tyler Karrels Salient Point Detection
33. Outline
Introduction
Salient Point Detection
Challenges
Results
Existence of Salient Points
Tyler Karrels Salient Point Detection
34. Outline
Introduction
Salient Point Detection
Challenges
Results
Quantification of Salient Points
Tyler Karrels Salient Point Detection
35. Outline
Introduction
Salient Point Detection
Challenges
Results
Performance
Tyler Karrels Salient Point Detection
36. Outline
Introduction
Salient Point Detection
Challenges
Results
Orientation Test Results
Tyler Karrels Salient Point Detection
37. Outline
Introduction
Salient Point Detection
Challenges
Results
Google Tyler Karrels - Click Homepage - Click Papers
Tyler Karrels Salient Point Detection
38. Outline
Introduction
Salient Point Detection
Challenges
Results
References
M. A. T. Figueiredo and A. K. Jain.
Unsupervised learning of finite mixture models.
IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 381–396, 2002.
L. Itti and C. Koch.
Feature combination strategies for saliency-based visual attention systems.
Journal of Electronic Imaging, 10:161, 2001.
Y. Ma, H. Derksen, W. Hong, and J. Wright.
Segmentation of multivariate mixed data via lossy data coding and compression.
IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 1546–1562, 2007.
A. Sha’asua.
Structural saliency: The detection of globally salient structures using a locally connected network, 1988.
ID: 1.
Tyler Karrels Salient Point Detection