This document summarizes Nathan Moroney's presentation on using online crowdsourcing for vision experiments. [1] It provides a brief history of crowdsourcing and describes several online experiments conducted on color naming, comparison, and image quality assessment. [2] These experiments involved thousands of voluntary participants providing data through online surveys and tools. [3] Moroney discusses eight considerations for online crowdsourcing experiments, including issues around scale, design, ambiguity, and using usage data as a source of additional information.
RBKartworks Graphic Design with your Brand in Mind.guest81f447b2
The document outlines various pain points and frustrations experienced with an existing design system, including low recognition, lost productivity, and designs not matching expertise. It then provides examples of before and after rebrands addressing recognition, client response, and ongoing design support. Outsourced design services are presented as a solution to save time and money while improving brand results.
This document discusses color and appearance attributes. It provides an overview of chromatic attributes related to hue, saturation and purity. It also discusses geometric attributes related to surface properties and light distribution. The document explores the visual perception of color and different factors that influence appearance, including light sources, materials, geometry and measurement conditions. It examines color measurement systems and differences in instrumental readings.
This document discusses input/output (I/O) concepts in operating systems. It covers I/O devices and controllers, principles of I/O software including device independence and uniform naming. Memory-mapped I/O, direct memory access, and interrupts are described. Page replacement algorithms like not recently used and first-in first-out are introduced. The document also examines disk hardware components, formatting, and scheduling algorithms. Error handling and stable storage concepts for disks are summarized. References for further reading on operating system concepts are provided.
The document provides 10 fast tips that executives can use to improve presentations and speeches, such as doing preparation work, being authentic, using microphones, employing risers or stages, avoiding jokes, keeping some details from audiences, assuming visual aids are illegible from a distance, using slides cautiously, watching timing, and working with a speech coach. The tips are from Marian Madonia and focus on practical strategies for effective public speaking.
RBKartworks Graphic Design with your Brand in Mind.guest81f447b2
The document outlines various pain points and frustrations experienced with an existing design system, including low recognition, lost productivity, and designs not matching expertise. It then provides examples of before and after rebrands addressing recognition, client response, and ongoing design support. Outsourced design services are presented as a solution to save time and money while improving brand results.
This document discusses color and appearance attributes. It provides an overview of chromatic attributes related to hue, saturation and purity. It also discusses geometric attributes related to surface properties and light distribution. The document explores the visual perception of color and different factors that influence appearance, including light sources, materials, geometry and measurement conditions. It examines color measurement systems and differences in instrumental readings.
This document discusses input/output (I/O) concepts in operating systems. It covers I/O devices and controllers, principles of I/O software including device independence and uniform naming. Memory-mapped I/O, direct memory access, and interrupts are described. Page replacement algorithms like not recently used and first-in first-out are introduced. The document also examines disk hardware components, formatting, and scheduling algorithms. Error handling and stable storage concepts for disks are summarized. References for further reading on operating system concepts are provided.
The document provides 10 fast tips that executives can use to improve presentations and speeches, such as doing preparation work, being authentic, using microphones, employing risers or stages, avoiding jokes, keeping some details from audiences, assuming visual aids are illegible from a distance, using slides cautiously, watching timing, and working with a speech coach. The tips are from Marian Madonia and focus on practical strategies for effective public speaking.
A new product offering combining marketing and sales data with social media marketing to bring the magic of marketing together with the science of sales
Highland-March Office Business Centers Overviewkimlibby
Highland-March Executive Suites is a provider of executive office suites, virtual offices, and administrative services. It was founded in 1996 when Leslie Libeskind purchased the business from its previous owner. Since then, Leslie has expanded the company to multiple locations in Massachusetts. Highland-March offers fully furnished private offices, virtual office packages, conference rooms, and administrative support staff to help businesses operate efficiently without the long term commitment of a traditional office lease.
Efficient Memory-Reference Checks for Real-time JavaAngelo Corsaro
The scoped-memory feature is central to the Real-Time Specifica- tion for Java. It allows greater control over memory management, in particular the deallocation of objects without the use of a garbage collector. To preserve the safety of storage references associated with Java since its inception, the use of scoped memory is con- strained by a set of rules in the specification. While a program’s adherence to the rules can be partially checked at compile-time, un- decidability issues imply that some—perhaps, many—checks may be required at run-time. Poor implementations of those run-time checks could adversely affect overall performance and predictabil- ity, the latter being a founding principle of the specification.
In this paper we present efficient algorithms for managing scoped memories and the checks they impose on programs. Implementa- tions and results published to date require time linear in the depth of scope nesting; our algorithms operate in constant time. We de- scribe our approach and present experiments quantifying the gains in efficiency.
Group communication involves interacting and influencing each other to accomplish common goals. Effective groups have clearly defined, consistent, and acceptable goals. The optimal size is smallest to do the job, and members bring diverse but relevant skills. Cohesiveness and productive norms like ground rules help the group achieve synergy and outcomes greater than individuals. Forming, storming, norming, performing, and adjourning describe the stages of group development. Analyzing problems, determining criteria, identifying solutions, and evaluating alternatives against criteria leads to a decision using methods like consensus or majority rule.
The document discusses various foods from different regions of Asia. It describes several major Asian cuisine styles including East Asian cuisine originating from China and now including Japan and Korea, and Southeast Asian cuisine encompassing countries like Cambodia, Laos, and Thailand. It then provides examples of specific iconic dishes for different areas, such as pilaf from Central Asia, doner kebab from Turkey, chicken tikka from India, hummus from the Middle East, Peking duck from China, sushi from Japan, dosa from South India, and hoppers from Sri Lanka.
Carolyne is a 17-year-old girl from Stoke-on-Trent, England who speaks Swahili as her native language. She enjoys communicating with friends on Facebook, listening to artists like Chris Brown, Michael Jackson, and Missy Elliot. Her favorite meal is chicken curry and she likes McDonald's fries. She finds Lamborghinis and convertibles to be cool cars and enjoys comedy and mildly scary movies.
Outlining is a systematic process that arranges ideas in a recognizable pattern for listeners to easily follow. It provides flexibility while speaking and an opportunity to critique and improve the speech before presenting. Outlining reduces anxiety by making it harder to lose your place and boosting ethos. The preparation outline involves creating a thesis, main points, and supporting material. It is then formatted and integrated with sources before revising. The formal outline uses complete sentences while the speaking outline is condensed for memory with abbreviations and delivery cues.
The document discusses democracy and the public sphere in the context of cyberpolitics. It defines democracy as rule by the people and outlines Robert Dahl's five principles of democracy. Three approaches to democracy are described: liberal individualism, communitarianism, and deliberative democracy. The internet is discussed as potentially enhancing each approach through information sharing, online communities, and as an electronic public sphere for deliberation. Habermas' concept of the public sphere and agora is also introduced. The document poses questions about whether the internet has transformed Habermas' idea of the public sphere and asks for examples of how this may contribute to the development of democracy.
Vortex: The Intelligent Data Sharing Platform for the Internet of ThingsAngelo Corsaro
The real value of the Internet of Things (IoT) and the Industrial Internet (I2) are ubiquitous information availability and consequently the decisions that can be made from it. If we look at the technology landscape, there isn’t a single platform that provides efficient, timely and ubiquitous data sharing across network-connected devices. Well… I should better say there wasn’t until now!
Vortex is the first platform to enable ubiquitous, efficient and timely data sharing across mobile, embedded, desktop, cloud and web applications. This presentation will (1) introduce the elements that make the Vortex platform and (2) describe its applicability
The document discusses the realities of innovation and its implications for projects. It states that innovation is a knowledge-intensive process that uses knowledge and ideas to create social and economic value. It also notes that innovation can involve new technologies, organizations, marketing strategies, or policies. The document emphasizes that innovation is an integrated and evolving process that requires diverse partnerships, including farmers, researchers, private sector, and government. It concludes that projects need flexibility to tackle multiple types of innovations, identify new problems and partners over time, and systematically reflect on successes and challenges.
The document discusses the interplay between the virtual and real, focusing on concepts like virtuality, spatiality, disembodiment, identity, and community in the digital age. It examines how virtual spaces like Second Life function as social spaces with their own rules and norms. It also explores how digital technologies have shaped new forms of identity and community that are disembedded from traditional notions of time, space, and physical embodiment.
La actividad de castañada se realizó en el colegio infantil en noviembre de 2012. Se celebró una fiesta tradicional con castañas asadas y dulces típicos de otoño. Los niños disfrutaron de juegos, canciones y merienda con motivo de la festividad.
SharePoint + Silverlight - new BFF's by Wictor WilénWictor Wilén
This document summarizes a presentation about using Silverlight in SharePoint. It discusses what Silverlight is, why it would be used with SharePoint, and how it can be integrated out of the box or through custom development. The presentation covers the key features of Silverlight, how to develop Silverlight applications that connect to SharePoint using the client object model or REST, and deployment options such as web parts, modules, or remote hosting. It includes demos of out of the box Silverlight experiences in SharePoint as well as a custom Silverlight web part.
El documento menciona varias obras maestras de la pintura del Renacimiento italiano, incluyendo pinturas de Fra Angelico, Piero della Francesca, Botticelli, Leonardo da Vinci, Miguel Ángel y Rafael, como La Anunciación, Federico de Montefeltro, La Primavera, El nacimiento de Venus, La Gioconda, el Techo de la Capilla Sixtina, El Juicio Final, La Sagrada Familia del Cordero y La escuela de Atenas.
A new product offering combining marketing and sales data with social media marketing to bring the magic of marketing together with the science of sales
Highland-March Office Business Centers Overviewkimlibby
Highland-March Executive Suites is a provider of executive office suites, virtual offices, and administrative services. It was founded in 1996 when Leslie Libeskind purchased the business from its previous owner. Since then, Leslie has expanded the company to multiple locations in Massachusetts. Highland-March offers fully furnished private offices, virtual office packages, conference rooms, and administrative support staff to help businesses operate efficiently without the long term commitment of a traditional office lease.
Efficient Memory-Reference Checks for Real-time JavaAngelo Corsaro
The scoped-memory feature is central to the Real-Time Specifica- tion for Java. It allows greater control over memory management, in particular the deallocation of objects without the use of a garbage collector. To preserve the safety of storage references associated with Java since its inception, the use of scoped memory is con- strained by a set of rules in the specification. While a program’s adherence to the rules can be partially checked at compile-time, un- decidability issues imply that some—perhaps, many—checks may be required at run-time. Poor implementations of those run-time checks could adversely affect overall performance and predictabil- ity, the latter being a founding principle of the specification.
In this paper we present efficient algorithms for managing scoped memories and the checks they impose on programs. Implementa- tions and results published to date require time linear in the depth of scope nesting; our algorithms operate in constant time. We de- scribe our approach and present experiments quantifying the gains in efficiency.
Group communication involves interacting and influencing each other to accomplish common goals. Effective groups have clearly defined, consistent, and acceptable goals. The optimal size is smallest to do the job, and members bring diverse but relevant skills. Cohesiveness and productive norms like ground rules help the group achieve synergy and outcomes greater than individuals. Forming, storming, norming, performing, and adjourning describe the stages of group development. Analyzing problems, determining criteria, identifying solutions, and evaluating alternatives against criteria leads to a decision using methods like consensus or majority rule.
The document discusses various foods from different regions of Asia. It describes several major Asian cuisine styles including East Asian cuisine originating from China and now including Japan and Korea, and Southeast Asian cuisine encompassing countries like Cambodia, Laos, and Thailand. It then provides examples of specific iconic dishes for different areas, such as pilaf from Central Asia, doner kebab from Turkey, chicken tikka from India, hummus from the Middle East, Peking duck from China, sushi from Japan, dosa from South India, and hoppers from Sri Lanka.
Carolyne is a 17-year-old girl from Stoke-on-Trent, England who speaks Swahili as her native language. She enjoys communicating with friends on Facebook, listening to artists like Chris Brown, Michael Jackson, and Missy Elliot. Her favorite meal is chicken curry and she likes McDonald's fries. She finds Lamborghinis and convertibles to be cool cars and enjoys comedy and mildly scary movies.
Outlining is a systematic process that arranges ideas in a recognizable pattern for listeners to easily follow. It provides flexibility while speaking and an opportunity to critique and improve the speech before presenting. Outlining reduces anxiety by making it harder to lose your place and boosting ethos. The preparation outline involves creating a thesis, main points, and supporting material. It is then formatted and integrated with sources before revising. The formal outline uses complete sentences while the speaking outline is condensed for memory with abbreviations and delivery cues.
The document discusses democracy and the public sphere in the context of cyberpolitics. It defines democracy as rule by the people and outlines Robert Dahl's five principles of democracy. Three approaches to democracy are described: liberal individualism, communitarianism, and deliberative democracy. The internet is discussed as potentially enhancing each approach through information sharing, online communities, and as an electronic public sphere for deliberation. Habermas' concept of the public sphere and agora is also introduced. The document poses questions about whether the internet has transformed Habermas' idea of the public sphere and asks for examples of how this may contribute to the development of democracy.
Vortex: The Intelligent Data Sharing Platform for the Internet of ThingsAngelo Corsaro
The real value of the Internet of Things (IoT) and the Industrial Internet (I2) are ubiquitous information availability and consequently the decisions that can be made from it. If we look at the technology landscape, there isn’t a single platform that provides efficient, timely and ubiquitous data sharing across network-connected devices. Well… I should better say there wasn’t until now!
Vortex is the first platform to enable ubiquitous, efficient and timely data sharing across mobile, embedded, desktop, cloud and web applications. This presentation will (1) introduce the elements that make the Vortex platform and (2) describe its applicability
The document discusses the realities of innovation and its implications for projects. It states that innovation is a knowledge-intensive process that uses knowledge and ideas to create social and economic value. It also notes that innovation can involve new technologies, organizations, marketing strategies, or policies. The document emphasizes that innovation is an integrated and evolving process that requires diverse partnerships, including farmers, researchers, private sector, and government. It concludes that projects need flexibility to tackle multiple types of innovations, identify new problems and partners over time, and systematically reflect on successes and challenges.
The document discusses the interplay between the virtual and real, focusing on concepts like virtuality, spatiality, disembodiment, identity, and community in the digital age. It examines how virtual spaces like Second Life function as social spaces with their own rules and norms. It also explores how digital technologies have shaped new forms of identity and community that are disembedded from traditional notions of time, space, and physical embodiment.
La actividad de castañada se realizó en el colegio infantil en noviembre de 2012. Se celebró una fiesta tradicional con castañas asadas y dulces típicos de otoño. Los niños disfrutaron de juegos, canciones y merienda con motivo de la festividad.
SharePoint + Silverlight - new BFF's by Wictor WilénWictor Wilén
This document summarizes a presentation about using Silverlight in SharePoint. It discusses what Silverlight is, why it would be used with SharePoint, and how it can be integrated out of the box or through custom development. The presentation covers the key features of Silverlight, how to develop Silverlight applications that connect to SharePoint using the client object model or REST, and deployment options such as web parts, modules, or remote hosting. It includes demos of out of the box Silverlight experiences in SharePoint as well as a custom Silverlight web part.
El documento menciona varias obras maestras de la pintura del Renacimiento italiano, incluyendo pinturas de Fra Angelico, Piero della Francesca, Botticelli, Leonardo da Vinci, Miguel Ángel y Rafael, como La Anunciación, Federico de Montefeltro, La Primavera, El nacimiento de Venus, La Gioconda, el Techo de la Capilla Sixtina, El Juicio Final, La Sagrada Familia del Cordero y La escuela de Atenas.
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
Building RAG with self-deployed Milvus vector database and Snowpark Container...Zilliz
This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Full-RAG: A modern architecture for hyper-personalizationZilliz
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfMalak Abu Hammad
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Monitoring Java Application Security with JDK Tools and JFR Events
Ei09 Thousands Observers
1. Thousands of Online
Observers is Just the
Beginning
Nathan Moroney, HP Labs
Human Vision and Electronic Imaging XIV
Session 2: Social Software, Internet Experiments and New Paradigms for the Web
Monday, January 19, 2009, 1:00-1:30 PM
2. Outline
• Brief History of Crowd-Sourcing
• Online Experiments
− Unconstrained color naming
− Color name comparison
− Color difference description
− Image quality description
− World Wide Gamma
• Online Tools
− Color Thesaurus, Color Zeitgeist & Italian Color Thesaurus
• Eight considerations
1/27/2009 2
3. Brief History of Crowdsourcing: Part 1
“Since the beginning, it was
just the same. The only
difference, the crowds are
bigger now.”
Elvis
1/27/2009 3
4. Brief History of Crowdsourcing: Part 2
“The future belongs to crowds.”
Mao II
Don Delillo
(Left as an exercise for the audience to do an Elvis – Delillo mash-up)
1/27/2009 4
5. Online Experiments
• Basic pieces
− Experimental design – unconstrained text
− Software, a server – JavaScript
− Communication network –World Wide Web
− Participants - volunteers
• Results
− Direct Data
− Usage Data
• Optional but useful – lab data for validation
1/27/2009 5
6. Unconstrained Color Naming
• Seven colored patches
• Randomly selected
− 6x6x6 RGB sampling
• Text field for names
• Provide the “best” name
• Optional comments
• Started in 2002
1/27/2009 6
7. On-Line vs. Berlin & Kay
CIECAM02Hue Angle
CIECAM02 hue angle
y = 0.9971x + 28.986
360
2
R = 0.9859
270
Berlin & Kay
180
90
0
0 90 180 270 360
On-Line
Web
1/27/2009 7
8. Color Name Comparison
• Text only
• Eleven color names
• Non-repeating random
walk
• Eleven triads
− Which color is least like the
other two?
• Collect
additional
demographic data
1/27/2009 8
10. Color Difference Description
• Five pairs of colored patches.
• Best describe the difference
• Text field per pair
− Unconstrained description
• Randomly sample RGB cube
− Constrained RGB offsets
1/27/2009 10
11. Frequencies of Words
0.048 right
0.045 more
0.031 left
is six times as frequent
• ‘More’
0.028 one
0.018 color
as ‘less’ 0.017 green
0.017 darker
• ‘Darker’ is twice as frequent
0.015 blue
0.012 than
as ‘lighter’, 0.012 saturated
0.011 patch
− same for ‘dark’ and ‘light’ 0.011 first
0.010 purple
• Lime and magenta are not in
0.009 lighter
0.009 second
the top 100 terms – 0.008 dark
0.007 less
− But they are in the top 10 of 0.007 brown
unconstrained naming. 0.007 red
0.006 different
0.006 yellow
0.006 difference
0.006 brighter
0.006 hue
0.005 pink
1/27/2009 11
12. Image Quality Description
Overall and specific
•
description of image quality
Demographic questions
•
Proportion vs. Token
0.089 the
0.033 of
0.032 is
0.031 and
color(s)
0.021
0.017 to
0.016 good
0.014 on
0.014 a
0.013 in
1/27/2009 12
13. Opt-In Demographics: n=338
Non-Native
Male 35%
44% Female
Native
56%
English
Gender 65%
Proficiency
Maybe
>60
1% Color Blind
40-60 < 20
1% Don’t Know 9%
Definitely
17% 1%
23%
Color Blind
Color
Age Vision
(years) (self-described)
59% 89%
Normal
20-40
1/27/2009 13
14. World Wide Gamma
• Lightness
partitioning task, benchmark to a nominal
display and existing lightness scales, such as L*.
After
Before
1/27/2009 14
15. World Wide Gamma
• Red is >600
participants
• Black is current
results
• Specific
experimental
feedback
• Offsetfor darkest
levels but quite
linear
1/27/2009 15
16. Online Color Thesaurus
• Interface to the underlying database of color names
• Largest number of users
1/27/2009 16
17. Color Zeitgeist
• Usage data – tools use creates data which in turn
creates another tool
1/27/2009 17
18. Italian Color Thesaurus
• Italian data < English data
• Adaptive tools
− Qualification through ratings
− Quantity through instance-
based harvesting, collect new
data only for missing colors
1/27/2009 18
19. Consideration 1: Scale
• Yes online experiments mean bigger crowds
− Larger & more diverse pool of possible participants
− Logarithmic scale of participation
Stanford
HP Palo San
HP
Department California
(under)
Labs Alto Jose
1 10 100 1K 10K 100K 1M 10M 100M
English Application OS
Lab Color
Web-based Based Based
Prototypes & Thesaurus
Color naming Color Color
Experiments
experiment Picker Picker
1/27/2009 19
20. Observers per Experiment by Year
10000
1000
Log of the Number Observers
These
should also
have error
bars and
100
connecting
lines…
10
1
1990 1995 2000 2005 2010
Experiment by Year
1/27/2009 20
21. Consideration 2: Distributed Design
• Minimize the effort from any single participant
− Increase volunteer participation rate?
− Minimize impact of an single, systematically disruptive
participant
•A ‘knob’ that can be used to dial the target “time to
completion” for any given web participant
• Applicable to even relatively complex tasks
− Triadic comparison
vs.
1/27/2009 21
22. Consideration 3: Ambiguity
• Lack of constraints is a trade-off
− May make the task more difficult for observers
− May enable a different set of questions
− General bias is towards unconstrained tasks
− Implicitly include real world variability
• Sourcesof variability are vast, robustness comes
from scale – and a focus categories not thresholds
“wasn’t sure whether you wanted
accurate or poetic names.”
Anonymous Comment
June 8, 2002
1/27/2009 22
23. Consideration 4: Hypotheses vs Training
• Thresholds versus Categories
• Individual performance versus collective capability
• Numbers versus Words
Pixel by pixel
machine color
naming – see -
‘Lexical Image
Processing’
CIC 16
1/27/2009 23
24. Consideration 5: Simplicity
• In both tasks and tools
• The simpler the task – likely the less confusion over
instructions, higher the volunteer participation rate
• The simpler the tools – lowest common denominator
infrastructure, minimum number of versions over the
years, likely widest audience
1/27/2009 24
25. Consideration 6: Global & Open-Ended
Global scale for participation
•
Effort is front loaded - once uploaded no
•
real penalty to indefinite data collection
Data ‘evolves’ as it changes scale
•
Especially true for
•
− inter-related experiments,
10000
− variations in experimental designs and 1000
Log of the Number Observers
− results that are in pursuit of an aggregate
property 100
− results that change over time
10
1
1990 1995 2000 2005 2010
Experiment by Year
1/27/2009 25
26. Consideration 7: Usage as Data
• Any online interaction creates data
• Theboundary between experiments and tools is
potentially fuzzy
• Usefulexperiments can be formatted as a useful
tool, and the more useful the tool the greater the
potential data.
• An important implication and possible advantage is
that a tool defines context for the task, the
pragmatics is inherent.
1/27/2009 26
27. Consideration 8: Mutual Bootstrapping
Mutual bootstrapping – machine learning applied to training
•
data gathered online, which in turn creates processed data
which can enable human learning.
Social data can be educational.
•
Chartreuse
Revisiting approaches to laboratory experiments – if the
•
goals are simplicity, categorization, ambiguity, larger scale
and so on, how are the designs different?
1/27/2009 27
28. Questions?
Elvis’s favorite color?
That would be blue.
1/27/2009 28