SlideShare a Scribd company logo
1 of 37
Ben Bederson

Human-Computer Interaction Lab
       Computer Science Dept.
            UMIACS / iSchool
        University of Maryland
Problem: Show More Than Fits
                                            on the screen
Solution categories:
 Scroll
 Multiple pages (tabs, link, search …)
 Denser displays (info vis)
   Fisheye
   Zooming




Is always a problem – and worse on small screens
Zooming Examples
   OS X Expose
   iPhone
   Google Maps
   Adobe Photoshop

Theme 1
 Are ZUIs a success?
 When do / don’t they work?

Theme 2
 How does innovation work?
Some early ZUIs


  Pad 1993

                              Pad++ 1994




                  Pa3D 1993
Pad++ (1997 Video)
Partial Timeline


         PadDraw       PadPrints PhotoMesa           PPTPlex
                            KidPad CounterPoint      Prezi
                                           Google          Pivot
                                           Maps     ZoomCanvas
              Space-Scale Diagrams
    Geometric Scaling       SDAZ
    Semantic Zooming
    Portals
       Lenses

                         SVG .NET
       Pa3D          Java2D   Sea Dragon
    Pad Pad++        Jazz Piccolo Cocoa WPF iPhone
    92 93 94 95 96 97 98 99 00 01 02 03 04 05 06 07 08 09 10
Animated Presentations


     KidPad - 1997           CounterPoint - 2001




  Microsoft PPTPlex - 2008      Prezi - 2009
PhotoMesa
 First attempt at building polished consumer ZUI
    Object-based zooming
    Domain-specific navigation
    Domain-specific semantic zoom
    Auto-layout
    Perf tricks
    Metadata & search


 Mobile version
iPhoto & Picasa
Other Full Screen ZUIs



     Canvas for OneNote   Seadragon (http://zoom.it)
Problems …
What Happened?
   “Eye candy” that doesn’t add much
   Don’t scale well
   Datasets aren’t persistent
   Navigation mechanisms difficult
   Spatial memory not as good as hoped
   2D layouts hard to scan
   People don’t know where to zoom
   Difficult to author

=> Instead
        simple
        linear structures
        hierarchical structures
        geographic systems
        search
More Successful ZUIs




       Google Maps     Wired on iPad
Wired Magazine on iPad
Mobile Zooming
  New interaction for touch screen
  Good for simple transitions – what else?




[Karlson, Bederson & SanGiovanni, CHI 2005]
Zumobi ZoomCanvas (2009)




  Zumobi ZoomCanvas Technology
ZUI Benefit
 Engaging
 Feels natural
 Improves some task performance
 Hurts other tasks
 More creative potential
 People like overviews
 Animation effective
 Structured content useful
Challenges
                                  Too complex
 Hard to scale
 Hard to design & author
 Temporal separation requires STM to integrate
  multiple views
 Spatial memory & spatial navigation limited
 Navigation controls non-standard, tricky
 Remaining technical challenges
What is Innovation?
Dictionary:
 "A new method, idea, product"
 "A creation resulting from study and experimentation"
 "The act of starting something for the first time"
 "Producing something like nothing done or experienced
  or created before"
"There is nothing new under the sun”
                          -- Ecclesiastes 1:9
Movie themes:
 Good vs. Evil
 Love conquers all
 Individual v. society
 Loss of innocence
 Man v. nature
How Do You Innovate?
Bolt from the blue? Ideas when you …
 Read the literature
 Competitive analysis
 Solve real problems
 Use available technologies
 Consider cost


=> Innovations happen in a cultural context
Ad Campaign
2001
Palm Pilot
1996
Apple Newton   Palm Pilot
1993           1996
Dynabook   Apple Newton   Palm Pilot
1980’s     1993           1996
Dynabook   Apple Newton   Palm Pilot
1980’s     1993           1996
Is Nothing Innovative?
 Of course not


 The point is that innovation is more subtle than it first
  appears
When is Copying Fair?
 Laws give us the societally accepted answer:
Fine line between protecting invention
 Always...
and stopping creative innovation

Except when protected by
  • Copyright (concrete expression)
  • Trademark (image, logo, short sequence of
  words)
  • Trade secret (most things you don't tell others)
  • Patent (processes, things, designs)
Patent Prosecution


     Prior art   Invention
Patent Prosecution
         Prior art

                 Invention
Patent Prosecution
         Prior art

                 Invention
Patent Prosecution
         Prior art

                 Invention

            Prior art
Patent Prosecution
         Prior art

                 Invention

            Prior art
Questions?

Benjamin B. Bederson
Computer Science Department
Human-Computer Interaction Lab
Institute for Advanced Computer Studies

University of Maryland

              www.cs.umd.edu/~bederson
                     @bederson

More Related Content

Similar to Zooming User Interfaces: Past, Present and Future

Touchpoint 2012 Symposium on Interaction Design: Notes
Touchpoint 2012 Symposium on Interaction Design: NotesTouchpoint 2012 Symposium on Interaction Design: Notes
Touchpoint 2012 Symposium on Interaction Design: NotesVisnja Milidragovic
 
IXDA Chicago - Interaction08 Recap
IXDA Chicago - Interaction08 RecapIXDA Chicago - Interaction08 Recap
IXDA Chicago - Interaction08 RecapFrank Grigurs
 
Collaboration Across Distributed Environments
Collaboration Across Distributed EnvironmentsCollaboration Across Distributed Environments
Collaboration Across Distributed EnvironmentsAgile Dimensions LLC
 
Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...
Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...
Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...John Mathon
 
Transitioning to Teaching with Technology
Transitioning to Teaching with TechnologyTransitioning to Teaching with Technology
Transitioning to Teaching with TechnologyJeff Aronowitz
 
CAMA 2007 Visions of the Future for Contextualized Attention Metadata
CAMA 2007 Visions of the Future for Contextualized Attention MetadataCAMA 2007 Visions of the Future for Contextualized Attention Metadata
CAMA 2007 Visions of the Future for Contextualized Attention MetadataWayne Hodgins
 
BICS Tech Plan PAC Presentation
BICS Tech Plan PAC PresentationBICS Tech Plan PAC Presentation
BICS Tech Plan PAC Presentationslater_45
 
Ipads in_the_Classroom 2
Ipads in_the_Classroom 2Ipads in_the_Classroom 2
Ipads in_the_Classroom 2mikedionne
 
If OLPC started today... JSConf.is
If OLPC started today... JSConf.isIf OLPC started today... JSConf.is
If OLPC started today... JSConf.isNicholas Doiron
 
ASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ Jacquez
ASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ JacquezASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ Jacquez
ASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ JacquezRJ Jacquez
 
Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...
Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...
Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...360|Conferences
 
Prototypes, Prototypes, Prototypes
Prototypes, Prototypes, PrototypesPrototypes, Prototypes, Prototypes
Prototypes, Prototypes, PrototypesShane Morris
 
Abou Teaching Girls Technology
Abou Teaching Girls TechnologyAbou Teaching Girls Technology
Abou Teaching Girls TechnologyLynn Langit
 
Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...
Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...
Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...BayCHI
 
UX Unicorns - legend or fable?
UX Unicorns - legend or fable?UX Unicorns - legend or fable?
UX Unicorns - legend or fable?Vanessa Kirby
 
Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)Seb Rose
 

Similar to Zooming User Interfaces: Past, Present and Future (20)

Touchpoint 2012 Symposium on Interaction Design: Notes
Touchpoint 2012 Symposium on Interaction Design: NotesTouchpoint 2012 Symposium on Interaction Design: Notes
Touchpoint 2012 Symposium on Interaction Design: Notes
 
IXDA Chicago - Interaction08 Recap
IXDA Chicago - Interaction08 RecapIXDA Chicago - Interaction08 Recap
IXDA Chicago - Interaction08 Recap
 
Collaboration Across Distributed Environments
Collaboration Across Distributed EnvironmentsCollaboration Across Distributed Environments
Collaboration Across Distributed Environments
 
Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...
Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...
Artificial Intelligence is back, Deep Learning Networks and Quantum possibili...
 
Transitioning to Teaching with Technology
Transitioning to Teaching with TechnologyTransitioning to Teaching with Technology
Transitioning to Teaching with Technology
 
CAMA 2007 Visions of the Future for Contextualized Attention Metadata
CAMA 2007 Visions of the Future for Contextualized Attention MetadataCAMA 2007 Visions of the Future for Contextualized Attention Metadata
CAMA 2007 Visions of the Future for Contextualized Attention Metadata
 
Multimodal Interfaces
Multimodal InterfacesMultimodal Interfaces
Multimodal Interfaces
 
BICS Tech Plan PAC Presentation
BICS Tech Plan PAC PresentationBICS Tech Plan PAC Presentation
BICS Tech Plan PAC Presentation
 
Digital Collaboration SGI 27_09_09
Digital Collaboration SGI 27_09_09Digital Collaboration SGI 27_09_09
Digital Collaboration SGI 27_09_09
 
Ipads in_the_Classroom 2
Ipads in_the_Classroom 2Ipads in_the_Classroom 2
Ipads in_the_Classroom 2
 
If OLPC started today... JSConf.is
If OLPC started today... JSConf.isIf OLPC started today... JSConf.is
If OLPC started today... JSConf.is
 
ASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ Jacquez
ASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ JacquezASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ Jacquez
ASTD Houston Keynote: The Time to Mobilize Learning is Now! by RJ Jacquez
 
Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...
Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...
Francisco Inchauste - RIA Mojo - Making your Flex application standout with a...
 
Prototypes, Prototypes, Prototypes
Prototypes, Prototypes, PrototypesPrototypes, Prototypes, Prototypes
Prototypes, Prototypes, Prototypes
 
Abou Teaching Girls Technology
Abou Teaching Girls TechnologyAbou Teaching Girls Technology
Abou Teaching Girls Technology
 
Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...
Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...
Industrial Design Intelligence: Evaluation Supporting Aesthetic and Functiona...
 
UX Unicorns - legend or fable?
UX Unicorns - legend or fable?UX Unicorns - legend or fable?
UX Unicorns - legend or fable?
 
Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)Common Objections to TDD (and their refutations)
Common Objections to TDD (and their refutations)
 
E-Learning
E-LearningE-Learning
E-Learning
 
Design Thinking?
Design Thinking?Design Thinking?
Design Thinking?
 

Recently uploaded

Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 

Zooming User Interfaces: Past, Present and Future

  • 1. Ben Bederson Human-Computer Interaction Lab Computer Science Dept. UMIACS / iSchool University of Maryland
  • 2. Problem: Show More Than Fits on the screen Solution categories:  Scroll  Multiple pages (tabs, link, search …)  Denser displays (info vis)  Fisheye  Zooming Is always a problem – and worse on small screens
  • 3. Zooming Examples  OS X Expose  iPhone  Google Maps  Adobe Photoshop Theme 1  Are ZUIs a success?  When do / don’t they work? Theme 2  How does innovation work?
  • 4. Some early ZUIs Pad 1993 Pad++ 1994 Pa3D 1993
  • 6. Partial Timeline PadDraw PadPrints PhotoMesa PPTPlex KidPad CounterPoint Prezi Google Pivot Maps ZoomCanvas Space-Scale Diagrams Geometric Scaling SDAZ Semantic Zooming Portals Lenses SVG .NET Pa3D Java2D Sea Dragon Pad Pad++ Jazz Piccolo Cocoa WPF iPhone 92 93 94 95 96 97 98 99 00 01 02 03 04 05 06 07 08 09 10
  • 7.
  • 8. Animated Presentations KidPad - 1997 CounterPoint - 2001 Microsoft PPTPlex - 2008 Prezi - 2009
  • 9. PhotoMesa  First attempt at building polished consumer ZUI  Object-based zooming  Domain-specific navigation  Domain-specific semantic zoom  Auto-layout  Perf tricks  Metadata & search  Mobile version
  • 10.
  • 12. Other Full Screen ZUIs Canvas for OneNote Seadragon (http://zoom.it)
  • 14. What Happened?  “Eye candy” that doesn’t add much  Don’t scale well  Datasets aren’t persistent  Navigation mechanisms difficult  Spatial memory not as good as hoped  2D layouts hard to scan  People don’t know where to zoom  Difficult to author => Instead simple linear structures hierarchical structures geographic systems search
  • 15. More Successful ZUIs Google Maps Wired on iPad
  • 17. Mobile Zooming  New interaction for touch screen  Good for simple transitions – what else? [Karlson, Bederson & SanGiovanni, CHI 2005]
  • 18. Zumobi ZoomCanvas (2009) Zumobi ZoomCanvas Technology
  • 19. ZUI Benefit  Engaging  Feels natural  Improves some task performance  Hurts other tasks  More creative potential  People like overviews  Animation effective  Structured content useful
  • 20. Challenges Too complex  Hard to scale  Hard to design & author  Temporal separation requires STM to integrate multiple views  Spatial memory & spatial navigation limited  Navigation controls non-standard, tricky  Remaining technical challenges
  • 21. What is Innovation? Dictionary:  "A new method, idea, product"  "A creation resulting from study and experimentation"  "The act of starting something for the first time"  "Producing something like nothing done or experienced or created before"
  • 22. "There is nothing new under the sun” -- Ecclesiastes 1:9 Movie themes:  Good vs. Evil  Love conquers all  Individual v. society  Loss of innocence  Man v. nature
  • 23. How Do You Innovate? Bolt from the blue? Ideas when you …  Read the literature  Competitive analysis  Solve real problems  Use available technologies  Consider cost => Innovations happen in a cultural context
  • 24.
  • 27. Apple Newton Palm Pilot 1993 1996
  • 28. Dynabook Apple Newton Palm Pilot 1980’s 1993 1996
  • 29. Dynabook Apple Newton Palm Pilot 1980’s 1993 1996
  • 30. Is Nothing Innovative?  Of course not  The point is that innovation is more subtle than it first appears
  • 31. When is Copying Fair?  Laws give us the societally accepted answer: Fine line between protecting invention  Always... and stopping creative innovation Except when protected by • Copyright (concrete expression) • Trademark (image, logo, short sequence of words) • Trade secret (most things you don't tell others) • Patent (processes, things, designs)
  • 32. Patent Prosecution Prior art Invention
  • 33. Patent Prosecution Prior art Invention
  • 34. Patent Prosecution Prior art Invention
  • 35. Patent Prosecution Prior art Invention Prior art
  • 36. Patent Prosecution Prior art Invention Prior art
  • 37. Questions? Benjamin B. Bederson Computer Science Department Human-Computer Interaction Lab Institute for Advanced Computer Studies University of Maryland www.cs.umd.edu/~bederson @bederson