The GNOME Shell Magnifier:
                 Adding Built-in Magnification to the GNOME Shell
                 Desktop
    ...
GNOME Shell


        • New window and desktop manager for GNOME 3.
        • High Level:
           – Application and win...
GNOME Shell Technologies

        • Clutter
              – Compositing.
        • D-Bus
              – Interprocess comm...
Approaches to Screen Enhancement

        • Pixel-based vs. Compositor-based Magnification.
        • Pixel-based:
       ...
Approaches to Screen Enhancement

        • Pixel-based magnification.




7 – 8 October 2010             ÆGIS 1st Interna...
Approaches to Screen Enhancement

        • Compositor-based:
        • Abstract description at a higher level than raw pi...
Approaches to Screen Enhancement

        • Compositor-based magnification.




7 – 8 October 2010            ÆGIS 1st Int...
GNOME Shell: Clutter


        • Clutter/mutter compositing window manager.
        • Stage metaphor.
        • Desktop is...
GNOME Shell Stage (basic)


        • Stage:




7 – 8 October 2010        ÆGIS 1st International Conference, Seville, Spa...
GNOME Shell Stage


        • Task Switcher:




7 – 8 October 2010         ÆGIS 1st International Conference, Seville, Sp...
GNOME Shell Stage (basic)


        • Stage:




7 – 8 October 2010        ÆGIS 1st International Conference, Seville, Spa...
GNOME Shell Stage (with magnifier)


        • Stage:




7 – 8 October 2010         ÆGIS 1st International Conference, Se...
GNOME Shell Magnifier


        • Can leverage compositing capabilities of Clutter to enhance
            the screen.
    ...
GNOME Shell: D-Bus


        • Interprocess communication
              – One process can call another.
              – An...
GNOME Shell: User Preferences


        • Configuration Management
              – Load and store preferences.
           ...
User Preferences: Mouse


        • Mouse Tracking
              – Centred.
              – Proportional.
              – ...
User Preferences: Screen Position


        • Screen Position
              – Full.
              – Top Half of Screen.
  ...
User Preferences: Magnification Factor


        • Magnification Factor
          – UI constrained from 1x through 10x .
 ...
User Preferences: Cross hairs


        • Cross hairs
           – Colour.
              – Opacity
                 • Comp...
User Preferences: Lens


        • Lens mode
              – The magnified view follows the mouse.
              – Like a ...
User Preferences




7 – 8 October 2010         ÆGIS 1st International Conference, Seville, Spain   21
Future Work


        • Colour inversion.
        • Brightness levels.
        • Contrast.
        • Multiple Screens.
   ...
Conclusions


        • Magnification built into next GNOME desktop.
        • Supports typical screen magnification/enhan...
The GNOME Shell Magnifier


        • GNOME Shell:
              – http://live.gnome.org/GnomeShell
        • GNOME Shell ...
Upcoming SlideShare
Loading in …5
×

The GNOME Shell Magnifier: Adding built-in magnification to the GNOME Shell desktop.

1,556 views

Published on

Inclusive Design Research Centre (IDRC) at Ontario College of Art & Design (OCAD)

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,556
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The GNOME Shell Magnifier: Adding built-in magnification to the GNOME Shell desktop.

  1. 1. The GNOME Shell Magnifier: Adding Built-in Magnification to the GNOME Shell Desktop Joseph Scheuhammer, Jorge Silva, Jan Richards Inclusive Design Research Institute OCAD University 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain
  2. 2. GNOME Shell • New window and desktop manager for GNOME 3. • High Level: – Application and window switching. – Workspace manager. – Find and launch Applications. • Lower Level: – A compositing window manager. – 2D effects such as transparency and animation. – Leverages “Clutter”, scene-based representation of the desktop. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 2
  3. 3. GNOME Shell Technologies • Clutter – Compositing. • D-Bus – Interprocess communication. • GSettings – Preferences storage, retrieval, modifications, and immediate response to preference changes. • A lot of available “power”. • How to leverage? • One way: magnification and screen enhancement. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 3
  4. 4. Approaches to Screen Enhancement • Pixel-based vs. Compositor-based Magnification. • Pixel-based: – Grab a region of pixels. – Transform them in some way (e.g., magnify). – No concept of “objects” – just a region of dots. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 4
  5. 5. Approaches to Screen Enhancement • Pixel-based magnification. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 5
  6. 6. Approaches to Screen Enhancement • Compositor-based: • Abstract description at a higher level than raw pixels. • “Objects” – Sprites, textures, layers, groups of objects. – Object properties (e.g., colour, transparency). 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 6
  7. 7. Approaches to Screen Enhancement • Compositor-based magnification. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 7
  8. 8. GNOME Shell: Clutter • Clutter/mutter compositing window manager. • Stage metaphor. • Desktop is the stage. • Windows, buttons, menus, icons are “actors”. • Actors can be atomic – contain no other actors. • Actors can be group, or containers of other actors. – Groups can contain atomic or other group actors. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 8
  9. 9. GNOME Shell Stage (basic) • Stage: 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 9
  10. 10. GNOME Shell Stage • Task Switcher: 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 10
  11. 11. GNOME Shell Stage (basic) • Stage: 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 11
  12. 12. GNOME Shell Stage (with magnifier) • Stage: 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 12
  13. 13. GNOME Shell Magnifier • Can leverage compositing capabilities of Clutter to enhance the screen. • Magnifier is itself an actor. • Magnification is not an add-on but an intrinsic function of the desktop. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 13
  14. 14. GNOME Shell: D-Bus • Interprocess communication – One process can call another. – Another application can invoke the magnifier. • Onscreen keyboard (GOK) – E.g., as focus is placed on a key that represents a menu item, show an enhanced version of that menu item. – Provides better context. • Orca Screen Reader – As user navigates UI, Orca asks for a magnified view of what has focus. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 14
  15. 15. GNOME Shell: User Preferences • Configuration Management – Load and store preferences. – Modify preferences. – *Respond to changes in preferences as they happen. • Currently – Mouse tracking. – Screen position. – Magnification factor. – Cross hairs. – “Lens Mode”. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 15
  16. 16. User Preferences: Mouse • Mouse Tracking – Centred. – Proportional. – Push. – None. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 16
  17. 17. User Preferences: Screen Position • Screen Position – Full. – Top Half of Screen. – Left Half. – Right Half. – Bottom Half. – Arbitrary or User defined. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 17
  18. 18. User Preferences: Magnification Factor • Magnification Factor – UI constrained from 1x through 10x . – Technically, less than 1 through very large • could act as a minifier. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 18
  19. 19. User Preferences: Cross hairs • Cross hairs – Colour. – Opacity • Completely transparent through opaque. – Thickness. – Length. – Clip near centre • If cross hairs interfere with mouse image. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 19
  20. 20. User Preferences: Lens • Lens mode – The magnified view follows the mouse. – Like a movable magnifying glass. – Interacts with mouse tracking modes. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 20
  21. 21. User Preferences 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 21
  22. 22. Future Work • Colour inversion. • Brightness levels. • Contrast. • Multiple Screens. • Quick access for magnification – Keystrokes to increase/decrease magnification. – Mouse scroll wheel. • Enhance accessible objects – e.g., Toolbar. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 22
  23. 23. Conclusions • Magnification built into next GNOME desktop. • Supports typical screen magnification/enhancement features. • Compositor-based leads to other ways to enhance the desktop. 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 23
  24. 24. The GNOME Shell Magnifier • GNOME Shell: – http://live.gnome.org/GnomeShell • GNOME Shell Magnifier: – http://live.gnome.org/GnomeShell/Magnification 7 – 8 October 2010 ÆGIS 1st International Conference, Seville, Spain 24

×