56 o oo ccf_final

514 views

Published on

Project number: 224348
Project acronym: AEGIS
Project title: Open Accessibility Everywhere: Groundwork, Infrastructure, Standards
Starting date: 1 September 2008
Duration: 48 Months
AEGIS is an Integrated Project (IP) within the ICT programme of FP7

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

56 o oo ccf_final

  1. 1. Graphic Symbol Support inOpen/LibreOffice Shaping UpGraphic Symbol Server and Inline Symbol Font Display Based on the CCF (Mats Lundälv, SU-DART) AEGIS Workshop and International Conference, Brussels
  2. 2. Symbol Supported Writing and Reading in LO/OO Writer● The rationale for this work and how its done● Primary and secondary target user needs● Current state: How the needs are met● The technology behind it● What the pilot testers say● Where were going from here – within and beyond AEGIS – conclusions AEGIS Workshop and International Conference, Brussels
  3. 3. Symbol Supported Writing and Reading in LO/OO Writer – the RationaleInclusive Multi-modal Language SupportThe Concept Coding Framework (CCF) multi-modaland multilingual support in a free standard officesuite offers a truly inclusive productive environmentfor a wide range of users and needs, e.g.: ● Early literacy or second language learning ● Cognitive impairments resulting in reading and writing difficulties and/or need for AAC ● Supporting the facilitators AEGIS Workshop and International Conference, Brussels
  4. 4. Target Personas – Jane, an AAC UserJane uses a voca with a symbol display and voiceoutput to communicate. Shed like to use a standardoffice application to create and read documentsbased on her symbol communication skills. AEGIS Workshop and International Conference, Brussels
  5. 5. Target Personas – Adam, a User with CIAdam reads and writes some, but is limited to short andsimple texts. Graphic symbol representation – in addition tospeech – will help him interpret and type more demandingwords and text – and may also help to give him basicaccess to the content of some English text . AEGIS Workshop and International Conference, Brussels
  6. 6. Symbol Supported Writing and Reading in LO/OO WriterWriting and reading with symbols displayedoutside text helps comprehension and spelling No symbol insertion in text: The CCF Symbol Server displays looked-up concepts and symbols (ARASAAC + Bliss) as words are written, and/or as the text cursor is moved in the text AEGIS Workshop and International Conference, Brussels
  7. 7. Writing with full AAC (Blissymbol) support Writer with CCF Symbols and SAW AEGIS Workshop and International Conference, Brussels
  8. 8. Helpers producing symbol materialMixed mode document – b&w symbol fonts,as well as colour graphics insertion in text AEGIS Workshop and International Conference, Brussels
  9. 9. Concept Coding Options dialog AEGIS Workshop and International Conference, Brussels
  10. 10. The CCF Symbol Support Desktop Package1) The CCF Symbol Server application (with its language and symbol database resources), and2) The CCF Symbol Support Extension for Writer AEGIS Workshop and International Conference, Brussels
  11. 11. CCF – the Concept Coding Framework … what is that? AEGIS Workshop and International Conference, Brussels
  12. 12. CCF - Architecture CCF CCF Assisted Technologies (Proprietary) Concept Code Definitions (CCD)WordNet CCF Bridge Assistive Bridge Assistive Ontology Base Complementary Reference Reference Ontology (BRO) Ontology (CRO) Assistive Database AEGIS Workshop and International Conference, Brussels
  13. 13. CCF - Architecture AEGIS Workshop and International Conference, Brussels
  14. 14. Pilot Testers and Experts - FeedbackAppreciated as an already fully usable and valuableapplication for a wide range of users and user needs. Thosesuggested by users, tutors and experts include:● AAC symbol users, as a tool for communication, writing and reading – typically supported by additional AT such as on- screen symbol charts for input, and text-to-speech (TTS) feedback● Users with cognitive disabilities of different kinds, rendering a need for anything from extensive to occasional graphical symbol feedback for functional reading and writing – typically in combination with TTS● Temporary support in early stages of second language learning● Mainstream use for early literacy introduction AEGIS Workshop and International Conference, Brussels
  15. 15. Advantages and disadvantages compared to competitive alternativesMain listed advantages and disadvantages in relation toexisting commercial software with corresponding functionality(e.g. the Widgit Communicate: series) include:Advantages:● Standard office software base with freely available extended functionality – accessible across a wider range of socio-economic circumstances and environments (school, home, public, private)● Cross-platform availability (Windows, Mac OS X and Linux/Unix)● Based on openly defined technologies and open-source software (allowing novel integration and innovation in a longer perspective) AEGIS Workshop and International Conference, Brussels
  16. 16. Advantages and disadvantages compared to competitive alternativesMain listed advantages and disadvantages in relation toexisting commercial software with corresponding functionality(e.g. the Widgit Communicate: series) include:Disadvantages:● Functionality and UI design less tailored (and tailorable) to some special needs requirements● Less sophisticated language technology and vocabulary support compared to the most advanced proprietary alternatives (though in parity to, or beyond, several other)● Possible issues in relation to future maintenance and support AEGIS Workshop and International Conference, Brussels
  17. 17. Remarks on existing or missing features of the second alpha versionGeneral comments:● Good progress since previous first alpha vesion● Need for simplifications of management – e.g. installation, manual handling of the separate CCF Server window etc.● Saving, restoring and sharing of Open Document Text (ODT)i documents with concept coded content and included symbol representations.● Limitations of the vocabulary resources, requested improvements.● Also expressed an understanding and acceptance of limitations as a trade-off for the advantages of the free and wide availability.● Stressed importance of clear information about functionality and limitations, to create realistic expectations among potential users. AEGIS Workshop and International Conference, Brussels
  18. 18. Remarks on existing or missing features of the second alpha versionSpecific comments:● Highly appreciated the ”out-of-text” symbol display. However, they requested improvements in the management of the CCF Symbol Server display. Suggested solutions included: ● The CCF server display window floating on top of all other windows – ideally with an option to let the symbol display follow the text insertion caret in the Writer document ● The symbol display being moved into the Writer window as a floating or docked display panel (similar to the ”Navigator” etc. panels)● Appreciation the Ruby Annotation display of symbols over their corresponding words. However, they regret the loss of colour in the ARASAAC● A specific request has been: ● Option to control the background colour of the symbols, which by some evaluators was now thought to be in a slightly too dark shade of blue-gray AEGIS Workshop and International Conference, Brussels
  19. 19. Remarks on existing or missing features of the second alpha versionSpecific comments:● Great with Ctrl+G keyboard shortcut to select preferred representation, but users and experts also wanted to be able to select by pointing and clicking● Swap the original word to a new custom one accompanying the same symbol, e.g. replacing the word ”dog” under a dog symbol with ”Pluto”● Specific requests for improvements of the word-concept-symbol look-up included: ● Better priority (based on frequency and probability) for first choice among concept alternatives ● Capability to handle two word (and potentially multi word) i.e. Suggestion of matching concepts and symbols while typing a word (and not only after completing the word with Space, as now)● The obvious requests for support of more text languages and other preferred symbol libraries AEGIS Workshop and International Conference, Brussels
  20. 20. Conclusions and Future PlansBased on the input from the first and second pilot tests,and the revised user needs and requirementsspecifications, a number of issues will be addressed:● Usability and UI enhancements: ● Smoother integration of the CCF Symbol Server and the OO/LO Writer extension, including: ● Automatic start of the CCF server, if its not running, when called from the extension ● CCF server symbol display window always floating on top, possibly with text cursor/caret following, alternatively adding a symbol display panel to the extension for presentation within the Writer window ● Selection of preferred concept-symbol representation by point and click (in addition to the current shortcut key command) ● Easier access to the settings panel, better grouping of the settings options, and improved design of the the toolbar panel AEGIS Workshop and International Conference, Brussels
  21. 21. Conclusions and Future Plans… more issues and requests to be considered:● Functional enhancements: ● Providing an option for the user to change text word for a symbol represented concept ● Support for two word (possibly three word) concept-symbol look-up (e.g. “all right” and “to go” to be joined to one concept representation) ● Possibly providing word-concept-symbol “prediction” (while typing) AEGIS Workshop and International Conference, Brussels
  22. 22. Further perspectives (some beyond the Writer extension and AEGIS)Within the scope of AEGIS:● The CCF ontologies and databases used by the CCF Symbol Server will be in need for continuous upgrades on several levels: ● Current resources need to be maintained in short term perspective with: ● improvements of the representational databases (in particular for ARASAAC symbols) ● improvements of lexical support for English and Swedish with better coverage, higher hit rate for most probable concept, support for multi-word concepts, etc. ● Additional basic support for Spanish and Dutch is underway ● A more strictly controlled and longer term re-build of the CCF ontologies as part of the employment of the CCF technology for the AAC app for Android● Special Access to Windows (SAW) will be upgraded to support integration with the CCF Symbol Server● The CCF Symbol Server is already used as an online cloud server for the provision of vocabulary resources for the first prototype of the Android AAC app AEGIS Workshop and International Conference, Brussels
  23. 23. The same open and free CCF technology applied for AAC on the mobile device AEGIS Workshop and International Conference, Brussels
  24. 24. Further perspectives (some beyond the Writer extension and AEGIS)The longer term CCF perspectives:● The work to integrate the CCF technology, as well as the graphic language of Blissymbolics, as part of the ISO TC 37 multi-modal terminology standards, has been initiated within the AEGIS project. As this is a longer term task, it will continue far beyond the duration of the project.● The general maintenance of the CCF vocabulary resources is basically a never-ending task of refinement of the support for the current languages and representational resources, and the subsequent addition of new ones.● The above tasks will in turn require maintenance and further development of the exploitation and business plans which are in progress as part of the AEGIS work. AEGIS Workshop and International Conference, Brussels
  25. 25. Final conclusions● The CCF Symbol Support Extension for OpenOffice/LibreOffice is in preparation for its beta release in early 2012.● This will provide a new basic level support for access to text content, and a new and wider range of opportunities to communicate for people with cognitive, speech and language impairments, and for those with multiple impairments.● Likely to be appreciated by wider groups of users in general, in particular in connection to early literacy and second language introduction.● Opens up new perspectives for providing more inclusive accessible ICT environments – for people in general, across socio-economic conditions, and for users with more challenging needs due to a wide range of impairing conditions.● This will not replace the need and space for dedicated ICT products in this area, but will serve as a complementary basic and more widely available entry level for this kind of language support.● AEGIS Workshop and International Conference, Brussels
  26. 26. Users in actionFrom Anna (tutor – in translation)“Hi!Ive tested the OpenOffice ext with one of ourstudents who comes to our school here oncea week. She was so happy when she coulduse her SAW on-screen-keyboard to writewith blissymbols...”To the right, the attached first produced blissymbol andtext document “Natalie goes to a party” (variation overCinderella)User at home with SAW + LO/OO Writer AEGIS Workshop and International Conference, Brussels

×