My unfunded projects WAI talk


Published on

My unfunded projects WAI talk.

this talk describes three as-of-yet unfunded projects:
1. LAVAIK: interacting with IATI Linked Data
2. ICONS: Icon based user interaction for mobile phones in developing countries
3. the Dance project with all kinds of names

Published in: Education, Technology
1 Like
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • After Babel (1975)  is a comprehensive study of the subject of language and translationtual challenge proved beyond his capacities. The actual themes range widely and defy conventional taboos: the torment of the gifted when they live among-when they confront-the very great; the experience of sex in different languages; a love for animals greater than for human beings; the costly privilege of exile; a theology of emptiness. Yet a unifying perception underlies this diversity. The best we have or can produce is only the tip of the iceberg. Behind every good book, as in a lit shadow, lies the book which remained unwritten, the one that would have failed better.
  • Spice this upRelate this to w4ra
  • Sensing: The environment can be used in different stages of the choreography process. The choreographer can start with a semi-finished dance piece or only have a few dance phrases. The ambient environment detects the current choreography through computer vision, pressure sensors in floor and walls or other modalities. The existing choreography or parts of it are translated into a higher level dance representation language. Creative Reasoning: The current choreography is transferred to the creative reasoning engine in real time. Here, variations on the choreography are generated. This tool can produce new choreography parts varying spatial positioning, the number of performers, variations of dance phrases, repetitions of dance phrases and differences in expressions of movements. Background knowledge about similar or completely different choreographies as well as different dance styles can also be used to modify the choreography. This background knowledge is also stored in the higher level representation language. All operations on the current choreography can be determined by the user, but a more serendipitous use of the tool is also possible. Multiple variations of one choreography can be generated at the same time. Presentation: These newly generated choreographies are then presented to the choreographer. For this, 3-D video images of the new choreographies are projected on the walls of the environment. In this manner, the dancer/choreographer can absorb the variations while moving around the environment and he/she can choose to copy entire dance phrases or incorporate only parts of the suggestions. The ambient environment will detect the new movements in real time, creating a creative closed loop where choreographer and the environment work together to create a new dance piece. The tool can also be used offline. The tool then provides the choreographer with an in depth analysis of the current choreography through a dancer-friendly interface.
  • Al these systems very academic, can be read by a few, mostly used for archival purposes
  • Already more at normal level of dancer communication
  • My unfunded projects WAI talk

    1. 1. My Unfunded Projects Victor de Boer WAI meeting 21-10-2013 img: Flickr/Kalexanderson
    2. 2. My Unfunded Projects 1. LaVAIK: Linking and Visualising Aid information Kit 2. ICONS 3. Dance project
    3. 3. 1. ICONS: Interaction design for lowliteracy communities
    4. 4. • Integrate local community radios and mobile ICT for knowledge sharing • Better support and integrate local languages in voicebased services – Development of appropriate speech elements (textto-speech and Speech recognition) • Develop a free and open source toolbox for local developers. – Investigate self-sustainability – Develop appropriate business models – In collaboration with local communities.
    5. 5. Feature phones
    6. 6. Icon-based interaction
    7. 7. Icon-based interaction NCR ATM interface for illiterate 'grammar' - ISOTYPE by Otto Neurath available at
    8. 8. ICONS
    9. 9. What happened? • FP7-ICT-2011-9 – – – – International partnership building and support to dialogues April 2012 Particip Participant organisation name Country ant 10 partners 1 (c) GEIE ERCIM France 2 (sci.c.) World Wide Web Foundation Switzerland 104 pages 3 4 • Did not pass first round – Not detailed enough on Req elicitation methodology – Management structure / budget issues Telecom 5 Council for Scientific and Industrial Research VU University Amsterdam Neth. 6 Sahel Eco Mali 7 Université Cheikh Anta Diop de Dakar Senegal 8 Di Maquina UK 9 VU University Amsterdam Neth. 10 Nokia Finland
    11. 11. LaVAIK: LINKING AND VISUALISING AID INFORMATION KIT • International Aid Transparency Initiative (IATI) “IATI is a voluntary, multi-stakeholder initiative that seeks to improve the transparency of aid in order to increase its effectiveness in tackling poverty.” • IATI registry (190+ organisations) – “IATI Data Registry, the place to find IATI raw data in XML format.”
    12. 12. IATI Stakeholders • • • • Funders o Where is the money of my organisation spent? o Where do other organisations spend their money? Governments o How much money is spent in my country? o What are the budgets or planned disbursements for my country? Public o Where is my tax money going? o What are the organisations doing with my donations? Locals o What organisations are working in my area? o What projects are currently going on in my area?
    13. 13. Linked Data for IATI Kasper Brandt, MSc Artificial Intelligence 1. A IATI Linked Data model is created based on requirements elicited from interviews with experts. 2. Datasets are linked to the Linked Data model based on IATI experts’ needs. 3. Linked Data applications are created, showing that linking IATI data adds value to the data and is able to fulfill the needs of IATI users. 4. Our approach and requirements are reusable for converting an open dataset to a Linked Data model in general
    14. 14. Linked Data model - Triple store Python • • • RDFLib Triples loaded into a ClioPatria triple store: o o Sparql endpoint – Dereferenceable URIs (!) ( Total number of triples: 36,629,017 Total number of named graphs: 4,790 o Largest activities graph is UNOPS containing 1,231,896 triples RDF/Turtle
    15. 15. Linking datasets
    16. 16.
    17. 17. Project goals Inst. of Development Studies LOD Sahel Pluvial data UN HAbitat 1. We will convert all the IATI datasets available to Linked Data. 2. Convert related open datasets and indicators from UNHabitat, Worldbank and OECD to Linked Data. 3. Citizen Journalism data Worldbank OECD Generate contextualized links between produced datasets as well as existing datasets on the Web of Data. – – 4. Link to Landportal Link to local (Malian) rainfall / market data Provide a web-based toolkit for multimodal and interactive access to the enriched Linked Aid Data. RadioMarché Linked market data Web interface IATI data
    18. 18. What happened? • Grand Challenges Round 11 – Increasing Interoperability of Social Good Data – 3 pages – 4 partners: • • • • VU DANS (Christophe) Zimmerman & Zimmerman Akvo • 2700 proposals!
    19. 19. 3. Dance project (EXMO, EM2)
    20. 20. Proposal: choreography assistant tool Choreography Representation Presentation generation + Sensing Reasoning Sensing data Choreography variation Presentation • Motion detection • Dance movement representation • Visual presentation • Floor sensors • Dance choreography representation • 3-D animation • Move recognition • Use of background knowledge • Auditory presentation • Pattern detection • Choreography generation
    21. 21. Sensing • Motion capture – Marker-based – Marker-less • Joint rotations, limb positions etc. – unintuitive • Backup: Video annotation img:
    22. 22. Representation languages of human movement: Labanotation
    23. 23. Labanotation
    24. 24. LabanXML and Laban Editor Nakamura & Hachimura (2006) LED Labanotation editor
    25. 25. Dance Forms
    26. 26. Benesh
    27. 27. Cecchetti system • 7 elementary movements: [plie (bend), etandre (stretch), releve (rise), sauter (jump), glisse (glide), tourne (turn), elancer (dart)] • Positions: 1st, 2nd, 3rd,.. (left right croise) • Facing position (1…8) • Position in space • Direction of movement (de cote, dessous, dessus, en avant, en arriere, devant, derriere) • Combinations (100+) pas-dechat, pas-de-bourre, piroutte Based on interview with Marije Koning
    28. 28. XML Dance Grammar Balakrishnan Ramadoss and Kannan Rajkumar. Modeling the Dance Video Semantics using Regular Tree Automata Fundamenta Informaticae 86 (2008) 175–189 175 IOS Press
    29. 29. Representation and Reasoning • Multi-tiered model – Low-level image features – Atomic movements (Labanotation?) – Compound movements (100+ movements) – Emotional content, Socio-cultural layers etc. • Machine Learning for classification and pattern detection – Generative module (automatic choreographer)
    30. 30. Presentation
    31. 31. What happened? 1st try: – FP-7 Future and Emerging Technologies Open Scheme (FET Open) • nov 2011 – VUA, UvA (Frank Nack), School of Interactive Arts and Technology – SFU California, Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur , Palindrome, Unige – Not accepted (High impact?) 2nd try: More healthcare oriented (VU movement science) 3rd try: NWO Creatieve industrie (2012) – VU, UVA, Utwente (Vanessa Evers, Ronald Poppen, Dirk Heylen) – Industry partner… 4th try?
    32. 32. So… • Not every project gets accepted  – Re-use some components for talks • None of these is really dead – If you’re interested in any one of these, come talk to me 