Con-Action Project Midterm Presentation
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Con-Action Project Midterm Presentation

on

  • 2,900 views

The Midterm Presentation of the Con-Action project represents the combined effort of all 20 members of the Digital Media Master projects DaVisMo (data visualization and student mobility) and Confetti ...

The Midterm Presentation of the Con-Action project represents the combined effort of all 20 members of the Digital Media Master projects DaVisMo (data visualization and student mobility) and Confetti (embodied conversational agents) in 2009/2010 at the University of Bremen and the University of the Arts Bremen in Germany.

The accompanying videos can be found at: http://vimeo.com/channels/digitalmedia

Statistics

Views

Total Views
2,900
Views on SlideShare
2,893
Embed Views
7

Actions

Likes
0
Downloads
7
Comments
0

1 Embed 7

http://confetti.informatik.uni-bremen.de 7

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial LicenseCC Attribution-NonCommercial License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Con-Action Project Midterm Presentation Presentation Transcript

  • 1. University of Bremen University of the Arts Bremen A combined proposal of the master projects Data Visualization and Student Mobility (DaVisMo) and Embodied Conversational Agents (Confetti) November 2009
  • 2. DaVisMo & Confetti A combined proposal of the master projects Data Visualization and Student Mobility (DaVisMo) and Embodied Conversational Agents (Confetti)
  • 3. DaVisMo & Confetti Concept (video)
  • 4. Methodology Learning by doing Problem identification -> Resolve -> Evaluate -> try again
  • 5. Database and Data API
  • 6. Database Different data sources: Data Sources • Int’l Offices Database Schema • Web Design the data schema based on the data found Transform all the data from the data sources into a single format (CSV)
  • 7. Data API Database Schema Easy access to Data API database for data visualization Mapping database schema to Java objects
  • 8. Data Mining Data API includes Data Mining methods Data Mining: extracting patterns from data Using Weka-API for Data Mining
  • 9. Data Mining Using Data Mining algorithm „Association“ Screen shot: http://www.amazon.com/
  • 10. Data Mining Destination country =LIECHTENSTEIN 133 ==> Home country =GERMANY 32 acc:(0.23805) Destination country =LUXEMBOURG 127 ==> Home country indicator=GERMANY 22 acc:(0.16204) Destination country=LIECHTENSTEIN 133 ==> Home country indicator=HUNGARY 15 acc:(0.11425)
  • 11. Future goals • API already finished • Finish Data Mining methods of Data API • Add additional socioeconomic data to the database • Find more interesting patterns
  • 12. DaVisMo & Confetti
  • 13. Data Visualization
  • 14. DaVisMo & Confetti
  • 15. User Requirement Research
  • 16. the Concept The requirements governing the project’s deliverable or product as expressed by the users. Address what users need to do their jobs. (Steve; Bryan, 2000)
  • 17. the Research Main target users: International Students & International Offices What we are looking for: – Their needs – Their interaction with websites on education
  • 18. the Research Method Qualitative Research (triangulation methodology) 1. Interviews 2. Online Research Case studies
  • 19. 1. Interviews • Interview with International & Administration Officers – HfK International Office – HfK Administration Office – Uni Erasmus Incoming Students’ Office • Interview with international students – 11 students form 6 continents
  • 20. 1. Interviews the Questions: – How they get the information – Opinions on existing Websites – Impressions and expectations on Data Visualization
  • 21. 1. Interviews Opinions on Existing Websites
  • 22. 1. Interviews OPINIONS on Existing Websites Positive Negative
  • 23. 1. Interviews OPINIONS on Existing Websites Positive Negative - Easy to navigate - Well structure, good colors - Complete contact address and links - Provide search function - Provide complete information
  • 24. 1. Interviews OPINIONS on Existing Websites Positive Negative - Easy to navigate - Hard to find information - Well structure, good colors - Bad structure - Complete contact address and - Distracting colors links - Some information only in - Provide search function native language - Provide complete information
  • 25. 1. Interviews EXPECTATIONS on Data Visualization Int’l Offices Int’l Students - Contain all the information, - Detailed information should be clear, - Colorful - Need to be compare with - Moving/blinking objects something, - Interactive - Little kilobyte is requested, - Background article about - Too technical, too Easy to the graphic complicated, distracting understand - Not too crowded should be avoid, - Easy to understand - Long text is not good, - Links to other Websites - Simple structure, - Easy to understand
  • 26. 2. Online Research Content Analysis: – Social Networks – TOP 25* European International Offices’ Websites * According to the visibility on the internet ranking (www.webometrics.info/index.html)
  • 27. 2. Online Research – Social Networks
  • 28. Students’ Pattern: Help to Country Decision 1. No idea: no clue, just About the country want to study abroad Course suggestion What to study Faculties & Institutes COUNTRY Course catalogue -Cultural aspects Degree programs About the country Information about everyday life Share experiences Contact Student Exchanges City suggestion Discussion Forum Testimonials FIRST APPROACH Prospective students Future students
  • 29. Students’ Pattern: COUNTRY -Cultural aspects -Tuition feeAbout the country Information about everyday life -Recommendation letter 1. No idea: no clue, just Help to Country Decision About the country want to study abroad -Professor’s guidance Course suggestion CareersWhat to study advise Faculties & Institutes -Life quality Course catalogue Work environment Degree programs 2. Some idea: knew - at -Language difficulties least one criteria - country, -Job Share experiences university, course or are Requirements to get a job Contact Student Exchanges Discussion Forum following the application Testimonials process Why this university? City suggestion Faculties & Institutes Curriculum structure -Living expenses -Visa Budgets and costs of living -Health insurance students FIRST APPROACH Prospective Meals and shopping Medical facilities Future students
  • 30. Students’ Pattern: COUNTRY -Cultural aspects About the country -Romance and relationshipHelp to Country Decision Information about everyday life 1. No idea: no clue, just Date About the country want to study abroad Study fields suggestions COUNTRY -Life quality Friends Curriculum structure Course suggestion What to study Faculties & Institutes -Language difficulties -Job opportunities Socialprograms Study behavior Course catalogue 2. Some idea: knew - at Requirements to get a job Choosing a program -Travel partners FINANCIAL -TV Degree programs All courses Undergraduate least one criteria - country, Bachelor program -Living expenses -Bank account Postgraduate Budgets and costs of living Meals and shopping -Delivery services Share experiences university, course or are Master program PhD opportunities Contact Student Exchanges following the application -Driving license Long courses -Internet Discussion Forum Medium courses University suggestions Testimonials process -Documents official translation Short courses Summer courses -Telephone Why this university? Faculties & Institutes Online & distance courses BUREAUCRACY City suggestion -Visa -Health insurance 3. Clear idea: finished the Medical facilities SOCIAL LIFE application, approved, just -Weather Leisure time Cultural tips Public services UNIVERSITY -University quality landed abroad Education quality Job opportunities -Cooking tips Events Art, culture -admission requirements -Application procedure Careers advise Work environment Libraries & Museums -Deadline -Duration & academic calendar -Recognized degree UNIVERSITY Recognition of qualifications FIRST APPROACH -Tuition fee -Scholarships Prospective students -Recommendation letter -English certification Future students -Professor’s guidance Tandem partner -Host family Studies in English Language of instruction -Flat mates
  • 31. Students’ Needs: COUNTRY -Cultural aspects -Romance and relationship About the country Date Information about everyday life Friends Social behavior Help to Country Decision -Travel partners About the country Curriculum structure Course suggestion What to study -Life quality Faculties & Institutes -Language difficulties Course catalogue -Job Degree programs Requirements to get a job Choosing a program All courses -Living expenses Undergraduate Budgets and costs of living Bachelor program Meals and shopping Share experiences Postgraduate Contact Student Exchanges Master program -TV Discussion Forum PhD opportunities -Bank account Testimonials Long courses -Delivery services Medium courses Why this university? -Internet Short courses Faculties & Institutes -Telephone Summer courses Online & distance courses City suggestion -Visa -Health insurance -Driving license Medical facilities -Documents official translation Leisure time Cultural tips -University quality Events Education quality -admission requirements Careers advise -Weather Art, culture Work environment -Cooking tips Libraries & Museums -Application procedure -Deadline -Duration & academic calendar -Recognized degree Recognition of qualifications FIRST APPROACH -Tuition fee -Scholarships Prospective students -Recommendation letter -English certification Future students -Professor’s guidance Studies in English Language of instruction -Host family -Flat mates Tandem partner Public services
  • 32. 2. Online Research – TOP 25* European Int’l Offices’ Websites 1 University of Cambridge - 2 University of Oxford - 3 Swiss Federal Institute of Technology ETH Zurich - 4 University College London - 5 University of Helsinki - 6 Norwegian University of Science & Technology - 7 University of Oslo - 8 Universität Wien - 9 Universidad Complutense de Madrid - 10 University of Edinburgh - 11 Università di Bologna - 12 University of Southampton - 13 Utrecht University - 14 Uppsala University - 15 Université Catholique de Louvain - 16 Freie Universität Berlin - 17 Université de Geneve - 18 Linkoping University - 19 University of Groningen - 20 Charles University - 21 Universität Hamburg - 22 Royal Institute of Technology - 23 Technische Universität Wien - 24 Lund University - 25 University of Amsterdam * According to the visibility on the internet ranking (www.webometrics.info/index.html)
  • 33. International Offices provide: ARRIVING Before arrival Welcome service ADVICES COUNTRY Upon arrival Orientation program -Cultural aspects First steps Counseling About the country First weeks Information & advice Information about everyday life First year Help to Country Decision About the country Main university regulation About the Int’l Office The collegiate system Address Curriculum structure Course suggestion Contact us What to study FAQ Faculties & Institutes Staff Course catalogue imprint Degree programs Erasmus incomings Choosing a program Erasmus outgoings All courses Exchanges -Living expenses Undergraduate Researcher exchange International collaboration Budgets and costs of living Bachelor program Researches and teachers Visiting students Meals and shopping Share experiences Postgraduate Free mover students Our visits overseas Contact Student Exchanges Master program Training and internships International mobility Discussion Forum Social institutions PhD opportunities Partnerships Testimonials Student association Long courses Mobility fund Student union Medium courses Why this university? Short courses Faculties & Institutes Summer courses Practical information Online & distance courses Guide orientation and A-Z Online services & search -Visa -Health insurance Studying with disability Medical facilities Students with special needs Leisure time Preparatory course Cultural tips -University quality Preparatory study Glossary Events Education quality Careers advise Newsletter Art, culture -admission requirements Work environment Special events calendar Information about swine flu Libraries & Museums -Application procedure Exams and lesson timetable Links -Deadline Grading, credits and exams -Duration & academic calendar Teaching methods -Recognized degree Recognition of qualifications FIRST APPROACH -Scholarships Sports Prospective students -English certification Video visual tour Public transport Future students Studies in English Visiting the university Language of instruction publications About the city Welfare services immigration Tandem partner Finance for international students Funding search
  • 34. International Offices provide: ARRIVING Before arrival Welcome service ADVICES COUNTRY Upon arrival Orientation program -Cultural aspects First steps Counseling About the country First weeks Information & advice Information about everyday life First year Help to Country Decision About the country Main university regulation About the Int’l Office The collegiate system Address Curriculum structure Course suggestion Contact us What to study FAQ Faculties & Institutes Staff Course catalogue imprint Degree programs Erasmus incomings Choosing a program Erasmus outgoings All courses Exchanges -Living expenses Undergraduate Researcher exchange International collaboration Budgets and costs of living Bachelor program Researches and teachers Visiting students Meals and shopping Share experiences Postgraduate Free mover students Our visits overseas Contact Student Exchanges Master program Training and internships International mobility Discussion Forum Social institutions PhD opportunities Partnerships Testimonials Student association Long courses Mobility fund Student union Medium courses Why this university? Short courses Faculties & Institutes Summer courses Practical information Online & distance courses Guide orientation and A-Z Online services & search -Visa -Health insurance Studying with disability Medical facilities Students with special needs Leisure time Preparatory course Cultural tips -University quality Preparatory study Glossary Events Education quality Careers advise Newsletter Art, culture -admission requirements Work environment Special events calendar Information about swine flu Libraries & Museums -Application procedure Exams and lesson timetable Links -Deadline Grading, credits and exams -Duration & academic calendar Teaching methods -Recognized degree Recognition of qualifications FIRST APPROACH -Scholarships Sports Prospective students -English certification Video visual tour Public transport Future students Studies in English Visiting the university Language of instruction publications About the city Welfare services immigration Tandem partner Finance for international students Funding search
  • 35. Where the requirements are fulfilled: ARRIVING Before arrival Welcome service ADVICES COUNTRY Upon arrival Orientation program -Cultural aspects First steps Counseling -Romance and relationship About the country First weeks Information & advice Date Information about everyday life First year Friends Social behavior Help to Country Decision -Travel partners About the country Main university regulation About the Int’l Office The collegiate system Address Curriculum structure Course suggestion Contact us What to study FAQ -Life quality Faculties & Institutes Staff -Language difficulties Course catalogue imprint -Job Degree programs Requirements to get a job Erasmus incomings Choosing a program Erasmus outgoings All courses Exchanges -Living expenses Undergraduate Researcher exchange International collaboration Budgets and costs of living Bachelor program Researches and teachers Visiting students Meals and shopping Share experiences Postgraduate Free mover students Our visits overseas Contact Student Exchanges Master program Training and internships International mobility -TV Discussion Forum Social institutions PhD opportunities Partnerships -Bank account Testimonials Student association Long courses Mobility fund -Delivery services Student union Medium courses Why this university? -Internet Short courses Faculties & Institutes -Telephone Practical information Summer courses Online & distance courses Guide orientation and A-Z City suggestion Online services & search -Visa -Health insurance Studying with disability -Driving license Medical facilities Students with special needs -Documents official translation Leisure time Preparatory course Cultural tips -University quality Preparatory study Glossary Events Education quality Careers advise Newsletter -Weather Art, culture -admission requirements Work environment Special events calendar Information about swine flu -Cooking tips Libraries & Museums -Application procedure Exams and lesson timetable Links -Deadline Grading, credits and exams -Duration & academic calendar Teaching methods -Recognized degree Recognition of qualifications FIRST APPROACH -Tuition fee -Scholarships Sports Prospective students -Recommendation letter -English certification Video visual tour Public transport Future students -Professor’s guidance Studies in English Visiting the university Language of instruction publications About the city -Host family Welfare services -Flat mates immigration Tandem partner Finance for international students Public services Funding search
  • 36. What some students take as priority: ARRIVING Before arrival Welcome service COUNTRY ADVICES Upon arrival Orientation program -Cultural aspects First steps First weeks Counseling -Romance and relationship About the country Information & advice Date First year Information about everyday life Friends Help to Country Decision ADMINISTRATIVE INTERNATIONAL OFFICE Social behavior About the country Main university regulation About the Int’l Office -Travel partners Study fields suggestions The collegiate system Address COUNTRY Curriculum structure Course suggestion Contact us -Life quality What to study FAQ -Language difficulties Faculties & Institutes Staff -Job opportunities Course catalogue imprint FINANCIAL STUDENT MOBILITY Requirements to get a job Degree programs Citizen registration Choosing a program -Living expenses Erasmus incomings Erasmus outgoings All courses Undergraduate Budgets and costs of Exchanges Researcher exchange INTERNATIONAL RELATIONS International collaboration SERVICES Bachelor program Postgraduate living Share experiences Contact Student Exchanges Researches and teachers Free mover students Visiting students Our visits overseas CONNECTION -TV -Bank account Master program PhD opportunities Meals and shopping Forum Discussion Testimonials Training and internships International mobility Partnerships Social institutions Student association Long courses University suggestions Mobility fund -Delivery services Student union -Internet Medium courses Why this university? START POINT -Telephone Short courses Faculties & Institutes Practical information Summer courses Guide orientation and A-Z BUREAUCRACY City suggestion Online & distance courses -Visa Online services & search STUDENTS Studying with disability BUREAUCRACY -Health insurance -Driving license Medical facilities Students with special needs SOCIAL LIFE UNIVERSITY -Documents official translation Leisure time -University quality EDUCATION Preparatory course EXTRA GENERAL -Weather Cultural tips Education quality Job opportunities Careers advise Preparatory study Glossary Newsletter Events -admission requirements Work environment Special events calendar Information about swine flu -Cooking tips Art, culture -Application procedure Exams and lesson timetable Links -Special market Libraries & Museums -Deadline Grading, credits and exams Transportation & -Duration & academic calendar -Recognized degree Teaching methods UNIVERSITY Connection -Tuition fee Recognition of qualifications FIRST APPROACH Prospective students UNIVERSITY FACILITIES Sports -Recommendation letter -Professor’s guidance - Scholarships Future students Video visual tour Visiting the university Public transport -English certification publications Studies in English COUNTRY/CITY ACCOMODATION Language of instruction About the city -Host family Welfare services -Flat mates immigration Language GENERAL FINANCES Tandem partner Public services Finance for international students Taxes Funding search
  • 37. What some students said they can’t find: ARRIVING Before arrival Welcome service ADVICES COUNTRY Upon arrival Orientation program SOCIAL LIFE -Cultural aspects First steps Counseling -Romance and relationship About the country First weeks Information & advice Date Information about everyday life First year Friends Social behavior Help to Country Decision ADMINISTRATIVE -Travel partners About the country Main university regulation COUNTRY The collegiate system Study fields suggestions -Life quality Course suggestion Curriculum structure -Language difficulties What to study -Job Faculties & Institutes Course catalogue About the Int’l Office Address STUDENT MOBILITY us Requirements to get a job Study programs Degree programs Contact Erasmus incomings FAQ Choosing a program Erasmus outgoings - Citizen registrationcourses All FINANCIAL -Living expenses Exchanges Staff imprint INTERNATIONAL RELATIONS Undergraduate Researcher exchange International collaboration Budgets and costs of living Bachelor program Share experiences Researches and teachers Visiting students Meals and shopping Postgraduate Contact Student Exchanges Free mover students Our visits overseas SERVICES CONNECTION Master program -TV BUREAUCRACY -Bank account PhD opportunities Discussion Forum Training and internships International mobility Partnerships Social institutions Student association -Driving license Long courses University suggestions Testimonials Mobility fund -Delivery services Student union Medium courses Why this university? -Documents official -Internet -Telephone Short courses Faculties & Institutes START POINT Practical information Summer courses translation suggestion City Online & distance courses BUREAUCRACY Guide orientation and A-Z Online services & search STUDENTS -Visa Studying with disability -Health insurance Students with special needs GENERAL Medical facilities -Weather SOCIAL LIFE UNIVERSITY EDUCATION -Cooking tips Leisure time -University quality Preparatory course EXTRA Cultural tips Education quality Preparatory study Glossary -Special market Events -admission requirements Job opportunities Careers advise Newsletter Art, culture -Application procedure Special events calendar Information about swine flu -Transportation & Libraries & Museums -Deadline Work environment Exams and lesson timetable Links Grading, credits and exams connection -Duration & academic calendar Teaching methods -Recognized degree Recognition of qualifications FIRST APPROACH FACILITIES UNIVERSITY Sports -Scholarships Prospective students UNIVERSITY Video visual tour Public transport -English certification Future students Visiting the university -Tuition fee Studies in English Language of instruction publications COUNTRY/CITY -Recommendation letter About the city -Professor’s guidance ACCOMODATION Welfare services -Host family Language immigration GENERAL FINANCES -Flat mates Tandem partner Public services Finance for international students Funding search
  • 38. Students keep asking questions to Int’l Office, which answers are available in Websites.
  • 39. Students keep asking questions to Int’l Office, which answers are available in Websites. Why?
  • 40. Students keep asking questions to Int’l Office, which answers are available in Websites. Why? • They look for specific or personal answers
  • 41. Students keep asking questions to Int’l Office, which answers are available in Websites. Why? • They look for specific or personal answers • The information is not clear enough or does not meet the needs
  • 42. Students keep asking questions to Int’l Office, which answers are available in Websites. Why? • They look for specific or personal answers • The information is not clear enough or does not meet the needs • Not all information is available in English or it uses some native language terms
  • 43. Students keep asking questions to Int’l Office, which answers are available in Websites. Why? • They look for specific or personal answers • The information is not clear enough or does not meet the needs • Not all information is available in English or it uses some native language terms • It is faster to ask directly • They prefer the human interface
  • 44. Considering All… What can we offer to the target users?
  • 45. Considering All… What can we offer to the target users? • All information in the same place
  • 46. Considering All… What can we offer to the target users? • All information in the same place • Deep, trustful and unique information
  • 47. Considering All… What can we offer to the target users? • All information in the same place • Deep, trustful and unique information • International language (English)
  • 48. References for User Requirements Universities web sites: Social Networks: www.admin.cam.ac.uk/offices/international/ Facebook – www.facebook.com www.ox.ac.uk/admissions/international_students/index.html My Space – www.myspace.com www.ethz.ch/prospectives/index_EN Orkut – www.orkut.com www.ucl.ac.uk/prospective-students/international-students/ Linkedin – www.linkedin.com www.helsinki.fi/international/ Just Landed - www.justlanded.com www.ntnu.no/studies www.uio.no/english/student_life/ www.ucm.es/centros/webs/en/index.php?tp=International%20Context&a=dir4&d=17747.p Theoretical reference: hp www.ed.ac.uk/studying/international “An Introduction to Content Analysis,” www.eng.unibo.it/PortaleEn/Students/International+Students/default.htm http://writing.colostate.edu/guides/research/content/pop2a. www.soton.ac.uk/international/index.shtml cfm. [last access 21/07/2009] www.uu.nl/EN/INFORMATIONFOR/INTERNATIONALSTUDENTS/Pages/default.aspx Clarke, Steve; Lehaneyo, Bryan (2000). Human centered methods in www.uu.se/en/node223 information systems: current research and practice. Eds: Idea www.uclouvain.be/en-etudiant-international.html Group. www.fu-berlin.de/en/studienbewerber/kompass/index.html www.unige.ch/international/coopuniv_en.html “Content Analysis,” www.liu.se/en/education/?l=en http://www.ischool.utexas.edu/~palmquis/courses/content.ht www.rug.nl/prospectiveStudents/index ml. [last access 23/07/2009] www.cuni.cz/UKENG-49.html “Main Articles: 'Involving Users in the Development of a Web www.uni-hamburg.de/Internationales/index_e.html Accessibility Tool', Ariadne Issue 44,” www.kth.se/studies?l=en_UK http://www.ariadne.ac.uk/issue44/craven/.[last access www.tuwien.ac.at/teaching/EN/ 22/07/2009] www.lu.se/lund-university/international-relations “Social Networking? For Business? «,” www.studeren.uva.nl/studyinginenglish/english.cfm http://www.bradhanksseminars.com/blog/?p=11. [last access Theoretical reference: “An Introduction to Content Analysis,” 22/07/2009] http://writing.colostate.edu/guides/research/content/pop2a.cfm. [last access 21/07/2009] Clarke, Steve; Lehaneyo, Bryan (2000). Human centered methods in information systems: current research and practice. Eds: Idea Group. “Content Analysis,” http://www.ischool.utexas.edu/~palmquis/courses/content.html. *last access 23/07/2009] “Main Articles: 'Involving Users in the Development of a Web Accessibility Tool', Ariadne Issue 44,” http://www.ariadne.ac.uk/issue44/craven/.*last access 22/07/2009+ “Social Networking? For Business? «,” http://www.bradhanksseminars.com/blog/?p=11. [last access 22/07/2009]
  • 49. DaVisMo & Confetti
  • 50. Integration PART I: Student Mobility Information, CEI & Semantic search
  • 51. Motivation Video
  • 52. Student Mobility Information System • Questions: – How could such a system work? – What should be part of it? – Would students really use it? – Doesn’t (google) search already solve this? – Why not just data visualization?
  • 53. Manovich’s Dream • Critique of Manovichs argument to use data mining and visualization to do „media analysis” instead of the traditional “media criticism”: – “*…+ the most significant critique of Manovich’s talk came from an intelligent questioner at the end… a young man in the front asked, ‘Is visualization even necessary in an age when you have all the data… isn’t the perfect map a 1 to 1 representation?’ ” http://medialogy.net/2008/08/16/new-new-media-lev-manovich-data-visualization-and-borges-maps/ • We don’t need a map to the library of babel, we need a way to navigate it! (cf. Borges) http://thedoublethink.com/wp-content/uploads/2009/09/network.png
  • 54. Sketches I – Tree Climber
  • 55. Sketches I – Data Clover
  • 56. Sketches I – Data Dive
  • 57. Sketches I – All My Marbles
  • 58. Sketches I – Data Zoom
  • 59. Visual Language Dimensions • Space (2D, 2.5D, 3D) – Position – Size – Distances – Shape • Time, Color, Texture Connections, Movement • Sound – Pitch – Duration – Rhythm • > Primitives, Dimensions & Relations Kim Marriott and Bernd E. Meyer, Visual language theory (Springer, 1998). http://www.focuseducational.com/images/user/fullsize/290.jpg
  • 60. Embodied Interaction: Design Principles 1. Computation is a medium (communication) 2. Meaning arises on multiple levels (objects, signs, metaphors) 3. Users, not designers, create and communicate meaning 4. Users, not designers, manage coupling – relating entities for the purpose of action 5. Embodied technologies participate in the world they represent – artifacts-in-use vs. separation of object and representation 6. Embodied interaction turns action into meaning – no meaning in the system itself, but in the way it is used Paul Dourish, Where the Action Is (MIT Press, 2004). http://mitpress.mit.edu/images/products/books/0262041960-f30.jpg
  • 61. Embodied Interaction + Data Visualization & Exploration 1. Data visualizations / exploration interfaces act as media 2. Meaning in such systems arises on multiple levels (objects, signs, metaphors) 3. Designers can not enforce a user’s context 4. The users and not the system designers decide how to interpret and use the system 5. The data has to be situated in a context, an embodied data exploration interface participates in the world it represents 6. Embodied data exploration turns actions into meaning > Context Enaction Interface
  • 62. CEI Sketches Keyword Combination
  • 63. CEI Sketches Information Presentation
  • 64. Semantic Search • Semantic web + search – augment and improve traditional search results • Two very different kinds of searches: – Navigational search – Research search R. Guha, Rob McCool, and Eric Miller, “Semantic Search,” http://www2003.org/cdrom/papers/refereed/p779/ess.html. • Employ domain knowledge modeled as ontologies to enhance information retrieval D. T. Tran et al., “Expressive resource descriptions for ontology-based information retrieval,” in Proceedings of the 1st International Conference on the Theory of Information Retrieval (ICTIR’07), 18th-20th October, 2007, 55–68. • Enable systems to construct a personal context
  • 65. Demo Animation
  • 66. Related Works • Google Wonder Wheel http://www.google.com/search?q=car&hl=en&sa=G&tbo=1&tbs=ww:1 • Google Side Wiki http://www.google.com/sidewiki/intl/en/index.html • Eyeplorer http://eyeplorer.com/show/ • Flokoon http://www.flokoon.com/#fotolia • Raum der Daten und Fakten http://viola.informatik.uni-bremen.de/typo/index.php?id=10
  • 67. Beginning Specification 1. Control Panel 1. Logo/Name of the project, Help/Info area, Login/Greeting, Dropdown Area for Library/Pinboard (Optional), Dropdown Area for Friends Activity, “Friends“ button 2. Canvas 1. Holds number search/browse-graphs, can hold multiples, Holds Disposal Area (6), that will be used to dipose, delete modes that are not needed, May hold suggestive nodes, May exceed screen range (movable/draggable) or multiple canvas, 3. Library (Pinboard) 1. Store and retrieve graphs or nodes, Options to sort and organize stored graphs and nodes, Search area for stored items 4. Search/Browse Graph (image bellow) 1. Root node + n generations of n children, Movable nodes connected by “wire“, Nodes can be pulled off by force or recombined by drag and drop, Pulled off nodes spawn new systems, Recombination means the node that is dragged into the other becomes a child of the other containing its own keywords + its new parent keywords, Any node of a graph can be commented (the comments itself can be rated), Any node or graph can be shared (with friends on the system or with the Url to pass to friends), Nodes of the same generation can have a different importance (height). This importance could be revaluated by user behavior 2. Plant like 3. After selecting a keyword node it is possible to visualize the content nodes inside of it: 5. Friends Activity 1. History of friends searches, comments and other actions 6. Nodes 1. Keywords Nodes vs. Content Nodes
  • 68. What’s Missing? • Personal guidance • Connection to students from destination countries • A fitting metaphor to convey the semantically augmented information http://synthese.files.wordpress.com/2009/04/intelligent-agent.jpg
  • 69. DaVisMo & Confetti
  • 70. Experiment
  • 71. Embodied Conversational Agent Speech Body Serve Stance Bidding Multimodal Software Interface Agent Hand Represent Gestures Human Facial Displays
  • 72. Demo
  • 73. http://www.youthserviceslitigation.com/uploads/image/StudyQuestion.jpg
  • 74. How can we make the agent credible and the user trust in the system? How intelligent should the agent appear? In which way should the agent speak with the user? Human-like or abstract representation?
  • 75. • Research question “How does the behavior of an agent influence the expectations of the user?” • For the experiment : - Behavior of an agent - Two DIFFERENT characters http://blog.lib.umn.edu/isss/isss/question-mark1a.jpg
  • 76. Experiment Concept Character A Character B Same appearance and simple humanoid body…why?
  • 77. Behaviors of Character A and B Bridge the How to Style of Way of processing I don't know welcome the movement answering gap/ user ‘thinking’ Gestures just concrete Tries to hide his lack of Formal, Character A Calm, simple answers, knowledge Walk and professional tell facts head down Guide the Honest lack user, of knowledge Sounds + Informal, Character B More active supplement More gestures energetic answers emotional
  • 78. Behaviors of Character A and B Style of movement Gestures just concrete Tries to hide his lack of Formal, Character A Calm, simple answers, knowledge Walk and professional tell facts head down Guide the Honest lack user, of knowledge Sounds + Informal, Character B More active supplement More gestures energetic answers emotional
  • 79. Behaviors of Character A and B Bridge the How to Style of Way of processing I don't know welcome the movement answering gap/ user ‘thinking’ Gestures just concrete Tries to hide his lack of Formal, Character A Calm, simple answers, knowledge Walk and professional tell facts head down Guide the Honest lack user, of knowledge Sounds + Informal, Character B More active supplement More gestures energetic answers emotional
  • 80. Behaviors of Character A and B Bridge the How to Style of Way of processing I don't know welcome the movement answering gap/ user ‘thinking’ Gestures just concrete Tries to hide his lack of Formal, Character A Calm, simple answers, knowledge Walk and professional tell facts head down Guide the Honest lack user, of knowledge Sounds + Informal, Character B More active supplement More gestures energetic answers emotional
  • 81. Behaviors of Character A and B Bridge the How to Style of Way of processing I don't know welcome the movement answering gap/ user ‘thinking’ Gestures just concrete Tries to hide his lack of Formal, Character A Calm, simple answers, knowledge Walk and professional tell facts head down Guide the Honest lack user, of knowledge Sounds + Informal, Character B More active supplement More gestures energetic answers emotional
  • 82. Behaviors of Character A and B Bridge the How to Style of Way of processing I don't know welcome the movement answering gap/ user ‘thinking’ Gestures just concrete Tries to hide his lack of Formal, Character A Calm, simple answers, knowledge Walk and professional tell facts head down Guide the Honest lack user, of knowledge Sounds + Informal, Character B More active supplement More gestures energetic answers emotional
  • 83. http://tjdesignspot.files.wordpress.com/2009/09/checklist.jpg
  • 84. Experiment Concept • Fully functional system cannot be prepared for the experiment • Wizard of Oz experiment • Comparable data and a stable experiment setup • Prerecord animations and basic answers • Enable live answering • Domain: Digital Media
  • 85. Next Steps
  • 86. Survey Survey Content: • Domain information and experiment procedure • Personal information • Questionnaire: - to get the feedback about the behaviors. • Write 10 questions http://massartlibrary.files.wordpress.com/2009/04/comms_center_survey.jpg
  • 87. Setup of the Pre-Test Aims: • Test the system • Practice • Get feedback Pre-Test with 4 users Work flow of the Pre-test: • Experiment information and sign letter of agreement • Read instructions • Live experiment and questionnaire • Feedback interview
  • 88. Trouble shooter Operator Trouble User shooter Interviewer Instructor Technician
  • 89. Quick WOZ + Sound/Video Conference Live Speech Video Recording Speaker Questionnaire Quick WOZ + + Instructions Sound Conference Video Recording
  • 90. Next Steps
  • 91. Conclusion for the Final Experiment Technical Problems • Solve server delay • Ping Signal User Feedback • Users did not realize that it was a WoZ experiment • Agent gestures too much • Questionnaire improvements • Add instructions: expect delays
  • 92. NLU and Machine Learning
  • 93. Natural Natural Language Language Input Output
  • 94. DaVisMo & Confetti
  • 95. Integration PART II: Agents, HCI & Interaction Metaphors
  • 96. Agents as HCI Metaphor • Idea originated with John McCarthy in the mid-1950’s • Term “agent” was coined by Oliver G. Selfridge a few years later at MIT • System that, when given a goal, can carry out the details of the appropriate computer operations and could ask for and receive advice (in natural language) – ‘soft robots’ living and doing their business within the computer’s world (Kay 1984, via: Bradshaw et al., “Living with agents and liking it: Addressing the technical and social acceptability of agent technology,” in AAAI Stanford Spring Symposium on Human Interaction with Autonomous Systems in Complex Environments, 2003.) – Fabricate goals of their own – (A. Kay, “Computers, Networks and Education”. In: Scientific American, Sept. 1991) • They can handle large amounts of data
  • 97. CEI + Agent • Moves around in the system and „data- mines“ for interesting nodes • May suggest nodes of interest to the user • May also augment the discovered nodes with information retrieved from additional databases • User can direct the agent to a certain node • Friends agents can interact with each other http://www.lustiges-taschenbuch.de/typo3temp/pics/24d579190a.png
  • 98. Plants & Animals
  • 99. Project Goals & Outlook on the Future • Implement a prototype CEI • User test / usability experiment • Surrounding research • In the future, agents could: – Connect to other agents to share information and learn – Connect to new databases by automatically “inventing” queries – Adapt their own ontology over time and in interaction various individuals – Evolve over succeeding generations
  • 100. DaVisMo & Confetti
  • 101. Research questions How is it possible to improve the existing interactive, web-based data visualization models in an innovative way? How can these innovations open the possibility to analyze complex data applied to the students mobility case?
  • 102. …and they lived happy until the end
  • 103. DaVisMo & Confetti
  • 104. DaVisMo & Confetti THANK YOU