This document presents XMMC, a real-time collaboration-enabled mobile augmented reality system with semantic multimedia. XMMC allows experts to collaboratively document cultural heritage sites using multimedia annotations and metadata. It uses an XMPP-based architecture to enable real-time sharing of multimedia and annotations between mobile clients. Concurrent editing of XML metadata is supported using an adaptation of the CEFX+ algorithm. An XMPP-extended augmented reality browser integrates multimedia annotations and metadata into a live video stream. Evaluation shows XMMC supports the collaborative documentation workflow while increasing cultural heritage awareness.
Beyond the Client-Server Architectures: A Survey of Mobile Cloud TechniquesDejan Kovachev
Mobile applications nowadays are developed either for a local (native) or for a client-server execution. However, applications in the future will be developed with cloud in mind, i.e. act as native applications, but do the heavy processing and storage in the cloud, deliver only needed parts and data at runtime and able to run offline. In order to better understand how to facilitate the building of mobile cloud-based applications, we have surveyed existing work in mobile computing through the prism of cloud computing principles. We provide an overview of the results from this survey, in particular, models of mobile cloud applications. We also highlight research challenges in the area of mobile cloud computing.
Multimedia Processing on Multimedia Semantics and Multimedia ContextRalf Klamma
The 10thWorkshop on Multimedia Metadata (SeMuDaTe‘09)
Yiwei Cao, Ralf Klamma, and Dejan KovachevI
Informatik 5 (Information Systems), RWTH Aachen University
2.12.2009
Graz, Austria
Cloud Services for Improved User Experience in Sharing Mobile VideosDejan Kovachev
Despite the popularity of mobile video sharing, mobile user experience (UX) is not comparable with traditional TV or desktop video productions. The issue of poor UX in mobile video sharing can be associated with the high development cost, since the creation and utilization of a multimedia processing and distribution infrastructure is a non-trivial task for small groups of developers. In this paper, we present our solution comprised of mobile video processing services based on standard libraries which augment the raw video streams. Our services utilize the cloud computing paradigm for fast and intelligent processing in near-real time. Video streams are split in chunks and then fed to the "resource-unlimited" distributed/cloud infrastructure which accelerate the processing phase. Application developers have the possibility to apply arbitrary computer vision algorithms on the video stream thus improving the quality of user experience depending on the application requirements. We providing navigation cues and content-based zooming of raw video streams. We evaluated the proposed solution from two perspectives - distributed chunk-based processing in the cloud and a user study by means of mental workload. Running experiments in mobile video applications demonstrate that our proposed techniques improve mobile user experience significantly.
Challenging Information Systems on a Web-Scale: Responsive Open Community Inf...Ralf Klamma
The document discusses reflective open community information systems on a web scale. It notes that the web is a fragmented, scale-free network based on trust and passion within communities. It presents paradigms of web science that combine analytic and synthetic approaches. It then outlines several technologies and tools for building responsive open community environments, supporting communities, and performing community analytics. Examples of demos and teaching activities are also provided.
Adaptive Computation Offloading from Mobile Devices into the CloudDejan Kovachev
The inherently limited processing power and battery lifetime of mobile phones hinder the possible execution of computationally intensive applications like content-based video analysis or 3D modeling. Offloading of computationally intensive application parts from the mobile platform into a remote cloud infrastructure or nearby idle computers addresses this problem. This paper presents our Mobile Augmentation Cloud Services (MACS) middleware which enables adaptive extension of Android application execution from a mobile client into the cloud. Applications are developed by using the standard Android development pattern. The middleware does the heavy lifting of adaptive application partitioning, resource monitoring and computation offloading. These elastic mobile applications can run as usual mobile application, but they can also reach transparently remote computing resources. Two prototype applications using the MACS middleware demonstrate the benefits of the approach. The evaluation shows that applications, which involve complicated algorithms and large computations, can benefit from offloading with around 95\% energy savings and significant performance gains compared to local execution only.
This document provides an overview of the piXserve solution for intelligent image and video search capabilities. piXserve can automatically index and analyze image and video content to generate searchable metadata without manual intervention. It allows users to perform visual searches using images, video frames, objects, faces, text, or complex multi-modal queries. piXserve also enables powerful automated alerting when matches to specified criteria are found. The solution is scalable and can process live and archived video and image sources for applications in defense, security and intelligence.
The document discusses a proposed novel many-core architecture called FlexTiles that is based on reconfigurable devices like FPGAs, DSPs, and GPPs. It aims to provide an adaptive technique and autonomous decision making to improve programming efficiency and reduce time to market for applications with time-varying workloads. The project has a budget of 3.67M euros over 3 years and involves several partner organizations.
Beyond the Client-Server Architectures: A Survey of Mobile Cloud TechniquesDejan Kovachev
Mobile applications nowadays are developed either for a local (native) or for a client-server execution. However, applications in the future will be developed with cloud in mind, i.e. act as native applications, but do the heavy processing and storage in the cloud, deliver only needed parts and data at runtime and able to run offline. In order to better understand how to facilitate the building of mobile cloud-based applications, we have surveyed existing work in mobile computing through the prism of cloud computing principles. We provide an overview of the results from this survey, in particular, models of mobile cloud applications. We also highlight research challenges in the area of mobile cloud computing.
Multimedia Processing on Multimedia Semantics and Multimedia ContextRalf Klamma
The 10thWorkshop on Multimedia Metadata (SeMuDaTe‘09)
Yiwei Cao, Ralf Klamma, and Dejan KovachevI
Informatik 5 (Information Systems), RWTH Aachen University
2.12.2009
Graz, Austria
Cloud Services for Improved User Experience in Sharing Mobile VideosDejan Kovachev
Despite the popularity of mobile video sharing, mobile user experience (UX) is not comparable with traditional TV or desktop video productions. The issue of poor UX in mobile video sharing can be associated with the high development cost, since the creation and utilization of a multimedia processing and distribution infrastructure is a non-trivial task for small groups of developers. In this paper, we present our solution comprised of mobile video processing services based on standard libraries which augment the raw video streams. Our services utilize the cloud computing paradigm for fast and intelligent processing in near-real time. Video streams are split in chunks and then fed to the "resource-unlimited" distributed/cloud infrastructure which accelerate the processing phase. Application developers have the possibility to apply arbitrary computer vision algorithms on the video stream thus improving the quality of user experience depending on the application requirements. We providing navigation cues and content-based zooming of raw video streams. We evaluated the proposed solution from two perspectives - distributed chunk-based processing in the cloud and a user study by means of mental workload. Running experiments in mobile video applications demonstrate that our proposed techniques improve mobile user experience significantly.
Challenging Information Systems on a Web-Scale: Responsive Open Community Inf...Ralf Klamma
The document discusses reflective open community information systems on a web scale. It notes that the web is a fragmented, scale-free network based on trust and passion within communities. It presents paradigms of web science that combine analytic and synthetic approaches. It then outlines several technologies and tools for building responsive open community environments, supporting communities, and performing community analytics. Examples of demos and teaching activities are also provided.
Adaptive Computation Offloading from Mobile Devices into the CloudDejan Kovachev
The inherently limited processing power and battery lifetime of mobile phones hinder the possible execution of computationally intensive applications like content-based video analysis or 3D modeling. Offloading of computationally intensive application parts from the mobile platform into a remote cloud infrastructure or nearby idle computers addresses this problem. This paper presents our Mobile Augmentation Cloud Services (MACS) middleware which enables adaptive extension of Android application execution from a mobile client into the cloud. Applications are developed by using the standard Android development pattern. The middleware does the heavy lifting of adaptive application partitioning, resource monitoring and computation offloading. These elastic mobile applications can run as usual mobile application, but they can also reach transparently remote computing resources. Two prototype applications using the MACS middleware demonstrate the benefits of the approach. The evaluation shows that applications, which involve complicated algorithms and large computations, can benefit from offloading with around 95\% energy savings and significant performance gains compared to local execution only.
This document provides an overview of the piXserve solution for intelligent image and video search capabilities. piXserve can automatically index and analyze image and video content to generate searchable metadata without manual intervention. It allows users to perform visual searches using images, video frames, objects, faces, text, or complex multi-modal queries. piXserve also enables powerful automated alerting when matches to specified criteria are found. The solution is scalable and can process live and archived video and image sources for applications in defense, security and intelligence.
The document discusses a proposed novel many-core architecture called FlexTiles that is based on reconfigurable devices like FPGAs, DSPs, and GPPs. It aims to provide an adaptive technique and autonomous decision making to improve programming efficiency and reduce time to market for applications with time-varying workloads. The project has a budget of 3.67M euros over 3 years and involves several partner organizations.
Semantic Web powering Enterprise and Web ApplicationsAmit Sheth
The document summarizes a presentation given by Amit Sheth at the 48th ACM Southeast Conference in Oxford, Mississippi from April 15-17, 2010. The presentation discussed several real-world applications of semantic web technologies in domains such as financial services, defense and intelligence, and clinical decision making. Specific applications highlighted included risk analysis in banking, assessing intelligence needs, and powering an active semantic electronic medical record system.
SCAPE - Building Digital Preservation InfrastructureSCAPE Project
Dr. Ross King, AIT Austrian Institute of Technology GmbH, gave an invited talk about the FP7 project SCAPE at the eSciDoc Days in Berlin, October 27, 2011, https://www.escidoc.org/JSPWiki/en/ESciDocDays.
Kalman Graffi - 15 Slide on Monitoring P2P Systems - 2010Kalman Graffi
The document discusses monitoring and managing peer-to-peer (P2P) overlays. It notes that as P2P applications have evolved to support real-time services like voice/video, there is a need to coordinate millions of autonomous peers to provide controlled quality of service (QoS). The modular nature of P2P software also necessitates monitoring and management components to optimize performance across dynamic, heterogeneous networks of peers.
This document discusses how bioprocessing companies have leveraged information technology (IT) solutions to help bring new therapies to market, but that maintaining complex IT infrastructure can become costly and inefficient. It argues that organizations need an enterprise-level informatics platform that integrates diverse data sources and systems to extract maximum value from research and development (R&D) data without overspending on IT. The document provides an example of how one pharmaceutical company benefited from a more holistic and integrated informatics approach based on the Accelrys Pipeline Pilot platform.
Kalman Graffi - Efficiency and Information Management in Peer-to-Peer SystemsKalman Graffi
This document discusses efficiency and information management in peer-to-peer systems. It covers trends in peer-to-peer research where quality aspects such as reliability, adaptability, and efficiency are gaining importance as applications become more complex. It also presents approaches for quality of service and emergency call handling in peer-to-peer overlays, as well as a vision for an efficiency management system to optimize resource usage across overlays.
Uncertainty Handling in Mobile Community Information SystemsYiwei Cao
This document presents an agenda for a seminar on uncertainty handling in mobile community information systems. It discusses background topics such as uncertainty in databases, Web 2.0 concepts, and communities of practice. It then presents a scenario involving uncertainty during a Formula 1 race. The document proposes models for handling uncertainty 2.0 through aspects like context, semantics, and community. It discusses research questions and presents concepts like a workflow model and data management model. It also discusses realizing the models through context-aware queries and collaborative tagging.
03 heemskerk eramind mobility mtg_trieste italy_fh_27_may10AREA Science Park
Frank Heemskerk presented on research mobility and commercialization. He discussed his background moving between academia and industry research. He emphasized the importance of networking and developing international partnerships between universities, research institutes, SMEs, and other organizations. Recommendations included improving communication between sectors, allowing flexibility in projects, and professionalizing research management to enable collaboration across borders.
Virtualised e-Learning with Real-Time Guarantees on the IRMOS Platformtcucinotta
The document describes research into deploying virtualized e-learning applications with real-time guarantees on the IRMOS cloud computing platform. It discusses modeling network and computing delays, benchmarking an e-learning application in a virtualized environment, and using neural networks to predict performance metrics like response time. The goal is to enable precise quality of service for interactive real-time applications in the cloud.
Scaling choreographies for the internet of the futurechoreos
The CHOReOS project aims to develop middleware to support large-scale choreographies (distributed service compositions) for the future internet. This will involve integrating distributed service bus, grid/cloud, and pervasive networking technologies to allow choreographies of thousands of services used by millions of users. Key challenges include achieving the necessary scalability levels and addressing the resource constraints of devices in heterogeneous pervasive networks. The proposed middleware architecture builds on existing technologies from partners to address composition, execution, deployment of large choreographies across heterogeneous networks and infrastructure.
The e-BioGrid project provides e-science infrastructure and support for life science research and development. It bridges the Dutch BiG Grid high performance computing resources and the life science community. The project designs and develops problem-solving environments for computationally intensive areas like next-generation sequencing, mass spectrometry, and nanoscopy imaging. Funded through the BiG Grid, e-BioGrid is led by NBIC, Nikhef, and NCF in collaboration with universities. It works on various application projects and provides researchers access to infrastructure, tools, training, and support to enable data-intensive life science research.
Issues of Information Semantics and Granularity in Cross-Media PublishingBeat Signer
CAiSE 2003, Conference on Advanced Information Systems Engineering, Klagenfurt/Velden, Austria, June 2003
ABSTRACT: While there have been dramatic increases in the use of digital technologies for the storage and processing of information, the affordances of paper have ensured its retention as a key information medium. Recent developments in digitally augmented paper provide the potential to embed active links within printed documents, thereby turning paper into an interactive medium. In this paper, we address the issues of information granularity and semantics that arise in integrating paper as a first-class interactive information medium in hypermedia systems and show that the information server is vital in realising the true potential of this vision. Further, we discuss the authoring issues of cross-media information environments and the forms of tools required to support the various categories of authoring activity.
This document summarizes the progress made in strengthening the ICT capacity of the National Institute of Statistics of Rwanda (NISR) with support from UNDP. It describes how the ICT team has expanded, the network infrastructure has been improved with email, file sharing and backup systems, and data processing and dissemination tools like databases, websites and data portals have been developed. New policies around equipment and software management have also been introduced. Staff training on technical skills and certifications has increased the capacity of both the ICT and NISR staff. Key partnerships with organizations like the Ministry of Finance have also been discussed.
[CONTEXT'12] Towards a lightweight mobile semantic based approach for enhanci...Josué Freelance
This document proposes a lightweight semantic approach to enhance interaction between users and smart objects. It presents an event-condition-action model to define rules for smart object behavior. Ontologies are used to describe smart objects, spaces, and rules semantically. This allows detecting incompatibilities between rules and optimizing rule execution through reasoning. Future work involves implementing the approach on Android, validating response times against non-semantic solutions, and handling multi-user scenarios.
The document outlines the structure and goals of the SHAMAN project. SHAMAN will develop a next-generation digital preservation framework and validate it through three application domains: scientific publishing, industrial design engineering, and e-science data. It will integrate new and legacy technologies to provide long-term preservation and access. The project consists of work packages, principal coordination areas, and integration and demonstration subprojects to develop components, conduct research, and evaluate the framework through use cases.
This document discusses monitoring and managing peer-to-peer systems. It aims to coordinate millions of autonomous peers to provide controlled quality of service. Specifically, it addresses how to monitor system-specific and peer-specific metrics to analyze the current system state. It then proposes a self-configuration framework where the root peer derives and distributes new parameter configurations to reach predefined quality goals. The evaluation shows this approach enables quick convergence to quality intervals while imposing low overhead.
Impact of Soft Errors in Silicon on Reliability and Availability of ServersIshwar Parulkar
This document discusses the impact of soft errors on the reliability and availability of servers used for internet computing. It outlines how soft errors can lead to silent data corruption or unscheduled system interruptions. While memory is a major source of soft errors, the number of logic gates and pipelines in processors is increasing, thereby increasing their potential soft error rate over time. Techniques like error correction codes help mitigate soft errors but ongoing improvements are needed to meet high reliability targets for internet infrastructure.
Provides quick overview of open source Mobile Augmented Reality and the results of an integration exercise between GeoServer and Mixare to build a augmented reality application.
Die Realität wird mit Hilfe von Computern um zusätzliche Informationen erweitert und virtuelle und physische Welt verschmelzen miteinander. Das bietet neue, ungewöhnliche Möglichkeiten für Kommunikations- und Informationslösungen. Es entsteht kreativer Raum für ganz unterschiedliche Anwendungen, zum Beispiel für Smartphone Apps, crossmediale Kampagnen oder online Games.
Die “lebendige Visitenkarte” von Namics ist ein kleines Beispiel, wie Augmented Reality aus einem zweidimensionalen Printprodukt eine lebendige Präsentation macht.
Social Interaction Design For Augmented Reality: Patterns and Principles for ...Joe Lamantia
Augmented reality blends the real world and the Internet in real time, making many new kinds of proximity, context, and location based experiences possible for individuals and groups. Despite these many possibilities, we know from history that the long term value and impact of augmented reality for most people will depend on how well these experiences integrate with ordinary social settings, and support everyday interactions. Yet the interaction patterns and behavior we see in current AR experiences seem almost ‘anti-social’ by design. This is an important gap that design must close in order to create successful AR offerings. In other words, much like children going to school for the first time, AR must to learn to ‘play well with others’ to be valuable and successful. This presentation reviews the interaction design patterns common to augmented reality, suggests tools to help understand and improve the ’social maturity’ of AR products and applications, and shares design principles for creating genuinely social augmented experiences that integrate well with human social settings and interactions.
Semantic Web powering Enterprise and Web ApplicationsAmit Sheth
The document summarizes a presentation given by Amit Sheth at the 48th ACM Southeast Conference in Oxford, Mississippi from April 15-17, 2010. The presentation discussed several real-world applications of semantic web technologies in domains such as financial services, defense and intelligence, and clinical decision making. Specific applications highlighted included risk analysis in banking, assessing intelligence needs, and powering an active semantic electronic medical record system.
SCAPE - Building Digital Preservation InfrastructureSCAPE Project
Dr. Ross King, AIT Austrian Institute of Technology GmbH, gave an invited talk about the FP7 project SCAPE at the eSciDoc Days in Berlin, October 27, 2011, https://www.escidoc.org/JSPWiki/en/ESciDocDays.
Kalman Graffi - 15 Slide on Monitoring P2P Systems - 2010Kalman Graffi
The document discusses monitoring and managing peer-to-peer (P2P) overlays. It notes that as P2P applications have evolved to support real-time services like voice/video, there is a need to coordinate millions of autonomous peers to provide controlled quality of service (QoS). The modular nature of P2P software also necessitates monitoring and management components to optimize performance across dynamic, heterogeneous networks of peers.
This document discusses how bioprocessing companies have leveraged information technology (IT) solutions to help bring new therapies to market, but that maintaining complex IT infrastructure can become costly and inefficient. It argues that organizations need an enterprise-level informatics platform that integrates diverse data sources and systems to extract maximum value from research and development (R&D) data without overspending on IT. The document provides an example of how one pharmaceutical company benefited from a more holistic and integrated informatics approach based on the Accelrys Pipeline Pilot platform.
Kalman Graffi - Efficiency and Information Management in Peer-to-Peer SystemsKalman Graffi
This document discusses efficiency and information management in peer-to-peer systems. It covers trends in peer-to-peer research where quality aspects such as reliability, adaptability, and efficiency are gaining importance as applications become more complex. It also presents approaches for quality of service and emergency call handling in peer-to-peer overlays, as well as a vision for an efficiency management system to optimize resource usage across overlays.
Uncertainty Handling in Mobile Community Information SystemsYiwei Cao
This document presents an agenda for a seminar on uncertainty handling in mobile community information systems. It discusses background topics such as uncertainty in databases, Web 2.0 concepts, and communities of practice. It then presents a scenario involving uncertainty during a Formula 1 race. The document proposes models for handling uncertainty 2.0 through aspects like context, semantics, and community. It discusses research questions and presents concepts like a workflow model and data management model. It also discusses realizing the models through context-aware queries and collaborative tagging.
03 heemskerk eramind mobility mtg_trieste italy_fh_27_may10AREA Science Park
Frank Heemskerk presented on research mobility and commercialization. He discussed his background moving between academia and industry research. He emphasized the importance of networking and developing international partnerships between universities, research institutes, SMEs, and other organizations. Recommendations included improving communication between sectors, allowing flexibility in projects, and professionalizing research management to enable collaboration across borders.
Virtualised e-Learning with Real-Time Guarantees on the IRMOS Platformtcucinotta
The document describes research into deploying virtualized e-learning applications with real-time guarantees on the IRMOS cloud computing platform. It discusses modeling network and computing delays, benchmarking an e-learning application in a virtualized environment, and using neural networks to predict performance metrics like response time. The goal is to enable precise quality of service for interactive real-time applications in the cloud.
Scaling choreographies for the internet of the futurechoreos
The CHOReOS project aims to develop middleware to support large-scale choreographies (distributed service compositions) for the future internet. This will involve integrating distributed service bus, grid/cloud, and pervasive networking technologies to allow choreographies of thousands of services used by millions of users. Key challenges include achieving the necessary scalability levels and addressing the resource constraints of devices in heterogeneous pervasive networks. The proposed middleware architecture builds on existing technologies from partners to address composition, execution, deployment of large choreographies across heterogeneous networks and infrastructure.
The e-BioGrid project provides e-science infrastructure and support for life science research and development. It bridges the Dutch BiG Grid high performance computing resources and the life science community. The project designs and develops problem-solving environments for computationally intensive areas like next-generation sequencing, mass spectrometry, and nanoscopy imaging. Funded through the BiG Grid, e-BioGrid is led by NBIC, Nikhef, and NCF in collaboration with universities. It works on various application projects and provides researchers access to infrastructure, tools, training, and support to enable data-intensive life science research.
Issues of Information Semantics and Granularity in Cross-Media PublishingBeat Signer
CAiSE 2003, Conference on Advanced Information Systems Engineering, Klagenfurt/Velden, Austria, June 2003
ABSTRACT: While there have been dramatic increases in the use of digital technologies for the storage and processing of information, the affordances of paper have ensured its retention as a key information medium. Recent developments in digitally augmented paper provide the potential to embed active links within printed documents, thereby turning paper into an interactive medium. In this paper, we address the issues of information granularity and semantics that arise in integrating paper as a first-class interactive information medium in hypermedia systems and show that the information server is vital in realising the true potential of this vision. Further, we discuss the authoring issues of cross-media information environments and the forms of tools required to support the various categories of authoring activity.
This document summarizes the progress made in strengthening the ICT capacity of the National Institute of Statistics of Rwanda (NISR) with support from UNDP. It describes how the ICT team has expanded, the network infrastructure has been improved with email, file sharing and backup systems, and data processing and dissemination tools like databases, websites and data portals have been developed. New policies around equipment and software management have also been introduced. Staff training on technical skills and certifications has increased the capacity of both the ICT and NISR staff. Key partnerships with organizations like the Ministry of Finance have also been discussed.
[CONTEXT'12] Towards a lightweight mobile semantic based approach for enhanci...Josué Freelance
This document proposes a lightweight semantic approach to enhance interaction between users and smart objects. It presents an event-condition-action model to define rules for smart object behavior. Ontologies are used to describe smart objects, spaces, and rules semantically. This allows detecting incompatibilities between rules and optimizing rule execution through reasoning. Future work involves implementing the approach on Android, validating response times against non-semantic solutions, and handling multi-user scenarios.
The document outlines the structure and goals of the SHAMAN project. SHAMAN will develop a next-generation digital preservation framework and validate it through three application domains: scientific publishing, industrial design engineering, and e-science data. It will integrate new and legacy technologies to provide long-term preservation and access. The project consists of work packages, principal coordination areas, and integration and demonstration subprojects to develop components, conduct research, and evaluate the framework through use cases.
This document discusses monitoring and managing peer-to-peer systems. It aims to coordinate millions of autonomous peers to provide controlled quality of service. Specifically, it addresses how to monitor system-specific and peer-specific metrics to analyze the current system state. It then proposes a self-configuration framework where the root peer derives and distributes new parameter configurations to reach predefined quality goals. The evaluation shows this approach enables quick convergence to quality intervals while imposing low overhead.
Impact of Soft Errors in Silicon on Reliability and Availability of ServersIshwar Parulkar
This document discusses the impact of soft errors on the reliability and availability of servers used for internet computing. It outlines how soft errors can lead to silent data corruption or unscheduled system interruptions. While memory is a major source of soft errors, the number of logic gates and pipelines in processors is increasing, thereby increasing their potential soft error rate over time. Techniques like error correction codes help mitigate soft errors but ongoing improvements are needed to meet high reliability targets for internet infrastructure.
Provides quick overview of open source Mobile Augmented Reality and the results of an integration exercise between GeoServer and Mixare to build a augmented reality application.
Die Realität wird mit Hilfe von Computern um zusätzliche Informationen erweitert und virtuelle und physische Welt verschmelzen miteinander. Das bietet neue, ungewöhnliche Möglichkeiten für Kommunikations- und Informationslösungen. Es entsteht kreativer Raum für ganz unterschiedliche Anwendungen, zum Beispiel für Smartphone Apps, crossmediale Kampagnen oder online Games.
Die “lebendige Visitenkarte” von Namics ist ein kleines Beispiel, wie Augmented Reality aus einem zweidimensionalen Printprodukt eine lebendige Präsentation macht.
Social Interaction Design For Augmented Reality: Patterns and Principles for ...Joe Lamantia
Augmented reality blends the real world and the Internet in real time, making many new kinds of proximity, context, and location based experiences possible for individuals and groups. Despite these many possibilities, we know from history that the long term value and impact of augmented reality for most people will depend on how well these experiences integrate with ordinary social settings, and support everyday interactions. Yet the interaction patterns and behavior we see in current AR experiences seem almost ‘anti-social’ by design. This is an important gap that design must close in order to create successful AR offerings. In other words, much like children going to school for the first time, AR must to learn to ‘play well with others’ to be valuable and successful. This presentation reviews the interaction design patterns common to augmented reality, suggests tools to help understand and improve the ’social maturity’ of AR products and applications, and shares design principles for creating genuinely social augmented experiences that integrate well with human social settings and interactions.
Come ogni nuova convergenza tecnologica l''Augmented Reality ridefinisce l'esperienza del corpo attraverso lo spazio e lo spazio attraverso i codici. Il buzz che circonda l'AR individua oggi un punto di convergenza tra tecnologie mature, sovraccarico delle potenzialità del presente.
Designing for an Augmented Reality worldthomas.purves
How “Augmented Reality” and the mobile web changes everything
Mobile broadband access and ever-smarter phones are shaking the internet out its lofty cloud and bringing the web into the real world. As a result, the old “real world”, and many old ideas and many old business models will be running out of places to hide from the pervasive influence of the net.
Meanwhile, each of our smart phones are in many ways even better than the old clunky tools we used to use to surf the net. Our mobile devices are not only connected but, also bristling with sensors like radios, cameras, microphones, GPS etc. that can directly perceive and interact with the world around you. We’re reaching a point where it’s theoretically possible to point that device at almost anything: a landmark, a product on a store shelf, your friends or a crowd of people; and draw from the cloud and your social graph as much, or perhaps more, relevant information than you ever wanted to know. Oh, and the cloud will be watching you and whatever’s around you as well.
In the new augmented reality, the web surfs you.
The goal of this talk will be to provide you with a fast paced overview of what this new “augmented” reality will mean for how we socialize, for how we sell and market physical products, for architecture, for media and entertainment, for public policy, crime, privacy and, as well, few early signals for what might be the new killer apps.
If all that is not interesting enough, I will also bring free beer.
Augmented Reality and Education: Learning connected to life - ReloadedRaúl Reinoso
Augmented reality has applications in education by allowing students to access additional information about objects and places in the real world. It can enhance learning by augmenting our senses and making the educational content more relevant to the real world. Some examples of augmented reality in education include using it to access information about objects and places, conducting discovery-based learning outside the classroom, using 3D models and simulations to illustrate concepts, and creating augmented textbooks and other publications.
Enhancing Academic Event Participation with Context-aware and Social Recommen...Dejan Kovachev
The plethora of talks and presentations taking place at academic conferences makes it difficult, especially for young researchers to attend the
right talks or discuss with participants and potential collaborators with similar interests. Participants may not have a priori knowledge that allows
them to select the right talks or informal interactions with other participants. In this paper we present the context-aware mobile
recommendation services (CAMRS) based on the current context (whereabouts at the venue, popularity and activities of talks and presentations)
sensed at the conference venue. Additionally, we augment the current context with the academic community context of conference participants
which is inferred by using social network analysis and link prediction on large-scale co-authorship and citation networks of participants. By
combining the dynamic and social context of participants, we are able to recommend talks and people that may be interesting to a particular
participant. We evaluated CAMRS using data from two large digital libraries - the DBLP and CiteSeerX, and participants from two conferences -
ICWL 2010 and EC-TEL 2011. The result shows that the new approach can recommend novel talks and helps participants in establishing new
connections at conference venue.
The document discusses a cloud multimedia platform and its applications. It begins with an agenda that covers cloud computing concepts, multimedia in the cloud, case studies, and a summary. Case studies include multimedia processing and metadata, social network analysis in the cloud, and mobile multimedia elastic cloud applications. The summary states that cloud computing provides on-demand scalability, drives new data processing systems, allows fast development of scalable multimedia services, and has benefits for multimedia systems by offloading heavy tasks to cloud services. It asks what types of tasks are reasonable to implement in the cloud.
SeViAnno 2.0: Web-Enabled CollaborativeSemantic Video Annotation Beyond the ...Nicolaescu Petru
This document discusses SeViAnno 2.0, a web-enabled collaborative semantic video annotation system. It presents the motivation and background of multimedia annotation tools. SeViAnno 2.0 has a 3-tier architecture that is cloud-enabled, scalable, and allows rapid development. It utilizes multimedia metadata web services and a user interface for collaborative tagging. Near real-time collaboration is supported through data structure dependencies and update propagation protocols. Future work includes developing a WebRTC infrastructure and operational transformation algorithms for distributed collaborative semantic annotations.
Supporting Professional Communities in the Next Web Ralf Klamma
Keynote
PWM Wissenstag Social Enterprise @ I-KNOW 2013
Wednesday, September 4, 2013 in Graz (Austria)
Ralf Klamma
Advanced Community Information Systems (ACIS)
RWTH Aachen
Virtual Campfire/iNMV Storytelling on the iPhoneYiwei Cao
This document summarizes a workshop on future mobile applications. It discusses the UMIC research cluster, challenges for mobile multimedia management, the Virtual Campfire architecture for mobile multimedia management, and the Virtual Campfire concept. It also summarizes the iNMV application for storytelling on the iPhone and the agenda for the workshop, including presentations on iNMV features, the developing environment, implementation experiences, and installation instructions for workshop participants.
Mobile Multimedia Cloud Computing and the WebDejan Kovachev
Mobile multimedia services are in high demand, but their development comes at high costs. The emergent computing paradigm cloud computing has great potential to embrace these issues. In fact, we are at the early stage of the coalescence of cloud computing, mobile multimedia and the Web. Motivated by the tremendous success story of the Web based on its simplicity principles, we argue for a comprehensive review on current practices of web and mobile multimedia cloud computing techniques for avoiding frictions. We draw on experience from the development of advanced collaborative multimedia web applications utilizing multimedia metadata standards like MPEG-7 and real-time communication protocols like XMPP. We propose our i5CLoud, a hybrid cloud architecture, which serves as a substrate for scalable and fast time-to-market mobile multimedia services. This paper demonstrates the applicability of emerging cloud computing concepts for mobile multimedia.
A Methodology and Tool Support for Widget-based Web Application DevelopmentNicolaescu Petru
Slides of the 15th International Conference for Web Engineering (ICWE15). How to widgetize applications for achieving collaborative mashups and near real-time features
The document summarizes a workshop presentation on mobile cloud computing. The presentation discusses how cloud computing concepts can be applied to mobile applications, allowing data storage and processing to occur remotely. It outlines benefits like scalability, reduced complexity, and cost savings. Examples are given of augmented mobile applications that leverage cloud resources for intensive tasks. The presentation also explores trends like pay-as-you-use models and the potential of HTML5 for mobile web applications.
Big Data Beyond Hadoop*: Research Directions for the FutureOdinot Stanislas
Michael Wrinn
Research Program Director, University Research Office,
Intel Corporation
Jason Dai
Engineering Director and Principal Engineer,
Intel Corporation
Today's Top "RESTful" Services and Why They Are Not RESTfulDominik Renzel
Presentation of WISE 12 Paper "Today's Top "RESTful" Services and Why They Are Not RESTful" (Renzel, Schlebusch, Klamma)
Abstract: Since Fielding's seminal contribution on the REST architecture style in 2000, the so-called class of RESTful services has taken off to challenge previously existing Web services. Several books have since then emerged, providing a set of valuable guidelines and design principles for the development of truly RESTful services. However, today's most popular "RESTful" services adopt only few of these guidelines, resulting in overburdening developers integrating multiple services in mashup applications. In this paper we present an in-depth analysis for the top 20 RESTful services listed on programmableweb.com against 17 RESTful service design criteria found in literature. Results provide evidence that hardly any of the services claiming to be RESTful is truly RESTful, probably due to the lack of rigidness and ease-of-use of currently available decision criteria. To improve the situation, we provide recommendations for various stakeholder groups.
Full Paper: http://www.springerlink.com/index/42307200X642M240.pdf
DireWolf - Distributing and Migrating User Interfaces for Widget-based Web Ap...Dejan Kovachev
Web applications have overcome traditional desktop applications especially in collaborative settings. However, the bulk of Web applications still follow the "single user on a single device" computing model. Therefore, we created the DireWolf framework for rich Web applications with distributed user interfaces (DUIs) over a federation of heterogeneous commodity devices supporting modern Web browsers such as laptops, smart phones and tablet computers.
The DUIs are based on widget technology coupled with cross-platform inter-widget communication and seamless session mobility. Inter-widget communication technologies connect the widgets and enable real-time collaborative applications as well as runtime migration in our framework. We show that the DireWolf framework facilitates the use case of collaborative semantic video annotation. For a single user it provides more flexible control over different parts of an application by enabling the simultaneous use of smart phones, tablets and computers. The work presented opens the way for creating distributed Web applications which can access device specific functionalities such as multi-touch, text input, etc. in a federated and usable manner.
DireWolf: http://dbis.rwth-aachen.de/cms/projects/the-xmpp-experience/direwolf/
Presented at ICWE 2013: http://icwe2013.webengineering.org/
Tim Malthus_Towards standards for the exchange of field spectral datasetsTERN Australia
This document discusses the development of standards for the exchange of field spectral datasets. It notes the importance of metadata for determining the quality and representativeness of spectral data obtained in the field. A workshop was held in 2012 to discuss best practices for data collection and exchange and key conclusions included the need for standards to facilitate accurate comparison across studies and the role of thorough metadata. Work is ongoing to enhance the SPECCHIO system for hosting spectral libraries and metadata and establishing it as the international tool for storage and exchange of spectral datasets.
What to curate? Preserving and Curating Software-Based Artneilgrindley
This is a presentation given at the CHArt (Computers and History of Art) conference held in London in November 2011. The slides on the title page are images taken from works exhibited at the V&A Decode exhibition.
Cassandra framework a service oriented distributed multimediaJoão Gabriel Lima
This document describes the CASSANDRA framework, a distributed multimedia content analysis system. It uses a service-oriented architecture that allows individual analysis components to be integrated and upgraded easily. The system is modular, self-organizing, and real-time. It can dynamically distribute workloads across available devices. The framework allows for flexible integration of new analysis algorithms and coordination of existing algorithms from different domains.
Strategic Options and Results of Introducing Blended Learning at the National University of Rwanda discusses introducing blended learning at the National University of Rwanda. It describes the challenges faced by the university including lack of infrastructure, resources, and qualified teachers. It also outlines the opportunities provided by growing ICT access in Rwanda. The document details how blended learning using open educational resources was implemented for an introductory physics course. Students engaged with course materials online and collaboratively before in-person lectures. Assessment found students performed better and were more satisfied with blended learning compared to traditional methods.
This document outlines the scheme of work for an Information Technology in a Global Society (ITGS) course over two academic terms. It includes the following:
- Six main topic areas to be covered including information systems, social/ethical impacts of IT, hardware/networks, databases/spreadsheets, word processing/presentations, and integrated systems.
- Specific learning objectives, subtopics, activities, resources and assessments for each topic.
- A focus on understanding technological concepts as well as evaluating the social and ethical issues of various IT applications.
- Real-life examples are to be used to demonstrate the impacts and applications of IT in various areas such as business, education, health, arts and
A vision on collaborative computation of things for personalized analysesDaniele Gianni
Presentation delivered at the 3rd IEEE Track on
Collaborative Modeling & Simulation - CoMetS'12.
Please see http://www.sel.uniroma2.it/comets12/ for further details.
Building a Data Discovery Network for Sustainability Science
A Real-time Collaboration-enabled Mobile Augmented Reality System with Semantic Multimedia
1. A Real-time Collaboration-enabled Mobile
Augmented Reality System with
Semantic Multimedia
Dejan Kovachev, Gökhan Aksakali & Ralf Klamma
RWTH Aachen University, Germany
Advanced Community Information Systems (ACIS)
kovachev@dbis.rwth-aachen.de
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-1 This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
2. Advanced Community
Information Systems (ACIS)
Responsive
Web Engineering Community
Web Analytics
Open
Visualization
Community
and
Information
Simulation
Systems
Community Community
Support Analytics
Lehrstuhl Informatik 5
Requirements
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-2
Engineering
3. Agenda
Motivation and scenarios
Conceptual approach
System design and implementation
Evaluation
Related Work
Conclusions and Future Work
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-3
4. Motivating Scenario
Documentation of Ghazni Wall
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-4
5. Digital Documentation in Cultural
Heritage
Ghazni, Afghanistan, capital of Islamic Culture 2013
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-5 http://arch.rwth-aachen.de/cms/Architektur/Forschung/Forschungsprojekte/Cultural_Heritage/~cqdn/Ghazni_2013/lidx/1/
6. Workflow of Documentation
1- images and videos
2- tag basic metadata
On-site
Documentation
Expert
On site
Architecture Remote expert (Historian)
Expert
Collaborative 8-view repository
Multimedia Cloud
Metadata
Local Workforce Repository
Lehrstuhl Informatik 5
MPEG-7,
(Information Systems) CIDOC CRM
Prof. Dr. M. Jarke
I5-KAKl-1012-6
7. Increase Awareness
of Cultural Heritage
Multimedia
overlays on
video stream
Metadata
Interaction via
position and 3D Captured time
movement Taken location
Creation time
Provenance
….
Still missing Ancient Helmet
– real-time collab.
– semantic
Lehrstuhl Informatik 5
metadata
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-7
8. XMPP-base Mobile Multimedia
Collaboration (XMMC)
Goals: How to enable
Collaborative digital documentation of historical
sites with rich multimedia and metadata using
inexpensive hardware
Increase of cultural heritage awareness
Prototype: XMMC
Mobile real-time multimedia collaboration system with
- integrated AR multimedia browser
- standardized metadata for semantic multimedia and
annotations (MPEG-7)
Lehrstuhl Informatik 5
(Information Systems) - Coordination, field note taking, instant geo-tagged multimedia
Prof. Dr. M. Jarke
I5-KAKl-1012-9 acquisition and sharing
9. XMMC Use Cases
Share
Acquire multimedia
multimedia Content
Producer <<extend>> Add POI
Annotate
multimedia Synchronize with
other clients
Collaborator Chat
Call LAS MPEG-7
Browse services
AR
<<include>>
<<include>> Display the
Consumer Select a POI
details
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-10
10. Concurrent Editing of XML
Most metadata standards use XML format
– Used by standards like MPEG-7, CIDOC CRM, SVG
XML suited for concurrent editing of metadata
– Hierarchal structure more efficient then linear
Concurrency Problems
– Divergence, Causality Violation, Intention Violation
Approach Architecture Algorithms Examples
Pessimistic centralized locking, turn taking SVN,CVS
Optimistic P2P OT, treeOPT, CMAX Google Operational
[Gerlicher 2007] Wave Transformation,
Lehrstuhl Informatik 5
(Information Systems)
CEFX+
Prof. Dr. M. Jarke
I5-KAKl-1012-11
11. Consistency Maintenance Algorithm
for XML (CMAX) [Gerlicher 2007]
Out-of-the-box lightweight concurrent editing of XML files
– CEFX+ [Voigt 2009] based on CMAX
Optimistic approach mainly inspired from OT
– First execute locally then propagate
Direct addressing with <cefx-uid>
Concurrent editing of the same node
– Delegates conflict resolution to user
State Vector
– Operation count for every participant
History Buffer
– Previous operations
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-12
12. eXtensible Messaging and Presence
Protocol (XMPP)
Classic SOAs like HTTP, SOAP are inadequate for
real-time purposes
Good fit for real-time communication
Easily customizable & extendable
– Open XML-based standard
Existing extensions
– File transfer, multi-user chat, PubSub
Library and server support
– Smack(Java), Openfire
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-13
13. XMMC Architecture
Client side Server Side
Client Side
XmmC Client XmmC Server
Media Acquisition Collab.
Modules
XMPP
AR Multimedia Relational
Annotation
Module Module DB
AR Browser Module
Metadata LAS-
Annotation Media Media Collab.
AR MPEG7 MPEG-7
Catalog Store Editing
Service Integration Services
Service Service Service
CEFX+ Service
XMPP Connection XMPP Client (Smack) implemented
Layer (XCL) modified
previously available
XMPP
XMPP Client
(aSmack)
XMPP XMPP Server (Openfire)
Camera WLAN GPS Compass ACCEL
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-14
14. Technical Contributions
Adaptation of CEFX+ for multimedia annotation
– New operations: editing and deleting of nodes
– Later join, leave collaboration session
XMPP-based AR browser by extending Mixare
[http://www.mixare.org/]
– POI awareness, ARML-based, mobile content provider
Custom XMPP IQ stanzas for multimedia sharing and AR
Integration with MPEG-7 metadata services
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-15
15. Collaborative Annotation
Mobile Client-2 Mobile Client-1
Collaborative Collaborative MPEG-7
Mpeg-7
Annotation Editing Integration
<message id="8Dpbh-26" Service Service Services
Module
to="xmmc@merian.informatik.rwth-aachen.de/Smack"
from="3b90aa319d44@conference.merian...de/test_1"
<jabber:iq:rpc> joinSession() joinSession()
type="groupchat">
<jabber:iq:rpc> SessionData SessionData
<body>
<basetype type="time" cefx:uid="101"> loadDocument()
<jabber:iq:rpc> loadDocument()
<name cefx:uid="201">
<jabber:iq:rpc> DocumentData DocumentData
Second World War</name>
<date cefx:uid="301">
<jabber:iq:rpc> joinSession()
…
1997-09-24T00:00:00:000F1000+01:00
<jabber:iq:rpc> DocumentData
</date> updateSemantic
<groupchat>Mess </basetype> Message (Operation)
<groupchat> executeOperation() Semanaticbasetype
age (Operation) BaseTypes()
</body> Service()
…
<x xmlns="jabber:x:cefx#ins" Ack Ack
p="100" ci="1" leaveSession()
<jabber:iq:rpc> sv="0,1"
ba="1" fn="null"/>
<jabber:iq:rpc> leaveSession()
</message>
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-16
16. XMPP-based Augmented
Reality Browser
Contemporary mobile AR Browsers
3rd Party
GPS data Content
Provider
Provider
Server
Get POIs
Wikipedia,
SOAP/RESTful Data Flicker,
Facebook,
etc.
XmmC
GPS data
XMPP XmmC
Create POI Server Create POI Server
Edit POI Metadata Edit POI Metadata
Event Message PubSub Publish Event
Node Data
Get POIs Get POIs
XMPP XMPP
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-17
18. Technical Evaluation
Collaborative Annotation
Remote operation execution
– Average = 412ms
– Stan. Derivation = 209ms
Conflict resolution
– Resolved the possible conflicts
– with 900ms latency and1,2 KB/s bandwidth network
– Still has open issues regarding undo and redo operations
AR Browser
The positions of closed POIs are not very accurate due to
Lehrstuhl Informatik 5
- Inaccuracy in GPS signal, compass, accelerometer
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-20
- Presence of nearby metal objects causes inaccurate results
19. Technical Evaluation
Energy consumption
XMPP
– Generates verbose XML streams
– Requires constant open sockets
– Community works for
Distribution of Stanza Types
improvement for mobile networks
AR browser consumes 4
times more battery than
collaborative annotation
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-21
20. User Evaluation
Field study with 7 participants
– various mobile devices, Android versions and screen sizes
Tasks
– acquisition of multimedia artifacts in a historical site
– editing basic metadata
– collaborative annotation
– browsing with AR
Questionnaire
– collect subjective qualitative measures and user experience
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-22
21. Evaluation Session Results
Majority of the participants observed real-time updates on
the annotations (85%)
Participants mostly satisfied with the user interface and
found it user-friendly and responsive
MPEG-7metadata service integration was successful
The prototype increased
cultural heritage
awareness of
the participants
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-23
23. Conclusions
XmmC is capable of storing and sharing various
multimedia types and sizes
Concurrent XML file editing with mobile clients
Collaborative annotation in digital documentation of
historical sites and increasing cultural heritage
awareness
XMPP fits well for mobile real-time multimedia
collaboration context
However, AR and XMPP consumes battery
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-25
24. Future Work
Further multimedia types
– Videos, 3D objects, visual formats
Improved AR browser with 3D rendering and
visual location mapping
Integration with real-time video streaming
services, mobile cloud computing
Community support
– User centric features, e.g. trust and security
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-26
25. Thanks for your attention!
Q&A
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-KAKl-1012-27