This summarizes my work during my first year of PhD at Institute for Manufacturing, University of Cambridge where I investigate the feasibility of deploying machine learning under uncertainty for cyber-physical manufacturing systems.
Presentation slides for my PhD thesis dissertation on machine learning algorithm development to analyze multi dimensional genomic data such as microarrays
At Aalborg University PhD students are required to give a 1 Year progress report. A professor (different from supervisor) acts as opponent. A discussion about the project usually follows with other professors and students. In my case there were 15 people and I obtained critical feedback for my project. I welcome any idea.
This power point pres will be useful for all the budding PhD aspirants who are preparing for their viva irrespective of their subject. Good Luck & All the Best !
Here is my progress Report of Term 1 from 29/1/2018 to 29/7/2018. The topic of my research is "Contemporary Retelling of Ramayana; In Search of New Cultural Meaning."
The aim of this talk is to discusses some of the ethical issues that can arise during scientific publication and the peer review process and discusses their implications. The presentation covers several issue including the scientific publication ethics, misconduct, integrity of the research, authorship and peer review ethics as well as Committee on publication Ethics (COPE) ,
This summarizes my work during my first year of PhD at Institute for Manufacturing, University of Cambridge where I investigate the feasibility of deploying machine learning under uncertainty for cyber-physical manufacturing systems.
Presentation slides for my PhD thesis dissertation on machine learning algorithm development to analyze multi dimensional genomic data such as microarrays
At Aalborg University PhD students are required to give a 1 Year progress report. A professor (different from supervisor) acts as opponent. A discussion about the project usually follows with other professors and students. In my case there were 15 people and I obtained critical feedback for my project. I welcome any idea.
This power point pres will be useful for all the budding PhD aspirants who are preparing for their viva irrespective of their subject. Good Luck & All the Best !
Here is my progress Report of Term 1 from 29/1/2018 to 29/7/2018. The topic of my research is "Contemporary Retelling of Ramayana; In Search of New Cultural Meaning."
The aim of this talk is to discusses some of the ethical issues that can arise during scientific publication and the peer review process and discusses their implications. The presentation covers several issue including the scientific publication ethics, misconduct, integrity of the research, authorship and peer review ethics as well as Committee on publication Ethics (COPE) ,
Teleconsultation refers to the electronic communication that happens between a clinician and patient for the purpose of diagnostic or therapeutic advice. Teleconsultations are particularly useful to provide healthcare services in situations where face-to-face consultation may not be easy. So far, the teleconsultations sessions are primarily supported by audio and video based communication. Although audio and video based communications are advantageous for teleconsultation, they may not fully support all the diagnostic tasks that are carried out in a face-to-face consultation session. For example, diagnosis of physical injuries may require physical handling through touch, which is not possible over video based communication. To address this, I put forward a novel approach of using tangible interfaces and artifacts to support physical diagnostic tasks in a teleconsultation sessions.
The aim of this thesis is to contribute to the understanding on how to design such tangible interfaces. The research will be carried out in three phases. In the first phase, I will investigate the experience of users with technology involved in a teleconsultation session through observation studies to gather a deep understanding on existing teleconsultation processes. These insights will inform the design for tangible interfaces to support teleconsultation session. The prototyping will be carried out in second phase. Finally, in the third phase I will field deploy the prototype to gather and understand its implication in teleconsultation sessions. This investigation will guide me towards a first conceptual understanding of the design of tangible interfaces for teleconsultation sessions. Ultimately, my aim is to invoke thinking towards natural (tangible) interfaces in supporting teleconsultations to get closer to the experience of face-to-face consultation.
PhD thesis defense presentation for my topic "Improving Content Delivery and Service Discovery in Networks" for wireless and other networks. Columbia University, 2016.
An Empirical Study on Faith-based Microfinance as an Alternative Tool of Poverty Alleviation. The doctoral study discussed the role of FBOs in microfinance.
The increase in the amount of structured data published using the principles of Linked Data, means that now it is more likely to find resources on the Web of Data that describe real life concepts. However, discovering resources related to any given resource is still an open research area. This thesis studies recommender systems that use Linked Data as a source for generating recommendations exploiting the big amount of available resources and the relationships between them. Accordingly, a framework named \emph{AlLied} to execute recommendation algorithms is proposed. This framework can be used as the main component for recommendations in a given architecture because it allows application developers to execute and evaluate recommendation algorithms in different contexts. Two implementations of this framework are presented and compared. The first one relies on graph-based algorithms and the second one on machine learning algorithms. Finally, a new recommendation algorithm that adapts dynamically to the linking features of the datasets used is also proposed
This is a presentation I gave to the Research Coordinators in the Federal Ministry of Health, Sudan (04.03.2015).
It included the following topics:
• Overview on the Knowledge Management Cycle and how research fits in it
• Brief historical background on research ethics
• What makes research ethical?
• Definition and examples of scientific misconduct
• How to make your research ethical and avoid scientific misconduct?
Juan Cruz-Benito
GRIAL Research Group, Department of Computers and Automatics
University of Salamanca, Salamanca, Spain.
Education in the Knowledge Society PhD programme.
University of Salamanca 7/11/2016
The presentation has the purpose to update the HCI department about my progress on my thesis. It was focused on the speech, not necessarily writing all the information on the slides.
This presentation is prepared as a part of Coursework for my PhD research and was presented at Department of English, Maharaja Krishnakumarsinhji Bhavnagar University, Gujarat, India.
Intellectual Honesty and Research Integrity.pptxsheelu57
Intellectual honesty is an applied method of problem solving, characterized by an unbiased, honest attitude, which can be demonstrated in a number of different ways including:
Ensuring support for chosen ideologies does not interfere with the pursuit of truth;
Relevant facts and information are not purposefully omitted even when such things may contradict one's hypothesis;
Facts are presented in an unbiased manner, and not twisted to give misleading impressions or to support one view over another;
References, or earlier work, are acknowledged where possible, and plagiarism is avoided. practices.
For individuals, research integrity is an aspect of moral character and experience. It involves above all a commitment to intellectual honesty and personal responsibility for one's actions and to a range of practices that characterize responsible research conduct.
Teleconsultation refers to the electronic communication that happens between a clinician and patient for the purpose of diagnostic or therapeutic advice. Teleconsultations are particularly useful to provide healthcare services in situations where face-to-face consultation may not be easy. So far, the teleconsultations sessions are primarily supported by audio and video based communication. Although audio and video based communications are advantageous for teleconsultation, they may not fully support all the diagnostic tasks that are carried out in a face-to-face consultation session. For example, diagnosis of physical injuries may require physical handling through touch, which is not possible over video based communication. To address this, I put forward a novel approach of using tangible interfaces and artifacts to support physical diagnostic tasks in a teleconsultation sessions.
The aim of this thesis is to contribute to the understanding on how to design such tangible interfaces. The research will be carried out in three phases. In the first phase, I will investigate the experience of users with technology involved in a teleconsultation session through observation studies to gather a deep understanding on existing teleconsultation processes. These insights will inform the design for tangible interfaces to support teleconsultation session. The prototyping will be carried out in second phase. Finally, in the third phase I will field deploy the prototype to gather and understand its implication in teleconsultation sessions. This investigation will guide me towards a first conceptual understanding of the design of tangible interfaces for teleconsultation sessions. Ultimately, my aim is to invoke thinking towards natural (tangible) interfaces in supporting teleconsultations to get closer to the experience of face-to-face consultation.
PhD thesis defense presentation for my topic "Improving Content Delivery and Service Discovery in Networks" for wireless and other networks. Columbia University, 2016.
An Empirical Study on Faith-based Microfinance as an Alternative Tool of Poverty Alleviation. The doctoral study discussed the role of FBOs in microfinance.
The increase in the amount of structured data published using the principles of Linked Data, means that now it is more likely to find resources on the Web of Data that describe real life concepts. However, discovering resources related to any given resource is still an open research area. This thesis studies recommender systems that use Linked Data as a source for generating recommendations exploiting the big amount of available resources and the relationships between them. Accordingly, a framework named \emph{AlLied} to execute recommendation algorithms is proposed. This framework can be used as the main component for recommendations in a given architecture because it allows application developers to execute and evaluate recommendation algorithms in different contexts. Two implementations of this framework are presented and compared. The first one relies on graph-based algorithms and the second one on machine learning algorithms. Finally, a new recommendation algorithm that adapts dynamically to the linking features of the datasets used is also proposed
This is a presentation I gave to the Research Coordinators in the Federal Ministry of Health, Sudan (04.03.2015).
It included the following topics:
• Overview on the Knowledge Management Cycle and how research fits in it
• Brief historical background on research ethics
• What makes research ethical?
• Definition and examples of scientific misconduct
• How to make your research ethical and avoid scientific misconduct?
Juan Cruz-Benito
GRIAL Research Group, Department of Computers and Automatics
University of Salamanca, Salamanca, Spain.
Education in the Knowledge Society PhD programme.
University of Salamanca 7/11/2016
The presentation has the purpose to update the HCI department about my progress on my thesis. It was focused on the speech, not necessarily writing all the information on the slides.
This presentation is prepared as a part of Coursework for my PhD research and was presented at Department of English, Maharaja Krishnakumarsinhji Bhavnagar University, Gujarat, India.
Intellectual Honesty and Research Integrity.pptxsheelu57
Intellectual honesty is an applied method of problem solving, characterized by an unbiased, honest attitude, which can be demonstrated in a number of different ways including:
Ensuring support for chosen ideologies does not interfere with the pursuit of truth;
Relevant facts and information are not purposefully omitted even when such things may contradict one's hypothesis;
Facts are presented in an unbiased manner, and not twisted to give misleading impressions or to support one view over another;
References, or earlier work, are acknowledged where possible, and plagiarism is avoided. practices.
For individuals, research integrity is an aspect of moral character and experience. It involves above all a commitment to intellectual honesty and personal responsibility for one's actions and to a range of practices that characterize responsible research conduct.
Lecture 8 of the COMP 4010 course taught at the University of South Australia. This lecture provides and introduction to VR technology. Taught by Mark Billinghurst on September 14th 2021 at the University of South Australia.
USABILITY EVALUATION OF A CONTROL AND PROGRAMMING ENVIRONMENT FOR PROGRAMMING...ijseajournal
This paper presents an assessment of usability of Control and Programming Environment (CPE) of a
remote mobile robot. The CPE is an educational environment focused on computer programming education
that integrates a program development online tool with a remote lab. To evaluate system usability,
empirical test was conducted with computer science students in order to identify the views of users on the
system and get directions on how to improve the quality of interface use. The study used questionnaire and
observation of the evaluator. The degree of users’ satisfaction was measured by using a quantitative
approach that establishes the average ranking for each question of the questionnaire. The results indicate
that the system is simple, easy to use and suited to programming practices, however needed changes to
make it more intuitive and efficient. The realization test of usability, even with a small sample user, is
important to provide feedback on the system's user experience and help identify problems.
Towards a Smart Control Room for Crisis Response Using Visual Perception of U...Joris IJsselmuiden
Due to ever increasing challenges and complexity, there is a high demand for new human-machine interaction approaches in crisis response scenarios. We aim at building a smart crisis response control room, in which vision-based perception of users will be used to facilitate innovative user interfaces and to support teamwork. Our control room is equipped with several cameras and has a videowall as the main interaction device. Using real-time computer vision, we can track and identify the users in the room, and estimate their head orientations and pointing gestures. In the near future, the room will also be equiped with speech recognition. In order to build a useful smart control room for crisis response, we are currently focusing on situation modeling for such rooms and we are investigating the target crisis response scenarios.
Modern computer-aided design (CAD) systems and software tools have played a significant role in improving the efficiency of the overall product design process, ensuring geometric accuracy and the exchange of product model data. However, the impact of these technologies is largely restricted to the detailed modeling and engineering analysis that occur during the embodiment design phase. Conceptual design has not benefited from these sophisticated and highly precise software tools to the same degree because the creative activities associated with developing and communicating potential solutions with minimal details is far less formulaic in its implementation. At the early stages of product design the specifications and constraints have not been fully established. The industrial designers and engineers need the freedom to change and modify the product configuration and mechanical behavior to investigate a wide range of alternative solutions. Any CAD system that seeks to support and enhance conceptual design must, therefore, enable natural and haptic modes of human-computer interaction. Recent advancements in high-speed, multi-core computer hardware and virtual reality (VR) technology provide opportunities to link the more fluid processes of creative conceptual design with the rigidly defined tasks of product detailing and engineering analysis. This paper discusses the role that virtual reality can play for concept design module.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™UiPathCommunity
In questo evento online gratuito, organizzato dalla Community Italiana di UiPath, potrai esplorare le nuove funzionalità di Autopilot, il tool che integra l'Intelligenza Artificiale nei processi di sviluppo e utilizzo delle Automazioni.
📕 Vedremo insieme alcuni esempi dell'utilizzo di Autopilot in diversi tool della Suite UiPath:
Autopilot per Studio Web
Autopilot per Studio
Autopilot per Apps
Clipboard AI
GenAI applicata alla Document Understanding
👨🏫👨💻 Speakers:
Stefano Negro, UiPath MVPx3, RPA Tech Lead @ BSP Consultant
Flavio Martinelli, UiPath MVP 2023, Technical Account Manager @UiPath
Andrei Tasca, RPA Solutions Team Lead @NTT Data
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
The Metaverse and AI: how can decision-makers harness the Metaverse for their...Jen Stirrup
The Metaverse is popularized in science fiction, and now it is becoming closer to being a part of our daily lives through the use of social media and shopping companies. How can businesses survive in a world where Artificial Intelligence is becoming the present as well as the future of technology, and how does the Metaverse fit into business strategy when futurist ideas are developing into reality at accelerated rates? How do we do this when our data isn't up to scratch? How can we move towards success with our data so we are set up for the Metaverse when it arrives?
How can you help your company evolve, adapt, and succeed using Artificial Intelligence and the Metaverse to stay ahead of the competition? What are the potential issues, complications, and benefits that these technologies could bring to us and our organizations? In this session, Jen Stirrup will explain how to start thinking about these technologies as an organisation.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofsAlex Pruden
This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second).
Paper: https://eprint.iacr.org/2023/1886
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Accelerate your Kubernetes clusters with Varnish Caching
PhD Proposal Presentation
1. Visuo-Haptic Augmented Reality
Runtime and Authoring Environment
for Medical Training
Ulrich Eck
Supervisor: Dr. Christian Sandor, University of South Australia
Co-Supervisor: Dr. Hamid Laga, University of South Australia
Associate Supervisor: Prof. Nassir Navab, TU Munich
14/02/2013, Research Proposal Presentation
1
Thank you for joining the presentation of my research proposal with the title:
Visuo-haptic Augmented Reality Runtime and Authoring Environment for Medical Training.
My supervisor is: Dr. Christian Sandor, my co-supervisor is: Dr. Hamid Laga,
and my associate supervisor is: Prof. Nassir Navab from TU Munich.
2. Visuo-Haptic Augmented Reality
Applications
Previous Work: Rapid Prototyping Vision: Medical Training
Authoring Environment
User
Interface
Runtime Environment
Development
System
Haptics Augmented Relality Simulation
2
I'm starting my presentation with an overview on the proposed research project.
The movie on the left side shows one example of my previous work on VHAR applications for rapid prototyping. The user uses a haptic device to paint on a virtual shoe.
We have evaluated such a painting application with kids as young as 6 years and found, that the user interface is an intuitive way to interact with virtual object.
My vision is to enable and motivate developers and researchers in the domain of medical procedures, to use VHAR user interfaces for their training simulators.
A mockup of such a training scenario is shown on the right.
In order to enable developers to build their applications with VHAR user interfaces, a new User Interface Development System is needed.
It consists of a runtime environment, which provides the required functionality, and an authoring environment, which allows developers to create and modify content and behavior
interactively.
In order to motivate researchers to use this technology in the medical domain, I will design and build medical training application prototypes and evaluate them with domain experts.
So let's look a bit closer to what VHAR is, related work in this young field of research, and the challenges in building applications with this user interface technology.
3. VHAR Properties
See and touch digital information:
embedded in the real world
Precisely co-located with haptic devices
Improved performance and realism for manual tasks
[P. Rhienmora et al., VR 2010]
3
The important properties of VHAR are:
- It enables users to see and touch digital information, which is embedded in the real world
- that haptic feedback and visual output are co-located
- previous research has shown, that VHAR improves user performance and realism for manual tasks
Some VHAR systems have been developed as part of research projects during the last decade.
I picked two interesting examples ...
4. Related Work
[Sandor, C. et al., IEICE 2007]
4
[Sandor and colleagues.] in 2007 presented a VHAR system which allowed users
to see and touch a virtual car, which is tracked using a real world object.
5. Related Work
[Harders, M. et al., TVCG 2009]
5
In 2009, Harders and colleagues presented a prototype for a medical training simulator
with physics-based simulation of soft tissue cutting.
Building such systems is challenging ...
6. Challenges in VHAR
Accurate co-location of visual rendering and haptic
interaction
Precise calibration of every component and
complete system
Low latency, realtime operation
6
The visual rendering and haptic interaction need to be accurately co-located.
Precise calibration of every component and the complete system is a necessary precondition.
Furthermore, VHAR applications need to run in realtime with low latency.
But there is more ...
7. More Challenges ...
Model representation and transformation:
Model simplification (haptic rendering requires
simpler geometry than visual rendering)
Simulation of deformable bodies (mass-spring
systems, finite element method)
Most VHAR applications have been built using
shared-data, multi-threaded architectures, which is
difficult to get right
7
Virtual models are needed in multiple representations at the same time for haptic rendering, physics-based simulation, and visual rendering.
Deformations of virtual objects need to be synchronized between all representations in realtime.
Finally, VHAR applications have been built using shared-data, multi-threaded architectures, which is difficult to get right.
In order to simplify and promote the development of such user interfaces, I want to answer the following research questions:
8. Research Questions
Is it possible to design and implement a widely applicable
VHAR runtime?
What is a suitable VHAR application authoring environment for
the stakeholders: programmers, designers, usability
engineers, and users?
What are measurable benefits of applications with VHAR user
interfaces in general, and specifically for medical training
simulators?
8
Is it possible to design and implement a widely applicable VHAR runtime?
What is a suitable VHAR application authoring environment for the stakeholders: programmers, designers, usability engineers, and users?
What are measurable benefits of applications with VHAR user interfaces in general, and specifically for medical training simulators?
9. Approach Overview
Applications Medical ...
controls executes
Authoring Environment
User Interface
Development uses
System
Runtime Environment
Haptics Augmented Relality Simulation
9
In order to answer these questions, I will first develop a runtime environment, which can be used to execute VHAR applications.
An authoring environment, which uses the runtime, enables users interactively create and modify content and behavior.
Finally, these applications will be evaluated to show measurable benefits in task performance.
Let’s have a closer look on a VHAR system ..
10. VHAR System Decomposition
Tracking Simulation
Tracker Simulation
World Model
Engine
Capture Haptic Rendering
Video
Haptic Collision Force
Visual Rendering Device Detection Response
Graphics Control
Engine Algorithms
[Eck, U., Honours Thesis 2012]
10
This simplified decomposition shows the main components of a typical VHAR application.
The haptic device sends sensor readings to the haptic rendering component and receives feedback forces.
The haptic rendering component determines collisions with virtual objects and calculates feedback forces based on the penetration depth.
The virtual object’s behavior is simulated based on physical laws.
Cameras from the head-mounted display capture the environment, which is used a background for the rendered objects and for tracking.
The users viewpoint and poses of other real objects are tracked in the video using fiducial markers and potentially fused with poses received from an external tracking system.
These poses are then used as input to the simulation engine and for visual rendering.
11. Simplify VHAR Development with a
User Interface Development System
Similar approach as early graphical user interface
development systems [Myers, B., IEEE Software 1989]
Dataflow process network architecture with support
for parallel execution [Lee, E., Proc. of IEEE 1995]
Runtime environment, that connects all components and
manages optimal scheduling of tasks on multi-core CPU
systems with multiple GPUs [Hermann et al., Euro-Par 2010]
Authoring environment, that enables developers to create and
modify content and behaviour at runtime [MacWilliams, 2005]
11
Building such applications is difficult.
I propose to create a UIDS for VHAR applications, similar to early research in graphical user interfaces.
As shown by Myers in 1989, UIDS can simplify the development of GUIs by providing appropriate communication patterns and clean apis to developers.
The communication pattern in VHAR applications is streams with varying update rates and throughput.
A suitable architecture for a set of processing nodes connected via streams is the dataflow process network architecture.
The dataflow architecture, which requires side-effect free processing components, decouples algorithms from communication and schedules.
The runtime environment implements the dataflow network and provides default implementations for all required components.
The authoring environment will use the flexible runtime to provide an interactive development system for creating and modifying content and behavior.
Let’s have a closer look onto the concurrency of VHAR systems ...
12. Concurrency of VHAR Subsystems
Continuos Time Discrete Time
Parallel scheduling of haptic
External
100Hz Tracking
Sensor rendering, simulation, sensor
Tracker Fusion
fusion, visual rendering, and
computer vision
Tracking/
Camera 30Hz Computer
Vision Distribution of workload on multi-
core CPUs and multiple GPUs
Haptic Haptic Simulation
Human 1Khz
Device Rendering 100-200Hz
Efficient data exchange between
concurrent subsystems
Visual Visual
Meet latency requirements for
60Hz
Display Rendering
realtime operation
12
The diagram shows physical devices which provide an interface to the real world, from analog to digital as well as from continuous time to discrete time.
All devices operate at different update rates and are normally not synchronized.
The update rates vary from 30Hz to 1kHz and the packet sizes range from small pose updates to large image buffers or geometric models.
In order to achieve maximum performance, all processing needs to be scheduled optimally for execution on all available CPU cores and GPUs.
Furthermore, the cost of communication between components needs to be taken into account, to achieve minimum latency and realtime operation.
A unique feature of the runtime environment will be the dynamic optimization of execution schedules.
13. Self Optimizing Dataflow Network
Static inputs:
- timing requirements (deadlines, latency)
- quality requirements (jitter, error)
Dataflow Specification - execution requirements (cpu, gpu, ...)
iteratively map dataflow network
optimally to available resources Scheduling
Algorithm
Runtime Environment
Dynamic inputs:
- node: processing time
- node: total error
- edge: cost of communication
Intra-process Connector
CPU1 GPU1 CPU2
Inter-process Connector
13
This diagram shows the dynamic schedule optimization for dataflow process networks
The dataflow graph connects processing nodes and provides information on static requirements, like timing, quality attributes, or execution context.
A scheduling algorithms segments the graph into a partition for every available CPU core and GPU.
During runtime, the dataflow runtime provides dynamic information about actual processing time, accumulated errors, and cost of communication.
This information is the used to iteratively optimize the graph segmentation until an optimal solution has been found.
14. Authoring Environment
Interactive creation and modification of
content and behavior
Support for development at runtime
to
[MacWilliams, Thesis 2005]
Live code editor with just-in-time compiler
[Victor, B., Cusec 2012, Storer, J., Projucer 2012]
14
The proposed authoring environment allow the developer to create and modify content and behavior interactively.
This can be done in two ways:
- Using the development at runtime process as presented by MacWilliams in 2005
- And via a live coding environment as demonstrated by Bret Victor in 2012
A short video for both approaches follows..
15. Development at Runtime
[Sandor et al., ISMAR 2005]
15
This clip shows a system developed by Sandor and colleagues in 2005, where users can define the behavior of interaction components at runtime.
16. Live Coding
[Victor, B., Cusec 2012]
16
This clip shows a live code editor developed by Bret Victor in 2012.
I’m planning to create such an environment for either C++ using the LLVM/Clang compiler suite or by using a jit-compiled language such as Racket, Clojure, Julia, or PyPy.
Once such an UIDS for VHAR exists, many applications can be built ...
17. Applications for VHAR
Medical procedures [Coles, T., PhD Thesis 2011]
Training [Knoerlein, B., PhD Thesis 2011]
Rapid prototyping [Sandor et al., IEICE 2007]
[Eck, Honours Thesis 2012]
many applications with haptic interaction
17
VHAR user interfaces can improve the user’s experience and performance in many domains, but this has not been studied extensively.
As previously shown, medical procedures, training, and rapid prototyping are good candidates.
Many haptic enabled applications can benefit from VHAR user interfaces.
Although, there are many options - I will focus on medical training scenarios during my research project.
18. State of the Art for Medical Simulation
[Ullrich and Kuhlen, VGC 2012]
18
This clip shows a typical setup of a VR-based medical training application.
In this demo, users can practice palpation and needle insertion using two haptic devices.
The visual output is presented on a 3D screen, but the haptic interaction is not co-located with the visual appearance.
I think, the user interface should be improved...
19. Improve User Interfaces with VHAR
State of the Art My Vision
[Ullrich and Kuhlen, VGC 2012]
19
As seen before, the haptic interaction and visual rendering are not co-located in current state of the art medical simulators.
I propose the use of VHAR user interfaces for medical procedures ...
20. VHAR can Improve Medical Training
Benefits:
Reduced cognitive load
Improved realism
Greater flexibility than mockup based simulators
Problem:
Formal evaluation of benefits is missing
20
because they can reduce cognitive load, improve realism, and provide greater flexibility than mockup based simulators.
But, in order to successfully deploy VHAR-enabled medical simulators, their benefits need to be formally evaluated.
21. Show Benefits of VHAR User Interfaces
Develop medical training prototypes using UIDS
Collaboration with TU Munich and German Space
Agency DLR
Evaluation with medical experts
Within-subject user study comparing task
performance to haptic-enabled VR training
21
Medical training simulators are complex to build and need be evaluated with medical experts.
Therefore, we have set up collaborations with TU Munich and the German Space Agency DLR.
This collaboration will help me
- to define appropriate scenarios for the evaluation of VHAR user interfaces in medical training,
- to build them using best-of-breed components for tracking, sensor fusion, collision detection, and haptic rendering,
- and to evaluate them with with domain experts in hospitals in Munich.
I plan to perform two within-subject user studies comparing task performance of VHAR-enabled simulators with haptic-enabled VR simulators.
I’m summarizing the expected research contributions as follows ..
22. Expected Contributions
Creation of the first widely applicable dataflow kernel for VHAR
applications and a reusable and extensible VHAR runtime
environment
The design and prototype implementation of the first
integrated development and authoring environment for VHAR,
which supports the development at runtime process
Show measurable benefits of VHAR user interfaces through
evaluation of VHAR-enabled applications with a focus on
medical training
22
The creation of the first widely applicable dataflow kernel for VHAR applications and a reusable and extensible VHAR runtime environment
The design and prototype implementation of the first integrated development and authoring environment for VHAR, which supports the development at runtime process.
To show measurable benefits of VHAR user interfaces through evaluation of VHAR-enabled applications with a focus on medical training.
23. Research Plan and Collaborations
DLR MVL TUM
2013
Collision Detection
VHAR Runtime Tracking
and Haptics with integrate integrate
Prototype Sensor Fusion
Rigid Bodies
Torque / Force TorqueViz Medical VHAR
consult
Visualisations Evaluation Requirements
specify
Authoring Env. specify
Prototype
2014
Medical VHAR Medical VHAR
collaborate
Prototyp 1 Prototype 1
Collisions and
Improved Authoring Prototype 1
Haptics with integrate refine
and Runtime Env. Evaluation
Deformable Bodies
2015
Medical VHAR Medical VHAR
collaborate
Prototype 2 Prototype 2
Prototype 2
Evaluation
23
A approximate timeline and an overview on our collaboration with TUM and DLR is shown in this diagram.
24. References
Selected References (14 out of 128):
Coles, T.R., 2011. Investigating Augmented Reality Visio- Haptic Techniques for Medical Training. Wales: Bangor
University.
Eck, U., 2011. HARP: A Framework for Visuo-Haptic Augmented Reality Research Projects. Adelaide: University of
South Australia.
Harders, M. et al., 2009. Calibration, Registration, and Synchronization for High Precision Augmented Reality Haptics.
IEEE Transactions on Visualization and Computer Graphics, 15(1), pp.138–149.
Hermann, E. et al., 2010. Multi-GPU and multi-CPU parallelization for interactive physics simulations. Euro-Par 2010-
Parallel Processing, pp.235–246.
Lee, E.A. & Parks, T.M., 1995. Dataflow Process Networks. Proceedings of the IEEE, 83(5), pp.773–801.
MacWilliams, A., 2005. A Decentralized Adaptive Architecture for Ubiquitous Augmented Reality Systems. Technische
Universität München.
Myers, B.A., 1989. User-Interface Tools: Introduction and Survey. IEEE Software, 6(1), pp.15–23.
Rhienmora, P. et al., 2010. Augmented Reality Haptics System for Dental Surgical Skills Training. In Proceedings of
the 17th ACM Symposium on Virtual Reality Software and Technology. Hong Kong: ACM, pp. 97–98.
Sandor, C. et al., 2005. Immersive Mixed-Reality Configuration of Hybrid User Interfaces. In Proceedings of IEEE and
Sandor, C. et al., 2007. Exploring Visuo-Haptic Mixed Reality, IEICE.
Sandor, C., 2010. Talk at TEDxAdelaide: The Ultimate Display, 2010, Last accessed on 20 November 2012.
ACM International Symposium on Mixed and Augmented Reality. Vienna, Austria, pp. 110–113.
Storer, J., 2012. Projucer Demo. youtu.be. Available at: http://youtu.be/imkVkRg-geI [Accessed December 6, 2012].
Ullrich, S. & Kuhlen, T., 2012. Haptic Palpation for Medical Simulation in Virtual Environments. Visualization and
Computer Graphics, pp.1–9.
Victor, B., 2012. Inventing on Principle. worrydream.com. Available at: http://worrydream.com/#!/InventingOnPrinciple
[Accessed February 6, 2013].
24
These are the references used in this presentation - 14 out of 128 citations in my research proposal.
25. Applications
Previous Work: Rapid Prototyping Vision: Medical Training
Authoring Environment
User
Interface
Runtime Environment
Development
System Questions ?
Haptics Augmented Relality Simulation
Thank You!
Expected Contributions:
Creation of the first widely applicable dataflow kernel for VHAR applications and a reusable and extensible VHAR
runtime environment
The design and prototype implementation of the first integrated development and authoring environment for VHAR,
which supports the development at runtime process
Show measurable benefits of VHAR user interfaces through evaluation of VHAR-enabled applications with a focus
on medical training
25
Thank you for listening - Any Questions ?