Description of a multi-touch multi-user application developed for Microsoft Surface 2.0 which allows to browse exhibitions and masterpieces of the Nippon Museum of Lugano in an easy-to-use and intuitive way.
Internship project - Disability compensation using new technologiesWassimELBOURI1
The present work, done within Ericsson France as a graduation project, is in the purpose of obtaining my Resarch Master diploma in "Advanced Wireless Communications Systems" from CentraleSupelec and my Engineering diploma in Telecommunications from the High School of Communications of Tunis.
The aim of this work is to afford a global solution, based on new technologies, for autistic persons to help them have a normal life.
The Italian economy is mainly based on tourism. In this regard, we have tried to enhance the most successful point, namely the artistic and cultural heritage, giving more attention to museums as a means of attracting tourists to discover our history, culture and tradition.
Day after day, the audience of cultural visitors has increased dramatically, attracting the attention of many companies in integrating computer technology with culture.
Our company, therefore, has thought to invest in this area by proposing a new product to the service of the museums to emphasize its works through augmented reality.
Augmented reality is taking away more and more foot, with the aim of enriching the experience of the user of an exhibition or of turning the streets into open-air museums.
When a visitor enters a museum, the AR can become the means to show the work in its context, provide important details to the user and allow the visualization of related works of art, creating real emotional paths.
The museum becomes, therefore, a real toy in scale 1:1 and the objects are no longer considered "relics" but assume a well-defined form thanks to their contextualization.
The target audience includes all age groups, involving both adults and children. And it is precisely in this area that augmented reality is proposed as a great help for the educational mission of the museums.
A Mobile and Web application for time measurement intended to get an accurate picture of the productive time in a production environment in order to reveal the root causes behind ineffective/idle time and to eliminate non-added activities/tasks .
Technical Key-words : Ionic 2, Angular 2, PouchDB, CouchDB ,
DB Replication Protocol, Django, Python NvD3 charts .
Master Thesis: The Design of a Rich Internet Application for Exploratory Sear...Roman Atachiants
Users who cannot formulate a precise query but know there must be a good answer somewhere, often rely on exploratory search. This requires an interactive and responsive system, or else the user will soon give up. As data bases are becoming larger, more specialized, and more distributed this calls for a Rich Internet Application, fast enough to keep pace with the users explorations. This thesis studies and implements a system, called MultiMap, which computes similarity maps in real-time. This entailed: (1) precomputing every data structure that does not change after the initial query, (2) optimizing algorithms for zooming and map generation (3) and providing a cognitively appropriate visualization of high dimensional space. Applied to a very large movie database, it resulted in a highly responsive, satisfying, usable system.
Internship project - Disability compensation using new technologiesWassimELBOURI1
The present work, done within Ericsson France as a graduation project, is in the purpose of obtaining my Resarch Master diploma in "Advanced Wireless Communications Systems" from CentraleSupelec and my Engineering diploma in Telecommunications from the High School of Communications of Tunis.
The aim of this work is to afford a global solution, based on new technologies, for autistic persons to help them have a normal life.
The Italian economy is mainly based on tourism. In this regard, we have tried to enhance the most successful point, namely the artistic and cultural heritage, giving more attention to museums as a means of attracting tourists to discover our history, culture and tradition.
Day after day, the audience of cultural visitors has increased dramatically, attracting the attention of many companies in integrating computer technology with culture.
Our company, therefore, has thought to invest in this area by proposing a new product to the service of the museums to emphasize its works through augmented reality.
Augmented reality is taking away more and more foot, with the aim of enriching the experience of the user of an exhibition or of turning the streets into open-air museums.
When a visitor enters a museum, the AR can become the means to show the work in its context, provide important details to the user and allow the visualization of related works of art, creating real emotional paths.
The museum becomes, therefore, a real toy in scale 1:1 and the objects are no longer considered "relics" but assume a well-defined form thanks to their contextualization.
The target audience includes all age groups, involving both adults and children. And it is precisely in this area that augmented reality is proposed as a great help for the educational mission of the museums.
A Mobile and Web application for time measurement intended to get an accurate picture of the productive time in a production environment in order to reveal the root causes behind ineffective/idle time and to eliminate non-added activities/tasks .
Technical Key-words : Ionic 2, Angular 2, PouchDB, CouchDB ,
DB Replication Protocol, Django, Python NvD3 charts .
Master Thesis: The Design of a Rich Internet Application for Exploratory Sear...Roman Atachiants
Users who cannot formulate a precise query but know there must be a good answer somewhere, often rely on exploratory search. This requires an interactive and responsive system, or else the user will soon give up. As data bases are becoming larger, more specialized, and more distributed this calls for a Rich Internet Application, fast enough to keep pace with the users explorations. This thesis studies and implements a system, called MultiMap, which computes similarity maps in real-time. This entailed: (1) precomputing every data structure that does not change after the initial query, (2) optimizing algorithms for zooming and map generation (3) and providing a cognitively appropriate visualization of high dimensional space. Applied to a very large movie database, it resulted in a highly responsive, satisfying, usable system.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofsAlex Pruden
This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second).
Paper: https://eprint.iacr.org/2023/1886
Enhancing Performance with Globus and the Science DMZGlobus
ESnet has led the way in helping national facilities—and many other institutions in the research community—configure Science DMZs and troubleshoot network issues to maximize data transfer performance. In this talk we will present a summary of approaches and tips for getting the most out of your network infrastructure using Globus Connect Server.
Welcome to the first live UiPath Community Day Dubai! Join us for this unique occasion to meet our local and global UiPath Community and leaders. You will get a full view of the MEA region's automation landscape and the AI Powered automation technology capabilities of UiPath. Also, hosted by our local partners Marc Ellis, you will enjoy a half-day packed with industry insights and automation peers networking.
📕 Curious on our agenda? Wait no more!
10:00 Welcome note - UiPath Community in Dubai
Lovely Sinha, UiPath Community Chapter Leader, UiPath MVPx3, Hyper-automation Consultant, First Abu Dhabi Bank
10:20 A UiPath cross-region MEA overview
Ashraf El Zarka, VP and Managing Director MEA, UiPath
10:35: Customer Success Journey
Deepthi Deepak, Head of Intelligent Automation CoE, First Abu Dhabi Bank
11:15 The UiPath approach to GenAI with our three principles: improve accuracy, supercharge productivity, and automate more
Boris Krumrey, Global VP, Automation Innovation, UiPath
12:15 To discover how Marc Ellis leverages tech-driven solutions in recruitment and managed services.
Brendan Lingam, Director of Sales and Business Development, Marc Ellis
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
The Metaverse and AI: how can decision-makers harness the Metaverse for their...Jen Stirrup
The Metaverse is popularized in science fiction, and now it is becoming closer to being a part of our daily lives through the use of social media and shopping companies. How can businesses survive in a world where Artificial Intelligence is becoming the present as well as the future of technology, and how does the Metaverse fit into business strategy when futurist ideas are developing into reality at accelerated rates? How do we do this when our data isn't up to scratch? How can we move towards success with our data so we are set up for the Metaverse when it arrives?
How can you help your company evolve, adapt, and succeed using Artificial Intelligence and the Metaverse to stay ahead of the competition? What are the potential issues, complications, and benefits that these technologies could bring to us and our organizations? In this session, Jen Stirrup will explain how to start thinking about these technologies as an organisation.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Leading Change strategies and insights for effective change management pdf 1.pdf
Nippon lugano multitouch
1. POLITECNICO DI MILANO
Dipartimento di Elettronica e Informazione
HUMAN COMPUTER INTERACTION
NipponLugano Multitouch
Lucio Bordonaro, Silvia Zicca, Andres Fernando Arroyave Yepes
Academic Year 2011/2012
2. Abstract
Multitouch technologies are evolving quite fast, not only for single-user applications, but also for cooper-
ative applications which allows users to interact with each others creating an engaging environment and
achieving tasks together. It is quite easy to learn how to use this kind of new technology even for people
that are not used at all and it allow to explore a new way of interaction that is more natural with respect
to the one of the personal computer, for example.
And this is why we developed a multitouch cooperative multi-user application which allows to navigate
the contents of a museum presented in an innovative way and that can be easily used also by children
and old people who want to know information about the exhibitions presented in the museum.
2
4. 1 Introduction
NipponLugano Multitouch is an application entirely dedicated to the Nippon Museum of Lugano, in
Switzerland. In this museum there are four exhibitions related to Japanese photographers. That mu-
seum proposes some informative contents in its website in an hypertextual and multimedial way to allow
guests to deepen the cultural context to which it is dedicated to, either before or after the visit.
The aim of the application is to repropose these contents in an innovative way towards a more natural
interaction exploiting the new technology offered by Microsoft Surface 2.0, a multitouch surface of the
last generation which allows, among other things, to perform cooperative tasks between users and to
recognize the direction of the touches.
The idea is to put the Surface with our application, inside the museum, near the entrance, so that po-
tential guests of every age are tempted to buy a ticket after viewing a preview of the contents presented
in the museum. This is because it is very easy to understand how to interact with the Surface so even a
person who does not know how to use a computer, or a child can use it.
This application can be used either in a cooperative way (an user can pass some contents to another user
to show it to him/her and discuss together) or in a non cooperative way (in case, for example, the Surface
is used by people who do not know each other or do not need to exchange information).
Given the dimensions of the surface, the idea is to have users only along the long edges of the Surface.
4
5. 2 Requirements
This application will have only one kind of users: the potential guests of the museum. We assume that
they received the practical information (address, opening hours and so on) through the website and they
are just arrived to the museum. We can suppose that this big group is heterogeneous and composed
by different kind of users (children in a school trip, old people, professionals photographers and also
common people with no particular characteristics), but they have the same requirements and needs.
In particular, considering the needs of every single independent user, he/she should receive the answer
to some questions like:
• what are the exhibitions of this museum?
• what is every exhibition about?
• what are the themes faced by each exhibition?
• what are the photos related to a specified theme of the exhibition?
• what are the details of a selected photo?
For each one of the answers to the questions above, there will be an answer in one screen of our applica-
tion which is structured to follow the questions that the user may have in order.
Besides these needs, there is also the possibility to use the Surface cooperatively. So every content can
be rotated and passed to another user that is placed on the other side of the Surface to discuss it together
and showing it to other users.
NOTE: In this documents we use the words “screens” and “windows” as a synonymous.
5
6. 3 Design
3.1 Gestures design
Microsoft Surface 2.0 supports a huge variety of possible gestures, so we had to select which ones to use
in our application.
Here we report the gestures used to interact for the Surface:
• Move the windows: One or more fingers on a window to move or flick it.
Figure 1: Move the window
• Rotate the windows: there are three ways to rotate a window:
– Single finger rotate: One finger touches a window and drags it around in a circle so that it
rotates.
Figure 2: Window rotation (1)
– Two-finger rotate: Two or more fingers on a window are dragged in opposite directions along
an arc.
6
7. Figure 3: Window rotation (2)
– Pin turn: One finger remains stationary acting as a pivot point while other fingers move
around it.
Figure 4: Window rotation (3)
• Screen simple touch: a simple tap on the screen with a finger.
Figure 5: Screen simple touch
• Zoom in and out: Two or more fingers on an item are dragged apart (used to resize the gallery
window).
7
9. 3.2 Screens design
3.2.1 Main screen
The main screen consists into a red circle on a white background which represents the Japanese flag
(because the museum is related to Japanese photographers). The red circle in the middle is interactive
and it is split into four slices that represents the different exhibitions (identified ). The users can rotate
it around its center and select the desired exhibition tapping on the slices. The use of a circle allows the
users to read it easily independently from his own position with respect to the surface.
Figure 7: Main screen
9
10. 3.2.2 Exhibition screen
Once the user selected an exhibition, it will appear a screen with all the details related to that exhibi-
tion (title, author, description and some random photos). The window can be rotated so that it can be
“passed” to other users that want to read it, it can be moved wherever on the surface, it can be zoomed
in and out, it can be closed or can allow to open the themes screen to allow to read more about the main
themes of the selected exhibition.
Figure 8: Exhibition screen
10
11. 3.2.3 Themes screen
The themes screen will show information about the themes of the selected exhibition (title, description
and one representative image). This window has a circular menu. Rotating it, it is possible to view in-
formation about the different themes. Tapping on the representative image, the gallery of the theme will
open. This screen can be moved and it is possible to show or hide the description of each theme.
Figure 9: Themes screen
11
12. 3.2.4 Gallery screen
Every theme has a gallery of images. This gallery window can be enlarged or reduced. Also the images
contained into the window can be zoomed in and out and is possible to scroll horizontally and vertically
to view images not directly showed when the screen is too small.
Figure 10: Gallery screen
12
13. 3.2.5 Image details screen
Every time you tap an image from a gallery or the exhibition library bar, it will open in an independent
screen with related details (title, author and description). It is possible for the user to pass the image to
another user without passing him/her the whole gallery of that theme. It is also possible to move, rotate
and zoom the image. Text can be showed or hidden.
Figure 11: Image details screen
13
14. 3.3 States diagram
The following diagram shows all the possible interactions that can be done with each window and how
to pass from one to another. Consider also that every window can be closed by the user in every moment
without influencing the behavior of the other. Also they can be opened more than ones simultaneously
by the two side of the surface.
Figure 12: State diagram
14
15. 3.4 Scenarios
3.4.1 A relevant non-cooperative scenario
Paolo wants to visit the Nippon Museum following the advice of a friend who has already gone there and
who has talked him vaguely what it is about. When he arrives to the museum, he has never visited the
website, so he knows only the practical information received by his friend (opening hours, address and
ticket price), so he decides to use the Surface to gain more detailed information about the contents of the
museum before buying the ticket.
From the main screen of the application, Paolo decides to retrieve information about the Araki’s exhibi-
tion.
Figure 13: Araki exhibition
15
16. After he read about that exhibition and slided some of the images it contains, he decides see what are the
themes faced in that exhibition.
Figure 14: Araki themes
16
17. Chosen the theme Artistic Expression, Paolo decides to browse its gallery to have an idea about what
photos he will find about that theme.
Figure 15: Araki theme: Artistic Expression
17
18. While zooming the gallery, Paolo is impressed by a photo, so he decides to zoom it in and to read some
additional information about it.
Figure 16: Araki photo details
Then, Paolo decides to close all the screens and to buy a ticket of the museum to visit it.
18
19. 3.4.2 A relevant cooperative scenario
Marta and Sara are two sisters fond of photography who decide to visit together the Nippon Museum of
Lugano. They walk towards the Surface and they place along the two long sides of the Surface and start
browsing information about two different exhibitions: Araki (Sara) and Shunga (Marta).
Figure 17: Multiuser exhibition
19
20. While Marta is still reading, Sara opens the themes screen of Araki exhibition, she select the one she
prefers opening the gallery.
Figure 18: Multi-user
20
21. Marta closes the Shunga screen and decides to view information about Ineffable Perfection, meanwhile
Sara opens and zooms in a photo that she likes.
Figure 19: Opening a new exhibition
21
22. Sara passes the zoomed photo to her sister to listen to her opinion.
Figure 20: Passing content to another user
They are both interested into that particular photo, so they decide to go to buy the tickets to watch it.
22
23. 4 Prototype Implementation
4.1 Paper prototype
After deciding which are the main elements of the application, we built up a paper prototype to simulate
the behavior of each component and analyzing if the user requirements were respected. As the term
“prototype” says itself, the definitive version of the application presents some differences.
Here follows some photos about the paper prototype.
Figure 21: Exhibition selector
Figure 22: Exhibition screen
23
26. 4.2 Hardware and software architecture
The following figure represents the entire Surface platform, including the hardware layer and software
components that you must be aware of when you develop Surface applications.
Figure 26: Software architecture
4.2.1 Windows 7
Microsoft Surface 2.0 runs on the Windows 7 64-bit operating system. Windows 7 provides all the ad-
ministrative, security, and directory functionality of the Surface. Developers and administrators working
with a Microsoft Surface unit have full access to Windows functionality (in Windows Mode). However,
when people interact with Microsoft Surface applications, the Windows user interface is suppressed (in
Surface Mode).
4.2.2 Vision system
The Vision System uses PixelSense™ to process captured touch data into useful application data you can
access through Surface SDK APIs. PixelSense™ enables each pixel in the Surface display to detect when a
person touches it or when someone moves a finger, tagged object, or untagged object over it. It does this
without the use of cameras, which is what makes newer Surface hardware much thinner than previous
versions.
4.2.3 Presentation layer
The Presentation layer integrates with Windows Presentation Foundation (WPF) and includes a suite
of interaction controls designed for Microsoft Surface enabling you to quickly and easily build touch
enabled applications.
26
27. 4.2.4 Core layer
The Core layer exposes Microsoft Surface specific contact data and events so you can create Microsoft
Surface enabled applications with any user interface (UI) framework that is based on HWND (Handle
WiNDows).
4.2.5 Windows integration
The tight integration between Microsoft Surface and the Windows operating system provides system
wide functionality on top of the Windows operating system. You must use this functionality to support
unique aspects of the Microsoft Surface experience, such as managing user sessions, switching between
the standard Windows user interface (Windows Mode) and the deployment experience (Surface mode),
monitoring critical Microsoft Surface processes, and handling critical failures.
4.2.6 Surface shell
Surface Shell is the component that manages applications, windows, orientation, and user sessions and
provides other functionality. Every Microsoft Surface application must integrate with Surface Shell.
27
28. 4.3 Technical requirements
To install and develop applications using the Microsoft Surface 2.0 SDK, you must you have the following
software installed on your Windows 7 PC workstation, Windows 7 touch PC, or Surface unit that you are
using for development:
• Windows 7 operating system (64-bit recommended)
• .NET Framework 4.0
• Visual Studio 2010 or Visual C# 2010
• XNA 4.0 Redistributable or XNA Games Studio 4.0
• Microsoft Expression Blend 4.0 (recommended)
Additionally, you must create your applications to run on hardware designed for Surface 2.0, such as the
Samsung SUR40 for Microsoft Surface, or Windows 7 touch PCs.
28
29. 4.4 Actual state of the implementation and open issues
At the moment the application responds to all the user’s requirements specified in Chapter 2, but it is
only a prototype that needs to be tested with real users. Also there are still some open issues to fix.
First of all, the gallery of each exhibition is made to contain nine images related to the exhibition. The
number of nine was chosen because it is simple to dispose images in a 3x3 matrix and put in the middle
of the square the selected image, so that the user can navigate all the figures starting from the chosen
one. Also it is not a big number, so it does not overload memory and slow down the program execution.
We decided to show different images from the same exhibition and the simplest way to do this was to
chose one image for each theme of the exhibition. The problem is that some exhibitions do not have
nine themes (but they have eight) so there can be some images repeated more than once.
The same problem is found when opening the gallery of a specified theme of the chosen exhibition: some
themes do not have nine images, so there are duplicates.
We analyzed the problem and one solution was to leave some empty spaces, but we decided that put
duplicates was a better solution, because empty spaces could have confused the users. Another possibil-
ity was to completely modify the structure of the gallery, but doing this we should have changed all the
possible interactions and GUI related to that screen.
Another issue consists in the fact that in the actual state of the implementation we have not set a max-
imum number of screens that can be opened on the Surface simultaneously. Probably it is not a real
problem since the Surface automatically put the last touched window over the others.
Also we have not set the maximum dimensions that every screen can have.
4.5 Technical problems
The main problem we had to face during the implementation part of the project, is that Microsoft Surface
2.0 was not on the market at the moment in which we developed the application, so we had to test it on
normal laptop with a screen resolution which is not like the one of the real surface (that is full HD). Also
we had to use a touch simulator to simulate multitouch actions and other kind of interactions that are
not easily created using mouse movements.
Another minor problem was that some guidelines find on the Surface official website for developer, are
too strict regards some aspects (i.e. the font size).
29
30. 5 Conclusions
The project NipponLugano Multitouch is a useful application related to Nippon Museum of Lugano, but
it can be easily modified and adapted to every kind of museum of exhibition losing only the metaphor of
the Japanese flag in the main screen.
The main thing we learned is to work in contact with new technologies and in particular with multitouch
world which offers a huge number of interactions and possibilities that you cannot find in classical com-
puters.
Also the Surface allows the simultaneous interaction of more than one users on the same device and this
cannot be provided by normal small devices with touch screen (i.e. smartphones, tablets...).
Working on this kind of technology, means to think in a totally different way about the human-computer
interaction and focus on the more natural interactions and gestures to allow the users to focus themselves
on the contents and not on what they have to do to find and manipulate it.
30