Yuki Fujiwara, Susumu Date, Kohei Ichikawa and Haruo Takemura: "A Multi-Application Controller for a Tiled Display Wall for Wide-area Distributed Computing," The 3rd International Conference on Human-centric Computing (HumanCom-10), Aug. 2010. Abstract—SAGE is a graphics streaming middleware for sup- porting collaborative scientific visualization environments and allows scientists to easily build a tiled display wall (TDW) composed of multiple computers and monitors. Furthermore, it allows scientists to share scientific images and movies stored or generated on local or remote computers through the use of network streaming technique. However, the original SAGE does not have any functions and methods for letting applications know user input from its user interface, SAGE UI, although scientists as users can manipulate operations related to window management. Our built-in application control module for SAGE offers transparency and usability in operation to SAGE users wherever SAGE-enabled application nodes are.

1. Yuki Fujiwara, Kohei Ichikawa,
Susumu Date, Haruo Takemura
(Osaka University)

2. SAGE (Scalable Adaptive
Graphics Environment)
Grid Computing
Visualize
France
US
Japan
India
China
Tiled Display Wall
(TDW)
2

3. Tiled Display Wall
Control
Molecular Docking Simulation: DOCK
User
Inefficient
3

4. Tiled Display Wall
Objective
To propose a new method to allow users to
Control
control multiple applications simultaneously
User
on a SAGE-based tiled display wall
Molecular Docking Simulation: DOCK
Inefficient
Problem
Inefficiency of multiple application
control using a tiled display wall
4

5. Tiled Display Wall
Pixel stream
…
Visualization
Application
Display
nodes
SAGE UI
Visualization
Application
…
Message
Message
Free
Space
Manager
Window
Control Message
5

6. Pixel stream
Tiled Display Wall
Event message
analysis
…
Transform
Application
Messag
e
Code
“click
”
to X Event
Button
1
Messag
(x,y)
e
Code
ex: Mouse Click
Free
Space
Manager
Display
nodes
Application
“click
”
Button
1
SAGE UI
(x,y)
Message
ex: Mouse Click
Message
Application
Control Message
Event detection
Event message
transmission
Seiki Kuwabara, Ichikawa Kohei, Susumu date and Shinji Shimojo, “A built-in
application control module for SAGE”, in Proceedings of 2007 IEEE Pacific Rim
6
Conference on Communications, Computers and Signal

7. Pixel stream
SAIL
Event message
analysis
SAIL
Event message
analysis
…
Application
Message
Tiled Display Wall
Display
nodes
Application
…
SAGE UI
Message
Event detection
…
Free
Space
Manager
Message
Message
Message
Event
Message
duplication
Application
Control Message
Event message
transmission
7

8. 

Multiple application control interface
A mechanism to improve response of multiple
application control
Options
Click or
drag
File Library
Preserve Aspect Ratio
Change SAGE Background Color
Tiled Display Wall
Show Chat Window
Show Console Output
AppLauncher Admin
✔Send Controls to All Apps
✔Send Drag in Real Time
Click or drag
8

9. 

Multiple application control interface
A mechanism to improve response of multiple
application control
SAGE UI
Start
Event
Message
Filter
Free
Space
Manager
Application
End
9

10. 
Compare the times to find a error data in multiple
results (8/24 results)
With the proposed multiple control
User can control multiple applications simultaneously
Without multiple control
User can control only a application at a time
Correct
Error
Tiled Display Wall
10

11. 
Using inter-campus network in our university
11

12. 

Confirmed: Usefulness of multi-data manipulation
The more applications, the more efficient
Fast
significant
difference
0
50
NO significant
difference
time[sec]
Late
100 150 200 250 300
24 applications
(A)multi
(B)single
Level of
significance: 5%
12

13. Problem
Approach
Conclusion
Lack of control function for
distributed visualization applications
with SAGE
To create a module
with the application control mechanism using
SAGE architecture
Usefulness of multi-data manipulation is
confirmed
Future work



To improve the event message filter
To create a UI to select controllable applications
To create a function of application control
synchronization
13