The project aims to use Unreal Engine 4 to render human activity data in real time by streaming joint angle data into the engine and applying it to an animated skeletal mesh. Currently, a skeleton can be controlled in C++ and animation applied via Blueprints. A network socket was implemented but library functions are not visible in the editor. Future work includes resolving the network library, creating a server, defining file structure, and rendering body occlusion.

1. Aoyagi Lab
Colloquium
Activity Data Renderer
2015-06-01 ~ Michele Bianchi

2. 1.
The project
Quick review of
the project

3. Project
Use Unreal Engine 4 to render human activity
data

4. Unreal Engine 4
Last version of a
very famous
engine in the
Industry.
Skeletal mesh
control using C++
and Blueprint.
The engine is Open
Source (github), so
all the project can
be Open Source

5. Input
Live stream of joint
angles.
Input and output of the program
Output
Activity animation
applied to a body
skeleton.
Using dynamic meshes
we can render in real
time the body
coverage for each
sensor node.

6. How does UE4 with skeletal mesh work?
Integrating a skeleton
definition, a skeletal mesh
and an animation blueprint
it is possible to control each
“bone” of the skeleton

7. What has been done
Managed to control a
skeleton joint using a C++
function to compute the
angle with respect to how
much time passed and
apply it using Blueprint

8. C++
Computing data every frame
and updating public variable

9. Blueprint
Getting data from the
C++ implementation

10. Current problem
Implemented a network
socket using Unreal Engine
4 low-level platform
independent interfaces as
BluePrint-callable library.
However none of the
functions are visible in the
editor, maybe due to a
library private variable.

11. 2.
Future work
Next steps for
the project

12. Proposed structure for Server-based communications

13. Future work
Make Network Library work
Create PC server
Render body occlusion
Define a file structure for future uses

14. Thanks!
Any questions?
@Jazzinghen
MicheleBianchi@protonmail.com / jazzinghen@gmail.
com
Presentation template by SlidesCarnival

15. SlidesCarnival icons are editable shapes.
This means that you can:
● Resize them without losing
quality.
● Change fill color and opacity.
● Change line color, width and
style.
Isn’t that nice? :)
Examples: