7. definition
Augmenta is a combination of hardware (multiple 3D
cameras, dedicated computers and a server computer)
and software (Image analysis, data fusion, tools, etc.)
which provides the position of every person or object in
scene via OSC, along with other useful data.
the technology
8. installation
Unlimited number of cameras
1 – 6 m
from the
ground
Cameras can
be positioned
at an angle
Overlaps are correctly handled
the technology
9. features
Performance
• Unlimited area size
• Unlimited number of people
• Precision up to a few millimetres
• Fast computation per frame
Simplicity
• Universal data protocol (OSC)
• Plug-and-play
• Web interface for setup
the technology
Augmenta web interface
13. intro
The power of Augmenta is that you don’t have to know how it works to use it.
Just listen to the OSC data in your favourite language/framework or use one
of the existing libs and examples (Processing / OpenFrameworks / Unity / … )
We chose to release everything client-side in open source, so feel free to
contribute, ask for help and share with us and the community !
getting started
15. data
/au/personEntered args0 arg1 ...
/au/personWillLeave args0 arg1 …
/au/personUpdated args0 arg1 …
Where args are :
0: pid (int)
1: oid (int)
2: age (int)
3: centroid.x (float 0-1)
4: centroid.y (float 0-1)
5: velocity.x (float 0-1)
6: velocity.y (float 0-1)
7: depth (float)
8: boundingRect.x (float 0-1)
9: boundingRect.y (float 0-1)
10: boundingRect.width (float 0-
1)
11: boundingRect.height (float
0-1)
12: highest.x (float 0-1)
13: highest.y (float 0-1)
14: highest.z (float 0-1)
// Personal ID ex : 42th person to enter has
pid=41
// Ordered ID ex : 3rd person still present has
oid=2
// Time on stage (in frame number)
// Position projected to the ground
// Speed and direction vector
// Distance to sensor (in m) (not implemented)
// Top view bounding box
// Highest point placement (not implemented)
// Height of the person (not implemented)
Messages sent for each detected person :
getting started
16. data
/au/scene args0 arg1 …
Where args are :
0: currentTime (int)
1: percentCovered (float 0-1)
2: numPeople (int)
3: averageMotion.x (float 0-1)
4: averageMotion.y (float 0-1)
5: scene.width (int)
6: scene.height (int)
7: scene.depth (int)
// Time (in frame number)
// Percent covered
// Number of person
// Average motion
// Scene size
// (not implemented)
getting started
Message sent each frame to describe the scene :
Data protocol is up-to-date here :
https://github.com/Theoriz/Augmenta/wiki
17. tools
A tool to simulate Augmenta data for testing
purposes.
- Simulate a moving person with the mouse
- Simulate a grid of people moving
automatically (up to thousands of people)
- Simulate a custom Augmenta scene size
Instructions, download, source :
https://github.com/Theoriz/Augmenta-Simulator
simulator
getting started
18. tools
Optional app to trigger OSC messages
depending of people’s position in the scene
- No coding skills needed
- Trigger custom OSC messages when someone
enters or leaves a custom polygonal area
- Link directly with any audio / video / other OSC
compatible software
…
area2osc
Instructions and download :
https://github.com/Theoriz/Augmenta/releases
getting started
19. libraries
If you want more creative freedom, you can either listen
to the OSC messages in your favourite program or start
using one of the existing libraries and examples
Find the complete list on https://github.com/Theoriz
getting started
20. libraries
- Easy to learn/use
- Multiple examples (2D/3D/assets)
- Complete set of features
- Interactive area cropping, auto adjust scene size,
etc.
- Advanced debug info
Instructions and download :
https://github.com/Theoriz/AugmentaP5
getting started
processing
21. libraries
- Complete set of features
- Advanced debug info
Instructions and download :
https://github.com/Theoriz/ofxAugmenta
openframeworks
getting started
22. libraries
- 3D engine
- Complete set of features
Instructions and download :
https://github.com/Theoriz/AugmentaUnity
getting started
unity
23. libraries
Contribute !
You can help us and the community by sending bug reports,
submitting pull requests and sharing your own examples /
libraries.
Find the guidelines here :
https://github.com/Theoriz/Augmenta/wiki
…
getting started
24. ready ?
start here :
https://github.com/Theoriz/Augmenta/wiki
getting started