Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Online feature extraction
and event generation for
computer-animal
interaction
Leon Bonde Larsen & Mathias Neerup
Advanced...
Introduction
Introduction
ATS v2.0
Problem: Stateless HTTP protocol
State using cookies
State using cookies
Memory
Server process
Process
Server side playing
somePlayer
Server side playing > Multiple users
Server side playing > Multiple users > Containers
Streams
Streams > Producers
Streams > Consumers
Streams > Historian
Streams > Processors
Event Database
Streams > Implementation
ATS v1.0
ATS v1.0> Limitations
▪ Janus WebRTC
▪ One user at a time
ATS v2.0
▪ Docker swarm
▪ React
▪ Redux
▪ SocketIO
▪ Semantic UI
ATS v2.0 > Janus
Janus
- Janus
- Input: Stream
ATS v2.0 > Backend
Backend
- Player
- Avahi Info.
ATS v2.0 > Plugin
Plugin
- A react
component
- Inputs
- Outputs
- Image
ATS v2.0 > Services
ATS v2.0 > Services
ATS v2.0 > Services
ATS v2.0 > Services
Container (service) pooling
▪ Pooler
▪ Service
▪ Acquired
▪ Released
▪ Policies
▪ Memory
Container (service) pooling
▪ Label on service
▪ SessionID
▪ Release policy
▪ 24 hours
▪ Closing session
Multicast traffic
▪ Multicast streams
▪ Enable IPv6
▪ Connect to bridge
https://github.com/mcproxy/mcproxy
Multicast traffic
▪ Multicast streams
▪ Avahi
▪ Avahi-daemon
▪ reflector
https://github.com/mcproxy/mcproxy
CD/CI
▪ Gitlab docker registry
CD/CI - imageUpdater
▪ Gitlab docker registry
CD/CI - deploy strategy
▪ Gitlab docker registry
Software stack
Hardware
Docker swarm is suitable in biological research
Summary
Demo
Questions ?
Leon Bonde Larsen Mads Tilgaard Jensen Mathias Neerup
Ph.d Student programmer Research Assistant
https://acsg....
Demo - Video
Results
Upcoming SlideShare
Loading in …5
×

DCSF 19 Online Feature Extraction and Event Generation for Computer-Animal Interaction

47 views

Published on

This talk will present an architecture developed to investigate the interaction with and between animals. The architecture allows online processing of multimedia streams and the generation, storing and visualizing of events using feature extraction. It allows biologists to analyze the events by monitoring live or by replaying streams through a web interface Docker swarm is the central component of the architecture and serves as infrastructure for stream processing, event generation, event processing and visualization. The main entry point for users is a web interface that spins up one container per user and allows independent replay of streams. This talk will focus on the architecture and on technical details concerning its implementation as well as how docker is utilized to process, store and visualize events. Some time will be spent explaining details about custom made docker solutions.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

DCSF 19 Online Feature Extraction and Event Generation for Computer-Animal Interaction

  1. 1. Online feature extraction and event generation for computer-animal interaction Leon Bonde Larsen & Mathias Neerup Advanced Computer Systems Group
  2. 2. Introduction
  3. 3. Introduction
  4. 4. ATS v2.0
  5. 5. Problem: Stateless HTTP protocol
  6. 6. State using cookies
  7. 7. State using cookies Memory
  8. 8. Server process Process
  9. 9. Server side playing somePlayer
  10. 10. Server side playing > Multiple users
  11. 11. Server side playing > Multiple users > Containers
  12. 12. Streams
  13. 13. Streams > Producers
  14. 14. Streams > Consumers
  15. 15. Streams > Historian
  16. 16. Streams > Processors Event Database
  17. 17. Streams > Implementation
  18. 18. ATS v1.0
  19. 19. ATS v1.0> Limitations ▪ Janus WebRTC ▪ One user at a time
  20. 20. ATS v2.0 ▪ Docker swarm ▪ React ▪ Redux ▪ SocketIO ▪ Semantic UI
  21. 21. ATS v2.0 > Janus Janus - Janus - Input: Stream
  22. 22. ATS v2.0 > Backend Backend - Player - Avahi Info.
  23. 23. ATS v2.0 > Plugin Plugin - A react component - Inputs - Outputs - Image
  24. 24. ATS v2.0 > Services
  25. 25. ATS v2.0 > Services
  26. 26. ATS v2.0 > Services
  27. 27. ATS v2.0 > Services
  28. 28. Container (service) pooling ▪ Pooler ▪ Service ▪ Acquired ▪ Released ▪ Policies ▪ Memory
  29. 29. Container (service) pooling ▪ Label on service ▪ SessionID ▪ Release policy ▪ 24 hours ▪ Closing session
  30. 30. Multicast traffic ▪ Multicast streams ▪ Enable IPv6 ▪ Connect to bridge https://github.com/mcproxy/mcproxy
  31. 31. Multicast traffic ▪ Multicast streams ▪ Avahi ▪ Avahi-daemon ▪ reflector https://github.com/mcproxy/mcproxy
  32. 32. CD/CI ▪ Gitlab docker registry
  33. 33. CD/CI - imageUpdater ▪ Gitlab docker registry
  34. 34. CD/CI - deploy strategy ▪ Gitlab docker registry
  35. 35. Software stack
  36. 36. Hardware
  37. 37. Docker swarm is suitable in biological research Summary
  38. 38. Demo
  39. 39. Questions ? Leon Bonde Larsen Mads Tilgaard Jensen Mathias Neerup Ph.d Student programmer Research Assistant https://acsg.sdu.dk
  40. 40. Demo - Video
  41. 41. Results

×