The rock climbing community in South Tyrol is an important touristic and cultural factor. Not only locals but also many tourists come here to take practice in both indoor and outdoor climbing. With the project SALSA, we are trying to analyze the activity of climbers. We want to identify, if a person is falling, climbing, and if the climber is taking a break. Furthermore, we want that our application can be used to measure the amount of time a climber needs to finish a certain route. To solve this problem, we used the stereo camera ZED 2, by the manufacturer Stereo Labs. With its body tracking, object detection, and depth-sensing features we were able to measure the relative coordinates and speed of a body in front of the camera. and so to track the movement of a climber. In this talk, I present the first prototype running on the Jetson Nano, a portable computer with a GPU necessary to process the images obtained through the camera.

1. Tracking
climbers using
stereo cameras
Meraner Alex

2. The overall goal of
the project „SALSA“
• Being able to detect a climbers’
activity in a climbing gym
• To provide feedback to climbing
gyms about any type of problem
• Detect popularity of certain
climbing routes
2
Sensors and data for the
analysis of sports activities

3. Context
• Who am I?
• The team
3

4. The objective
• We want to identify, if a person is
falling, climbing upwards or
downwards and if the climber is taking
a break
• Furthermore, we want that our
application can be used to measure
the amount of time a climber needs to
finish a certain route
* Picture © 2021 Go Climb Magazine, https://goclimbmagazine.com/the-secret-to-overcoming-your-fear-of-falling-lead-climbing/
4

5. Hardware
• ZED 2 Stereo camera
• Jetson Nano
5

6. Used algorithms
• Body tracking
• Object detection
6

7. Data processing and analysis
• Logging
• Anomaly detection
7

8. Testing phase
• Manual tests
8

9. Testing results
• First prototype
• Visualization
9
Distance
of
the
object
from
the
camera Camera
Jetson Nano
Browser
Time
Sends data
about objects
Gets current
visualization
Log file Web server

10. Thank you for the attention!
10