This document describes a remote debug system designed for SAGEMCOM to help debug software issues in customer products without needing to be on-site. The system collects exception logs and other information from products in the field and uploads it to a log server for analysis. It includes modules for exception log saving, log uploading, and remote information collection. While useful for many issues, it has some limitations like being unable to debug problems that occur during the boot process or when internet connectivity is not available.

1. Remote Debug System
Wei Shi
weishigoname@hotmail.com
March, 2014
Designed for SAGEMCOM

2. Background
• Customer complain software issue
• No much useful information available
• Issue failed to reproduce in LAB
• Impossible to debug on-site

3. Network Setup

4. System Architecture

5. • Exception Log Saving: This module is used to
save exception log when some abnormal
behavior happens in products on-site
• Log Uploading: The module is used to send
exceptional log, and syslog into log server
• Information Collecting: The module is used to
remote information collecting, and debug

6. Exception Log Saving

7. Exception Type
• User Space in general -- recoverable
application crash, memory leak, dead lock
• User Space Main Process -- unrecoverable
• Kernel Space -- unrecoverable
Crash, memory, dead lock -- sleep safe
Interrupt -- sleep unsafe

8. Log Uploading

9. Information Collecting

10. Limitation & difficult
• Rely on Internet connection
• Impossible to debug boot issue
• Can’t sacrifice customer’s product experience

11. Q&A

12. Thank you