The document discusses NUGU SDK, which allows developers to connect applications to NUGU AI assistants. It describes the SDK architecture including layers for the SDK, device control, and applications. It also outlines key SDK functions like device authentication flows, integrating with the SDK, and capability interfaces that applications use to control device functions through directives from the NUGU server. Extension agents allow supporting new capabilities by creating custom directives and applications.

1. NUGU SDK
SK 텔레콤 AI Assistant 개발 Cell
이민철

2. NUGU SDK history
Device 인증 flow
NUGU SDK 연동 flow

3. NUGU SDK history
NUGU 스피커

4. NUGU SDK history
NUGU SDK

5. NUGU SDK history
SDK Layer
Device Control Layer
Application Layer

6. NUGU SDK history
SDK Layer
Device Control Layer
Application Layer
…

7. NUGU SDK history NEW
NUGU play Kit
NUGU Developers
NUGU SDK
Capability
Agent
Capability
Interface

8. NUGU SDK history
•Application/Device 확장성
•서비스 확장성

9. NUGU SDK history
Device 인증 flow
NUGU SDK 연동 flow

10. Device 정보 등록
• Mobile Device
• iPhone
• Android Phone
• Device
• Speaker, Robot, Set-top box, etc…
NUGU Developers
https://developers.nugu.co.kr/#/sdk/nuguSdkInfo

11. NUGU SDK 설치
• Android: Maven
• iOS: Cocoapods
• Linux: APT repository
NUGU Developers
Application + SDK
https://developers-doc.nugu.co.kr/nugu-sdk/platform

12. 사용자 로그인
• OAuth + T아이디
• Client secret
• Secure storage
• Server
• Access/Refresh token
• Expire time
NUGU Developers
Application + SDK
Application + Authorization

13. NUGU 앱
https://play.google.com/store/apps/details?id=com.skt.aladdin
https://apps.apple.com/app/id1142864065

14. NUGU SDK history
Device 인증 flow
NUGU SDK 연동 flow

15. “아리아, NUGU DJ 틀어줘”
NUGU Server
NUGU DJ 서비스 시작 안내
“아리아, NUGU DJ 틀어줘”
NUGU DJ 가 선곡한 음악
NUGU DJ 멘트

16. Microphone
WakeUpDetector
WakeUpDetector
• On device
• Wake up word
• 아리아
• 팅커벨

17. ASRAgent
ASRAgent
• ASR(AutomatedSpeechRecognition)
• State
• Idle
• listening(timeout 7sec)
• recognizing(duration 10sec)
• thinking(timeout 10sec)
• expectingSpeech
Microphone
WakeUpDetector

18. ASRAgent
Idle Listening Recognizing Thinking Expecting Speech

19. NetworkManager
NetworkManager
• HTTP/2
• HTTP/1.1(지원예정)
• WebSocket(지원예정)
ASRAgent
NUGU Server

20. NetworkManager
• Directive
• JSON format 으로 규격 전달
• Capability interface
• 디바이스 기능 제어를 위한 규격
• Capability interface agent
• 규격에 정의된 기능 수행
NUGU Server
NetworkManager
Directive

21. Capability interface agent
TTSAgent
AudioPlayerAgent DisplayAgent
TextAgent
ExtensionAgent MovementAgent
AlertAgent LightAgent
SpeakerAgent BluetoothAgent
MicrophoneAgent
“가장 최근에
등록된 NUGU DJ
6월 12일 에피소드
음악은 FLO
미리듣기로
들려드릴께요.”

22. Capability interface agent
TTSAgent
AudioPlayerAgent DisplayAgent
TextAgent
ExtensionAgent MovementAgent
AlertAgent LightAgent
SpeakerAgent BluetoothAgent
MicrophoneAgent …
https://hpd.music-
flo.com/track/.../1min.m4a

23. TTSAgent
DirectiveSequencer
DirectiveSequencer
AudioPlayerAgent DisplayAgent …
NetworkManager
“가장 최근에 등록된...”Living On A Prayer - Bon Jovi“누군가 어딘가에 ...”

24. Extension agent

25. Extension agent
“지원하지 않는 기능입니다.”“Tmap 에서 집으로 가는 길 안내해줘”

26. Extension agent
NUGU Server
ExtensionAgent
Application
Directive
Directive

27. Play 제작
• Play 생성
• Intent/Action
• Directive
{
"type": "Extension.Action",
"data": {
"action": ”start_app",
”scheme": ”tmap://goto?code=1"
}
}
NUGU Developers
사용자 정의

28. ExtensionAgent
ExtensionAgent
Directive
"header": {
"namespace": ”Extension",
"name": ”Action"
},
"payload": {
"data": {
"action": ”start_app",
”scheme": ”tmap://goto?code=1"
}
}
DirectiveSequencer
Application

29. NUGU SDK
• https://github.com/nugu-developers/nugu-client-kit-ios
•https://github.com/nugu-developers/nugu-android
•https://github.com/nugu-developers/nugu-linux