SlideShare a Scribd company logo
From Virtual to Real World: Applying
Animation to Design the
Activity Recognition System
Keio University
Chengshuo Xia, Sugiura Yuta
Late Breaking Work
• Data-driven Human Activity Recognition (HAR) system relies on
the training dataset which is collected from the significant signal
variation regions.
• Such regions limited the flexibility to alter the sensor position.
• Change the position requires the system to re-collect the sensory
data from desired position.
2
Background
Specific position
sensory data
collection
HAR Training Application
• A virtual platform combined with sensor simulation to design the
non-visual HAR systems.
• Provide the accuracy as the feedback of examined positions via
cross-validation.
• Virtual sensor can be tested to check the corresponding accuracy.
• Classifier interface trained by simulation signal can be generated
forwarding to the real activity recognition.
3
System
UNITY 3D based platform
• Input data stream:
• Generated from Xsens MVN taken by subjects.
• Sensor Simulation:
• HAR system based on virtual dataset:
• Down-sampled to decrease frame rate influence
• Segmentation
• Augmentation
4
System
• Case-a:
Wearable acceleromters system for daily activity recognition
Testing & Application
Several types of daily activity recognition with an accelerometer
worn on the body.
User can have customized demand of sensor position and
activity recognized.
• Case-b:
Wearable distance sensor system for exercises recognition
Testing & Application
Design a wearable distance sensor system which the sensor is
attached on the lower limbs of an individual.
• Case-c:
Distance sensing system for motion recognition in a bathroom
Testing & Application
Distance map into
grayscale figure
• Result:
Testing & Application
9
Conclusion
• Virtual simulation environment to produce the simulated multi-
modal sensor data.
• Drop back the position choice to the end-user side.
• Arbitrarily to place the sensor in the virtual scenario.
• Combine with virtual sensory, improve the process of HAR
system design.
• Recognize the activity in the real-world
• Future work:
• Virtual motion generator
• VR/AR combined for serious/somatosensory game
Thank you very much!

More Related Content

What's hot

3d Machine Vision Systems Paper Presentation
3d  Machine Vision Systems Paper Presentation3d  Machine Vision Systems Paper Presentation
3d Machine Vision Systems Paper Presentation
guestac67362
 
Collecting big data in cinemas to improve recommendation systems - a model wi...
Collecting big data in cinemas to improve recommendation systems - a model wi...Collecting big data in cinemas to improve recommendation systems - a model wi...
Collecting big data in cinemas to improve recommendation systems - a model wi...
ICDEcCnferenece
 
Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...
Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...
Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...
Olympus IMS
 
Activity Recognition using Cell Phone Accelerometers
Activity Recognition using Cell Phone AccelerometersActivity Recognition using Cell Phone Accelerometers
Activity Recognition using Cell Phone Accelerometers
Ishara Amarasekera
 
Fingerprint Images Enhancement ppt
Fingerprint Images Enhancement pptFingerprint Images Enhancement ppt
Fingerprint Images Enhancement ppt
Mukta Gupta
 
Machine vision systems ppt
Machine vision systems pptMachine vision systems ppt
Machine vision systems ppt
Akash Maurya
 
Micrometry
MicrometryMicrometry
Micrometry
sachuelsa
 
On the Development of A Real-Time Multi-Sensor Activity Recognition System
On the Development of A Real-Time Multi-Sensor Activity Recognition SystemOn the Development of A Real-Time Multi-Sensor Activity Recognition System
On the Development of A Real-Time Multi-Sensor Activity Recognition System
Oresti Banos
 
Micrometry and camera lucida
Micrometry and camera lucidaMicrometry and camera lucida
Micrometry and camera lucida
Kottakkal farook arts and science college
 
Tot.st 1
Tot.st 1Tot.st 1
Tot.st 1
Shalika Manoj
 
Scanner
ScannerScanner
Scanner
Nikhil Jha
 
Micoscopy lesson 2
Micoscopy lesson 2Micoscopy lesson 2
Micoscopy lesson 2
Aneela Arshad
 
ppt on image processing
ppt on image processingppt on image processing
ppt on image processing
sangeethachinnasamy
 
A benchmark dataset to evaluate sensor displacement in activity recognition
A benchmark dataset to evaluate sensor displacement in activity recognitionA benchmark dataset to evaluate sensor displacement in activity recognition
A benchmark dataset to evaluate sensor displacement in activity recognition
Oresti Banos
 
Lecture 06: Features and Uncertainty
Lecture 06: Features and UncertaintyLecture 06: Features and Uncertainty
Lecture 06: Features and Uncertainty
University of Colorado at Boulder
 
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
CSCJournals
 
fundamentals of machine vision system
fundamentals of machine vision systemfundamentals of machine vision system
fundamentals of machine vision system
shalet kochumuttath Shaji
 
Why Customizable Imaging Software is Better than a "Jack of All Trades"
Why Customizable Imaging Software is Better than a "Jack of All Trades"Why Customizable Imaging Software is Better than a "Jack of All Trades"
Why Customizable Imaging Software is Better than a "Jack of All Trades"
Olympus IMS
 
Indoor localisation and dead reckoning using Sensor Tag™ BLE.
Indoor localisation and dead reckoning using Sensor Tag™ BLE.Indoor localisation and dead reckoning using Sensor Tag™ BLE.
Indoor localisation and dead reckoning using Sensor Tag™ BLE.
Abhishek Madav
 

What's hot (19)

3d Machine Vision Systems Paper Presentation
3d  Machine Vision Systems Paper Presentation3d  Machine Vision Systems Paper Presentation
3d Machine Vision Systems Paper Presentation
 
Collecting big data in cinemas to improve recommendation systems - a model wi...
Collecting big data in cinemas to improve recommendation systems - a model wi...Collecting big data in cinemas to improve recommendation systems - a model wi...
Collecting big data in cinemas to improve recommendation systems - a model wi...
 
Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...
Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...
Using Digital Microscopes to Solve Common Microscopy Issues: Even First-Time ...
 
Activity Recognition using Cell Phone Accelerometers
Activity Recognition using Cell Phone AccelerometersActivity Recognition using Cell Phone Accelerometers
Activity Recognition using Cell Phone Accelerometers
 
Fingerprint Images Enhancement ppt
Fingerprint Images Enhancement pptFingerprint Images Enhancement ppt
Fingerprint Images Enhancement ppt
 
Machine vision systems ppt
Machine vision systems pptMachine vision systems ppt
Machine vision systems ppt
 
Micrometry
MicrometryMicrometry
Micrometry
 
On the Development of A Real-Time Multi-Sensor Activity Recognition System
On the Development of A Real-Time Multi-Sensor Activity Recognition SystemOn the Development of A Real-Time Multi-Sensor Activity Recognition System
On the Development of A Real-Time Multi-Sensor Activity Recognition System
 
Micrometry and camera lucida
Micrometry and camera lucidaMicrometry and camera lucida
Micrometry and camera lucida
 
Tot.st 1
Tot.st 1Tot.st 1
Tot.st 1
 
Scanner
ScannerScanner
Scanner
 
Micoscopy lesson 2
Micoscopy lesson 2Micoscopy lesson 2
Micoscopy lesson 2
 
ppt on image processing
ppt on image processingppt on image processing
ppt on image processing
 
A benchmark dataset to evaluate sensor displacement in activity recognition
A benchmark dataset to evaluate sensor displacement in activity recognitionA benchmark dataset to evaluate sensor displacement in activity recognition
A benchmark dataset to evaluate sensor displacement in activity recognition
 
Lecture 06: Features and Uncertainty
Lecture 06: Features and UncertaintyLecture 06: Features and Uncertainty
Lecture 06: Features and Uncertainty
 
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
An Enhanced Computer Vision Based Hand Movement Capturing System with Stereo ...
 
fundamentals of machine vision system
fundamentals of machine vision systemfundamentals of machine vision system
fundamentals of machine vision system
 
Why Customizable Imaging Software is Better than a "Jack of All Trades"
Why Customizable Imaging Software is Better than a "Jack of All Trades"Why Customizable Imaging Software is Better than a "Jack of All Trades"
Why Customizable Imaging Software is Better than a "Jack of All Trades"
 
Indoor localisation and dead reckoning using Sensor Tag™ BLE.
Indoor localisation and dead reckoning using Sensor Tag™ BLE.Indoor localisation and dead reckoning using Sensor Tag™ BLE.
Indoor localisation and dead reckoning using Sensor Tag™ BLE.
 

Similar to From Virtual to Real World: Applying Animation to Design the Activity Recognition System (CHI2021 LBW)

Augumented reallity
Augumented reallityAugumented reallity
Augumented reallity
Shashwat Shriparv
 
Sensor's inside
Sensor's insideSensor's inside
Sensor's inside
Anando Kumar Paul
 
Android location and sensors API
Android location and sensors APIAndroid location and sensors API
Android location and sensors API
eleksdev
 
Machine learning and Autonomous System
Machine learning and Autonomous SystemMachine learning and Autonomous System
Machine learning and Autonomous System
Anshul Saxena
 
final report-4
final report-4final report-4
final report-4
Zhuo Li
 
final presentation from William, Amy and Alex
final presentation from William, Amy and Alexfinal presentation from William, Amy and Alex
final presentation from William, Amy and Alex
Ziwei Zhu
 
RSS and Sensor Fusion Algorithms for Indoor Location Systems on Smartphones
RSS and Sensor Fusion Algorithms for Indoor Location Systems on SmartphonesRSS and Sensor Fusion Algorithms for Indoor Location Systems on Smartphones
RSS and Sensor Fusion Algorithms for Indoor Location Systems on Smartphones
UOC Universitat Oberta de Catalunya
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learning
pratik pratyay
 
slide-171212080528.pptx
slide-171212080528.pptxslide-171212080528.pptx
slide-171212080528.pptx
SharanrajK22MMT1003
 
Towards Rapid Implementation of Adaptive Robotic Systems
Towards Rapid Implementation of Adaptive Robotic SystemsTowards Rapid Implementation of Adaptive Robotic Systems
Towards Rapid Implementation of Adaptive Robotic Systems
MeshDynamics
 
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
IRJET Journal
 
Internet of Things: Energy Efficient Public Sensing
Internet of Things: Energy Efficient Public SensingInternet of Things: Energy Efficient Public Sensing
Internet of Things: Energy Efficient Public Sensing
Rashed Miraj
 
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
Edge AI and Vision Alliance
 
NERC_panoptes_final2
NERC_panoptes_final2NERC_panoptes_final2
NERC_panoptes_final2
Manomit Bal
 
Sensor Cloud
Sensor CloudSensor Cloud
Sensor Cloud
Debjyoti Ghosh
 
Deep VO and SLAM IV
Deep VO and SLAM IVDeep VO and SLAM IV
Deep VO and SLAM IV
Yu Huang
 
Track 1 session 1 - st dev con 2016 - contextual awareness
Track 1   session 1 - st dev con 2016 - contextual awarenessTrack 1   session 1 - st dev con 2016 - contextual awareness
Track 1 session 1 - st dev con 2016 - contextual awareness
ST_World
 
Rule-based Real-Time Activity Recognition in a Smart Home Environment
Rule-based Real-Time Activity Recognition in a Smart Home EnvironmentRule-based Real-Time Activity Recognition in a Smart Home Environment
Rule-based Real-Time Activity Recognition in a Smart Home Environment
George Baryannis
 
Virtual Yoga System Using Kinect Sensor
Virtual Yoga System Using Kinect SensorVirtual Yoga System Using Kinect Sensor
Virtual Yoga System Using Kinect Sensor
IRJET Journal
 
JPN1414 Distributed Deployment Algorithms for Improved Coverage in a Networ...
JPN1414   Distributed Deployment Algorithms for Improved Coverage in a Networ...JPN1414   Distributed Deployment Algorithms for Improved Coverage in a Networ...
JPN1414 Distributed Deployment Algorithms for Improved Coverage in a Networ...
chennaijp
 

Similar to From Virtual to Real World: Applying Animation to Design the Activity Recognition System (CHI2021 LBW) (20)

Augumented reallity
Augumented reallityAugumented reallity
Augumented reallity
 
Sensor's inside
Sensor's insideSensor's inside
Sensor's inside
 
Android location and sensors API
Android location and sensors APIAndroid location and sensors API
Android location and sensors API
 
Machine learning and Autonomous System
Machine learning and Autonomous SystemMachine learning and Autonomous System
Machine learning and Autonomous System
 
final report-4
final report-4final report-4
final report-4
 
final presentation from William, Amy and Alex
final presentation from William, Amy and Alexfinal presentation from William, Amy and Alex
final presentation from William, Amy and Alex
 
RSS and Sensor Fusion Algorithms for Indoor Location Systems on Smartphones
RSS and Sensor Fusion Algorithms for Indoor Location Systems on SmartphonesRSS and Sensor Fusion Algorithms for Indoor Location Systems on Smartphones
RSS and Sensor Fusion Algorithms for Indoor Location Systems on Smartphones
 
Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learning
 
slide-171212080528.pptx
slide-171212080528.pptxslide-171212080528.pptx
slide-171212080528.pptx
 
Towards Rapid Implementation of Adaptive Robotic Systems
Towards Rapid Implementation of Adaptive Robotic SystemsTowards Rapid Implementation of Adaptive Robotic Systems
Towards Rapid Implementation of Adaptive Robotic Systems
 
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
 
Internet of Things: Energy Efficient Public Sensing
Internet of Things: Energy Efficient Public SensingInternet of Things: Energy Efficient Public Sensing
Internet of Things: Energy Efficient Public Sensing
 
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
“Sensor Fusion Techniques for Accurate Perception of Objects in the Environme...
 
NERC_panoptes_final2
NERC_panoptes_final2NERC_panoptes_final2
NERC_panoptes_final2
 
Sensor Cloud
Sensor CloudSensor Cloud
Sensor Cloud
 
Deep VO and SLAM IV
Deep VO and SLAM IVDeep VO and SLAM IV
Deep VO and SLAM IV
 
Track 1 session 1 - st dev con 2016 - contextual awareness
Track 1   session 1 - st dev con 2016 - contextual awarenessTrack 1   session 1 - st dev con 2016 - contextual awareness
Track 1 session 1 - st dev con 2016 - contextual awareness
 
Rule-based Real-Time Activity Recognition in a Smart Home Environment
Rule-based Real-Time Activity Recognition in a Smart Home EnvironmentRule-based Real-Time Activity Recognition in a Smart Home Environment
Rule-based Real-Time Activity Recognition in a Smart Home Environment
 
Virtual Yoga System Using Kinect Sensor
Virtual Yoga System Using Kinect SensorVirtual Yoga System Using Kinect Sensor
Virtual Yoga System Using Kinect Sensor
 
JPN1414 Distributed Deployment Algorithms for Improved Coverage in a Networ...
JPN1414   Distributed Deployment Algorithms for Improved Coverage in a Networ...JPN1414   Distributed Deployment Algorithms for Improved Coverage in a Networ...
JPN1414 Distributed Deployment Algorithms for Improved Coverage in a Networ...
 

More from sugiuralab

ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識
ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識
ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識
sugiuralab
 
ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法
ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法
ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法
sugiuralab
 
TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案
TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案
TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案
sugiuralab
 
Selfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェース
Selfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェースSelfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェース
Selfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェース
sugiuralab
 
スマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システムスマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システム
sugiuralab
 
EarAuthCam: Personal Identification and Authentication Method Using Ear Image...
EarAuthCam: Personal Identification and Authentication Method Using Ear Image...EarAuthCam: Personal Identification and Authentication Method Using Ear Image...
EarAuthCam: Personal Identification and Authentication Method Using Ear Image...
sugiuralab
 
プレイマットのパターン生成支援ツールの評価
プレイマットのパターン生成支援ツールの評価プレイマットのパターン生成支援ツールの評価
プレイマットのパターン生成支援ツールの評価
sugiuralab
 
プレイマットのパターン生成支援ツール
プレイマットのパターン生成支援ツールプレイマットのパターン生成支援ツール
プレイマットのパターン生成支援ツール
sugiuralab
 
EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
sugiuralab
 
SkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイス
SkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイスSkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイス
SkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイス
sugiuralab
 
バイオリンの運弓動作計測による初心者と経験者の差異分析
バイオリンの運弓動作計測による初心者と経験者の差異分析バイオリンの運弓動作計測による初心者と経験者の差異分析
バイオリンの運弓動作計測による初心者と経験者の差異分析
sugiuralab
 
Converting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring CapacitanceConverting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring Capacitance
sugiuralab
 
Pinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic SensorPinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic Sensor
sugiuralab
 
Smartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing MotionsSmartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing Motions
sugiuralab
 
Tactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion TrajectoryTactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion Trajectory
sugiuralab
 
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
sugiuralab
 
Seeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow InputSeeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow Input
sugiuralab
 
Identification and Authentication Using Clavicles
Identification and Authentication Using ClaviclesIdentification and Authentication Using Clavicles
Identification and Authentication Using Clavicles
sugiuralab
 
Estimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective SensorsEstimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective Sensors
sugiuralab
 
バウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイスバウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイス
sugiuralab
 

More from sugiuralab (20)

ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識
ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識
ヒアラブルへの入力を想定したユーザ定義型ジェスチャ調査と IMUセンサによる耳タッチジェスチャの認識
 
ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法
ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法
ShadoCookies: 視点位置に依存して情報切り替え可能なクッキー製造手法
 
TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案
TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案
TataPixel: 畳の異方性を利用した切り替え可能なディスプレイの提案
 
Selfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェース
Selfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェースSelfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェース
Selfie WanD: 自撮り棒を動かすことによる撮影用入力インタフェース
 
スマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システムスマートフォンを用いた新生児あやし動作の教示システム
スマートフォンを用いた新生児あやし動作の教示システム
 
EarAuthCam: Personal Identification and Authentication Method Using Ear Image...
EarAuthCam: Personal Identification and Authentication Method Using Ear Image...EarAuthCam: Personal Identification and Authentication Method Using Ear Image...
EarAuthCam: Personal Identification and Authentication Method Using Ear Image...
 
プレイマットのパターン生成支援ツールの評価
プレイマットのパターン生成支援ツールの評価プレイマットのパターン生成支援ツールの評価
プレイマットのパターン生成支援ツールの評価
 
プレイマットのパターン生成支援ツール
プレイマットのパターン生成支援ツールプレイマットのパターン生成支援ツール
プレイマットのパターン生成支援ツール
 
EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
EarHover:ヒアラブルデバイスにおける音漏れ信号を用いた空中ジェスチャ認識
 
SkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイス
SkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイスSkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイス
SkinRing: 装着方向に依らない指側面でのジェスチャ入力可能なリング型デバイス
 
バイオリンの運弓動作計測による初心者と経験者の差異分析
バイオリンの運弓動作計測による初心者と経験者の差異分析バイオリンの運弓動作計測による初心者と経験者の差異分析
バイオリンの運弓動作計測による初心者と経験者の差異分析
 
Converting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring CapacitanceConverting Tatamis into Touch Sensors by Measuring Capacitance
Converting Tatamis into Touch Sensors by Measuring Capacitance
 
Pinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic SensorPinch Force Measurement Using a Geomagnetic Sensor
Pinch Force Measurement Using a Geomagnetic Sensor
 
Smartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing MotionsSmartphone-Based Teaching System for Neonate Soothing Motions
Smartphone-Based Teaching System for Neonate Soothing Motions
 
Tactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion TrajectoryTactile Presentation of Orchestral Conductor's Motion Trajectory
Tactile Presentation of Orchestral Conductor's Motion Trajectory
 
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective SensorsTouchLog: Finger Micro Gesture Recognition  Using Photo-Reflective Sensors
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
 
Seeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow InputSeeing the Wind: An Interactive Mist Interface for Airflow Input
Seeing the Wind: An Interactive Mist Interface for Airflow Input
 
Identification and Authentication Using Clavicles
Identification and Authentication Using ClaviclesIdentification and Authentication Using Clavicles
Identification and Authentication Using Clavicles
 
Estimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective SensorsEstimation of Violin Bow Pressure Using Photo-Reflective Sensors
Estimation of Violin Bow Pressure Using Photo-Reflective Sensors
 
バウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイスバウンサーを動かす外付けデバイス
バウンサーを動かす外付けデバイス
 

Recently uploaded

Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
DianaGray10
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Precisely
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
BibashShahi
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Ajin Abraham
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Pitangent Analytics & Technology Solutions Pvt. Ltd
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 

Recently uploaded (20)

Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 

From Virtual to Real World: Applying Animation to Design the Activity Recognition System (CHI2021 LBW)

  • 1. From Virtual to Real World: Applying Animation to Design the Activity Recognition System Keio University Chengshuo Xia, Sugiura Yuta Late Breaking Work
  • 2. • Data-driven Human Activity Recognition (HAR) system relies on the training dataset which is collected from the significant signal variation regions. • Such regions limited the flexibility to alter the sensor position. • Change the position requires the system to re-collect the sensory data from desired position. 2 Background Specific position sensory data collection HAR Training Application
  • 3. • A virtual platform combined with sensor simulation to design the non-visual HAR systems. • Provide the accuracy as the feedback of examined positions via cross-validation. • Virtual sensor can be tested to check the corresponding accuracy. • Classifier interface trained by simulation signal can be generated forwarding to the real activity recognition. 3 System
  • 4. UNITY 3D based platform • Input data stream: • Generated from Xsens MVN taken by subjects. • Sensor Simulation: • HAR system based on virtual dataset: • Down-sampled to decrease frame rate influence • Segmentation • Augmentation 4 System
  • 5. • Case-a: Wearable acceleromters system for daily activity recognition Testing & Application Several types of daily activity recognition with an accelerometer worn on the body. User can have customized demand of sensor position and activity recognized.
  • 6. • Case-b: Wearable distance sensor system for exercises recognition Testing & Application Design a wearable distance sensor system which the sensor is attached on the lower limbs of an individual.
  • 7. • Case-c: Distance sensing system for motion recognition in a bathroom Testing & Application Distance map into grayscale figure
  • 8. • Result: Testing & Application
  • 9. 9 Conclusion • Virtual simulation environment to produce the simulated multi- modal sensor data. • Drop back the position choice to the end-user side. • Arbitrarily to place the sensor in the virtual scenario. • Combine with virtual sensory, improve the process of HAR system design. • Recognize the activity in the real-world • Future work: • Virtual motion generator • VR/AR combined for serious/somatosensory game
  • 10. Thank you very much!