The document discusses NICTA's work developing portable motion analysis technologies using inertial measurement units (IMUs). It summarizes several applications including monitoring arm movements in stroke patients, detecting gait events in Parkinson's disease patients, measuring sway in epilepsy patients, and assessing surgeons' proficiency. For each application, it describes the customer problem, NICTA's technical approach using IMUs, results compared to existing technologies, and benefits of NICTA's solution such as low-cost portable monitoring of patients in their natural environments.
2. NICTA Copyright 2012 Commercial-in-Confidence 2
NICTA - Overview
• National Information and Communications Technology
(ICT) Australia Ltd
• Supported by Commonwealth, States and Territory
Governments
• Five ICT research labs across Australia
• More than 450 staff across 7 Research Groups and 4
Business Teams
Sydney
Brisbane
Canberra
Melbourne
3. NICTA Copyright 2012 Commercial-in-Confidence
3
Health & Life Science Business Area
Health & Life Sciences
Business Area
Research Groups Partners / Customers
Bioinformatics
• Diagnostic Genomics
• Computational Genomics
• Biomedical Informatics
• Bio-Imaging Analytics
Medical Devices
• Portable Motion Analytics
• Bionic Eye
• Adaptive Bionics
E-Health
• Living Lab
• Hospitals
Royal Melbourne
Kingston Rehab
Eye & Ear
• Medical Research
Institutes
NARI
• Universities
Melbourne
Deakin
CONTROL & SIGNAL
PROCESSING
MACHINE LEARNING
OPTIMISATION
4. NICTA Copyright 2012 Commercial-in-Confidence
Team’s Capabilities
• Algorithm development (signal processing)
• Hardware development
4
5. NICTA Copyright 2012 Commercial-in-Confidence
1. Individual need to be brought into a clinic for assessment
2. Only a limited movement can be analysed in laboratory
3. Artificial environment, where behaviour may be altered
What is the problem in Motion Analysis?
6. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO Sub-mm Technician NO
Current System in the market
7. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Current System in the market
8. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Animazoo Gyroscope > $90,000 NO mm NO NO
The world’s leading
manufacturer of inertial
motion capture systems
Current System in the market
9. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Animazoo Gyroscope > $90,000 NO mm NO NO
Xsense Inertial > $30,000 NO mm wired NO
Current System in the market
10. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Animazoo Gyroscope > $90,000 NO mm NO NO
Xsense Inertial > $30,000 NO mm wired YES
IDEEA Inertial > $5,000 YES mm wired YES
Current System in the market
11. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Animazoo Gyroscope > $90,000 NO mm NO NO
IDEEA Inertial > $5,000 YES mm wired YES
WalkinSens Pressure > $5,000 YES mm Wired YES
Xsense Inertial > $30,000 NO Mm Wired NO
Current System in the market
12. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Animazoo Gyroscope > $90,000 NO mm NO NO
Xsense Inertial > $30,000 NO mm wired NO
IDEEA Inertial > $5,000 NO mm wired NO
WalkinSens Pressure > $8,000 YES mm Wired YES
Shimmer Inertial > $5,000 YES mm Wireless YES
Current System in the market
13. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Animazoo Gyroscope > $90,000 NO mm NO NO
Xsense Inertial > $70,000 NO mm wired NO
IDEEA Inertial > $5,000 NO mm wired NO
WalkinSens Pressure > $8,000 YES mm Wired YES
Nintendo Inertial > $500 YES mm Wireless NO
Shimmer Inertial > $5,000 YES mm Wireless YES
Current System in the market
14. NICTA Copyright 2012 Commercial-in-Confidence
Current Systems in the market
Sensors Price Portable Accuracy Ease of
use
Monitor
natural enviro
Vicon IR Sensors >$250,000 NO mm Technician NO
GaiteRite Pressure
Sensors
> $50,000 NO mm Technician NO
Animazoo Gyroscope > $90,000 NO mm NO NO
Xsense Inertial > $70,000 NO mm wired NO
IDEEA Inertial > $5,000 NO mm wired YES
Shimmer Inertial > $5,000 YES mm Wireless YES
Nintendo Inertial > $500 YES mm Wireless NO
Xbox Inertial > $500 YES mm Wireless NO
WalkinSens Pressure > $5,000 YES mm Wired YES
Current System in the market
16. NICTA Copyright 2012 Commercial-in-Confidence
NICTA’s Sensors
New sensor
New sensor & old sensor
(lengthwise)
New sensor & old sensor
(height wise)
17. NICTA Copyright 2012 Commercial-in-Confidence 17
• In Australia, it is the 2nd single greatest killer after coronary heart
disease costing an estimated $2.14 billion a year.[1]
• 15 million people suffer from stroke worldwide each year. Of these, 5
million die and another 5 million are permanently disabled.[2]
• Early symptom detection, prompt intervention, and post acute
rehabilitation are necessary as stroke is the leading cause of long-
term disability among adults in industrialized countries.[3]
1 Australian Institute of Health and Welfare. Australia’s Health, 2006.
2 International Cardiovascular Disease Statistics (2007 Update). World Health Report, 2007
3 Hummel, F., et al., Effects of non-invasive cortical stimulation on skilled motor function in chronic stroke. Brain, 2005. 128(3): p. 490-499.
What is the Customers Problem & Pain?
Monitoring arm movements in stroke patients
(ROYAL MELBOURNE HOSPITAL)
Stroke
18. NICTA Copyright 2012 Commercial-in-Confidence
What is the Customers Problem & Pain?
Monitoring arm movements
(ROYAL MELBOURNE HOSPITAL)
ReJoyce
Workstation
turn
grip
remove
peg
turn
key
place
coin
turn
jar lid
turn
handle
turn
door knob
19. NICTA Copyright 2012 Commercial-in-Confidence
Shoulder
(3 DOF: α,β,γ)
Elbow
(2 DOF: θ,φ) II: forearm
NICTA Sensor
I
II
Frame 1, z axis fixed
to the upper arm
Frame 2,z axis fixed
to the forearm
Frame 0, the inertial
frame
I: upper arm
Z
X
Y
Z1
X1
Y1
Z2
Y2
X2
The Arm Model
Monitoring arm movements in community
(ROYAL MELBOURNE HOSPITAL)
20. NICTA Copyright 2012 Commercial-in-Confidence
• IMU measurements: gyroscope, accelerometer, magnetometer (biased and noisy)
given in local, rotating frame of reference.
R – rotation matrix between
global & local frames
Gyroscope : Ω – angular velocity,
Ω0 – motion angular velocity
b – bias,
– noise
Accelerometer : a – acceleration,
a0– motion acceleration,
g – gravity vector
ba– bias,
a– noise
Magnetometer : m – direction of magnetic field,
h – Earth Magnetic Field
S.Suvorova, T. Vaithianathan, T. Caelli: “Action Trajectory Reconstruction From Inertial Sensor
Measurements”;11th International Conference on Information Sciences, Signal Processing and their
Applications, July 3rd – 5th July, Montreal, Canada, p1016 – 1021, (2012).
IMU Measurement & Signal Processing
Monitoring arm movements in community
(ROYAL MELBOURNE HOSPITAL)
21. NICTA Copyright 2012 Commercial-in-Confidence
Lifting box above head
Comparison of IMU vs VICON
Monitoring arm movements in community
(ROYAL MELBOURNE HOSPITAL)
IMU{
26. NICTA Copyright 2012 Commercial-in-Confidence
Freezing
• PD is the 2nd most common neurological
condition in Australia
• There are around 100,000 Australians
with PD
• 1 in 7 Australians are diagnosed with PD
before the age of 50
• PD costs the economy $527.8 million.
This figure reaches around $6.3 billion
when loss of quality of life due to
disability is also considered.
(Howard Florey Institute, 2007)
Extremely expensive ($250,000 and upwards).
Measurements “artificial environment”.
Limited number of steps analysed.
Requires highly trained staff.
Process time consuming
NOTHING that measures step length
Limitations
What is the customer’s pain & problem
Parkinson’s Disease
(KINGSTON REHAB)
28. NICTA Copyright 2012 Commercial-in-Confidence
Subject Trial Number of
Strides Walked
Number of
Strides
Detected
Subject A
(Normal)
100 cm Stride 120 120
140 cm Stride 90 90
160 cm Stride 90 90
Subject B
(Normal)
100 cm Stride 90 88
140 cm Stride 90 90
160 cm Stride 90 89
Subject C
(Normal)
100 cm Stride 30 30
140 cm Stride 30 30
160 cm Stride 30 30
Parkinson
Disease
Patient
Before Medication
(Smaller Stride)
27 26
After Medication
(Larger Stride)
22 20
RESULTS
Parkinson’s Disease
(KINGSTON REHAB)
34. NICTA Copyright 2012 Commercial-in-Confidence
NeuroCom ®
Upper back
sensor ONLY
Composite of
four sensors
Fusing the data readings from multiple sensors allows us to match
the NeuroCom® standard for Centre of Pressure much more
closely.
How many sensors?
MEASURE SWAY IN EPILEPSY PATIENTS
(NARI)
IMU
35. NICTA Copyright 2012 Commercial-in-Confidence
Comparison of IMU & Neurocom
MEASURE SWAY IN EPILEPSY PATIENTS
(NARI)
IMU NeuroCom
®
36. NICTA Copyright 2012 Commercial-in-Confidence
Normal Speed
NeuroCom®IMU
Fast Speed
NeuroCom®IMU
Temporary loss of balance is
more obvious in IMU
IMU vs NeuroCom® for different speeds
MEASURE SWAY IN EPILEPSY PATIENTS
(NARI)
37. NICTA Copyright 2012 Commercial-in-Confidence
•Surgical profession is in need of objective assessment of operative
performance
•Objective assessment provided by tracking of hand movements
Metrics:
Stroke Detection (Number)
Stroke Speed
Stroke Length
Stroke (Time) Duration
•Existing tracking systems a very expensive
What is the Customer’s Problem & Pain
ASSESSING SURGEON’S PROFICIENCY
(REEH)
38. NICTA Copyright 2012 Commercial-in-Confidence
RESULTS
ASSESSING SURGEON’S PROFICIENCY DURING SURGERY
(REEH)
Number of
Strokes
(IMU)
Number of
Strokes
(Video)
Avg Time per
Stroke (sec)
Trial1 7 10 1.67
Trial 2 10 10 1.49
Trial 3 12 10 1.45
Trial 4 12 10 1.28
39. NICTA Copyright 2012 Commercial-in-Confidence
Conclusion
Benefits of NICTA Technology
o Provides clinicians metric information
about the movements of patients in
their home environment
o Long term monitoring
– Improved recovery rate of patients
– Improved quality of life of patients
– Improve productivity of medical staff
– Reduced healthcare cost
40
