SlideShare a Scribd company logo
Magnetic Tracking
-- talking from Magic Leap One
James Wang
20th Aug 2018
Magnetic tracking is one of miscellaneous motion capture methods, and
maybe the oldest. However, its working principle is rarely introduced in
detail perhaps due to its early adaptation resides in military and medical
industry. Due to my interest in VR & animation MoCap, I’ve spent
some time digging into the very depth of it and would like to share
some non-confidential knowledge of it with you.
In this slide, a short history of magnetic tracking will be visited, followed
by its working principle and algorithm simulation. Hope you enjoy it.
If you wanna discuss something in depth with me, please don’t
hesitate to contact me via: dibao.wang@gmail.com
Content
• Tech. Overview
• Working Principle
• Modeling & Simulation
• Conclusion
Tech. Overview
Old But Still Sexy
• Magnetic tracking was first used in military, medical and animation industry
• Although it’s old, with patents expired, it’s still powerful in short-range
tracking … even the latest Magic Leap One adopts it as a key component
1990
2011
2013
2018
Raab et al @ 1979
• Remote Object Position And Orientation Locater (US 4,314,251)
• Filed: Jul. 30, 1979
• Almost all EMTS (electromagnetic tracking system) traces back to this patent
filed by Raab
Ascension since 1990
• Wired multi-point tracking by DC-magnetic field emission/detection
Razer Hydra 2011
• Wired two-controller tracking with AC-type magnetic field emission/detection
• Should be the first consumer product of magnetic tracking
Sixsens STEM 2013~
• Wireless 5-point (hands, head and legs) AC magnetic field tracking
• Failed to manufacture until now (a notorious Kickstarter project)
Magic Leap @2017
• Electromagnetic tracking with augmented reality systems (US2017/0307891)
• Filed: Apr. 24, 2017
Magic Leap One @2018
• A wireless 2-controller tracking by AC (or DC) magnetic field
• Thanks for the teardown by iFixit (link)
Receiver Coils
Transmitter
Coils
Limitation
• Near-field error & signal saturation (r< 0.2m)
• Solution: non-linear numerical algorithm, auto-gain control
•
• Far-field noise (r > 1.0 m)
• Solution: sensor fusion
• Metal-induced distortions
• Solution: N/A (old issues though)
• Complex calibration in production site
• Solution: N/A (company like Sixsense seemed to fail at this point)
Working Principle
How Does It Work?
• A 3-axis current loop (emitter) generates magnetic field (DC or AC)
• A 3-axis magnetic sensor (magnetometer or induction coil) measures the field quantity
at surrounding position with any orientation
• A signal processing method to extract the signal components regarding sensor-
emitter pairing relationship
• A pre-built field-pose algorithm reverses the pose of the sensor w.r.t. the emitter
( 𝑟 𝑇𝑥
𝑅𝑥
, 𝑅 𝑇𝑥
𝑅𝑥
)Tx
Rx
Emission
Detection
Extraction
Reversion
M-field Emission
• Biot-Savart law quantitatively determines the magnetic field generated
by a piece of current wire segment
• It’s a building block of magnetic-field modeling
∆Bk=
𝜇0I
4𝜋
∆Lk × rk
rk
3
B =
k
∆Bk
rk
W
∆Lk
∆Bk
I
Magnetic Field
• Circular and square coils are two often used emitter coil
• The point-symmetric property indicates the non-uniqueness of solution
B(−r)
B(r)B(r)
B(−r)
3D-Coil
• EMTS usually uses XYZ-coil for transmitter and receiver
• If the field-pose relationship is built, then a tracking device can be made
• Ideally, m-field generated by XYZ-coil can be approximated by magnetic
dipole, 𝐵 =
𝑘
4𝜋r3 3 𝑟 𝑟′ − 𝐼 𝐼 𝑥𝑦𝑧, which will be used to build the field-pose
relationship
M-Field of XYZ Coil
• Four coordinate frames will be used
• W: world reference
• Tx: transmitter
• Rx: receiver
• Rd: radial-direction (with x-axis aligned with r)
•
• Two orientation transform matrices used
• 𝑻 𝒕 ≡ 𝑅 𝑇𝑥
𝑅𝑑
… translation related
• 𝑻 𝒓 ≡ 𝑅 𝑇𝑥
𝑅𝑥
… rotation related
• Given Tx & Rx pose, the sensed m-field signal
tensor is like 𝐵 = Tr′Tt(
𝑘
r3 𝐶 𝑑 𝑇𝑡
′
𝐼 𝑥𝑦𝑧)
W
Pose Reversion Alg.
• Given measured B, Tr & Tr can also be solved with the algorithm flow
summarized as below
• Then 6D-pose (Rx_in_Tx) can be solved as
• 𝑇𝑟 = 𝑅 𝑇𝑥
𝑅𝑥
• 𝑟 = 𝑟𝑇𝑥
𝑅𝑥
= (𝑟𝑐𝛽𝑐𝛼, 𝑟𝑐𝛽𝑠𝛼, 𝑟𝑠𝛼)
𝑈 = 𝑆 𝑝,𝑚𝑒𝑎𝑠
′
𝑆 𝑝,𝑚𝑒𝑎𝑠
𝑟 =
2
3
𝑡𝑟 𝑈
1/6
𝑆 𝑟 = 𝑟3 𝑆
𝑋 =
4
3
( 𝑆 𝑟′ 𝑆𝑟 −
1
4
𝐼)
𝛼′ = tan−1(𝑋22/𝑋12) 𝒐𝒓 tan−1(𝑋22/𝑋12) + 𝜋
𝛽′ = ± sin−1(𝑋33)
𝑇𝑟 = [ 𝑆 𝑟(4 𝑆𝑟′ 𝑆𝑟 − 3 𝐼)]′
Algorithm Issue (1)
• Near-field Error
• Dipole model approximates square or circular loop only when distance
>> coil diameter, as shown below. This causes near-field pose error
Algorithm Issue (2.1)
• Hemisphere ambiguity
• Two possible position solutions exist, which requires
• angular boundary judgement
• sensor fusion with IMUs
Algorithm Issue (2.2)
A-B Search Algorithm:
1. Given starting point 𝛼, 𝛽 𝑖𝑛𝑖𝑡
2. Calculate 4 possible 𝛼′, 𝛽′ 𝑘 for t(k)
3. Re-arrange 𝛼 to [0,2𝜋]
4. Find best choice to satisfy
• Minimum distance between 𝛼′, 𝛽′ 𝑘 and
𝛼, 𝛽 𝑘−1
• norm( 𝑋(𝛼′, 𝛽′)- 𝑋)/norm( 𝑋) < Thr
5. Update solver output 𝛼, 𝛽 𝑘
6. Repeat 2->5
Modeling & Simulation
Modeling & Sim. Flow
• Pose & Current Signal to drive emitter field generation
• The solved pose will be compared with the input one
EM-Tx
Emission
RxCoil & ADC
Extraction
Sig. Gen.
Pose Solver
DAC & TxCoil
𝑡𝑖𝑚𝑒 ( 𝑝, 𝑄)
𝐵
PCM
( 𝑝′, 𝑄′)
𝐼(t)
(𝑠1, 𝑠2, 𝑠3)
Calibration
[𝑣1 𝑣2 𝑣3]
𝑆𝑖𝑗
𝜎𝑖𝑗
compare
Pose
Modeling
Tx-Coil Excitation
• Here is an example of Tx-coil excited by square wave current input (DC)
• In most modern cases, excitation uses sinusoidal wave (AC)
B 𝑅𝑥
Pose Check (1)
• Comparison between pose input and solver output are performed for:
• Position, Quaternion and Orientation Matrix
Pose Check (2)
• 3D trajectory and Distance/Angle Error
Model error and boundary crossing
Model error and filter-delay bias
Conclusion
Still More …
• This slide just aims to provide a brief introduction for those who want to
develop magnetic tracking system. Of course, there are still more to know
before get it useful and reliably such as (I’ll publish another slide to talk
about them soon)
1. Using AC signal to enhance signal magnitude and enlarge operation
distance
2. Auto-gain control to deal with radical change of field magnitude
3. Accurate but cost effective calibration process for emitter and receiver
4. IMU-fusion to suppress noise in far field
5. Apply quadratic excitation to reduce metal distortion

More Related Content

What's hot

Radar 2009 a 14 airborne pulse doppler radar
Radar 2009 a 14 airborne pulse doppler radarRadar 2009 a 14 airborne pulse doppler radar
Radar 2009 a 14 airborne pulse doppler radar
Forward2025
 
Chapter 2b
Chapter 2bChapter 2b
Chapter 2b
Gabriel O'Brien
 
DSP_FOEHU - Lec 11 - IIR Filter Design
DSP_FOEHU - Lec 11 - IIR Filter DesignDSP_FOEHU - Lec 11 - IIR Filter Design
DSP_FOEHU - Lec 11 - IIR Filter Design
Amr E. Mohamed
 
RF Circuit Design - [Ch4-2] LNA, PA, and Broadband Amplifier
RF Circuit Design - [Ch4-2] LNA, PA, and Broadband AmplifierRF Circuit Design - [Ch4-2] LNA, PA, and Broadband Amplifier
RF Circuit Design - [Ch4-2] LNA, PA, and Broadband Amplifier
Simen Li
 
Fiduccia mattheyses
Fiduccia mattheysesFiduccia mattheyses
Fiduccia mattheyses
Tanvi Prabhu Dessai
 
Antenna arrays
Antenna arraysAntenna arrays
Antenna arrays
AJAL A J
 
Op-amp & its characteristics
Op-amp  & its characteristics Op-amp  & its characteristics
Op-amp & its characteristics
Abhinay Potlabathini
 
Design of IIR filters
Design of IIR filtersDesign of IIR filters
Design of IIR filters
op205
 
Active Phased Array Radar Systems
Active Phased Array Radar SystemsActive Phased Array Radar Systems
Active Phased Array Radar SystemsReza Taryghat
 
Satellite link-budget-analysis-matlab-code
Satellite link-budget-analysis-matlab-codeSatellite link-budget-analysis-matlab-code
Satellite link-budget-analysis-matlab-code
vijaya selvan sundaram
 
Parallel Prefix Adders Presentation
Parallel Prefix Adders PresentationParallel Prefix Adders Presentation
Parallel Prefix Adders PresentationPeeyush Pashine
 
Fir and iir filter_design
Fir and iir filter_designFir and iir filter_design
Fir and iir filter_designshrinivasgnaik
 
5 pulse compression waveform
5 pulse compression waveform5 pulse compression waveform
5 pulse compression waveform
Solo Hermelin
 
Introduction to rf and microwave circuits
Introduction to rf and microwave circuitsIntroduction to rf and microwave circuits
Introduction to rf and microwave circuits
Shankar Gangaju
 
Photo detector noise
Photo detector noisePhoto detector noise
Photo detector noise
Gec bharuch
 
CFAR
CFARCFAR
Millimeter wave 5G antennas for smartphones
Millimeter wave 5G antennas for smartphonesMillimeter wave 5G antennas for smartphones
Millimeter wave 5G antennas for smartphones
Pei-Che Chang
 
Vlsi(140083112008,15,16)
Vlsi(140083112008,15,16)Vlsi(140083112008,15,16)
Vlsi(140083112008,15,16)
Kashyap Mandaliya
 
RF Circuit Design - [Ch1-2] Transmission Line Theory
RF Circuit Design - [Ch1-2] Transmission Line TheoryRF Circuit Design - [Ch1-2] Transmission Line Theory
RF Circuit Design - [Ch1-2] Transmission Line Theory
Simen Li
 

What's hot (20)

Radar 2009 a 14 airborne pulse doppler radar
Radar 2009 a 14 airborne pulse doppler radarRadar 2009 a 14 airborne pulse doppler radar
Radar 2009 a 14 airborne pulse doppler radar
 
Chapter 2b
Chapter 2bChapter 2b
Chapter 2b
 
DSP_FOEHU - Lec 11 - IIR Filter Design
DSP_FOEHU - Lec 11 - IIR Filter DesignDSP_FOEHU - Lec 11 - IIR Filter Design
DSP_FOEHU - Lec 11 - IIR Filter Design
 
RF Circuit Design - [Ch4-2] LNA, PA, and Broadband Amplifier
RF Circuit Design - [Ch4-2] LNA, PA, and Broadband AmplifierRF Circuit Design - [Ch4-2] LNA, PA, and Broadband Amplifier
RF Circuit Design - [Ch4-2] LNA, PA, and Broadband Amplifier
 
Fiduccia mattheyses
Fiduccia mattheysesFiduccia mattheyses
Fiduccia mattheyses
 
Antenna arrays
Antenna arraysAntenna arrays
Antenna arrays
 
Op-amp & its characteristics
Op-amp  & its characteristics Op-amp  & its characteristics
Op-amp & its characteristics
 
Actel fpga
Actel fpgaActel fpga
Actel fpga
 
Design of IIR filters
Design of IIR filtersDesign of IIR filters
Design of IIR filters
 
Active Phased Array Radar Systems
Active Phased Array Radar SystemsActive Phased Array Radar Systems
Active Phased Array Radar Systems
 
Satellite link-budget-analysis-matlab-code
Satellite link-budget-analysis-matlab-codeSatellite link-budget-analysis-matlab-code
Satellite link-budget-analysis-matlab-code
 
Parallel Prefix Adders Presentation
Parallel Prefix Adders PresentationParallel Prefix Adders Presentation
Parallel Prefix Adders Presentation
 
Fir and iir filter_design
Fir and iir filter_designFir and iir filter_design
Fir and iir filter_design
 
5 pulse compression waveform
5 pulse compression waveform5 pulse compression waveform
5 pulse compression waveform
 
Introduction to rf and microwave circuits
Introduction to rf and microwave circuitsIntroduction to rf and microwave circuits
Introduction to rf and microwave circuits
 
Photo detector noise
Photo detector noisePhoto detector noise
Photo detector noise
 
CFAR
CFARCFAR
CFAR
 
Millimeter wave 5G antennas for smartphones
Millimeter wave 5G antennas for smartphonesMillimeter wave 5G antennas for smartphones
Millimeter wave 5G antennas for smartphones
 
Vlsi(140083112008,15,16)
Vlsi(140083112008,15,16)Vlsi(140083112008,15,16)
Vlsi(140083112008,15,16)
 
RF Circuit Design - [Ch1-2] Transmission Line Theory
RF Circuit Design - [Ch1-2] Transmission Line TheoryRF Circuit Design - [Ch1-2] Transmission Line Theory
RF Circuit Design - [Ch1-2] Transmission Line Theory
 

Similar to Magnetic tracking --- talking from Magic Leap One

IMU General Introduction
IMU General IntroductionIMU General Introduction
IMU General Introduction
James D.B. Wang, PhD
 
Presentation final
Presentation finalPresentation final
Presentation finalKate Lu
 
Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1
Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1
Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1
James D.B. Wang, PhD
 
EC6602 - AWP UNI-4
EC6602 - AWP UNI-4EC6602 - AWP UNI-4
EC6602 - AWP UNI-4
krishnamrm
 
ANSYS Emag 8.0 Capabilities.ppt
ANSYS Emag 8.0 Capabilities.pptANSYS Emag 8.0 Capabilities.ppt
ANSYS Emag 8.0 Capabilities.ppt
DavidEscudero
 
Algorithmic Techniques for Parametric Model Recovery
Algorithmic Techniques for Parametric Model RecoveryAlgorithmic Techniques for Parametric Model Recovery
Algorithmic Techniques for Parametric Model Recovery
CurvSurf
 
Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...
Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...
Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...
Sasidhar Tadanki
 
Introduction of Quantum Annealing and D-Wave Machines
Introduction of Quantum Annealing and D-Wave MachinesIntroduction of Quantum Annealing and D-Wave Machines
Introduction of Quantum Annealing and D-Wave Machines
Arithmer Inc.
 
BallCatchingRobot
BallCatchingRobotBallCatchingRobot
BallCatchingRobotgauravbrd
 
Radar 2009 a 7 radar cross section 2
Radar 2009 a 7 radar cross section 2Radar 2009 a 7 radar cross section 2
Radar 2009 a 7 radar cross section 2
Forward2025
 
Mk slides.ppt
Mk slides.pptMk slides.ppt
Mk slides.ppt
Tabassum Saher
 
Defect detection in circlips using image processing in ni lab view
Defect detection in circlips using image processing in ni lab viewDefect detection in circlips using image processing in ni lab view
Defect detection in circlips using image processing in ni lab view
Sayali Bodhankar
 
Electrical Engineering Assignment Help
Electrical Engineering Assignment HelpElectrical Engineering Assignment Help
Electrical Engineering Assignment Help
Matlab Assignment Experts
 
Mobile antennae general Beamforming principles presentation
Mobile antennae general Beamforming principles presentationMobile antennae general Beamforming principles presentation
Mobile antennae general Beamforming principles presentation
Pierre LARREGLE
 
Module-5-1_230523_171754 (1).pdf
Module-5-1_230523_171754 (1).pdfModule-5-1_230523_171754 (1).pdf
Module-5-1_230523_171754 (1).pdf
vikasmittal92
 
Alternative architecture and control strategy july 2010 - joe beno
Alternative architecture and control strategy   july 2010 - joe benoAlternative architecture and control strategy   july 2010 - joe beno
Alternative architecture and control strategy july 2010 - joe benocahouser
 
ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21
Dae Woon Kim
 

Similar to Magnetic tracking --- talking from Magic Leap One (20)

IMU General Introduction
IMU General IntroductionIMU General Introduction
IMU General Introduction
 
Presentation final
Presentation finalPresentation final
Presentation final
 
Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1
Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1
Imu fusion algorithm for pose estimation (mCube invited talk) 2018 1003-1
 
EC6602 - AWP UNI-4
EC6602 - AWP UNI-4EC6602 - AWP UNI-4
EC6602 - AWP UNI-4
 
ANSYS Emag 8.0 Capabilities.ppt
ANSYS Emag 8.0 Capabilities.pptANSYS Emag 8.0 Capabilities.ppt
ANSYS Emag 8.0 Capabilities.ppt
 
Algorithmic Techniques for Parametric Model Recovery
Algorithmic Techniques for Parametric Model RecoveryAlgorithmic Techniques for Parametric Model Recovery
Algorithmic Techniques for Parametric Model Recovery
 
Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...
Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...
Multiple Resonant Multiconductor Transmission line Resonator Design using Cir...
 
testpang
testpangtestpang
testpang
 
Rikvold Presentation
Rikvold PresentationRikvold Presentation
Rikvold Presentation
 
Introduction of Quantum Annealing and D-Wave Machines
Introduction of Quantum Annealing and D-Wave MachinesIntroduction of Quantum Annealing and D-Wave Machines
Introduction of Quantum Annealing and D-Wave Machines
 
BallCatchingRobot
BallCatchingRobotBallCatchingRobot
BallCatchingRobot
 
Radar 2009 a 7 radar cross section 2
Radar 2009 a 7 radar cross section 2Radar 2009 a 7 radar cross section 2
Radar 2009 a 7 radar cross section 2
 
Radar Systems Engineering L7P2
Radar Systems Engineering L7P2Radar Systems Engineering L7P2
Radar Systems Engineering L7P2
 
Mk slides.ppt
Mk slides.pptMk slides.ppt
Mk slides.ppt
 
Defect detection in circlips using image processing in ni lab view
Defect detection in circlips using image processing in ni lab viewDefect detection in circlips using image processing in ni lab view
Defect detection in circlips using image processing in ni lab view
 
Electrical Engineering Assignment Help
Electrical Engineering Assignment HelpElectrical Engineering Assignment Help
Electrical Engineering Assignment Help
 
Mobile antennae general Beamforming principles presentation
Mobile antennae general Beamforming principles presentationMobile antennae general Beamforming principles presentation
Mobile antennae general Beamforming principles presentation
 
Module-5-1_230523_171754 (1).pdf
Module-5-1_230523_171754 (1).pdfModule-5-1_230523_171754 (1).pdf
Module-5-1_230523_171754 (1).pdf
 
Alternative architecture and control strategy july 2010 - joe beno
Alternative architecture and control strategy   july 2010 - joe benoAlternative architecture and control strategy   july 2010 - joe beno
Alternative architecture and control strategy july 2010 - joe beno
 
ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21
 

Recently uploaded

State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 

Recently uploaded (20)

State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 

Magnetic tracking --- talking from Magic Leap One

  • 1. Magnetic Tracking -- talking from Magic Leap One James Wang 20th Aug 2018
  • 2. Magnetic tracking is one of miscellaneous motion capture methods, and maybe the oldest. However, its working principle is rarely introduced in detail perhaps due to its early adaptation resides in military and medical industry. Due to my interest in VR & animation MoCap, I’ve spent some time digging into the very depth of it and would like to share some non-confidential knowledge of it with you. In this slide, a short history of magnetic tracking will be visited, followed by its working principle and algorithm simulation. Hope you enjoy it. If you wanna discuss something in depth with me, please don’t hesitate to contact me via: dibao.wang@gmail.com
  • 3. Content • Tech. Overview • Working Principle • Modeling & Simulation • Conclusion
  • 5. Old But Still Sexy • Magnetic tracking was first used in military, medical and animation industry • Although it’s old, with patents expired, it’s still powerful in short-range tracking … even the latest Magic Leap One adopts it as a key component 1990 2011 2013 2018
  • 6. Raab et al @ 1979 • Remote Object Position And Orientation Locater (US 4,314,251) • Filed: Jul. 30, 1979 • Almost all EMTS (electromagnetic tracking system) traces back to this patent filed by Raab
  • 7. Ascension since 1990 • Wired multi-point tracking by DC-magnetic field emission/detection
  • 8. Razer Hydra 2011 • Wired two-controller tracking with AC-type magnetic field emission/detection • Should be the first consumer product of magnetic tracking
  • 9. Sixsens STEM 2013~ • Wireless 5-point (hands, head and legs) AC magnetic field tracking • Failed to manufacture until now (a notorious Kickstarter project)
  • 10. Magic Leap @2017 • Electromagnetic tracking with augmented reality systems (US2017/0307891) • Filed: Apr. 24, 2017
  • 11. Magic Leap One @2018 • A wireless 2-controller tracking by AC (or DC) magnetic field • Thanks for the teardown by iFixit (link) Receiver Coils Transmitter Coils
  • 12. Limitation • Near-field error & signal saturation (r< 0.2m) • Solution: non-linear numerical algorithm, auto-gain control • • Far-field noise (r > 1.0 m) • Solution: sensor fusion • Metal-induced distortions • Solution: N/A (old issues though) • Complex calibration in production site • Solution: N/A (company like Sixsense seemed to fail at this point)
  • 14. How Does It Work? • A 3-axis current loop (emitter) generates magnetic field (DC or AC) • A 3-axis magnetic sensor (magnetometer or induction coil) measures the field quantity at surrounding position with any orientation • A signal processing method to extract the signal components regarding sensor- emitter pairing relationship • A pre-built field-pose algorithm reverses the pose of the sensor w.r.t. the emitter ( 𝑟 𝑇𝑥 𝑅𝑥 , 𝑅 𝑇𝑥 𝑅𝑥 )Tx Rx Emission Detection Extraction Reversion
  • 15. M-field Emission • Biot-Savart law quantitatively determines the magnetic field generated by a piece of current wire segment • It’s a building block of magnetic-field modeling ∆Bk= 𝜇0I 4𝜋 ∆Lk × rk rk 3 B = k ∆Bk rk W ∆Lk ∆Bk I
  • 16. Magnetic Field • Circular and square coils are two often used emitter coil • The point-symmetric property indicates the non-uniqueness of solution B(−r) B(r)B(r) B(−r)
  • 17. 3D-Coil • EMTS usually uses XYZ-coil for transmitter and receiver • If the field-pose relationship is built, then a tracking device can be made • Ideally, m-field generated by XYZ-coil can be approximated by magnetic dipole, 𝐵 = 𝑘 4𝜋r3 3 𝑟 𝑟′ − 𝐼 𝐼 𝑥𝑦𝑧, which will be used to build the field-pose relationship
  • 18. M-Field of XYZ Coil • Four coordinate frames will be used • W: world reference • Tx: transmitter • Rx: receiver • Rd: radial-direction (with x-axis aligned with r) • • Two orientation transform matrices used • 𝑻 𝒕 ≡ 𝑅 𝑇𝑥 𝑅𝑑 … translation related • 𝑻 𝒓 ≡ 𝑅 𝑇𝑥 𝑅𝑥 … rotation related • Given Tx & Rx pose, the sensed m-field signal tensor is like 𝐵 = Tr′Tt( 𝑘 r3 𝐶 𝑑 𝑇𝑡 ′ 𝐼 𝑥𝑦𝑧) W
  • 19. Pose Reversion Alg. • Given measured B, Tr & Tr can also be solved with the algorithm flow summarized as below • Then 6D-pose (Rx_in_Tx) can be solved as • 𝑇𝑟 = 𝑅 𝑇𝑥 𝑅𝑥 • 𝑟 = 𝑟𝑇𝑥 𝑅𝑥 = (𝑟𝑐𝛽𝑐𝛼, 𝑟𝑐𝛽𝑠𝛼, 𝑟𝑠𝛼) 𝑈 = 𝑆 𝑝,𝑚𝑒𝑎𝑠 ′ 𝑆 𝑝,𝑚𝑒𝑎𝑠 𝑟 = 2 3 𝑡𝑟 𝑈 1/6 𝑆 𝑟 = 𝑟3 𝑆 𝑋 = 4 3 ( 𝑆 𝑟′ 𝑆𝑟 − 1 4 𝐼) 𝛼′ = tan−1(𝑋22/𝑋12) 𝒐𝒓 tan−1(𝑋22/𝑋12) + 𝜋 𝛽′ = ± sin−1(𝑋33) 𝑇𝑟 = [ 𝑆 𝑟(4 𝑆𝑟′ 𝑆𝑟 − 3 𝐼)]′
  • 20. Algorithm Issue (1) • Near-field Error • Dipole model approximates square or circular loop only when distance >> coil diameter, as shown below. This causes near-field pose error
  • 21. Algorithm Issue (2.1) • Hemisphere ambiguity • Two possible position solutions exist, which requires • angular boundary judgement • sensor fusion with IMUs
  • 22. Algorithm Issue (2.2) A-B Search Algorithm: 1. Given starting point 𝛼, 𝛽 𝑖𝑛𝑖𝑡 2. Calculate 4 possible 𝛼′, 𝛽′ 𝑘 for t(k) 3. Re-arrange 𝛼 to [0,2𝜋] 4. Find best choice to satisfy • Minimum distance between 𝛼′, 𝛽′ 𝑘 and 𝛼, 𝛽 𝑘−1 • norm( 𝑋(𝛼′, 𝛽′)- 𝑋)/norm( 𝑋) < Thr 5. Update solver output 𝛼, 𝛽 𝑘 6. Repeat 2->5
  • 24. Modeling & Sim. Flow • Pose & Current Signal to drive emitter field generation • The solved pose will be compared with the input one EM-Tx Emission RxCoil & ADC Extraction Sig. Gen. Pose Solver DAC & TxCoil 𝑡𝑖𝑚𝑒 ( 𝑝, 𝑄) 𝐵 PCM ( 𝑝′, 𝑄′) 𝐼(t) (𝑠1, 𝑠2, 𝑠3) Calibration [𝑣1 𝑣2 𝑣3] 𝑆𝑖𝑗 𝜎𝑖𝑗 compare Pose Modeling
  • 25. Tx-Coil Excitation • Here is an example of Tx-coil excited by square wave current input (DC) • In most modern cases, excitation uses sinusoidal wave (AC) B 𝑅𝑥
  • 26. Pose Check (1) • Comparison between pose input and solver output are performed for: • Position, Quaternion and Orientation Matrix
  • 27. Pose Check (2) • 3D trajectory and Distance/Angle Error Model error and boundary crossing Model error and filter-delay bias
  • 29. Still More … • This slide just aims to provide a brief introduction for those who want to develop magnetic tracking system. Of course, there are still more to know before get it useful and reliably such as (I’ll publish another slide to talk about them soon) 1. Using AC signal to enhance signal magnitude and enlarge operation distance 2. Auto-gain control to deal with radical change of field magnitude 3. Accurate but cost effective calibration process for emitter and receiver 4. IMU-fusion to suppress noise in far field 5. Apply quadratic excitation to reduce metal distortion

Editor's Notes

  1. 2-now