SlideShare a Scribd company logo
1 of 17
Download to read offline
Estimating a rotation matrix R
by using higher-order matrices Rn
              with application to
      supervised pose estimation

                Toru Tamaki
                Bisser Raytchev
                Kazufumi Kaneda
                Toshiyuki Amano
Estimating a rotation matrix R
     by using higher-order matrices Rn
                   with application to
           supervised pose estimation
Can  Rnestimate R
                 Toru Tamaki
more accurately Bisser Raytchev
than R ?         Kazufumi Kaneda
                 Toshiyuki Amano
To  improve  estimates…  Average!

               t1                       When  measurement  is  only  once…




               t2
                            t
      …

               …

                        Average
               tn       Lease-Squares

                                             How improve?
   Measure many times
To  improve  estimates…  Average!

               t1                       When  measurement  is  only  once…




               t2
                              t
      …

                …

                        Average
               tn       Lease-Squares

                                             Improve!
   Measure with many timers
To  improve  estimates…  Average?

               t                        When  measurement  is  only  once…




               t2
                              t
      …

                …

                        Average
               tn       Lease-Squares

                                             How improve?
   Measure with many timers
To  improve  estimates…  Average.

               t              When  measurement  is  only  once…




               t2
                              t
      …

                …


               tn
                                   Improve!
   Measure with many timers
                                        But, What is it?
Our problem: Pose estimation
                      Pose parameters

                            R       3x3 rotation matrix

                            t        3D translation



                     Regression:
image                    Appearance-based /
           Pose
        parameters       View-based pose estimation

          R                Parametric Eigenspace (Murase et al., 1995)
                                  linear regression (Okatani et al., 2000)
                                         kernel CCA (Melzer et al., 2003)
                                       SV regression (Ando et al., 2005)
                                            Manifold learning, and others
        R              (Rothganger et al., 2006) (Lowe, 2004) (Ferrari et
                          al., 2006) (Kushal et al., 2006) (Viksten, 2009)
Our concept
                               Pose     Rotation
               image
                               vector    matrix

           1
                                   p1    R
                       !    axis



                           µ angle
Training



           2                       p2    R2
                   !

                       2µ
Our concept
     New
                    Pose          Rotation
    image
                    vector         matrix              axis   angle

1
                        p1             R               ! µ
            !    axis         Polar           Eigen
                             Decomp.         Decomp.

                µ angle




2                       p2             R2              ! 2µ
        !

            2µ                                         ! µ
Our concept
     New
                    Pose          Rotation
    image                                                                  Examples
                    vector         matrix              axis   angle

1
                        p1             R               ! µ            29 [deg]   210 [deg]
            !    axis         Polar           Eigen
                             Decomp.         Decomp.

                µ angle



                                                                      62 [deg]   420 [deg]
2                       p2             R2              ! 2µ                      =60 [deg]
        !                                                             Div by 2    Div by 2

                                                                      31 [deg]    30 [deg]
            2µ                                         ! µ
                                                                      30 [deg]     ? [deg]
Surveying




Electronic Distance Measurement
EDM




                                      Surveying – ARCHEOSCAN
                                      http://archeoscan.com/16.html
Principle of EDM
Transmitter                                          Receiver
                             Dist
                                                                ¸1


          ¸2
                                                      µ2
                                 µ1
device                                                      target



         Use
         •Longer wavelength ¸1 first, for a rough phase estimate µ1
         •Shorter wavelength ¸2 next, for a fine phase estimate µ2
Our concept
     New
                    Pose      Rotation
    image                                                              Examples
                    vector     matrix              axis   angle

1
                    p1             R               ! µ            29 [deg]   210 [deg]
            !             Polar           Eigen
                         Decomp.         Decomp.

                µ



                                                                  62 [deg]   420 [deg]
2                   p2             R2              ! 2µ                      =60 [deg]
        !                                                         Div by 2    Div by 2

                                                                  31 [deg]   210 [deg]
            2µ                                     ! µ
                                                                  30 [deg] 210 [deg]
Measurements           Simulation 1
         Pose             Rotation
         vector            matrix              axis   angle

R   R    p1 +noise             R               !1 µ1
    …                 Polar           Eigen




          …




                               …


                                                …
                                                      …
                     Decomp.         Decomp.
                                                              µ
    R8   p8 +noise             R8              !8 µ8
                                               !              R
Measurements
                                              Simulation 2
                          Pose      Rotation
                          vector     matrix              axis   angle

R +noise      R           p1             R               !1 µ1
                                Polar           Eigen




               …

                           …


                                         …


                                                          …
                                                                …
                               Decomp.         Decomp.
                                                                           µ
             R8           p8             R8              !8 µ8
                                                         !                 R

                                                         Error  doesn’t  change…
                                                         No free lunch!
•Linear regression
                         Experimental results
•Training with
                         Pose      Rotation
images and poses
                         vector     matrix              axis   angle


                     1
                         p1             R               !1 µ1
                               Polar           Eigen




                          …


                                        …


                                                         …
                                                               …
                              Decomp.         Decomp.
                                                                       µ
                 8
                         p8             R8              !8 µ8
 images
                                                        !              R
Summary

• Improve estimates of a pose R with
many measurements R1, R2,  …,  R8
• Simulations and experimental results
shows that the concept works!

More Related Content

What's hot

Short-time homomorphic wavelet estimation
Short-time homomorphic wavelet estimation Short-time homomorphic wavelet estimation
Short-time homomorphic wavelet estimation UT Technology
 
Effects of Long Duration Motions on Ground Failure - Steve Kramer
Effects of Long Duration Motions on Ground Failure - Steve KramerEffects of Long Duration Motions on Ground Failure - Steve Kramer
Effects of Long Duration Motions on Ground Failure - Steve KramerEERI
 
Chapter 2-forces-and-motion-2011
Chapter 2-forces-and-motion-2011Chapter 2-forces-and-motion-2011
Chapter 2-forces-and-motion-2011izzatulsyahadah97
 
A review of time­‐frequency methods
A review of time­‐frequency methodsA review of time­‐frequency methods
A review of time­‐frequency methodsUT Technology
 
Curriculum specification F5
Curriculum specification F5Curriculum specification F5
Curriculum specification F5hajahrokiah
 
Waves 2012-website
Waves 2012-websiteWaves 2012-website
Waves 2012-websitestephm32
 
2.0 forces and motion
2.0 forces and motion2.0 forces and motion
2.0 forces and motiondeanamin
 
Iaetsd an enhanced circular detection technique rpsw using circular hough t...
Iaetsd an enhanced circular detection technique   rpsw using circular hough t...Iaetsd an enhanced circular detection technique   rpsw using circular hough t...
Iaetsd an enhanced circular detection technique rpsw using circular hough t...Iaetsd Iaetsd
 
Physics Note! ( Chap. 1&2)
Physics Note! ( Chap. 1&2)Physics Note! ( Chap. 1&2)
Physics Note! ( Chap. 1&2)gracenyura
 
Underwater Target Tracking Using Unscented Kalman Filter
Underwater Target Tracking Using Unscented Kalman FilterUnderwater Target Tracking Using Unscented Kalman Filter
Underwater Target Tracking Using Unscented Kalman FilterIJAPEJOURNAL
 
Cse684 circlesandchords
Cse684 circlesandchordsCse684 circlesandchords
Cse684 circlesandchordsamcginn
 
study Image and video abstraction by multi scale anisotropic kuwahara
study  Image and video abstraction by multi scale anisotropic kuwaharastudy  Image and video abstraction by multi scale anisotropic kuwahara
study Image and video abstraction by multi scale anisotropic kuwaharaChiamin Hsu
 

What's hot (15)

Short-time homomorphic wavelet estimation
Short-time homomorphic wavelet estimation Short-time homomorphic wavelet estimation
Short-time homomorphic wavelet estimation
 
Lecture 17
Lecture 17Lecture 17
Lecture 17
 
Effects of Long Duration Motions on Ground Failure - Steve Kramer
Effects of Long Duration Motions on Ground Failure - Steve KramerEffects of Long Duration Motions on Ground Failure - Steve Kramer
Effects of Long Duration Motions on Ground Failure - Steve Kramer
 
Chapter 2-forces-and-motion-2011
Chapter 2-forces-and-motion-2011Chapter 2-forces-and-motion-2011
Chapter 2-forces-and-motion-2011
 
A review of time­‐frequency methods
A review of time­‐frequency methodsA review of time­‐frequency methods
A review of time­‐frequency methods
 
Curriculum specification F5
Curriculum specification F5Curriculum specification F5
Curriculum specification F5
 
Waves 2012-website
Waves 2012-websiteWaves 2012-website
Waves 2012-website
 
2.0 forces and motion
2.0 forces and motion2.0 forces and motion
2.0 forces and motion
 
Iaetsd an enhanced circular detection technique rpsw using circular hough t...
Iaetsd an enhanced circular detection technique   rpsw using circular hough t...Iaetsd an enhanced circular detection technique   rpsw using circular hough t...
Iaetsd an enhanced circular detection technique rpsw using circular hough t...
 
Physics Note! ( Chap. 1&2)
Physics Note! ( Chap. 1&2)Physics Note! ( Chap. 1&2)
Physics Note! ( Chap. 1&2)
 
Underwater Target Tracking Using Unscented Kalman Filter
Underwater Target Tracking Using Unscented Kalman FilterUnderwater Target Tracking Using Unscented Kalman Filter
Underwater Target Tracking Using Unscented Kalman Filter
 
Note chapter9 0708-edit-1
Note chapter9 0708-edit-1Note chapter9 0708-edit-1
Note chapter9 0708-edit-1
 
Lecture 07
Lecture 07Lecture 07
Lecture 07
 
Cse684 circlesandchords
Cse684 circlesandchordsCse684 circlesandchords
Cse684 circlesandchords
 
study Image and video abstraction by multi scale anisotropic kuwahara
study  Image and video abstraction by multi scale anisotropic kuwaharastudy  Image and video abstraction by multi scale anisotropic kuwahara
study Image and video abstraction by multi scale anisotropic kuwahara
 

Viewers also liked

20110326 CG・CVにおける散乱
20110326 CG・CVにおける散乱20110326 CG・CVにおける散乱
20110326 CG・CVにおける散乱Toru Tamaki
 
20120629PRMU CVPR2012報告
20120629PRMU CVPR2012報告20120629PRMU CVPR2012報告
20120629PRMU CVPR2012報告Toru Tamaki
 
20110415 Scattering in CG and CV
20110415 Scattering in CG and CV20110415 Scattering in CG and CV
20110415 Scattering in CG and CVToru Tamaki
 
広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科
広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科
広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科Toru Tamaki
 
201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...
201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...
201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...Toru Tamaki
 
ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...
ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...
ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...Toru Tamaki
 
20090924 姿勢推定と回転行列
20090924 姿勢推定と回転行列20090924 姿勢推定と回転行列
20090924 姿勢推定と回転行列Toru Tamaki
 
20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出
20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出
20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出Toru Tamaki
 
SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部
SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部
SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部Toru Tamaki
 

Viewers also liked (9)

20110326 CG・CVにおける散乱
20110326 CG・CVにおける散乱20110326 CG・CVにおける散乱
20110326 CG・CVにおける散乱
 
20120629PRMU CVPR2012報告
20120629PRMU CVPR2012報告20120629PRMU CVPR2012報告
20120629PRMU CVPR2012報告
 
20110415 Scattering in CG and CV
20110415 Scattering in CG and CV20110415 Scattering in CG and CV
20110415 Scattering in CG and CV
 
広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科
広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科
広島大学工学部における医用画像処理の取り組み:放射線科,眼科,内科
 
201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...
201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...
201109CVIM/PRMU Inverse Composite Alignment of a sphere under orthogonal proj...
 
ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...
ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...
ICASSP2012 Poster Estimating the spin of a table tennis ball using inverse co...
 
20090924 姿勢推定と回転行列
20090924 姿勢推定と回転行列20090924 姿勢推定と回転行列
20090924 姿勢推定と回転行列
 
20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出
20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出
20110606PRMU 2D-3Dマッチングを用いた3次元点群の時間的な剛体変化検出
 
SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部
SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部
SSII2012 2D&3Dレジストレーション ~画像と3次元点群の合わせ方~ 第1部
 

Similar to SPPRA2010 Estimating a Rotation Matrix R by using higher-order Matrices R^n with Application to Supervised Pose Estimation

Simple circular curve by Nikhil Pakwanne
Simple circular curve by Nikhil PakwanneSimple circular curve by Nikhil Pakwanne
Simple circular curve by Nikhil PakwanneNIKHIL PAKWANNE
 
Within the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdf
Within the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdfWithin the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdf
Within the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdfgrssieee
 
GeometricTransformations.ppt
GeometricTransformations.pptGeometricTransformations.ppt
GeometricTransformations.pptDebjit Doira
 
Physics Chapter 8- Rotational of a Rigid Body
Physics Chapter 8- Rotational of a Rigid BodyPhysics Chapter 8- Rotational of a Rigid Body
Physics Chapter 8- Rotational of a Rigid BodyMuhammad Solehin
 
X2 t06 03 circular motion (2012)
X2 t06 03 circular motion (2012)X2 t06 03 circular motion (2012)
X2 t06 03 circular motion (2012)Nigel Simmons
 
X2 T06 03 circular motion (2011)
X2 T06 03 circular motion (2011)X2 T06 03 circular motion (2011)
X2 T06 03 circular motion (2011)Nigel Simmons
 
Motion in a circle
Motion in a circleMotion in a circle
Motion in a circleCatherine He
 
Implementing 3D SPHARM Surfaces Registration on Cell B.E. Processor
Implementing 3D SPHARM Surfaces Registration on Cell B.E. ProcessorImplementing 3D SPHARM Surfaces Registration on Cell B.E. Processor
Implementing 3D SPHARM Surfaces Registration on Cell B.E. ProcessorPTIHPA
 
Rotational motion
Rotational motionRotational motion
Rotational motionsdor7
 
Uniform circular motion worked examples
Uniform circular motion worked examplesUniform circular motion worked examples
Uniform circular motion worked examplescyberspaced educator
 
Vladan Mlinar Ph.D. defense (2007)
Vladan Mlinar Ph.D. defense (2007)Vladan Mlinar Ph.D. defense (2007)
Vladan Mlinar Ph.D. defense (2007)Vladan Mlinar
 

Similar to SPPRA2010 Estimating a Rotation Matrix R by using higher-order Matrices R^n with Application to Supervised Pose Estimation (16)

Ray tracing
 Ray tracing Ray tracing
Ray tracing
 
Simple circular curve by Nikhil Pakwanne
Simple circular curve by Nikhil PakwanneSimple circular curve by Nikhil Pakwanne
Simple circular curve by Nikhil Pakwanne
 
Within the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdf
Within the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdfWithin the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdf
Within the Resolution Cell_Super-resolution in Tomographic SAR Imaging.pdf
 
GeometricTransformations.ppt
GeometricTransformations.pptGeometricTransformations.ppt
GeometricTransformations.ppt
 
Physics Chapter 8- Rotational of a Rigid Body
Physics Chapter 8- Rotational of a Rigid BodyPhysics Chapter 8- Rotational of a Rigid Body
Physics Chapter 8- Rotational of a Rigid Body
 
X2 t06 03 circular motion (2012)
X2 t06 03 circular motion (2012)X2 t06 03 circular motion (2012)
X2 t06 03 circular motion (2012)
 
X2 T06 03 circular motion (2011)
X2 T06 03 circular motion (2011)X2 T06 03 circular motion (2011)
X2 T06 03 circular motion (2011)
 
Motion in a circle
Motion in a circleMotion in a circle
Motion in a circle
 
Lecture 11
Lecture 11Lecture 11
Lecture 11
 
Polar Coordinates.pptx
Polar Coordinates.pptxPolar Coordinates.pptx
Polar Coordinates.pptx
 
Angle modulation
Angle modulationAngle modulation
Angle modulation
 
Implementing 3D SPHARM Surfaces Registration on Cell B.E. Processor
Implementing 3D SPHARM Surfaces Registration on Cell B.E. ProcessorImplementing 3D SPHARM Surfaces Registration on Cell B.E. Processor
Implementing 3D SPHARM Surfaces Registration on Cell B.E. Processor
 
Rotational motion
Rotational motionRotational motion
Rotational motion
 
Uniform circular motion worked examples
Uniform circular motion worked examplesUniform circular motion worked examples
Uniform circular motion worked examples
 
Vladan Mlinar Ph.D. defense (2007)
Vladan Mlinar Ph.D. defense (2007)Vladan Mlinar Ph.D. defense (2007)
Vladan Mlinar Ph.D. defense (2007)
 
Elhabian_curves10.pdf
Elhabian_curves10.pdfElhabian_curves10.pdf
Elhabian_curves10.pdf
 

More from Toru Tamaki

論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...
論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...
論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...Toru Tamaki
 
論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...
論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...
論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...Toru Tamaki
 
論文紹介:Automated Classification of Model Errors on ImageNet
論文紹介:Automated Classification of Model Errors on ImageNet論文紹介:Automated Classification of Model Errors on ImageNet
論文紹介:Automated Classification of Model Errors on ImageNetToru Tamaki
 
論文紹介:Semantic segmentation using Vision Transformers: A survey
論文紹介:Semantic segmentation using Vision Transformers: A survey論文紹介:Semantic segmentation using Vision Transformers: A survey
論文紹介:Semantic segmentation using Vision Transformers: A surveyToru Tamaki
 
論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex Scenes
論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex Scenes論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex Scenes
論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex ScenesToru Tamaki
 
論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...
論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...
論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...Toru Tamaki
 
論文紹介:Tracking Anything with Decoupled Video Segmentation
論文紹介:Tracking Anything with Decoupled Video Segmentation論文紹介:Tracking Anything with Decoupled Video Segmentation
論文紹介:Tracking Anything with Decoupled Video SegmentationToru Tamaki
 
論文紹介:Real-Time Evaluation in Online Continual Learning: A New Hope
論文紹介:Real-Time Evaluation in Online Continual Learning: A New Hope論文紹介:Real-Time Evaluation in Online Continual Learning: A New Hope
論文紹介:Real-Time Evaluation in Online Continual Learning: A New HopeToru Tamaki
 
論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...
論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...
論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...Toru Tamaki
 
論文紹介:Multitask Vision-Language Prompt Tuning
論文紹介:Multitask Vision-Language Prompt Tuning論文紹介:Multitask Vision-Language Prompt Tuning
論文紹介:Multitask Vision-Language Prompt TuningToru Tamaki
 
論文紹介:MovieCLIP: Visual Scene Recognition in Movies
論文紹介:MovieCLIP: Visual Scene Recognition in Movies論文紹介:MovieCLIP: Visual Scene Recognition in Movies
論文紹介:MovieCLIP: Visual Scene Recognition in MoviesToru Tamaki
 
論文紹介:Discovering Universal Geometry in Embeddings with ICA
論文紹介:Discovering Universal Geometry in Embeddings with ICA論文紹介:Discovering Universal Geometry in Embeddings with ICA
論文紹介:Discovering Universal Geometry in Embeddings with ICAToru Tamaki
 
論文紹介:Efficient Video Action Detection with Token Dropout and Context Refinement
論文紹介:Efficient Video Action Detection with Token Dropout and Context Refinement論文紹介:Efficient Video Action Detection with Token Dropout and Context Refinement
論文紹介:Efficient Video Action Detection with Token Dropout and Context RefinementToru Tamaki
 
論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...
論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...
論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...Toru Tamaki
 
論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...
論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...
論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...Toru Tamaki
 
論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusion
論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusion論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusion
論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusionToru Tamaki
 
論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving
論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving
論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous DrivingToru Tamaki
 
論文紹介:Spatio-Temporal Action Detection Under Large Motion
論文紹介:Spatio-Temporal Action Detection Under Large Motion論文紹介:Spatio-Temporal Action Detection Under Large Motion
論文紹介:Spatio-Temporal Action Detection Under Large MotionToru Tamaki
 
論文紹介:Vision Transformer Adapter for Dense Predictions
論文紹介:Vision Transformer Adapter for Dense Predictions論文紹介:Vision Transformer Adapter for Dense Predictions
論文紹介:Vision Transformer Adapter for Dense PredictionsToru Tamaki
 
動画像理解のための深層学習アプローチ Deep learning approaches to video understanding
動画像理解のための深層学習アプローチ Deep learning approaches to video understanding動画像理解のための深層学習アプローチ Deep learning approaches to video understanding
動画像理解のための深層学習アプローチ Deep learning approaches to video understandingToru Tamaki
 

More from Toru Tamaki (20)

論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...
論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...
論文紹介:Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Gene...
 
論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...
論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...
論文紹介:Content-Aware Token Sharing for Efficient Semantic Segmentation With Vis...
 
論文紹介:Automated Classification of Model Errors on ImageNet
論文紹介:Automated Classification of Model Errors on ImageNet論文紹介:Automated Classification of Model Errors on ImageNet
論文紹介:Automated Classification of Model Errors on ImageNet
 
論文紹介:Semantic segmentation using Vision Transformers: A survey
論文紹介:Semantic segmentation using Vision Transformers: A survey論文紹介:Semantic segmentation using Vision Transformers: A survey
論文紹介:Semantic segmentation using Vision Transformers: A survey
 
論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex Scenes
論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex Scenes論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex Scenes
論文紹介:MOSE: A New Dataset for Video Object Segmentation in Complex Scenes
 
論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...
論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...
論文紹介:MoLo: Motion-Augmented Long-Short Contrastive Learning for Few-Shot Acti...
 
論文紹介:Tracking Anything with Decoupled Video Segmentation
論文紹介:Tracking Anything with Decoupled Video Segmentation論文紹介:Tracking Anything with Decoupled Video Segmentation
論文紹介:Tracking Anything with Decoupled Video Segmentation
 
論文紹介:Real-Time Evaluation in Online Continual Learning: A New Hope
論文紹介:Real-Time Evaluation in Online Continual Learning: A New Hope論文紹介:Real-Time Evaluation in Online Continual Learning: A New Hope
論文紹介:Real-Time Evaluation in Online Continual Learning: A New Hope
 
論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...
論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...
論文紹介:PointNet: Deep Learning on Point Sets for 3D Classification and Segmenta...
 
論文紹介:Multitask Vision-Language Prompt Tuning
論文紹介:Multitask Vision-Language Prompt Tuning論文紹介:Multitask Vision-Language Prompt Tuning
論文紹介:Multitask Vision-Language Prompt Tuning
 
論文紹介:MovieCLIP: Visual Scene Recognition in Movies
論文紹介:MovieCLIP: Visual Scene Recognition in Movies論文紹介:MovieCLIP: Visual Scene Recognition in Movies
論文紹介:MovieCLIP: Visual Scene Recognition in Movies
 
論文紹介:Discovering Universal Geometry in Embeddings with ICA
論文紹介:Discovering Universal Geometry in Embeddings with ICA論文紹介:Discovering Universal Geometry in Embeddings with ICA
論文紹介:Discovering Universal Geometry in Embeddings with ICA
 
論文紹介:Efficient Video Action Detection with Token Dropout and Context Refinement
論文紹介:Efficient Video Action Detection with Token Dropout and Context Refinement論文紹介:Efficient Video Action Detection with Token Dropout and Context Refinement
論文紹介:Efficient Video Action Detection with Token Dropout and Context Refinement
 
論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...
論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...
論文紹介:Learning from Noisy Pseudo Labels for Semi-Supervised Temporal Action Lo...
 
論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...
論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...
論文紹介:MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Lon...
 
論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusion
論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusion論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusion
論文紹介:Revealing the unseen: Benchmarking video action recognition under occlusion
 
論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving
論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving
論文紹介:Video Task Decathlon: Unifying Image and Video Tasks in Autonomous Driving
 
論文紹介:Spatio-Temporal Action Detection Under Large Motion
論文紹介:Spatio-Temporal Action Detection Under Large Motion論文紹介:Spatio-Temporal Action Detection Under Large Motion
論文紹介:Spatio-Temporal Action Detection Under Large Motion
 
論文紹介:Vision Transformer Adapter for Dense Predictions
論文紹介:Vision Transformer Adapter for Dense Predictions論文紹介:Vision Transformer Adapter for Dense Predictions
論文紹介:Vision Transformer Adapter for Dense Predictions
 
動画像理解のための深層学習アプローチ Deep learning approaches to video understanding
動画像理解のための深層学習アプローチ Deep learning approaches to video understanding動画像理解のための深層学習アプローチ Deep learning approaches to video understanding
動画像理解のための深層学習アプローチ Deep learning approaches to video understanding
 

Recently uploaded

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 

Recently uploaded (20)

AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 

SPPRA2010 Estimating a Rotation Matrix R by using higher-order Matrices R^n with Application to Supervised Pose Estimation

  • 1. Estimating a rotation matrix R by using higher-order matrices Rn with application to supervised pose estimation Toru Tamaki Bisser Raytchev Kazufumi Kaneda Toshiyuki Amano
  • 2. Estimating a rotation matrix R by using higher-order matrices Rn with application to supervised pose estimation Can Rnestimate R Toru Tamaki more accurately Bisser Raytchev than R ? Kazufumi Kaneda Toshiyuki Amano
  • 3. To  improve  estimates…  Average! t1 When  measurement  is  only  once… t2 t … … Average tn Lease-Squares How improve? Measure many times
  • 4. To  improve  estimates…  Average! t1 When  measurement  is  only  once… t2 t … … Average tn Lease-Squares Improve! Measure with many timers
  • 5. To  improve  estimates…  Average? t When  measurement  is  only  once… t2 t … … Average tn Lease-Squares How improve? Measure with many timers
  • 6. To  improve  estimates…  Average. t When  measurement  is  only  once… t2 t … … tn Improve! Measure with many timers But, What is it?
  • 7. Our problem: Pose estimation Pose parameters R 3x3 rotation matrix t 3D translation Regression: image Appearance-based / Pose parameters View-based pose estimation R Parametric Eigenspace (Murase et al., 1995) linear regression (Okatani et al., 2000) kernel CCA (Melzer et al., 2003) SV regression (Ando et al., 2005) Manifold learning, and others R (Rothganger et al., 2006) (Lowe, 2004) (Ferrari et al., 2006) (Kushal et al., 2006) (Viksten, 2009)
  • 8. Our concept Pose Rotation image vector matrix 1 p1 R ! axis µ angle Training 2 p2 R2 ! 2µ
  • 9. Our concept New Pose Rotation image vector matrix axis angle 1 p1 R ! µ ! axis Polar Eigen Decomp. Decomp. µ angle 2 p2 R2 ! 2µ ! 2µ ! µ
  • 10. Our concept New Pose Rotation image Examples vector matrix axis angle 1 p1 R ! µ 29 [deg] 210 [deg] ! axis Polar Eigen Decomp. Decomp. µ angle 62 [deg] 420 [deg] 2 p2 R2 ! 2µ =60 [deg] ! Div by 2 Div by 2 31 [deg] 30 [deg] 2µ ! µ 30 [deg] ? [deg]
  • 11. Surveying Electronic Distance Measurement EDM Surveying – ARCHEOSCAN http://archeoscan.com/16.html
  • 12. Principle of EDM Transmitter Receiver Dist ¸1 ¸2 µ2 µ1 device target Use •Longer wavelength ¸1 first, for a rough phase estimate µ1 •Shorter wavelength ¸2 next, for a fine phase estimate µ2
  • 13. Our concept New Pose Rotation image Examples vector matrix axis angle 1 p1 R ! µ 29 [deg] 210 [deg] ! Polar Eigen Decomp. Decomp. µ 62 [deg] 420 [deg] 2 p2 R2 ! 2µ =60 [deg] ! Div by 2 Div by 2 31 [deg] 210 [deg] 2µ ! µ 30 [deg] 210 [deg]
  • 14. Measurements Simulation 1 Pose Rotation vector matrix axis angle R R p1 +noise R !1 µ1 … Polar Eigen … … … … Decomp. Decomp. µ R8 p8 +noise R8 !8 µ8 ! R
  • 15. Measurements Simulation 2 Pose Rotation vector matrix axis angle R +noise R p1 R !1 µ1 Polar Eigen … … … … … Decomp. Decomp. µ R8 p8 R8 !8 µ8 ! R Error  doesn’t  change… No free lunch!
  • 16. •Linear regression Experimental results •Training with Pose Rotation images and poses vector matrix axis angle 1 p1 R !1 µ1 Polar Eigen … … … … Decomp. Decomp. µ 8 p8 R8 !8 µ8 images ! R
  • 17. Summary • Improve estimates of a pose R with many measurements R1, R2,  …,  R8 • Simulations and experimental results shows that the concept works!