SlideShare a Scribd company logo
1 of 108
Paper #34
Low-cost data-driven 3D
reconstruction and applications
Alfredo Ballester
Technical Session 10: RGB-D Sensors & Low-cost systems
28th October 2015
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
• Developers of 3D scanners
• E-commerce Virtual Fashion
• CAD developers
• Digital Human Model developers
• Body mannequin manufacturers
• 3D database owners
• 1D database owners
Technology Development Partner
for IT Industry and Academia
• Transports
• Footwear
• Furniture
• Orthopaedics
• Electronic Devices
• Workplace Ergonomics
Product Design Consultancy
for Manufacturing Industries
• Automotive
• Apparel
• Home Appliances
• Headgear
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
• Developers of 3D scanners
• E-commerce Virtual Fashion
• CAD developers
• Digital Human Model developers
• Body mannequin manufacturers
• 3D database owners
• 1D database owners
Technology Development Partner
for IT Industry and Academia
• Transports
• Footwear
• Furniture
• Orthopaedics
• Electronic Devices
• Workplace Ergonomics
Product Design Consultancy
for Manufacturing Industries
• Automotive
• Apparel
• Home Appliances
• Headgear
• Why?
• How it works
• Our solutions
• Next evolutions
• Some examples
Why data-driven reconstruction?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
millimetric
precision is not
needed for all
applications
Why data-driven reconstruction?
#3
we had
the databases
to do it
#1
high-end 3D
scanning is not
for everybody
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
millimetric
precision is not
needed for all
applications
Why data-driven reconstruction?
High-end 3D
scanners
at home or
at small shops?
#3
we had
the databases
to do it
#1
high-end 3D
scanning is not
for everybody
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
millimetric
precision is not
needed for all
applications
Why data-driven reconstruction?
#3
we had
the databases
to do it
#1
high-end 3D
scanning is not
for everybody
€conomic  cost & room/size
Usability  expertise needed
Availability  not portable
High-end 3D
scanners
at home or
at small shops?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
millimetric
precision is not
needed for all
applications
Why data-driven reconstruction?
#3
we had
the databases
to develop it
#1
high-end 3D
scanning is not
for everybody
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#2
millimetric
precision is not
needed for all
applications
Why data-driven reconstruction?
#3
we had
the databases
to develop it
#1
high-end 3D
scanning is not
for everybody
Product PersonalisationSize Recommendation
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Why data-driven reconstruction?
#3
we had
the databases
to develop it
#1
high-end 3D
scanning is not
for everybody
#2
millimetric
precision is not
needed for all
applications
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Why data-driven reconstruction?
#3
we had
the databases
to develop it
over 13.000
individual scan data
#1
high-end 3D
scanning is not
for everybody
#2
millimetric
precision is not
needed for all
applications
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
high-end 3D
scanning is not
for everybody
#2
millimetric
precision is not
needed for all
applications
Our targets
#3
we had
the databases
to develop it
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
high-end 3D
scanning is not
for everybody
• Mobile phone app
• Low-cost pricing model
• For everybody
• Easy-to-use
#2
millimetric
precision is not
needed for all
applications
Our targets
#3
we had
the databases
to develop it
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
high-end 3D
scanning is not
for everybody
• Mobile phone app
• Low-cost pricing model
• For everybody
• Easy-to-use
#2
millimetric
precision is not
needed for all
applications
Accurate enough for:
• Size selection
• Made-to-measure
Our targets
#3
we had
the databases
to develop it
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
#1
high-end 3D
scanning is not
for everybody
• Mobile phone app
• Low-cost pricing model
• For everybody
• Easy-to-use
#2
millimetric
precision is not
needed for all
applications
Accurate enough for:
• Size selection
• Made-to-measure
Our targets
#3
we had
the databases
to develop it
• Launching a solution
as soon as possible
• Southern European data
• Extending database
How it works
How it works: the guts
3D scan databases registered
using Template-based Methods
(Ballester et al. 2014)
How it works: the guts
3D scan databases registered
using Template-based Methods
(Ballester et al. 2014)
How it works: the guts
3D scan databases registered
using Template-based Methods
(Ballester et al. 2014)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
PC40
How it works: the guts
Parametric Space of Shapes
obtained using PCA
(Allen et al. 2003)
….
PC1
PC2
PC3
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the guts
PC1
PC2
PC3
PC100
….
Parametric Space of Shapes
obtained using PCA
(Allen et al. 2003)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the guts
PC1
PC2
PC3
PC100
….
Parametric Space of Shapes
obtained using PCA
(Allen et al. 2003)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the guts
PC1
PC2
PC3
PC100
….
Parametric Space of Shapes
obtained using PCA
(Allen et al. 2003)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input
data
Image
processing
Iterative
optimisation
3D
object
Data
extraction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input
data
Image
processing
Iterative
optimisation
3D
object
Data
extraction
Image calibration
(external element +
camera parameters)
& segmentation
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input
data
Image
processing
Iterative
optimisation
3D
object
Data
extraction
Image calibration
(external element +
camera parameters)
& segmentation
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input
data
Image
processing
Iterative
optimisation
3D
object
Data
extraction
Image calibration
(external element +
camera parameters)
& segmentation
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input
data
Image
processing
Iterative
optimisation
3D
object
Data
extraction
Image calibration
(external element +
camera parameters)
& segmentation
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
search->check->search (iterative)
Departs from average shape and
searches until shape matches silhouette
using L-BFGS-B minimisation
(Zhu et al. 1997)
….
Iteration 0
(initial solution)
Iteration 1 Iteration 2 Iteration 3
(convergence)
Parametric Shape Space
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
Digital measurement extraction
based on homologous topology
and on geometric searches
(Ballester et al. 2014)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
Digital measurement extraction
based on homologous topology
and on geometric searches
(Ballester et al. 2014)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
Other shape data extraction
(Ballester et al. 2014) like:
• Body part shapes
• Landmark positions
• 2D sections & contours
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
How it works: the process
Input data
Image
processing
Iterative
optimisation
3D object
Data
extraction
Other shape data extraction
(Ballester et al. 2014) like:
• Body part shapes
• Landmark positions
• 2D sections & contours
Our solutions
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning booth
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning booth
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning booth
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning booth
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app & booth (specs)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app & booth (specs)
• Four feet with very
different shapes
• Scanned five times each
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app & booth (specs)
• Four feet with very
different shapes
• Scanned five times each
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app & booth (specs)
• Four feet with very
different shapes
• Scanned five times each
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app & booth (specs)
• Four feet with very
different shapes
• Scanned five times each
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app & booth (specs)
• Four feet with very
different shapes
• Scanned five times each
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Foot scanning app & booth (specs)
• Four feet with very
different shapes
• Scanned five times each
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Adaptive guiding
silhouette
Adapted guiding
silhouette
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Adaptive guiding
silhouette
Adapted guiding
silhouette
Boundary
detection
Boundary
detection
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Adaptive guiding
silhouette
Adapted guiding
silhouette
Boundary
detection
Boundary
detection
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Adaptive guiding
silhouette
Adapted guiding
silhouette
Boundary
detection
Boundary
detection
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Adaptive guiding
silhouette
Adapted guiding
silhouette
Boundary
detection
Boundary
detection
Volunteer C
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Body scanning app (proto)
Next steps in data-driven
reconstruction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: pose, composition & size
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: pose, composition & size
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: pose, composition & size
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: pose, composition & size
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: pose, composition & size
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: pose, composition & size
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: pose, composition & size
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: depth images in phones
Why not using depth sensors?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: depth images in phones
Why not using depth sensors?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: depth images in phones
Why not using depth sensors?
100 200 300 400 500 600
50
100
150
200
250
300
350
400
450
Will image-based reconstruction become
obsolete when Depth will be in all devices?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: depth images in phones
Why not using depth sensors?
100 200 300 400 500 600
50
100
150
200
250
300
350
400
450
Will image-based reconstruction become
obsolete when Depth will be in all devices?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: depth images in phones
Why not using depth sensors?
100 200 300 400 500 600
50
100
150
200
250
300
350
400
450
Will image-based reconstruction become
obsolete when Depth will be in all devices?
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Next steps: depth images in phones
Why not using depth sensors?
100 200 300 400 500 600
50
100
150
200
250
300
350
400
450
Will image-based reconstruction become
obsolete when Depth will be in all devices?
Examples of services including IBV
data-driven 3D reconstruction
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Insole personalisation
http://www.sunfeet.es/en/
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Footwear personalisation
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
Kidsize DB
• Customers,
• Manufacturers
• e-commerces
Kidsize iFrame (customers)
Virtual try-on engine
Kidsize App (customers)
Size allocation engine
Kidsize backoffice (SMEs)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
Kidsize DB
• Customers,
• Manufacturers
• e-commerces
Kidsize iFrame (customers)
Virtual try-on engine
Kidsize App (customers)
Size allocation engine
Kidsize backoffice (SMEs)
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
http://www.kidsizesolution.com/
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
http://www.kidsizesolution.com/
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
http://www.kidsizesolution.com/
Actual
scan
KidSize
App
Actual
scan
KidSize
App
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
http://www.kidsizesolution.com/
Actual
scan
KidSize
App
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
http://www.kidsizesolution.com/
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
http://www.kidsizesolution.com/
Actual
scan
KidSize
App
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Childrenswear size allocation
http://www.kidsizesolution.com/
Actual
scan
KidSize
App
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 28
Weight 53
Height 166
Bust 83
Waist 66
Hip 90
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 28
Weight 53
Height 166
Bust 83
Waist 66
Hip 90
DAZ
Parametric
IBV
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 28
Weight 53
Height 166
Bust 83
Waist 66
Hip 90
DAZ
Parametric
IBV Enriched Virtual try-on
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 40
Weight 60
Height 175
Bust 90
Waist 73
Hip 102
DAZ
Parametric
IBV Enriched Virtual try-on
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 40
Weight 60
Height 175
Bust 90
Waist 73
Hip 102
DAZ
Parametric
IBV Enriched Virtual try-on
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 40
Weight 60
Height 175
Bust 90
Waist 73
Hip 102
DAZ
Parametric
IBV Enriched Virtual try-on
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 40
Weight 60
Height 175
Bust 90
Waist 73
Hip 102
DAZ
Parametric
IBV Enriched Virtual try-on
6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015
Virtual look
Age 40
Weight 60
Height 175
Bust 90
Waist 73
Hip 102
DAZ
Parametric
IBV Enriched Virtual try-on
Thanks!
Alfredo Ballester
Alfredo.ballester@ibv.upv.es
Any Questions?
Dr. Carlos Soler (CTO)
Sandra Alemany (Chief Researcher)
Dr. Eduardo Parrilla (Chief Developer)
Dr. Juan C. González (Product Manager)
Jordi Uriel
Ana Piérola
Paola Piqueras
Beatriz Nácher
Clara Solves
Sergio A. Puigcerver
Julio A. Vivas
Silvia San Jerónimo
Francisco Fos
…
anthropometry.ibv.org

More Related Content

Viewers also liked

Imagerie medicale 3d
Imagerie medicale 3dImagerie medicale 3d
Imagerie medicale 3dmacorder
 
Visualisation et Reconstruction
Visualisation et ReconstructionVisualisation et Reconstruction
Visualisation et ReconstructionBarts_706
 
Comment l’impression 3D va révolutionner le monde et le retail
 Comment l’impression 3D va révolutionner le monde et le retail Comment l’impression 3D va révolutionner le monde et le retail
Comment l’impression 3D va révolutionner le monde et le retailHUB INSTITUTE
 
Reconstruction de surfaces d'objets 3D a partir de nuage de points
Reconstruction de surfaces d'objets 3D a partir de nuage de pointsReconstruction de surfaces d'objets 3D a partir de nuage de points
Reconstruction de surfaces d'objets 3D a partir de nuage de pointsYassine Nasser
 
Prothese de genou plannification ichg
Prothese de genou plannification ichgProthese de genou plannification ichg
Prothese de genou plannification ichgsailhan
 
TerraNumerica - Presentation CapDigital 2009
TerraNumerica - Presentation CapDigital 2009TerraNumerica - Presentation CapDigital 2009
TerraNumerica - Presentation CapDigital 2009Cédric Guiard
 
Analysis of the 3D reconstruction methodologies used within the framework of ...
Analysis of the 3D reconstruction methodologies used within the framework of ...Analysis of the 3D reconstruction methodologies used within the framework of ...
Analysis of the 3D reconstruction methodologies used within the framework of ...3D ICONS Project
 
The unmanned system in hydrographic applications (Z-Boat)
The unmanned system in hydrographic applications (Z-Boat)The unmanned system in hydrographic applications (Z-Boat)
The unmanned system in hydrographic applications (Z-Boat)Hydrographic Society Benelux
 
The Future of Unmanned Undersea and Surface Vehicles
The Future of Unmanned Undersea and Surface VehiclesThe Future of Unmanned Undersea and Surface Vehicles
The Future of Unmanned Undersea and Surface VehiclesSteve Shaker
 
Autonomous underwater vehicles
Autonomous underwater vehiclesAutonomous underwater vehicles
Autonomous underwater vehiclesRAKESH MC
 
Modelado basado en imágenes
Modelado basado en imágenesModelado basado en imágenes
Modelado basado en imágenesMario Rodriguez
 
An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...Giulio Bigliardi
 
Teleimmersion
TeleimmersionTeleimmersion
Teleimmersionstudent
 
Crime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike AndersonCrime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike AndersonPPI_Group
 
Shape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationShape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationVanya Valindria
 

Viewers also liked (20)

Imagerie medicale 3d
Imagerie medicale 3dImagerie medicale 3d
Imagerie medicale 3d
 
Visualisation et Reconstruction
Visualisation et ReconstructionVisualisation et Reconstruction
Visualisation et Reconstruction
 
3D HOLOGRAPHIC PROJECTION
3D HOLOGRAPHIC PROJECTION3D HOLOGRAPHIC PROJECTION
3D HOLOGRAPHIC PROJECTION
 
Comment l’impression 3D va révolutionner le monde et le retail
 Comment l’impression 3D va révolutionner le monde et le retail Comment l’impression 3D va révolutionner le monde et le retail
Comment l’impression 3D va révolutionner le monde et le retail
 
Reconstruction de surfaces d'objets 3D a partir de nuage de points
Reconstruction de surfaces d'objets 3D a partir de nuage de pointsReconstruction de surfaces d'objets 3D a partir de nuage de points
Reconstruction de surfaces d'objets 3D a partir de nuage de points
 
Reconstruction 3 D
Reconstruction 3 DReconstruction 3 D
Reconstruction 3 D
 
Prothese de genou plannification ichg
Prothese de genou plannification ichgProthese de genou plannification ichg
Prothese de genou plannification ichg
 
Impression 3D en EPN
Impression 3D en EPNImpression 3D en EPN
Impression 3D en EPN
 
TerraNumerica - Presentation CapDigital 2009
TerraNumerica - Presentation CapDigital 2009TerraNumerica - Presentation CapDigital 2009
TerraNumerica - Presentation CapDigital 2009
 
Analysis of the 3D reconstruction methodologies used within the framework of ...
Analysis of the 3D reconstruction methodologies used within the framework of ...Analysis of the 3D reconstruction methodologies used within the framework of ...
Analysis of the 3D reconstruction methodologies used within the framework of ...
 
The unmanned system in hydrographic applications (Z-Boat)
The unmanned system in hydrographic applications (Z-Boat)The unmanned system in hydrographic applications (Z-Boat)
The unmanned system in hydrographic applications (Z-Boat)
 
The Future of Unmanned Undersea and Surface Vehicles
The Future of Unmanned Undersea and Surface VehiclesThe Future of Unmanned Undersea and Surface Vehicles
The Future of Unmanned Undersea and Surface Vehicles
 
2013_UTS_Fall_web
2013_UTS_Fall_web2013_UTS_Fall_web
2013_UTS_Fall_web
 
AUV based on EL - Copy
AUV based on EL - CopyAUV based on EL - Copy
AUV based on EL - Copy
 
Autonomous underwater vehicles
Autonomous underwater vehiclesAutonomous underwater vehicles
Autonomous underwater vehicles
 
Modelado basado en imágenes
Modelado basado en imágenesModelado basado en imágenes
Modelado basado en imágenes
 
An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...
 
Teleimmersion
TeleimmersionTeleimmersion
Teleimmersion
 
Crime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike AndersonCrime Scene Diagramming and Reconstruction by Det. Mike Anderson
Crime Scene Diagramming and Reconstruction by Det. Mike Anderson
 
Shape from Distortion - 3D Digitization
Shape from Distortion - 3D DigitizationShape from Distortion - 3D Digitization
Shape from Distortion - 3D Digitization
 

Similar to Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body Scanning Tecnologies, October 2015, Lugano

Simpda 2014 - A living story: measuring quality of developments in a large in...
Simpda 2014 - A living story: measuring quality of developments in a large in...Simpda 2014 - A living story: measuring quality of developments in a large in...
Simpda 2014 - A living story: measuring quality of developments in a large in...SpagoWorld
 
How to fully automate a store.pptx
How to fully automate a store.pptxHow to fully automate a store.pptx
How to fully automate a store.pptxIgor Moiseev
 
Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....
Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....
Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....Alfredo BALLESTER FERNÁNDEZ
 
DATA @ NFLX (Tableau Conference 2014 Presentation)
DATA @ NFLX (Tableau Conference 2014 Presentation)DATA @ NFLX (Tableau Conference 2014 Presentation)
DATA @ NFLX (Tableau Conference 2014 Presentation)Blake Irvine
 
ABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3D
ABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3DABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3D
ABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3D恒州博智QYResearch
 
ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data Lake
ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data LakeITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data Lake
ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data LakeITCamp
 
Data science, self learning algorithms (by Alexander Frimout & Max Nie)
Data science, self learning algorithms (by Alexander Frimout & Max Nie)Data science, self learning algorithms (by Alexander Frimout & Max Nie)
Data science, self learning algorithms (by Alexander Frimout & Max Nie)Verhaert Masters in Innovation
 
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...Codemotion
 
Alteryx training online for corporate
Alteryx training online for corporateAlteryx training online for corporate
Alteryx training online for corporatesimpleanalytics
 
2014 DATA @ NFLX (Tableau Customer Conference)
2014 DATA @ NFLX (Tableau Customer Conference)2014 DATA @ NFLX (Tableau Customer Conference)
2014 DATA @ NFLX (Tableau Customer Conference)Albert Wong
 
Self-Service IoT Data Analytics with StreamPipes
Self-Service IoT Data Analytics with StreamPipesSelf-Service IoT Data Analytics with StreamPipes
Self-Service IoT Data Analytics with StreamPipesApache StreamPipes
 
Advanced Quality Inspection and Data Insights (Artificial Intelligence)
Advanced Quality Inspection and Data Insights (Artificial Intelligence)Advanced Quality Inspection and Data Insights (Artificial Intelligence)
Advanced Quality Inspection and Data Insights (Artificial Intelligence)byteLAKE
 
R, Spark, Tensorflow, H20.ai Applied to Streaming Analytics
R, Spark, Tensorflow, H20.ai Applied to Streaming AnalyticsR, Spark, Tensorflow, H20.ai Applied to Streaming Analytics
R, Spark, Tensorflow, H20.ai Applied to Streaming AnalyticsKai Wähner
 
How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...
How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...
How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...Codemotion
 
3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...
3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...
3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...Alfredo BALLESTER FERNÁNDEZ
 
Data analytics and software sensors for single use bioprocessing
Data analytics and software sensors for single use bioprocessingData analytics and software sensors for single use bioprocessing
Data analytics and software sensors for single use bioprocessingExputec
 

Similar to Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body Scanning Tecnologies, October 2015, Lugano (20)

Simpda 2014 - A living story: measuring quality of developments in a large in...
Simpda 2014 - A living story: measuring quality of developments in a large in...Simpda 2014 - A living story: measuring quality of developments in a large in...
Simpda 2014 - A living story: measuring quality of developments in a large in...
 
How to fully automate a store.pptx
How to fully automate a store.pptxHow to fully automate a store.pptx
How to fully automate a store.pptx
 
Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....
Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....
Fast, portable & low cost 3D foot digitizers: validity & reliability @3DBody....
 
I4MS join webinar_c2t_digitbrain_
I4MS join webinar_c2t_digitbrain_I4MS join webinar_c2t_digitbrain_
I4MS join webinar_c2t_digitbrain_
 
DATA @ NFLX (Tableau Conference 2014 Presentation)
DATA @ NFLX (Tableau Conference 2014 Presentation)DATA @ NFLX (Tableau Conference 2014 Presentation)
DATA @ NFLX (Tableau Conference 2014 Presentation)
 
ABB Journey to Digital
ABB Journey to DigitalABB Journey to Digital
ABB Journey to Digital
 
ABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3D
ABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3DABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3D
ABB AQUIRES BARCELONA-BASED 3-D SENSOR COMPANY NUB3D
 
ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data Lake
ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data LakeITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data Lake
ITCamp 2019 - Andy Cross - Machine Learning with ML.NET and Azure Data Lake
 
Data science, self learning algorithms (by Alexander Frimout & Max Nie)
Data science, self learning algorithms (by Alexander Frimout & Max Nie)Data science, self learning algorithms (by Alexander Frimout & Max Nie)
Data science, self learning algorithms (by Alexander Frimout & Max Nie)
 
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
 
Alteryx training online for corporate
Alteryx training online for corporateAlteryx training online for corporate
Alteryx training online for corporate
 
Industrial Sensory Data Analytics
Industrial Sensory Data AnalyticsIndustrial Sensory Data Analytics
Industrial Sensory Data Analytics
 
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
noProj.aa1.ro  » M&ES4DE/DD-IT&C+AnoProj.aa1.ro  » M&ES4DE/DD-IT&C+A
noProj.aa1.ro » M&ES4DE/DD-IT&C+A
 
2014 DATA @ NFLX (Tableau Customer Conference)
2014 DATA @ NFLX (Tableau Customer Conference)2014 DATA @ NFLX (Tableau Customer Conference)
2014 DATA @ NFLX (Tableau Customer Conference)
 
Self-Service IoT Data Analytics with StreamPipes
Self-Service IoT Data Analytics with StreamPipesSelf-Service IoT Data Analytics with StreamPipes
Self-Service IoT Data Analytics with StreamPipes
 
Advanced Quality Inspection and Data Insights (Artificial Intelligence)
Advanced Quality Inspection and Data Insights (Artificial Intelligence)Advanced Quality Inspection and Data Insights (Artificial Intelligence)
Advanced Quality Inspection and Data Insights (Artificial Intelligence)
 
R, Spark, Tensorflow, H20.ai Applied to Streaming Analytics
R, Spark, Tensorflow, H20.ai Applied to Streaming AnalyticsR, Spark, Tensorflow, H20.ai Applied to Streaming Analytics
R, Spark, Tensorflow, H20.ai Applied to Streaming Analytics
 
How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...
How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...
How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...
 
3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...
3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...
3D-based Resources Fostering the Analysis, Use and Exploitation of availabale...
 
Data analytics and software sensors for single use bioprocessing
Data analytics and software sensors for single use bioprocessingData analytics and software sensors for single use bioprocessing
Data analytics and software sensors for single use bioprocessing
 

Low-cost data-driven 3D reconstruction and its applications @ 6th ICE 3D Body Scanning Tecnologies, October 2015, Lugano

  • 1. Paper #34 Low-cost data-driven 3D reconstruction and applications Alfredo Ballester Technical Session 10: RGB-D Sensors & Low-cost systems 28th October 2015
  • 2. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 • Developers of 3D scanners • E-commerce Virtual Fashion • CAD developers • Digital Human Model developers • Body mannequin manufacturers • 3D database owners • 1D database owners Technology Development Partner for IT Industry and Academia • Transports • Footwear • Furniture • Orthopaedics • Electronic Devices • Workplace Ergonomics Product Design Consultancy for Manufacturing Industries • Automotive • Apparel • Home Appliances • Headgear
  • 3. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 • Developers of 3D scanners • E-commerce Virtual Fashion • CAD developers • Digital Human Model developers • Body mannequin manufacturers • 3D database owners • 1D database owners Technology Development Partner for IT Industry and Academia • Transports • Footwear • Furniture • Orthopaedics • Electronic Devices • Workplace Ergonomics Product Design Consultancy for Manufacturing Industries • Automotive • Apparel • Home Appliances • Headgear
  • 4. • Why? • How it works • Our solutions • Next evolutions • Some examples
  • 6. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to do it #1 high-end 3D scanning is not for everybody
  • 7. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? High-end 3D scanners at home or at small shops? #3 we had the databases to do it #1 high-end 3D scanning is not for everybody
  • 8. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to do it #1 high-end 3D scanning is not for everybody €conomic  cost & room/size Usability  expertise needed Availability  not portable High-end 3D scanners at home or at small shops?
  • 9. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to develop it #1 high-end 3D scanning is not for everybody
  • 10. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #2 millimetric precision is not needed for all applications Why data-driven reconstruction? #3 we had the databases to develop it #1 high-end 3D scanning is not for everybody Product PersonalisationSize Recommendation
  • 11. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Why data-driven reconstruction? #3 we had the databases to develop it #1 high-end 3D scanning is not for everybody #2 millimetric precision is not needed for all applications
  • 12. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Why data-driven reconstruction? #3 we had the databases to develop it over 13.000 individual scan data #1 high-end 3D scanning is not for everybody #2 millimetric precision is not needed for all applications
  • 13. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody #2 millimetric precision is not needed for all applications Our targets #3 we had the databases to develop it
  • 14. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody • Mobile phone app • Low-cost pricing model • For everybody • Easy-to-use #2 millimetric precision is not needed for all applications Our targets #3 we had the databases to develop it
  • 15. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody • Mobile phone app • Low-cost pricing model • For everybody • Easy-to-use #2 millimetric precision is not needed for all applications Accurate enough for: • Size selection • Made-to-measure Our targets #3 we had the databases to develop it
  • 16. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 #1 high-end 3D scanning is not for everybody • Mobile phone app • Low-cost pricing model • For everybody • Easy-to-use #2 millimetric precision is not needed for all applications Accurate enough for: • Size selection • Made-to-measure Our targets #3 we had the databases to develop it • Launching a solution as soon as possible • Southern European data • Extending database
  • 18. How it works: the guts 3D scan databases registered using Template-based Methods (Ballester et al. 2014)
  • 19. How it works: the guts 3D scan databases registered using Template-based Methods (Ballester et al. 2014)
  • 20. How it works: the guts 3D scan databases registered using Template-based Methods (Ballester et al. 2014)
  • 21. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 PC40 How it works: the guts Parametric Space of Shapes obtained using PCA (Allen et al. 2003) …. PC1 PC2 PC3
  • 22. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the guts PC1 PC2 PC3 PC100 …. Parametric Space of Shapes obtained using PCA (Allen et al. 2003)
  • 23. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the guts PC1 PC2 PC3 PC100 …. Parametric Space of Shapes obtained using PCA (Allen et al. 2003)
  • 24. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the guts PC1 PC2 PC3 PC100 …. Parametric Space of Shapes obtained using PCA (Allen et al. 2003)
  • 25. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  • 26. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  • 27. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  • 28. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  • 29. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  • 30. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Image calibration (external element + camera parameters) & segmentation
  • 31. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction search->check->search (iterative) Departs from average shape and searches until shape matches silhouette using L-BFGS-B minimisation (Zhu et al. 1997) …. Iteration 0 (initial solution) Iteration 1 Iteration 2 Iteration 3 (convergence) Parametric Shape Space
  • 32. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  • 33. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  • 34. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction
  • 35. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Digital measurement extraction based on homologous topology and on geometric searches (Ballester et al. 2014)
  • 36. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Digital measurement extraction based on homologous topology and on geometric searches (Ballester et al. 2014)
  • 37. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Other shape data extraction (Ballester et al. 2014) like: • Body part shapes • Landmark positions • 2D sections & contours
  • 38. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 How it works: the process Input data Image processing Iterative optimisation 3D object Data extraction Other shape data extraction (Ballester et al. 2014) like: • Body part shapes • Landmark positions • 2D sections & contours
  • 40. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app
  • 41. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app
  • 42. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  • 43. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  • 44. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  • 45. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning booth
  • 46. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs)
  • 47. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  • 48. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  • 49. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  • 50. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  • 51. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  • 52. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Foot scanning app & booth (specs) • Four feet with very different shapes • Scanned five times each
  • 53. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  • 54. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  • 55. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  • 56. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  • 57. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  • 58. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  • 59. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Volunteer C
  • 60. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Volunteer C
  • 61. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  • 62. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  • 63. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  • 64. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto) Adaptive guiding silhouette Adapted guiding silhouette Boundary detection Boundary detection Volunteer C
  • 65. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  • 66. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  • 67. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  • 68. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  • 69. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  • 70. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  • 71. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Body scanning app (proto)
  • 72. Next steps in data-driven reconstruction
  • 73. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  • 74. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  • 75. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  • 76. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  • 77. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  • 78. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  • 79. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: pose, composition & size
  • 80. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors?
  • 81. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors?
  • 82. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  • 83. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  • 84. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  • 85. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Next steps: depth images in phones Why not using depth sensors? 100 200 300 400 500 600 50 100 150 200 250 300 350 400 450 Will image-based reconstruction become obsolete when Depth will be in all devices?
  • 86. Examples of services including IBV data-driven 3D reconstruction
  • 87. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Insole personalisation http://www.sunfeet.es/en/
  • 88. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Footwear personalisation
  • 89. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation Kidsize DB • Customers, • Manufacturers • e-commerces Kidsize iFrame (customers) Virtual try-on engine Kidsize App (customers) Size allocation engine Kidsize backoffice (SMEs)
  • 90. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation Kidsize DB • Customers, • Manufacturers • e-commerces Kidsize iFrame (customers) Virtual try-on engine Kidsize App (customers) Size allocation engine Kidsize backoffice (SMEs)
  • 91. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation
  • 92. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/
  • 93. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/
  • 94. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App Actual scan KidSize App
  • 95. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App
  • 96. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/
  • 97. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App
  • 98. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Childrenswear size allocation http://www.kidsizesolution.com/ Actual scan KidSize App
  • 99. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look
  • 100. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 28 Weight 53 Height 166 Bust 83 Waist 66 Hip 90
  • 101. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 28 Weight 53 Height 166 Bust 83 Waist 66 Hip 90 DAZ Parametric IBV
  • 102. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 28 Weight 53 Height 166 Bust 83 Waist 66 Hip 90 DAZ Parametric IBV Enriched Virtual try-on
  • 103. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  • 104. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  • 105. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  • 106. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  • 107. 6th International Conference and Exhibition on 3D BODY SCANNING TECHNOLOGIES, Lugano, Switzerland, 27-28 October 2015 Virtual look Age 40 Weight 60 Height 175 Bust 90 Waist 73 Hip 102 DAZ Parametric IBV Enriched Virtual try-on
  • 108. Thanks! Alfredo Ballester Alfredo.ballester@ibv.upv.es Any Questions? Dr. Carlos Soler (CTO) Sandra Alemany (Chief Researcher) Dr. Eduardo Parrilla (Chief Developer) Dr. Juan C. González (Product Manager) Jordi Uriel Ana Piérola Paola Piqueras Beatriz Nácher Clara Solves Sergio A. Puigcerver Julio A. Vivas Silvia San Jerónimo Francisco Fos … anthropometry.ibv.org

Editor's Notes

  1. Medio paso de talla para size recommendation 2-3mm para calzado 1cm en ropa, PERO SHAPE IS IMPORTANT
  2. Medio paso de talla para size recommendation 2-3mm para calzado 1cm en ropa, PERO SHAPE IS IMPORTANT