Results delivered by IBV within WP2 of Eurofit project Funded by the European Commission FP7-ICT-2011-SME-DCL Project: 296116 Area: SME Initiative on Digital Content and Languages - Bootstrapping a data econo

1. EUROFIT project:
Results on 3D data harmonisation
Alfredo Ballester (IBV)
FP7-ICT-2011-SME-DCL
SME initiative on Digital
Content and Languages
G.A. No.: 296116

2. PROJECT OVERVIEW
PROJECT RESULTS
3D harmonisation
1D to 3D enhancement
Posture harmonisation

3. EUROFIT project: 3D scan harmonisation
EUROFIT OVERVIEW
EUROFIT is an joint initiative co-funded
by the European Commission aimed at:
Fostering the global trade of Digital Anthropometric Data
Opening the use of 3D anthropometry to product design
Supporting SMEs to enter international markets
“EUROFIT vision is to unleash the huge potential contained in
the increasing number of databases of 3D body scans for the
European consumer goods’industries”
What is EUROFIT?

4. EUROFIT project: 3D scan harmonisation
Spain (HS)
11.000 subjects
Germany (HS)
12.000 subjects
Greece (Telmat)
7.000 subjects
Poland (HS)
(ongoing)
US, CA, NL, IT (Cw/HS)
Caesar - 4.800 subj.
USA (TC2)
11.000 subjects
Brazil (TC2)
(in preparation)
S. Korea (Cw)
10.000 subjects
China (HS/oth.)
(ongoing)
France (HS)
11.000 subjects
Sweden (HS)
4.000 subjects
UK (TC2)
11.000 subjects
Mexico (TC2)
16.000 subjects
Romania (HS)
(ongoing)
Thailand (TC2)
13.000 subjects
Japan
20.000 subjects
Malaysia (TC2)
12.000 subjects
Taiwan
10.000 subjects
3D raw scan databases
>> 500.000 points persubject
1D measure databases
< 100 manual measures
per subject
Ready for 1D data analysis and exploitation
> 20 countries
>> 150.000 individual sets
~16 countries
~ 120.000 individual sets
EXTRACTION
SHAPE
LOST!
1D measures
• Huge Digital Anthropometric Data
available now – both 1D and 3D
• Much more data will be generated
in the following years
3D data exists but
3D exploitation is
NOT AVAILABLE to industry
• Few tools for industrial application of 1D
data to consumer goods’ industries
EUROFIT OVERVIEW
Why EUROFIT?

5. EUROFIT project: 3D scan harmonisation
# Harmonisation of 3D scan data that enables cross-data analyses
# 3D enhancing of existing 1D databases
# Making 3D data available, usable and affordable to industry
# Attracting third party contributors (beyond project)
EUROFIT
pool
Offline
3D sources
1D sources
Online interactive
EUROFIT portal
3D Shape
Analysis &
developer
tools
Sector-
specific use
services
Data Owners IT SME developersand maintainers Industryend-users
EUROFIT OVERVIEW
Main S&T challenges

6. EUROFIT project: 3D scan harmonisation
EUROFIT OVERVIEW
Data enhancement concept
Shape
information
lost

7. EUROFIT project: 3D scan harmonisation
EUROFIT OVERVIEW
Concept overview

8. EUROFIT project: 3D scan harmonisation
Homology
Point-to-point correspondence that
• enables interpolation of shapes
• enables statistical analyses
• enables fast body part selections
PROJECT RESULTS – 3D harmonisation
Basis of the approach followed
Homologous mesh structure – Homodel
• Single mesh of 50K vertices and 99K faces
• Key anatomical landmarks associated to vertices
• Unisex semantic structure enabling body part focus
• Skeleton enabling posture corrections

9. EUROFIT project: 3D scan harmonisation
PROJECT RESULTS – 3D harmonisation
Process overview
Raw Scan Pre-processed Mesh
SCAN
PRE-PROCESSING
HOMODEL
CREATION
Homodel
• Hole filling
• Single surface reconstruction
• Removal of noise
• Same homologous mesh structure
• Anatomical correspondence
• Slit area correction

10. EUROFIT project: 3D scan harmonisation
PROJECT RESULTS – 3D harmonisation
Pre-processing of raw scans
• Holes in surface
• Multiple layers
• Noise in surface
• Physical markers
• ...
Hole-filling
Poison’s reconstruction plus surface fairing
Physical marker removal
Crop of markers followed by
Poison’s reconstruction plus surface fairing
Identification of
artificially completed
area, especially those
with low reliability
(slit areas), to be used
in automated post-
processing
Single Surface
Reconstruction

11. EUROFIT project: 3D scan harmonisation
Fitting of a template mesh equipped with a skeleton
to a 3D scan using a set of anatomical references.
Made in three automated steps:
• Template posing and scaling
• Template fitting to scan surface
• Post processing of slit areas
TEMPLATE-BASED HOMODEL CREATION
PROJECT RESULTS – 3D harmonisation
Homodel creation from 3D scans
Video
Raw scan
target Template
Posed &
Scaled
Template
Fitted
Homodel
Automated post processing
of slit areas using:
• Template structure
information
• Surface fairing in
selected areas
Surface distance error
per vertice <0.5mm in
most of the surface
Only >1mm in less
than 5% of the surface
0 mm
0.25 mm
0.50 mm
> 1 mm
No original surface

12. EUROFIT project: 3D scan harmonisation
TESTED FOR DIFFERENT 3D SCAN SOURCES, POSTURES, AND SURVEYS
PROJECT RESULTS – 3D harmonisation
Homodel creation from 3D scans
Size Spain
Human Solutions
Laser
Size Germany
Human Solutions
Laser
CAESAR US
Cyberware
Laser
Size Portugal
TC2
Structured light

13. EUROFIT project: 3D scan harmonisation
PROJECT RESULTS – 1D to 3D
Homodel creation from 1D measurement data
Homologous
3D data
Representative
3D+1D Database
(500-900 homodels +
measurements)
1D
data
Shape synthesis
through 30-200
Principal Components
Regression model
relating 3D shape
components to
measurements
Step 0:
Input of a list of
measurements from
any source (tape,
caliper or digital)
Step 1:
Approx.
shape
obtained
from the
model
Step 2:
Iterative
measurement &
optimisation until
all measurements
are matched

14. EUROFIT project: 3D scan harmonisation
Video
PROJECT RESULTS – 1D to 3D
Homodel creation from 1D measurement data
Up to
3cm
error
Nearly
zero
error

15. EUROFIT project: 3D scan harmonisation
PROJECT RESULTS – Shape Analysis
Posture correction and PCA
Automated fitting of a skeleton to Homodels
Automated posture alignment using inverse kinematics
Body
height
Body
mass
Limbs’
lenght
Effects in PCA results
with full bodies
Reuduction of the main
noise due to posture

16. EUROFIT project: 3D scan harmonisation
Thanks!
Alfredo Ballester Fernández
Alfredo.ballester@ibv.upv.es
www.eurofit-project.eu