SlideShare a Scribd company logo
High-dimensional sampling and volume computation
Apostolos Chalkis
Dept. of Informatics & Telecommunications, University of Athens
GeomScale Project
package volesti: sampling and volume estimation
https://github.com/GeomScale/volume_approximation
open source, written in C++, R package in CRAN.
depends on Eigen, LPSolve, Boost.
currently 3 volume algorithms, 4 sampling algorithms.
main contributors: A. Chalkis and V. Fisikopoulos plus several
community contributors.
Problems
Given P a convex body in Rn:
compute the volume of P.
sample from a distribution π truncated in P.
minimize a convex function f in P (convex optimization).
compute the integral of a function f over P.
volesti provides randomized approximation algorithms based on
sampling from P with geometric random walks.
volume computation of a polytope P
First thoughts
Compute a triangulation of P and sum up the volumes of the
triangles.
Sample from a bounding box, count the number of points in P.
both approaches fail in high dimensions (curse of
dimensionality).
Multiphase Monte Carlo
There are several algorithms based on MMC.
The only alternative in R: package geometry (exact
computations).
An example:
#exact computation with package geometry
P = gen_rand_vpoly(20, 40)
geom_values = geometry::convhulln(P$V, options = ’FA’)
QH6082 qhull error (qh_memalloc): insufficient memory
to allocate 1329542232 bytes
#computation with volesti
time2 = system.time({ vol2 = volume(P) })
cat(time2[3], vol2)
14.524 2.68443e-07
Convex bodies
H-polytope : P = {x | Ax ≤ b, A ∈ Rm×n, b ∈ Rm}
V-polytope : P is the convex hull of a set of points in Rn
Z-polytope : Minkowski sum of k segments (projection of k-cube)
Spectrahedron : P = {x | A0 + x1A1 + · · · + xnAn 0},
where Ai : symmetric matrices, B 0: B is positive
semidefinite
volesti provide three volume algorithms
volesti is the first software that performs volume
computations in thousands of dimensions.
Algorithm
H-polytope
V- & Z-polytope
n ≤ 20 n > 20
Sequence of Balls [1]
CoolingGaussians [2]
CoolingBodies [3]
[1] I.Z. Emiris, V. Fisikopoulos, 2014
[2] S. Vempala, B. Cousins, 2014
[3] A. Chalkis, I.Z. Emiris, V. Fisikopoulos, 2019
volesti provides four random walks
random walk
uniform gaussian exponential
distribution distribution distribution
Ball walk
hit and run
Random directions
hit and run
Coordinate directions
Billiard walk
B
p
q
p
q
p q
p
q
Comparing mixing times
Uniform sampling from the hypercube [−1, 1]200 and projection
to R3.
Rows: Ball Walk, Coordinate Directions Hit and Run, Random
Directions Hit and Run, Billiard Walk.
Columns: walk length, {1, 50, 100, 150, 200}
Rounding a convex body
Example
Let P = [−1, 1] × [−100, 100]. We want to sample uniformly
distributed points from P.
Left we sample directly from P.
Right we round the body to obtain a higher quality sample.
volesti provides three rounding methods.
Application
Multivariate integration
Let I = P f (x)dx.
Sample N uniformly distributed points x1, . . . , xN from P and,
I ≈ vol(P)
1
N
N
i=1
f (xi ).
Example:
P = gen_rand_vpoly(n, 2 * n, seed = 127)
f = function(x) {sum(x^2) + (2 * x[1]^2 + x[2] + x[3])}
points = sample_points(P, random_walk =
list("walk" = "BiW", "walk_length" = 1),
n = 5000, seed = 5)
int = 0
for (i in 1:num_of_points) int = int + f(points[, i])
V = volume(P, settings = list("error" = 0.05))
I = (int * V) / 5000 })
Application
Multivariate integration
Comparison with exact computation: R packages geometry
(triangulation) and SimplicialCubature (integration over
each triangle).
dimension error exact time volesti time
5 0.05129854 0.41 3.095
10 0.08964482 2.945 12.01
15 0.01541695 471.479 33.256
20 – – 64.058
volesti can do general convex bodies (not only triangles).
Future work: improve accuracy with more advanced MC
integration methods such as importance sampling.
Application in finance
Crisis detection in stock markets
Data: 52 popular exchange traded funds (ETFs) and the US
central bank (FED)
https://stanford.edu/class/ee103/portfolio.html.
Approximation of the joint distribution (copula) between portfolio return
and volatility (risk) in a given time period.
Left, a copula that corresponds to normal period (07/03/2007 -
31/05/2007).
Right, a copula that corresponds to a crisis period
(18/12/2008 − 13/03/2009).
Application in finance
Crisis detection in stock markets
We define an indicator as the ratio between two masses (red /
blue).
If the indicator is ≥ 1 then the copula corresponds to a crises,
otherwise corresponds to a normal period.
Applications in finance
Crisis detection in stock markets
Cales, C. et. al - SoCG 2018
GeomScale/volesti on Google Summer of Code 2020
Mentoring organization
https://summerofcode.withgoogle.com/organizations/
5673184117915648/
3 student projects this year:
1. Sampling log-concave densities.
2. Convex optimization
3. Uniform sampling for Machine Learning.
Communication channels:
gitter.im/GeomScale/community,
geomscale-gsoc@googlegroups.com
website geomscale.github.io/
Thank you!

More Related Content

What's hot

Volume and edge skeleton computation in high dimensions
Volume and edge skeleton computation in high dimensionsVolume and edge skeleton computation in high dimensions
Volume and edge skeleton computation in high dimensions
Vissarion Fisikopoulos
 
High-dimensional sampling and volume computation
High-dimensional sampling and volume computationHigh-dimensional sampling and volume computation
High-dimensional sampling and volume computation
Vissarion Fisikopoulos
 
Semi-automatic ABC: a discussion
Semi-automatic ABC: a discussionSemi-automatic ABC: a discussion
Semi-automatic ABC: a discussion
Christian Robert
 
Efficient Random-Walk Methods forApproximating Polytope Volume
Efficient Random-Walk Methods forApproximating Polytope VolumeEfficient Random-Walk Methods forApproximating Polytope Volume
Efficient Random-Walk Methods forApproximating Polytope Volume
Vissarion Fisikopoulos
 
Derivatives Lesson Oct 5
Derivatives Lesson  Oct 5Derivatives Lesson  Oct 5
Derivatives Lesson Oct 5ingroy
 
Code of the multidimensional fractional pseudo-Newton method using recursive ...
Code of the multidimensional fractional pseudo-Newton method using recursive ...Code of the multidimensional fractional pseudo-Newton method using recursive ...
Code of the multidimensional fractional pseudo-Newton method using recursive ...
mathsjournal
 
Bagging-Clustering Methods to Forecast Time Series
Bagging-Clustering Methods to Forecast Time SeriesBagging-Clustering Methods to Forecast Time Series
Bagging-Clustering Methods to Forecast Time Series
Tiago Mendes Dantas
 
Ultrasound Modular Architecture
Ultrasound Modular ArchitectureUltrasound Modular Architecture
Ultrasound Modular ArchitectureJose Miguel Moreno
 
RuleML 2015 Constraint Handling Rules - What Else?
RuleML 2015 Constraint Handling Rules - What Else?RuleML 2015 Constraint Handling Rules - What Else?
RuleML 2015 Constraint Handling Rules - What Else?
RuleML
 
A Posteriori Error Analysis Presentation
A Posteriori Error Analysis  PresentationA Posteriori Error Analysis  Presentation
Theory of Automata and formal languages unit 2
Theory of Automata and formal languages unit 2Theory of Automata and formal languages unit 2
Theory of Automata and formal languages unit 2
Abhimanyu Mishra
 
Module 13 Gradient And Area Under A Graph
Module 13  Gradient And Area Under A GraphModule 13  Gradient And Area Under A Graph
Module 13 Gradient And Area Under A Graphguestcc333c
 
Network flows
Network flowsNetwork flows
Network flows
Richa Bandlas
 
Mapping analysis
Mapping analysisMapping analysis
APassengerKnockOnDelayModelForTimetableOptimisation_beamer
APassengerKnockOnDelayModelForTimetableOptimisation_beamerAPassengerKnockOnDelayModelForTimetableOptimisation_beamer
APassengerKnockOnDelayModelForTimetableOptimisation_beamerPeter Sels
 
Assignment 3 push down automata final
Assignment 3 push down automata finalAssignment 3 push down automata final
Assignment 3 push down automata final
Pawan Goel
 
Model Checking Base on Interoplation
Model Checking Base onInteroplationModel Checking Base onInteroplation
Model Checking Base on Interoplation
leticia2307
 
p-adic integration and elliptic curves over number fields
p-adic integration and elliptic curves over number fieldsp-adic integration and elliptic curves over number fields
p-adic integration and elliptic curves over number fields
mmasdeu
 
Quiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT Kanpur
Quiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT KanpurQuiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT Kanpur
Quiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT Kanpur
Vivekananda Samiti
 

What's hot (20)

Volume and edge skeleton computation in high dimensions
Volume and edge skeleton computation in high dimensionsVolume and edge skeleton computation in high dimensions
Volume and edge skeleton computation in high dimensions
 
20320140501020
2032014050102020320140501020
20320140501020
 
High-dimensional sampling and volume computation
High-dimensional sampling and volume computationHigh-dimensional sampling and volume computation
High-dimensional sampling and volume computation
 
Semi-automatic ABC: a discussion
Semi-automatic ABC: a discussionSemi-automatic ABC: a discussion
Semi-automatic ABC: a discussion
 
Efficient Random-Walk Methods forApproximating Polytope Volume
Efficient Random-Walk Methods forApproximating Polytope VolumeEfficient Random-Walk Methods forApproximating Polytope Volume
Efficient Random-Walk Methods forApproximating Polytope Volume
 
Derivatives Lesson Oct 5
Derivatives Lesson  Oct 5Derivatives Lesson  Oct 5
Derivatives Lesson Oct 5
 
Code of the multidimensional fractional pseudo-Newton method using recursive ...
Code of the multidimensional fractional pseudo-Newton method using recursive ...Code of the multidimensional fractional pseudo-Newton method using recursive ...
Code of the multidimensional fractional pseudo-Newton method using recursive ...
 
Bagging-Clustering Methods to Forecast Time Series
Bagging-Clustering Methods to Forecast Time SeriesBagging-Clustering Methods to Forecast Time Series
Bagging-Clustering Methods to Forecast Time Series
 
Ultrasound Modular Architecture
Ultrasound Modular ArchitectureUltrasound Modular Architecture
Ultrasound Modular Architecture
 
RuleML 2015 Constraint Handling Rules - What Else?
RuleML 2015 Constraint Handling Rules - What Else?RuleML 2015 Constraint Handling Rules - What Else?
RuleML 2015 Constraint Handling Rules - What Else?
 
A Posteriori Error Analysis Presentation
A Posteriori Error Analysis  PresentationA Posteriori Error Analysis  Presentation
A Posteriori Error Analysis Presentation
 
Theory of Automata and formal languages unit 2
Theory of Automata and formal languages unit 2Theory of Automata and formal languages unit 2
Theory of Automata and formal languages unit 2
 
Module 13 Gradient And Area Under A Graph
Module 13  Gradient And Area Under A GraphModule 13  Gradient And Area Under A Graph
Module 13 Gradient And Area Under A Graph
 
Network flows
Network flowsNetwork flows
Network flows
 
Mapping analysis
Mapping analysisMapping analysis
Mapping analysis
 
APassengerKnockOnDelayModelForTimetableOptimisation_beamer
APassengerKnockOnDelayModelForTimetableOptimisation_beamerAPassengerKnockOnDelayModelForTimetableOptimisation_beamer
APassengerKnockOnDelayModelForTimetableOptimisation_beamer
 
Assignment 3 push down automata final
Assignment 3 push down automata finalAssignment 3 push down automata final
Assignment 3 push down automata final
 
Model Checking Base on Interoplation
Model Checking Base onInteroplationModel Checking Base onInteroplation
Model Checking Base on Interoplation
 
p-adic integration and elliptic curves over number fields
p-adic integration and elliptic curves over number fieldsp-adic integration and elliptic curves over number fields
p-adic integration and elliptic curves over number fields
 
Quiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT Kanpur
Quiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT KanpurQuiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT Kanpur
Quiz3 | Theory of Computation | Akash Anand | MTH 401A | IIT Kanpur
 

Similar to Presentation of volesti in eRum 2020

2. polynomial interpolation
2. polynomial interpolation2. polynomial interpolation
2. polynomial interpolation
EasyStudy3
 
BALANCING BOARD MACHINES
BALANCING BOARD MACHINESBALANCING BOARD MACHINES
BALANCING BOARD MACHINESbutest
 
Volume computation and applications
Volume computation and applications Volume computation and applications
Volume computation and applications
Vissarion Fisikopoulos
 
BALANCING BOARD MACHINES
BALANCING BOARD MACHINESBALANCING BOARD MACHINES
BALANCING BOARD MACHINESbutest
 
A new practical algorithm for volume estimation using annealing of convex bodies
A new practical algorithm for volume estimation using annealing of convex bodiesA new practical algorithm for volume estimation using annealing of convex bodies
A new practical algorithm for volume estimation using annealing of convex bodies
Vissarion Fisikopoulos
 
Slides econometrics-2017-graduate-2
Slides econometrics-2017-graduate-2Slides econometrics-2017-graduate-2
Slides econometrics-2017-graduate-2
Arthur Charpentier
 
Lecture7 cross validation
Lecture7 cross validationLecture7 cross validation
Lecture7 cross validationStéphane Canu
 
Bisection method
Bisection methodBisection method
Bisection method
Tirth Parmar
 
Polyhedral computations in computational algebraic geometry and optimization
Polyhedral computations in computational algebraic geometry and optimizationPolyhedral computations in computational algebraic geometry and optimization
Polyhedral computations in computational algebraic geometry and optimization
Vissarion Fisikopoulos
 
An introduction to Bayesian Statistics using Python
An introduction to Bayesian Statistics using PythonAn introduction to Bayesian Statistics using Python
An introduction to Bayesian Statistics using Python
freshdatabos
 
Absorbing Random Walk Centrality
Absorbing Random Walk CentralityAbsorbing Random Walk Centrality
Absorbing Random Walk Centrality
Michael Mathioudakis
 
1
11
Machine Learning meets DevOps
Machine Learning meets DevOpsMachine Learning meets DevOps
Machine Learning meets DevOps
Pooyan Jamshidi
 
OpenEdition Lab projects in Text Mining
OpenEdition Lab projects in Text MiningOpenEdition Lab projects in Text Mining
Binu Siva Singh Final.pptx
Binu Siva Singh Final.pptxBinu Siva Singh Final.pptx
Binu Siva Singh Final.pptx
divisatish
 
comments on exponential ergodicity of the bouncy particle sampler
comments on exponential ergodicity of the bouncy particle samplercomments on exponential ergodicity of the bouncy particle sampler
comments on exponential ergodicity of the bouncy particle sampler
Christian Robert
 
Language Language Models (in 2023) - OpenAI
Language Language Models (in 2023) - OpenAILanguage Language Models (in 2023) - OpenAI
Language Language Models (in 2023) - OpenAI
SamuelButler15
 
Mathematics xii paper 13 with answer with value vased questions
Mathematics xii paper 13 with answer with value vased questionsMathematics xii paper 13 with answer with value vased questions
Mathematics xii paper 13 with answer with value vased questions
Pratima Nayak ,Kendriya Vidyalaya Sangathan
 

Similar to Presentation of volesti in eRum 2020 (20)

2. polynomial interpolation
2. polynomial interpolation2. polynomial interpolation
2. polynomial interpolation
 
BALANCING BOARD MACHINES
BALANCING BOARD MACHINESBALANCING BOARD MACHINES
BALANCING BOARD MACHINES
 
Volume computation and applications
Volume computation and applications Volume computation and applications
Volume computation and applications
 
BALANCING BOARD MACHINES
BALANCING BOARD MACHINESBALANCING BOARD MACHINES
BALANCING BOARD MACHINES
 
A new practical algorithm for volume estimation using annealing of convex bodies
A new practical algorithm for volume estimation using annealing of convex bodiesA new practical algorithm for volume estimation using annealing of convex bodies
A new practical algorithm for volume estimation using annealing of convex bodies
 
Slides econometrics-2017-graduate-2
Slides econometrics-2017-graduate-2Slides econometrics-2017-graduate-2
Slides econometrics-2017-graduate-2
 
Lecture7 cross validation
Lecture7 cross validationLecture7 cross validation
Lecture7 cross validation
 
Bisection method
Bisection methodBisection method
Bisection method
 
Lesson 29
Lesson 29Lesson 29
Lesson 29
 
AI Lesson 29
AI Lesson 29AI Lesson 29
AI Lesson 29
 
Polyhedral computations in computational algebraic geometry and optimization
Polyhedral computations in computational algebraic geometry and optimizationPolyhedral computations in computational algebraic geometry and optimization
Polyhedral computations in computational algebraic geometry and optimization
 
An introduction to Bayesian Statistics using Python
An introduction to Bayesian Statistics using PythonAn introduction to Bayesian Statistics using Python
An introduction to Bayesian Statistics using Python
 
Absorbing Random Walk Centrality
Absorbing Random Walk CentralityAbsorbing Random Walk Centrality
Absorbing Random Walk Centrality
 
1
11
1
 
Machine Learning meets DevOps
Machine Learning meets DevOpsMachine Learning meets DevOps
Machine Learning meets DevOps
 
OpenEdition Lab projects in Text Mining
OpenEdition Lab projects in Text MiningOpenEdition Lab projects in Text Mining
OpenEdition Lab projects in Text Mining
 
Binu Siva Singh Final.pptx
Binu Siva Singh Final.pptxBinu Siva Singh Final.pptx
Binu Siva Singh Final.pptx
 
comments on exponential ergodicity of the bouncy particle sampler
comments on exponential ergodicity of the bouncy particle samplercomments on exponential ergodicity of the bouncy particle sampler
comments on exponential ergodicity of the bouncy particle sampler
 
Language Language Models (in 2023) - OpenAI
Language Language Models (in 2023) - OpenAILanguage Language Models (in 2023) - OpenAI
Language Language Models (in 2023) - OpenAI
 
Mathematics xii paper 13 with answer with value vased questions
Mathematics xii paper 13 with answer with value vased questionsMathematics xii paper 13 with answer with value vased questions
Mathematics xii paper 13 with answer with value vased questions
 

Recently uploaded

Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Globus
 
Graphic Design Crash Course for beginners
Graphic Design Crash Course for beginnersGraphic Design Crash Course for beginners
Graphic Design Crash Course for beginners
e20449
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
Globus
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
XfilesPro
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
Philip Schwarz
 
Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx
Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptxText-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx
Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx
ShamsuddeenMuhammadA
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Shahin Sheidaei
 
GraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph TechnologyGraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph Technology
Neo4j
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Introduction to Pygame (Lecture 7 Python Game Development)
Introduction to Pygame (Lecture 7 Python Game Development)Introduction to Pygame (Lecture 7 Python Game Development)
Introduction to Pygame (Lecture 7 Python Game Development)
abdulrafaychaudhry
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 

Recently uploaded (20)

Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
 
Graphic Design Crash Course for beginners
Graphic Design Crash Course for beginnersGraphic Design Crash Course for beginners
Graphic Design Crash Course for beginners
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
 
Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx
Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptxText-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx
Text-Summarization-of-Breaking-News-Using-Fine-tuning-BART-Model.pptx
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
GraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph TechnologyGraphSummit Paris - The art of the possible with Graph Technology
GraphSummit Paris - The art of the possible with Graph Technology
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Introduction to Pygame (Lecture 7 Python Game Development)
Introduction to Pygame (Lecture 7 Python Game Development)Introduction to Pygame (Lecture 7 Python Game Development)
Introduction to Pygame (Lecture 7 Python Game Development)
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 

Presentation of volesti in eRum 2020

  • 1. High-dimensional sampling and volume computation Apostolos Chalkis Dept. of Informatics & Telecommunications, University of Athens GeomScale Project
  • 2. package volesti: sampling and volume estimation https://github.com/GeomScale/volume_approximation open source, written in C++, R package in CRAN. depends on Eigen, LPSolve, Boost. currently 3 volume algorithms, 4 sampling algorithms. main contributors: A. Chalkis and V. Fisikopoulos plus several community contributors.
  • 3. Problems Given P a convex body in Rn: compute the volume of P. sample from a distribution π truncated in P. minimize a convex function f in P (convex optimization). compute the integral of a function f over P. volesti provides randomized approximation algorithms based on sampling from P with geometric random walks.
  • 4. volume computation of a polytope P First thoughts Compute a triangulation of P and sum up the volumes of the triangles. Sample from a bounding box, count the number of points in P. both approaches fail in high dimensions (curse of dimensionality).
  • 5. Multiphase Monte Carlo There are several algorithms based on MMC. The only alternative in R: package geometry (exact computations). An example: #exact computation with package geometry P = gen_rand_vpoly(20, 40) geom_values = geometry::convhulln(P$V, options = ’FA’) QH6082 qhull error (qh_memalloc): insufficient memory to allocate 1329542232 bytes #computation with volesti time2 = system.time({ vol2 = volume(P) }) cat(time2[3], vol2) 14.524 2.68443e-07
  • 6. Convex bodies H-polytope : P = {x | Ax ≤ b, A ∈ Rm×n, b ∈ Rm} V-polytope : P is the convex hull of a set of points in Rn Z-polytope : Minkowski sum of k segments (projection of k-cube) Spectrahedron : P = {x | A0 + x1A1 + · · · + xnAn 0}, where Ai : symmetric matrices, B 0: B is positive semidefinite
  • 7. volesti provide three volume algorithms volesti is the first software that performs volume computations in thousands of dimensions. Algorithm H-polytope V- & Z-polytope n ≤ 20 n > 20 Sequence of Balls [1] CoolingGaussians [2] CoolingBodies [3] [1] I.Z. Emiris, V. Fisikopoulos, 2014 [2] S. Vempala, B. Cousins, 2014 [3] A. Chalkis, I.Z. Emiris, V. Fisikopoulos, 2019
  • 8. volesti provides four random walks random walk uniform gaussian exponential distribution distribution distribution Ball walk hit and run Random directions hit and run Coordinate directions Billiard walk B p q p q p q p q
  • 9. Comparing mixing times Uniform sampling from the hypercube [−1, 1]200 and projection to R3. Rows: Ball Walk, Coordinate Directions Hit and Run, Random Directions Hit and Run, Billiard Walk. Columns: walk length, {1, 50, 100, 150, 200}
  • 10. Rounding a convex body Example Let P = [−1, 1] × [−100, 100]. We want to sample uniformly distributed points from P. Left we sample directly from P. Right we round the body to obtain a higher quality sample. volesti provides three rounding methods.
  • 11. Application Multivariate integration Let I = P f (x)dx. Sample N uniformly distributed points x1, . . . , xN from P and, I ≈ vol(P) 1 N N i=1 f (xi ). Example: P = gen_rand_vpoly(n, 2 * n, seed = 127) f = function(x) {sum(x^2) + (2 * x[1]^2 + x[2] + x[3])} points = sample_points(P, random_walk = list("walk" = "BiW", "walk_length" = 1), n = 5000, seed = 5) int = 0 for (i in 1:num_of_points) int = int + f(points[, i]) V = volume(P, settings = list("error" = 0.05)) I = (int * V) / 5000 })
  • 12. Application Multivariate integration Comparison with exact computation: R packages geometry (triangulation) and SimplicialCubature (integration over each triangle). dimension error exact time volesti time 5 0.05129854 0.41 3.095 10 0.08964482 2.945 12.01 15 0.01541695 471.479 33.256 20 – – 64.058 volesti can do general convex bodies (not only triangles). Future work: improve accuracy with more advanced MC integration methods such as importance sampling.
  • 13. Application in finance Crisis detection in stock markets Data: 52 popular exchange traded funds (ETFs) and the US central bank (FED) https://stanford.edu/class/ee103/portfolio.html. Approximation of the joint distribution (copula) between portfolio return and volatility (risk) in a given time period. Left, a copula that corresponds to normal period (07/03/2007 - 31/05/2007). Right, a copula that corresponds to a crisis period (18/12/2008 − 13/03/2009).
  • 14. Application in finance Crisis detection in stock markets We define an indicator as the ratio between two masses (red / blue). If the indicator is ≥ 1 then the copula corresponds to a crises, otherwise corresponds to a normal period.
  • 15. Applications in finance Crisis detection in stock markets Cales, C. et. al - SoCG 2018
  • 16. GeomScale/volesti on Google Summer of Code 2020 Mentoring organization https://summerofcode.withgoogle.com/organizations/ 5673184117915648/ 3 student projects this year: 1. Sampling log-concave densities. 2. Convex optimization 3. Uniform sampling for Machine Learning. Communication channels: gitter.im/GeomScale/community, geomscale-gsoc@googlegroups.com website geomscale.github.io/