SlideShare a Scribd company logo
Robust hp-Adaptation Method for Discontinuous
Galerkin Discretizations Applied to Aerodynamic
Flows
Marco Ceze, PhD. Candidate
Department of Aerospace Engineering
University of Michigan
Doctoral Committee: Assistant Professor Krzysztof Fidkowski, Chair
Assistant Professor Eric Johnsen
Emeritus Professor Bram van Leer
Professor David W. Zingg, University of Toronto
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 1/52
An airline is a difficult business
Profit margin over the past 10 years for various airlines.
Source: http://www.ycharts.com
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 2/52
The impact of drag prediction
+
−1% drag translates into
−
+7% payload (revenue).
From the aircraft manufacturer perpective:
Drag under-prediction ⇒ contractual penalties.
Drag over-prediction ⇒ lower selling price.
AIAA organizes workshops for assessing the state-of-the-art.
Pressure distribution over NASA’s CRM-WB
geometry
DPW’s finest common meshes.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 3/52
Motivation
Quantitatively reliable CFD solutions are still hard to obtain
Accuracy is usually assessed by uniform mesh refinement studies
and even then, errors may be large (e.g. AIAA-DPW, HLPW).
Acceptable engineering solutions on representative geometries
often come at prohibitively-large grid sizes.
Robustness of the analysis process is rarely addressed.
Good news!
Most engineers are interested in only certain scalar outputs, eg.:
drag, lift, moments, etc..
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 4/52
Why good news?...Adjoints!
Sensitivity of the output w.r.t. residuals in the physics.
Input perturbations are converted into residual perturbations.
Advantage: residuals are generally cheap to compute.
Flow	
  simula+on	
  
Post-­‐processing	
  
e.g.:	
  drag,	
  li7.	
  	
  
J(U)
Input	
  parameters	
  
↵
R
J
2
6
6
6
4
R1(U)
R2(U)
...
Rn(U)
3
7
7
7
5
=
2
6
6
6
4
0
0
...
0
3
7
7
7
5
Adjoint	
  variables	
  
U
“Mesh”	
  +	
  
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 5/52
Why good news?...Adjoints!
Sensitivity of the output w.r.t. residuals in the physics.
Input perturbations are converted into residual perturbations.
Advantage: residuals are generally cheap to compute.
Flow	
  simula+on	
  
Post-­‐processing	
  
e.g.:	
  drag,	
  li7.	
  	
  
J(U)
Input	
  parameters	
  
↵
R
J
2
6
6
6
4
R1(U)
R2(U)
...
Rn(U)
3
7
7
7
5
=
2
6
6
6
4
0
0
...
0
3
7
7
7
5
Adjoint	
  variables	
  
U
↵
“Mesh”	
  +	
  
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 5/52
Sensitivity analysis
Why good news?...Adjoints!
Sensitivity of the output w.r.t. residuals in the physics.
Input perturbations are converted into residual perturbations.
Advantage: residuals are generally cheap to compute.
Flow	
  simula+on	
  
Post-­‐processing	
  
e.g.:	
  drag,	
  li7.	
  	
  
J(U)
Input	
  parameters	
  
↵
R
J
2
6
6
6
4
R1(U)
R2(U)
...
Rn(U)
3
7
7
7
5
=
2
6
6
6
4
0
0
...
0
3
7
7
7
5
Adjoint	
  variables	
  
U
“Mesh”	
  +	
  
Residual	
  evalua+on	
  
in	
  finer	
  space	
  
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 5/52
Output error
estimation
A derivation of the adjoint equation
Consider an output J ((α), u) where u satisfies R((α), u) = 0 for
input parameter set α.
We form a Lagrangian L((α), u, ψ) to incorporate the constraint:
L((α), u, ψ) = J (u) + ψT
R((α), u).
We take the variation of the Lagrangian assuming R((α), u) = 0:
δL((α), u, ψ) =
∂J
∂u
T
+ ψT ∂R
∂u
= 0
Adjoint equation
δu +
∂J
∂α
T
+ ψT ∂R
∂α
= 0
δα.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 6/52
Making δL = 0 selects only realizable δJ ’s.
Linear
equation!
Output Error Estimation
Output error: difference between an output computed with the
discrete system solution and that computed with the exact solution.
δJ = JH(uH) − J(u)
uH ∈ VH = approximate solution, u ∈ V = exact solution
Adjoint-based output error estimation techniques
Account for propagation effects inherent to hyperbolic problems.
Can provide a correction factor for the output.
Identify all areas of the domain that are important for an accurate
prediction of the output ⇒ Mesh adaptation!
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 7/52
Discontinuous Galerkin and hp-adaptation
P (u) = 0
PDE
Ri ≡
Ω
wi(x) P N
j=1 Ujφj (x) dx = 0
Discrete
MWR
Mesh:
κ1 κ2 κ3 κ4
Solution space:
κ1
φ1,1 φ1,2
κ2
φ2,1 φ2,2
κ3
φ3,1 φ3,2
κ4
φ4,1 φ4,2
hp-adapted
solution space:
κ1
φ1,1 φ1,2
κ4
φ4,1 φ4,2
h-ref.
κ2
φ2,1φ2,2
κ5
φ5,1φ5,2
κ3
p-ref.
φ3,1 φ3,2 φ3,3
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 8/52
How do we choose between h and p refinements?
Solution process and this work
•  Ini$al	
  condi$on	
  
•  Parameters	
  
•  Mesh	
  
Flow	
  solver	
   Converged?	
  
Interven$on	
  
by	
  user	
  
Error	
  
es$ma$on	
  
Error	
  within	
  	
  
tolerance?	
  
Finished	
  
Mesh	
  
adapta$on	
  
NO	
  
YES	
  
YES	
  NO	
  
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 9/52
Solution process and this work
Solver	
  Robustness	
  
•  Ini$al	
  condi$on	
  
•  Parameters	
  
•  Mesh	
  
Flow	
  solver	
   Converged?	
  
Interven$on	
  
by	
  user	
  
Error	
  
es$ma$on	
  
Error	
  within	
  	
  
tolerance?	
  
Finished	
  
Mesh	
  
adapta$on	
  
NO	
  
YES	
  
YES	
  NO	
  
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 9/52
Solution process and this work
hp	
  -­‐	
  Adapta(on	
  
Solver	
  Robustness	
  
•  Ini$al	
  condi$on	
  
•  Parameters	
  
•  Mesh	
  
Flow	
  solver	
   Converged?	
  
Interven$on	
  
by	
  user	
  
Error	
  
es$ma$on	
  
Error	
  within	
  	
  
tolerance?	
  
Finished	
  
Mesh	
  
adapta$on	
  
NO	
  
YES	
  
YES	
  NO	
  
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 9/52
Overview of this work
High-order DG-FEM for spatial discretization.
Exact Jacobian with line-Jacobi preconditioner and GMRES linear
solver.
MPI parallelization.
Focus on steady problems relevant to the aeronautical industry.
Oliver’s modifications to the Spalart-Allmaras turbulence model.
Quadrilateral and hexahedral meshes.
Constrained pseudo-transient continuation (CPTC) for time
integration.
Output-based anisotropic hp-adaptation.
Node-edge weighted mesh partitioning.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 10/52
Constrained pseudo-transient continuation
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 11/52
Problem statement
Consider the semi-discrete flow equations:
Ut = −R(U).
The discrete solution U is used to approximate the state, u, as a
field uH,p(t, x). In finite elements:
uH,p
(t, x) =
j
Uj(t)φH,p
j (x).
The field uH,p(t, x) is subject to physical realizability constraints:
p(uH,p(t, x))
p∞
> 0,
ρ(uH,p(t, x))
ρ∞
> 0 and
ν(uH,p) + νt (uH,p)
ν(uH,p)
> 0.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 11/52
These realizability constraints are violated
sometimes.
Marching to steady-state
M
1
∆t
+
∂R
∂U Uk
A
∆Uk
= −R(Uk
)
Pseudo-transient continuation
Multiply left-hand side by its transpose:
∆UT
AT
A∆U = −∆UT
AT
R(U)
∂f
∂U
≥ 0.
∆U is a descent direction for:
f(˜U) = |Rt (˜U)|2
L2
= |M
1
∆t
(˜U − Uk
) + R(˜U)|2
L2
.
No direct mechanism to avoid
physicality constraints!
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 12/52
Handling physicality constraints
We propose augmenting the residual with a penalty vector:
Rp(U) = R(U) + P(U).
For a repelling effect w.r.t the constraints, it is sufficient to make
P(U)T R(U) > 0. We choose:
P = Φ R,
where Φ is a diagonal matrix with elemental penalties:
PκH (UκH (t), µ) = µ
Ni
i
Nj
j
wj
ci(uH,p(t, xj))
.
where µ is the penalty factor, ci are the constraints, and xj are
interrogation points.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 13/52
Handling physicality constraints
Apply PTC to Rp and the equation for the state update becomes:





(I + Φ)−1 M
∆t
a
+
∂R
∂U
+ (I + Φ)−1 ∂Φ
∂U
R(U)
b





∆U = −R(U).
The elemental ∆t gets amplified by a factor (1 + PκH ).
In the limit ∆t → ∞, the solution seeks a minimum of |Rp|L2
.
As the state in an element approaches a non-physical condition,
term "a" vanishes locally while "b" remains due to the derivative of
the inverse barrier function.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 14/52
Constrained PTC example
Solve a simple nonlinear algebraic system:
sin(4πx1x2) − 2x2 − x1 = 0
4π − 1
4π
(e2x1
− e) + 4ex2
2 − 2ex1 = 0
−1 ≤ x1 ≤ 1
−1 ≤ x2 ≤ 1
−1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1
−1
−0.8
−0.6
−0.4
−0.2
0
0.2
0.4
0.6
0.8
1
x2
x1
Prohibited
PTC
−1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1
−1
−0.8
−0.6
−0.4
−0.2
0
0.2
0.4
0.6
0.8
1
x2
x1
Prohibited
Constrained PTC
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 15/52
Solution update methods
Uk+1 = Uk + ωk ∆Uk , for ωk ≤ 1
Maximum Primitive Change (MPC)
Limit ωk such that changes in ρ, p, and ˜ν are within ηmax = 10%
for all κH.
Line Search (LS)
Compute ωphys such that changes in ρ, p, and ˜ν are within
ηmax = 10% for κH with ∆U|κH ·
∂PκH
∂U
> 0.
Backtrack from ωk = ωphys until |Rt (˜U)|L2
< |R(Uk )|L2
.
Line Search + Greedy (LS+G)
If LS exits with ωk = ωphys < 1, amplify ωk while
|Rt (˜U)|L2
< |R(Uk )|L2
and ωk < 1.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 16/52
CFL evolution strategies
If (ωk ≤ ωmin) ⇒ Repeat step “k” with smaller CFL =
λmax,κH ∆tκH
LκH
Exponential progression (EXP)
CFLk+1
=



β · CFLk
for β > 1 if ωk
= 1
CFLk
if ωmin < ωk
< 1
κ · CFLk
for κ < 1 if ωk
< ωmin
Switched Evolution Relaxation (SER)
CFLk
= min CFLk−1 |Rk−1
|L2
|Rk |L2
, CFLmax
Residual Difference Method (RDM - mRDM)
CFLk
= min

CFLk−1
· β
|Rk−1|L2
−|Rk |L2
|Rk−1|L2 , CFLmax

 for β > 1
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 17/52
Let’s test this!
Combine the PTC and CPTC with the solution update methods
and CFL strategies.
Test cases range from intermediate to difficult.
Residual convergence is 9 orders of magnitude reduction.
We compare the methods under same GMRES and discretization
parameters.
Rules of the game:
A maximum run time is fixed for all runs within a case.
A maximum number of iterations is fixed for all runs within a case.
Performance of the converged runs is measured in terms of number
of iterations and wall time.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 18/52
MDA 30p30n - M∞ = 0.2, Re = 9 × 106
, α = 16◦
, p = 1
Quartic mesh generated by agglomerating linear cells.
y+ ≈ 3 × 103 based on a flat-plate correlation.
16 CPU’s, 8 hours, maximum of 10k iterations.
Quartic mesh (4070 elements) Mach number contours
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 19/52
MDA 30p30n - M∞ = 0.2, Re = 9 × 106
, α = 16◦
, p = 1
Success of all runs:
→ converged,
→ timeout or max iterations,
→ CFL below minimum or non-physical.
PTC CPTC
MPC LS LS+G MPC LS LS+G
EXP run 1.1.1 run 1.2.1 run 1.3.1 run 2.1.1 run 2.2.1 run 2.3.1
SER run 1.1.2 run 1.2.2 run 1.3.2 run 2.1.2 run 2.2.2 run 2.3.2
RDM run 1.1.3 run 1.2.3 run 1.3.3 run 2.1.3 run 2.2.3 run 2.3.3
mRDM run 1.1.4 run 1.2.4 run 1.3.4 run 2.1.4 run 2.2.4 run 2.3.4
Performance of converged runs.
Run ID Nonlinear iterations GMRES iterations Wall time (seconds)
1.3.1 1.000 (1412) 1.000 (608770) 1.000 (5.085 × 103)
1.3.4 4.750 0.935 1.005
2.2.4 5.135 1.346 1.059
2.3.1 1.161 0.881 0.920
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 20/52
NACA 0012 - M∞ = 0.8, Re = 6.5 × 106
, α = 0◦
, p = 2
No shock-capturing ⇒ oscillations.
y+ ≈ 2 × 103 based on a flat-plate correlation.
40 CPU’s, 8 hours, maximum of 10k iterations.
Quartic mesh (1740 elements) Mach number contours
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 21/52
NACA 0012 - M∞ = 0.8, Re = 6.5 × 106
, α = 0◦
, p = 2
Success of all runs:
PTC CPTC
MPC LS LS+G MPC LS LS+G
EXP run 1.1.1 run 1.2.1 run 1.3.1 run 2.1.1 run 2.2.1 run 2.3.1
SER run 1.1.2 run 1.2.2 run 1.3.2 run 2.1.2 run 2.2.2 run 2.3.2
RDM run 1.1.3 run 1.2.3 run 1.3.3 run 2.1.3 run 2.2.3 run 2.3.3
mRDM run 1.1.4 run 1.2.4 run 1.3.4 run 2.1.4 run 2.2.4 run 2.3.4
Performance of converged runs.
Run ID Nonlinear iterations GMRES iterations Wall time (seconds)
1.1.4 1.000 (3707) 1.000 (34671) 1.000 (1.347 × 104s)
1.2.1 0.281 0.456 0.327
1.2.4 0.454 0.557 0.477
1.3.1 0.0968 0.316 0.170
1.3.4 0.179 0.301 0.229
2.1.1 0.401 0.440 0.410
2.1.4 0.308 0.537 0.367
2.2.1 0.250 0.474 0.309
2.2.4 0.386 0.542 0.422
2.3.1 0.127 0.335 0.200
2.3.4 0.136 0.529 0.275
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 22/52
DPW 3 W1 - M∞ = 0.76, Re = 5 × 106
, α = 0.5◦
, p = 1
Cubic mesh generated by agglomerating linear cells.
y+ ≈ 1 based on a flat-plate correlation.
804 CPU’s, 5 hours, maximum of 4k iterations.
Mesh and pressure contours (29310 elements) Mach number and ρ˜ν contours
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 23/52
DPW 3 W1 - M∞ = 0.76, Re = 5 × 106
, α = 0.5◦
, p = 1
Success of all runs:
→ converged,
→ timeout or max iterations,
→ CFL below minimum or non-physical.
PTC CPTC
MPC LS LS+G MPC LS LS+G
EXP run 1.1.1 run 1.2.1 run 1.3.1 run 2.1.1 run 2.2.1 run 2.3.1
SER run 1.1.2 run 1.2.2 run 1.3.2 run 2.1.2 run 2.2.2 run 2.3.2
RDM run 1.1.3 run 1.2.3 run 1.3.3 run 2.1.3 run 2.2.3 run 2.3.3
mRDM run 1.1.4 run 1.2.4 run 1.3.4 run 2.1.4 run 2.2.4 run 2.3.4
Performance of converged runs.
Run ID Nonlinear iterations GMRES iterations Wall time (seconds)
2.1.1 1.000 (1255) 1.000 (68253) 1.000 (5.694 × 103s)
2.1.4 0.897 0.935 0.845
2.2.1 0.880 0.944 1.021
2.2.4 0.751 1.002 1.127
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 24/52
Output-based hp-adaptation
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 25/52
Error estimate and adaptive indicator
uH,p will generally not satisfy the original PDE: R(uH,p, w) = 0
Instead, it satisfies the weak form:
R(u, w) + δR(w) = 0 where δR(w) = −R(uH,p
, w).
ψ ∈ V relates the residual perturbation to an output perturbation:
δJ = J(uH,p
) − J(u) ≈ −R(uH,p
, ψ)
We approximate ψ in a higher order space VH,p+1 ⊃ VH,p and
estimate the error as:
δJ ≈ −
κH ∈TH
RκH (uH,p
, ψH,p+1
− ψH,p
),
We assign an adaptive indicator to κH based on its contribution to
the error estimate:
ηκH = RκH (uH,p
, ψH,p+1
− ψH,p
) .
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 25/52
Output-based hp adaptation
Select a fraction fadapt of the elements with largest ηκH .
A set of discrete refinement options is considered, e.g.:
pp
(a) x
p
p
(b) y
p
p p
p
(c) xy
p+1
(d) p
Rank the refinement options based on a merit function:
m(i) =
b(i)
c(i)
c(i) is a measure of the computational cost of refinement option i.
b(i) measures the gain in accuracy due to the refinement option i.
Balance between high-cost-low-error and low-cost-high-error
options
Choose the option with the highest m(i)
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 26/52
Output-based hp adaptation
The merit function is computed on local sub-problems that involve
the element to be refined and its neighbors.
We compare two measures of computational cost:
Degrees of freedom
cDOF(i) =
κh∈κH
(pκh (i) + 1)dim
,
Non-zeros in the Jacobian
cNZ(i) =
κh∈κH
(pκh (i) + 1)2·dim
+
∂κh∂D[(pκh (i) + 1) · (p−
κh (i) + 1)]dim .
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 27/52
Output-based hp adaptation
The benefit is defined as an output sensitivity to a local residual
perturbation due to a refinement i.
b(i) =
κh∈κH
|Rκh (U(i))| · |Ψκh (i)|
where Ψκh is the coarse adjoint injected in the semi-refined space.
Observations:
The benefit as defined is machine-zero if computed before refining
the central element.
In the limit of the discrete solution representing the exact solution
to residual tolerance, εR, the benefit will also be ∼ εR.
The refinement option with the largest b(i) is expected to be the
option that produces the largest change in the output of interest.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 28/52
DPW3 W1 - M∞ = 0.76, α = 0.5o
, Re = 5 × 106
Drag-based hp adaptation results.
p = 1 baseline solution.
Initial cubic (q = 3) mesh generated by agglomerating 3 linear
elements in each direction.
Spalart-Allmaras model with Oliver’s modification [MIT PhD.
Thesis - 2008].
Initial pressure contours
(29310 cubic elements, p = 1).
Pressure contours on the 1st level of uniform
h-refinement (234480 cubic elements, p = 1).
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 29/52
DPW3 W1 - M∞ = 0.76, α = 0.5o
, Re = 5 × 106
Results computed with 180 Harpertown 8-core nodes.
We limited the total wall time to 72 hours.
cDOF cNZ
Adaptation step iso-h sc-h dc-h iso-p iso-h sc-h dc-h iso-p
1 0.0 99.3 0.0 0.7 0.0 100.0 0.0 0.0
2 0.0 97.3 0.0 2.7 0.0 99.9 0.0 0.1
3 0.0 94.9 0.0 5.1 0.0 99.8 0.0 0.2
4 0.0 91.8 0.4 7.8 0.0 99.1 0.3 0.6
5 0.0 90.6 0.3 9.1 0.0 98.7 0.5 0.8
6 – – – – 0.0 98.6 0.5 0.9
7 – – – – 0.0 98.6 0.4 1.0
10
5
10
6
10
7
0.02
0.021
0.022
0.023
0.024
0.025
0.026
0.027
Dragcoefficient
Number of degrees of freedom
hp − cnz
hp − cdof
Uniform h
10
6
0.0206
0.0208
0.021
0.0212
0.0214
0.0216
10
4
10
5
10
6
0.02
0.021
0.022
0.023
0.024
0.025
0.026
0.027
Dragcoefficient
CPU wall−time (seconds)
10
5
0.0206
0.0208
0.021
0.0212
0.0214
0.0216
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 30/52
DPW3 W1 - M∞ = 0.76, α = 0.5o
, Re = 5 × 106
Final hp-adapted meshes with pressure contours (p = 1 → 5).
Pressure contours on the 5th drag-adapted
mesh using cDOF (59503 cubic elements).
Pressure contours on the 7th drag-adapted
mesh using cNZ (85377 cubic elements).
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 31/52
NACA 0012, M∞ = 0.15, Re = 6 × 106
, drag polar
Drag-based anisotropic h-adaptation with p = 2.
Validation of Oliver’s SA modifications against Ladson’s
experimental data.
α = 0◦, 2◦, 4◦, 6◦, 8◦, 10◦, 12◦, and 15◦
Farfield at 500-chord-lengths.
Initial mesh for α = 10◦ (720 quartic elements)
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 32/52
NACA 0012, M∞ = 0.15, Re = 6 × 106
, drag polar
Drag convergence:
Continuous lines: drag output.
Dashed lines: drag corrected by error estimate.
Shaded region: sum of adaptive indicators.
Largest final error estimate: 3 counts (∼ 3%) in the α = 15o case.
Final DOF count: ∼12k.
α = 10◦
α = 15◦
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 33/52
NACA 0012, M∞ = 0.15, Re = 6 × 106
, drag polar
Comparison with experimental results with transition at
∼ 5%-chord location.
Our results are within 3% of CFL3D results.
NASA’s Turbulence Modeling Resource spread of results is 4%.
CFL3D computed on a fine, ∼230k element, structured grid.
−5 0 5 10 15 20
−0.5
0
0.5
1
1.5
2
CL
Ladson 80grit
Ladson 120grit
Ladson 180grit
CFL3D
XFlow (drag adapted)
−0.5 0 0.5 1 1.5 2
0.005
0.01
0.015
0.02
0.025
C
L
C
D
Ladson 80grit
Ladson 120grit
Ladson 180grit
CFL3D
XFlow (drag adapted)
XFlow + error estimate
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 34/52
NACA 0012, M∞ = 0.15, Re = 6 × 106
, drag polar
The adjoint solution shows regions of the computational domain
where discretization errors affect the output of interest.
Final mesh and ˜ν contours for α = 10o x-mom. drag adjoint on final mesh for α = 10o
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 35/52
DPW5 CRM - M∞ = 0.85, Re = 5 × 106
, CL = 0.5
Cubic (q = 3) mesh generated by agglomerating 3 linear cells in
each direction.
Drag-driven anisotropic h-adaptation at fixed lift with p = 1.
y+ ≈ 100 based on a flat-plate correlation for Cf .
Linear mesh (1218375 elements). Agglomerated cubic mesh (45125 elements).
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 36/52
DPW5 CRM - M∞ = 0.85, Re = 5 × 106
, CL = 0.5
Adjoint-based parameter correction.
General framework for computing sensitivities using adjoints.
Fixed-lift adds an extra term to error estimate.
Mesh
Initial Conditions
Jtarget, εtol, αguess
Solve
Solve
R(α, U) = 0
|J − Jtarget| ≤ εtol Finished
True
False
∂R
∂U
T
Ψ = −
∂J
∂U
Compute
δR = R(α + δα, U)
Update
α ⇐ α +
(J − Jtarget)δα
ΨT δR
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 37/52
DPW5 CRM - M∞ = 0.85, Re = 5 × 106
, CL = 0.5
Could not achieve CL = 0.5 on the initial mesh.
Gray shaded region: range of DPW5 data computed on "fine"
mesh (∼ 50M cells).
Our last adapted mesh has a number of degrees of freedom close
to the coarse meshes from the workshop.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 38/52
DPW5 CRM - M∞ = 0.85, Re = 5 × 106
, CL = 0.5
Mach contours at 37% of the span.
Separation appeared on coarse mesh due to lack of spatial
resolution.
Initial mesh (α = 2.8◦) 1st drag-adapted mesh (α = 2.675◦)
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 39/52
DPW5 CRM - M∞ = 0.85, Re = 5 × 106
, CL = 0.5
Mach contours at 37% of the span.
Smaller differences in the Mach contours after the first adaptive
step.
1st drag-adapted mesh (α = 2.675◦) 5th drag-adapted mesh (α = 2.1598◦)
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 40/52
DPW5 CRM - M∞ = 0.85, Re = 5 × 106
, CL = 0.5
Cp comparison with NASA’s experimental data.
13% of the reference span
X/Chord
-Cp
0 0.2 0.4 0.6 0.8 1
-0.5
0
0.5
Initial mesh
1st
2nd
3rd
4th
5th
Exp. data
50% of the reference span
X/Chord
-Cp
0 0.2 0.4 0.6 0.8 1
-0.5
0
0.5
Initial mesh
1st
2nd
3rd
4th
5th
Cp
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 41/52
Weighted mesh partitioning
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 42/52
Weighted mesh partitioning
The mesh is represented as an irregular graph where elements
are nodes and interior faces are edges.
The sets in red represent lines of the line-Jacobi preconditioner.
The inter-domain communication stores the data in one layer of
fictitious elements neighboring each inter-domain boundary.
We use the k-way partitioning algorithm implemented in
ParMETIS.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 43/52
Weighted mesh partitioning
Node weights are based on the number of non-zeros in the
self-blocks of the residual Jacobian:
ωκH = (pκH + 1)2·dim
.
The edge weights are computed in the following sequence:
1 Loop through edges of the graph (faces of the mesh) and compute:
ω∂κH ∂D = (p+
κH + 1)dim
+ (p−
κH + 1)dim
2 Loop through lines of the preconditioner and augment ω∂κH ∂D
based on the valence (connections per node) vκH :
ω∂κH ∂D ⇐ ω∂κH ∂D · max(v+
κH , v−
κH ).
Step 1 assigns weights proportional to the amount of data transfer
and step 2 increases the weight of connections between elements
that are strongly coupled.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 44/52
Is it worth doing this?...YES!
NACA 0012 - M∞ = 0.5, Re = 5 × 103, α = 1◦, hp-adaptation on
8 CPU’s.
Primal solution time
1400 1600 1800 2000 2200 2400 2600 2800
0
5
10
15
20
25
30
Number of degrees of freedom
Primalsolvetime(seconds)
c
NZ
unweighted
cNZ
weighted
c
DOF
unweighted
c
DOF
weighted
Adjoint solution time
1400 1600 1800 2000 2200 2400 2600 2800
0
0.5
1
1.5
2
2.5
Number of degrees of freedom
Adjointsolvetime(seconds)
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 45/52
Is it worth doing this?...YES!
NACA 0012 - M∞ = 0.5, Re = 5 × 103, α = 1◦, hp-adaptation on
8 CPU’s.
Number of GMRES iterations is directly related to using the
preconditioner lines in the partitioning.
Adaptation time
1400 1600 1800 2000 2200 2400 2600 2800
1.5
2
2.5
3
3.5
4
4.5
5
5.5
Number of degrees of freedom
Adaptationtime(seconds)
cNZ
unweighted
c
NZ
weighted
cDOF
unweighted
c
DOF
weighted
GMRES iterations for primal and dual solves
1400 1600 1800 2000 2200 2400 2600 2800
1800
2000
2200
2400
2600
2800
3000
Number of degrees of freedom
NumberofGMRESiterations
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 46/52
Partition map
NACA 0012 - M∞ = 0.5, Re = 5 × 103, α = 1◦, hp-adaptation on
8 CPU’s.
Red: global preconditioner lines; Black dotted: partition boundary.
Unweighted Weighted
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 47/52
What about 3D?...Larger savings!
DPW III Wing 1 - M∞ = 0.76, Re = 5 × 106, α = 0.5◦,
hp-adaptation on 720 CPU’s.
Challenge:what to do with empty partitions?
Primal solution time
2 2.5 3 3.5 4 4.5
x 10
5
0
0.5
1
1.5
2
x 10
4
Number of degrees of freedom
Primalsolvetime(seconds)
cNZ
unweighted
cNZ
weighted
Adjoint solution time
2 2.5 3 3.5 4 4.5
x 10
5
0
1000
2000
3000
4000
5000
Number of degrees of freedom
Adjointsolvetime(seconds)
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 48/52
What about 3D?...Larger savings!
DPW III Wing 1 - M∞ = 0.76, Re = 5 × 106, α = 0.5◦,
hp-adaptation on 720 CPU’s.
Number of GMRES iterations is directly related to using the
preconditioner lines in the partitioning.
Adaptation time
2 2.5 3 3.5 4 4.5
x 10
5
200
300
400
500
600
700
800
900
Number of degrees of freedom
Adaptationtime(seconds)
cNZ
unweighted
cNZ
weighted
GMRES iterations for primal and dual solves
2 2.5 3 3.5 4 4.5
x 10
5
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
x 10
5
Number of degrees of freedom
NumberofGMRESiterations
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 49/52
Conclusions
RANS is still very challenging with DG (specially in 3D), inclusion
of physicality constraints and better scaling of ˜ν helps in achieving
residual convergence.
Adjoints not only can be used to localize bad cells in the mesh but
also can guide directional mesh refinement.
Our hp-adaptation method is effective in achieving output
convergence as demonstrated in challenging problems in the
aeronautical industry.
Significant savings in CPU time and degrees of freedom are
observed with hp-adaptation.
The proposed mesh partitioning algorithm significantly improves
the parallel performance of both primal and dual solves.
Many challenges still exist but we hope this work helps with
increasing the presence of adaptive, high-order methods in
industrial environments.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 50/52
Some ideas for the future
Better flow initialization strategies: CPTC + line-search is not
bullet-proof.
h and p coarsening: adaptation at ∼ fixed solution cost.
Adaptive node movement: reduce dependence on the initial
mesh topology.
Other element types: simplices are better for more complicated
geometries.
µ-evolution in the constrained solver: other strategies may
further improve the robustness of the solver.
Extension to other DG methods: there are more cost-efficient
DG discretizations.
Weighted partitioning: not clear what is the best way to handle
empty partitions.
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 51/52
Thank you!...
“Burgers are meant to be eaten, not solved!”
Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 52/52

More Related Content

What's hot

Guarding Polygons via CSP
Guarding Polygons via CSPGuarding Polygons via CSP
Guarding Polygons via CSP
AkankshaAgrawal55
 

What's hot (13)

Hybrid Evolutionary Algorithms on Minimum Vertex Cover for Random Graphs
Hybrid Evolutionary Algorithms on Minimum Vertex Cover for Random GraphsHybrid Evolutionary Algorithms on Minimum Vertex Cover for Random Graphs
Hybrid Evolutionary Algorithms on Minimum Vertex Cover for Random Graphs
 
Guarding Polygons via CSP
Guarding Polygons via CSPGuarding Polygons via CSP
Guarding Polygons via CSP
 
CEM Workshop Lectures (6/11): FVTD Method in CEM
CEM Workshop Lectures (6/11): FVTD Method in CEMCEM Workshop Lectures (6/11): FVTD Method in CEM
CEM Workshop Lectures (6/11): FVTD Method in CEM
 
CEM Workshop Lectures (8/11): Method of moments
CEM Workshop Lectures (8/11):  Method of momentsCEM Workshop Lectures (8/11):  Method of moments
CEM Workshop Lectures (8/11): Method of moments
 
Guarding Terrains though the Lens of Parameterized Complexity
Guarding Terrains though the Lens of Parameterized ComplexityGuarding Terrains though the Lens of Parameterized Complexity
Guarding Terrains though the Lens of Parameterized Complexity
 
Sensors and Samples: A Homological Approach
Sensors and Samples:  A Homological ApproachSensors and Samples:  A Homological Approach
Sensors and Samples: A Homological Approach
 
Chap05
Chap05Chap05
Chap05
 
Discussion of Fearnhead and Prangle, RSS&lt; Dec. 14, 2011
Discussion of Fearnhead and Prangle, RSS&lt; Dec. 14, 2011Discussion of Fearnhead and Prangle, RSS&lt; Dec. 14, 2011
Discussion of Fearnhead and Prangle, RSS&lt; Dec. 14, 2011
 
Lossy Kernelization
Lossy KernelizationLossy Kernelization
Lossy Kernelization
 
Polylogarithmic approximation algorithm for weighted F-deletion problems
Polylogarithmic approximation algorithm for weighted F-deletion problemsPolylogarithmic approximation algorithm for weighted F-deletion problems
Polylogarithmic approximation algorithm for weighted F-deletion problems
 
Biconnectivity
BiconnectivityBiconnectivity
Biconnectivity
 
Fine Grained Complexity of Rainbow Coloring and its Variants
Fine Grained Complexity of Rainbow Coloring and its VariantsFine Grained Complexity of Rainbow Coloring and its Variants
Fine Grained Complexity of Rainbow Coloring and its Variants
 
Supervisory control of discrete event systems for linear temporal logic speci...
Supervisory control of discrete event systems for linear temporal logic speci...Supervisory control of discrete event systems for linear temporal logic speci...
Supervisory control of discrete event systems for linear temporal logic speci...
 

Similar to MarcoCeze_defense

QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...
QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...
QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...
The Statistical and Applied Mathematical Sciences Institute
 

Similar to MarcoCeze_defense (20)

Distributed solution of stochastic optimal control problem on GPUs
Distributed solution of stochastic optimal control problem on GPUsDistributed solution of stochastic optimal control problem on GPUs
Distributed solution of stochastic optimal control problem on GPUs
 
Применение машинного обучения для навигации и управления роботами
Применение машинного обучения для навигации и управления роботамиПрименение машинного обучения для навигации и управления роботами
Применение машинного обучения для навигации и управления роботами
 
MUMS: Bayesian, Fiducial, and Frequentist Conference - Model Selection in the...
MUMS: Bayesian, Fiducial, and Frequentist Conference - Model Selection in the...MUMS: Bayesian, Fiducial, and Frequentist Conference - Model Selection in the...
MUMS: Bayesian, Fiducial, and Frequentist Conference - Model Selection in the...
 
lecture01_lecture01_lecture0001_ceva.pdf
lecture01_lecture01_lecture0001_ceva.pdflecture01_lecture01_lecture0001_ceva.pdf
lecture01_lecture01_lecture0001_ceva.pdf
 
Developing fast low-rank tensor methods for solving PDEs with uncertain coef...
Developing fast  low-rank tensor methods for solving PDEs with uncertain coef...Developing fast  low-rank tensor methods for solving PDEs with uncertain coef...
Developing fast low-rank tensor methods for solving PDEs with uncertain coef...
 
Data sparse approximation of Karhunen-Loeve Expansion
Data sparse approximation of Karhunen-Loeve ExpansionData sparse approximation of Karhunen-Loeve Expansion
Data sparse approximation of Karhunen-Loeve Expansion
 
Data sparse approximation of the Karhunen-Loeve expansion
Data sparse approximation of the Karhunen-Loeve expansionData sparse approximation of the Karhunen-Loeve expansion
Data sparse approximation of the Karhunen-Loeve expansion
 
Slides
SlidesSlides
Slides
 
My presentation at University of Nottingham "Fast low-rank methods for solvin...
My presentation at University of Nottingham "Fast low-rank methods for solvin...My presentation at University of Nottingham "Fast low-rank methods for solvin...
My presentation at University of Nottingham "Fast low-rank methods for solvin...
 
An Iteratively Coupled Solution Method for Partial and Super-Cavitation Predi...
An Iteratively Coupled Solution Method for Partial and Super-Cavitation Predi...An Iteratively Coupled Solution Method for Partial and Super-Cavitation Predi...
An Iteratively Coupled Solution Method for Partial and Super-Cavitation Predi...
 
Polynomial Matrix Decompositions
Polynomial Matrix DecompositionsPolynomial Matrix Decompositions
Polynomial Matrix Decompositions
 
A walk through the intersection between machine learning and mechanistic mode...
A walk through the intersection between machine learning and mechanistic mode...A walk through the intersection between machine learning and mechanistic mode...
A walk through the intersection between machine learning and mechanistic mode...
 
Rachel Leuthold: Shape Optimization for Rigid Airfoils in Multiple-Kite AWE S...
Rachel Leuthold: Shape Optimization for Rigid Airfoils in Multiple-Kite AWE S...Rachel Leuthold: Shape Optimization for Rigid Airfoils in Multiple-Kite AWE S...
Rachel Leuthold: Shape Optimization for Rigid Airfoils in Multiple-Kite AWE S...
 
Phonons & Phonopy: Pro Tips (2014)
Phonons & Phonopy: Pro Tips (2014)Phonons & Phonopy: Pro Tips (2014)
Phonons & Phonopy: Pro Tips (2014)
 
Smoothed Particle Galerkin Method Formulation.pdf
Smoothed Particle Galerkin Method Formulation.pdfSmoothed Particle Galerkin Method Formulation.pdf
Smoothed Particle Galerkin Method Formulation.pdf
 
Iterative methods with special structures
Iterative methods with special structuresIterative methods with special structures
Iterative methods with special structures
 
Optimal Multisine Probing Signal Design for Power System Electromechanical Mo...
Optimal Multisine Probing Signal Design for Power System Electromechanical Mo...Optimal Multisine Probing Signal Design for Power System Electromechanical Mo...
Optimal Multisine Probing Signal Design for Power System Electromechanical Mo...
 
CORSO SMORZATORI_LEZ 2_31-05-2023.pdf
CORSO SMORZATORI_LEZ 2_31-05-2023.pdfCORSO SMORZATORI_LEZ 2_31-05-2023.pdf
CORSO SMORZATORI_LEZ 2_31-05-2023.pdf
 
QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...
QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...
QMC: Transition Workshop - Probabilistic Integrators for Deterministic Differ...
 
Finite frequency H∞ control for wind turbine systems in T-S form
Finite frequency H∞ control for wind turbine systems in T-S formFinite frequency H∞ control for wind turbine systems in T-S form
Finite frequency H∞ control for wind turbine systems in T-S form
 

MarcoCeze_defense

  • 1. Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations Applied to Aerodynamic Flows Marco Ceze, PhD. Candidate Department of Aerospace Engineering University of Michigan Doctoral Committee: Assistant Professor Krzysztof Fidkowski, Chair Assistant Professor Eric Johnsen Emeritus Professor Bram van Leer Professor David W. Zingg, University of Toronto Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 1/52
  • 2. An airline is a difficult business Profit margin over the past 10 years for various airlines. Source: http://www.ycharts.com Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 2/52
  • 3. The impact of drag prediction + −1% drag translates into − +7% payload (revenue). From the aircraft manufacturer perpective: Drag under-prediction ⇒ contractual penalties. Drag over-prediction ⇒ lower selling price. AIAA organizes workshops for assessing the state-of-the-art. Pressure distribution over NASA’s CRM-WB geometry DPW’s finest common meshes. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 3/52
  • 4. Motivation Quantitatively reliable CFD solutions are still hard to obtain Accuracy is usually assessed by uniform mesh refinement studies and even then, errors may be large (e.g. AIAA-DPW, HLPW). Acceptable engineering solutions on representative geometries often come at prohibitively-large grid sizes. Robustness of the analysis process is rarely addressed. Good news! Most engineers are interested in only certain scalar outputs, eg.: drag, lift, moments, etc.. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 4/52
  • 5. Why good news?...Adjoints! Sensitivity of the output w.r.t. residuals in the physics. Input perturbations are converted into residual perturbations. Advantage: residuals are generally cheap to compute. Flow  simula+on   Post-­‐processing   e.g.:  drag,  li7.     J(U) Input  parameters   ↵ R J 2 6 6 6 4 R1(U) R2(U) ... Rn(U) 3 7 7 7 5 = 2 6 6 6 4 0 0 ... 0 3 7 7 7 5 Adjoint  variables   U “Mesh”  +   Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 5/52
  • 6. Why good news?...Adjoints! Sensitivity of the output w.r.t. residuals in the physics. Input perturbations are converted into residual perturbations. Advantage: residuals are generally cheap to compute. Flow  simula+on   Post-­‐processing   e.g.:  drag,  li7.     J(U) Input  parameters   ↵ R J 2 6 6 6 4 R1(U) R2(U) ... Rn(U) 3 7 7 7 5 = 2 6 6 6 4 0 0 ... 0 3 7 7 7 5 Adjoint  variables   U ↵ “Mesh”  +   Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 5/52 Sensitivity analysis
  • 7. Why good news?...Adjoints! Sensitivity of the output w.r.t. residuals in the physics. Input perturbations are converted into residual perturbations. Advantage: residuals are generally cheap to compute. Flow  simula+on   Post-­‐processing   e.g.:  drag,  li7.     J(U) Input  parameters   ↵ R J 2 6 6 6 4 R1(U) R2(U) ... Rn(U) 3 7 7 7 5 = 2 6 6 6 4 0 0 ... 0 3 7 7 7 5 Adjoint  variables   U “Mesh”  +   Residual  evalua+on   in  finer  space   Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 5/52 Output error estimation
  • 8. A derivation of the adjoint equation Consider an output J ((α), u) where u satisfies R((α), u) = 0 for input parameter set α. We form a Lagrangian L((α), u, ψ) to incorporate the constraint: L((α), u, ψ) = J (u) + ψT R((α), u). We take the variation of the Lagrangian assuming R((α), u) = 0: δL((α), u, ψ) = ∂J ∂u T + ψT ∂R ∂u = 0 Adjoint equation δu + ∂J ∂α T + ψT ∂R ∂α = 0 δα. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 6/52 Making δL = 0 selects only realizable δJ ’s. Linear equation!
  • 9. Output Error Estimation Output error: difference between an output computed with the discrete system solution and that computed with the exact solution. δJ = JH(uH) − J(u) uH ∈ VH = approximate solution, u ∈ V = exact solution Adjoint-based output error estimation techniques Account for propagation effects inherent to hyperbolic problems. Can provide a correction factor for the output. Identify all areas of the domain that are important for an accurate prediction of the output ⇒ Mesh adaptation! Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 7/52
  • 10. Discontinuous Galerkin and hp-adaptation P (u) = 0 PDE Ri ≡ Ω wi(x) P N j=1 Ujφj (x) dx = 0 Discrete MWR Mesh: κ1 κ2 κ3 κ4 Solution space: κ1 φ1,1 φ1,2 κ2 φ2,1 φ2,2 κ3 φ3,1 φ3,2 κ4 φ4,1 φ4,2 hp-adapted solution space: κ1 φ1,1 φ1,2 κ4 φ4,1 φ4,2 h-ref. κ2 φ2,1φ2,2 κ5 φ5,1φ5,2 κ3 p-ref. φ3,1 φ3,2 φ3,3 Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 8/52 How do we choose between h and p refinements?
  • 11. Solution process and this work •  Ini$al  condi$on   •  Parameters   •  Mesh   Flow  solver   Converged?   Interven$on   by  user   Error   es$ma$on   Error  within     tolerance?   Finished   Mesh   adapta$on   NO   YES   YES  NO   Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 9/52
  • 12. Solution process and this work Solver  Robustness   •  Ini$al  condi$on   •  Parameters   •  Mesh   Flow  solver   Converged?   Interven$on   by  user   Error   es$ma$on   Error  within     tolerance?   Finished   Mesh   adapta$on   NO   YES   YES  NO   Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 9/52
  • 13. Solution process and this work hp  -­‐  Adapta(on   Solver  Robustness   •  Ini$al  condi$on   •  Parameters   •  Mesh   Flow  solver   Converged?   Interven$on   by  user   Error   es$ma$on   Error  within     tolerance?   Finished   Mesh   adapta$on   NO   YES   YES  NO   Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 9/52
  • 14. Overview of this work High-order DG-FEM for spatial discretization. Exact Jacobian with line-Jacobi preconditioner and GMRES linear solver. MPI parallelization. Focus on steady problems relevant to the aeronautical industry. Oliver’s modifications to the Spalart-Allmaras turbulence model. Quadrilateral and hexahedral meshes. Constrained pseudo-transient continuation (CPTC) for time integration. Output-based anisotropic hp-adaptation. Node-edge weighted mesh partitioning. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 10/52
  • 15. Constrained pseudo-transient continuation Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 11/52
  • 16. Problem statement Consider the semi-discrete flow equations: Ut = −R(U). The discrete solution U is used to approximate the state, u, as a field uH,p(t, x). In finite elements: uH,p (t, x) = j Uj(t)φH,p j (x). The field uH,p(t, x) is subject to physical realizability constraints: p(uH,p(t, x)) p∞ > 0, ρ(uH,p(t, x)) ρ∞ > 0 and ν(uH,p) + νt (uH,p) ν(uH,p) > 0. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 11/52 These realizability constraints are violated sometimes.
  • 17. Marching to steady-state M 1 ∆t + ∂R ∂U Uk A ∆Uk = −R(Uk ) Pseudo-transient continuation Multiply left-hand side by its transpose: ∆UT AT A∆U = −∆UT AT R(U) ∂f ∂U ≥ 0. ∆U is a descent direction for: f(˜U) = |Rt (˜U)|2 L2 = |M 1 ∆t (˜U − Uk ) + R(˜U)|2 L2 . No direct mechanism to avoid physicality constraints! Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 12/52
  • 18. Handling physicality constraints We propose augmenting the residual with a penalty vector: Rp(U) = R(U) + P(U). For a repelling effect w.r.t the constraints, it is sufficient to make P(U)T R(U) > 0. We choose: P = Φ R, where Φ is a diagonal matrix with elemental penalties: PκH (UκH (t), µ) = µ Ni i Nj j wj ci(uH,p(t, xj)) . where µ is the penalty factor, ci are the constraints, and xj are interrogation points. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 13/52
  • 19. Handling physicality constraints Apply PTC to Rp and the equation for the state update becomes:      (I + Φ)−1 M ∆t a + ∂R ∂U + (I + Φ)−1 ∂Φ ∂U R(U) b      ∆U = −R(U). The elemental ∆t gets amplified by a factor (1 + PκH ). In the limit ∆t → ∞, the solution seeks a minimum of |Rp|L2 . As the state in an element approaches a non-physical condition, term "a" vanishes locally while "b" remains due to the derivative of the inverse barrier function. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 14/52
  • 20. Constrained PTC example Solve a simple nonlinear algebraic system: sin(4πx1x2) − 2x2 − x1 = 0 4π − 1 4π (e2x1 − e) + 4ex2 2 − 2ex1 = 0 −1 ≤ x1 ≤ 1 −1 ≤ x2 ≤ 1 −1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1 −1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1 x2 x1 Prohibited PTC −1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1 −1 −0.8 −0.6 −0.4 −0.2 0 0.2 0.4 0.6 0.8 1 x2 x1 Prohibited Constrained PTC Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 15/52
  • 21. Solution update methods Uk+1 = Uk + ωk ∆Uk , for ωk ≤ 1 Maximum Primitive Change (MPC) Limit ωk such that changes in ρ, p, and ˜ν are within ηmax = 10% for all κH. Line Search (LS) Compute ωphys such that changes in ρ, p, and ˜ν are within ηmax = 10% for κH with ∆U|κH · ∂PκH ∂U > 0. Backtrack from ωk = ωphys until |Rt (˜U)|L2 < |R(Uk )|L2 . Line Search + Greedy (LS+G) If LS exits with ωk = ωphys < 1, amplify ωk while |Rt (˜U)|L2 < |R(Uk )|L2 and ωk < 1. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 16/52
  • 22. CFL evolution strategies If (ωk ≤ ωmin) ⇒ Repeat step “k” with smaller CFL = λmax,κH ∆tκH LκH Exponential progression (EXP) CFLk+1 =    β · CFLk for β > 1 if ωk = 1 CFLk if ωmin < ωk < 1 κ · CFLk for κ < 1 if ωk < ωmin Switched Evolution Relaxation (SER) CFLk = min CFLk−1 |Rk−1 |L2 |Rk |L2 , CFLmax Residual Difference Method (RDM - mRDM) CFLk = min  CFLk−1 · β |Rk−1|L2 −|Rk |L2 |Rk−1|L2 , CFLmax   for β > 1 Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 17/52
  • 23. Let’s test this! Combine the PTC and CPTC with the solution update methods and CFL strategies. Test cases range from intermediate to difficult. Residual convergence is 9 orders of magnitude reduction. We compare the methods under same GMRES and discretization parameters. Rules of the game: A maximum run time is fixed for all runs within a case. A maximum number of iterations is fixed for all runs within a case. Performance of the converged runs is measured in terms of number of iterations and wall time. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 18/52
  • 24. MDA 30p30n - M∞ = 0.2, Re = 9 × 106 , α = 16◦ , p = 1 Quartic mesh generated by agglomerating linear cells. y+ ≈ 3 × 103 based on a flat-plate correlation. 16 CPU’s, 8 hours, maximum of 10k iterations. Quartic mesh (4070 elements) Mach number contours Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 19/52
  • 25. MDA 30p30n - M∞ = 0.2, Re = 9 × 106 , α = 16◦ , p = 1 Success of all runs: → converged, → timeout or max iterations, → CFL below minimum or non-physical. PTC CPTC MPC LS LS+G MPC LS LS+G EXP run 1.1.1 run 1.2.1 run 1.3.1 run 2.1.1 run 2.2.1 run 2.3.1 SER run 1.1.2 run 1.2.2 run 1.3.2 run 2.1.2 run 2.2.2 run 2.3.2 RDM run 1.1.3 run 1.2.3 run 1.3.3 run 2.1.3 run 2.2.3 run 2.3.3 mRDM run 1.1.4 run 1.2.4 run 1.3.4 run 2.1.4 run 2.2.4 run 2.3.4 Performance of converged runs. Run ID Nonlinear iterations GMRES iterations Wall time (seconds) 1.3.1 1.000 (1412) 1.000 (608770) 1.000 (5.085 × 103) 1.3.4 4.750 0.935 1.005 2.2.4 5.135 1.346 1.059 2.3.1 1.161 0.881 0.920 Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 20/52
  • 26. NACA 0012 - M∞ = 0.8, Re = 6.5 × 106 , α = 0◦ , p = 2 No shock-capturing ⇒ oscillations. y+ ≈ 2 × 103 based on a flat-plate correlation. 40 CPU’s, 8 hours, maximum of 10k iterations. Quartic mesh (1740 elements) Mach number contours Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 21/52
  • 27. NACA 0012 - M∞ = 0.8, Re = 6.5 × 106 , α = 0◦ , p = 2 Success of all runs: PTC CPTC MPC LS LS+G MPC LS LS+G EXP run 1.1.1 run 1.2.1 run 1.3.1 run 2.1.1 run 2.2.1 run 2.3.1 SER run 1.1.2 run 1.2.2 run 1.3.2 run 2.1.2 run 2.2.2 run 2.3.2 RDM run 1.1.3 run 1.2.3 run 1.3.3 run 2.1.3 run 2.2.3 run 2.3.3 mRDM run 1.1.4 run 1.2.4 run 1.3.4 run 2.1.4 run 2.2.4 run 2.3.4 Performance of converged runs. Run ID Nonlinear iterations GMRES iterations Wall time (seconds) 1.1.4 1.000 (3707) 1.000 (34671) 1.000 (1.347 × 104s) 1.2.1 0.281 0.456 0.327 1.2.4 0.454 0.557 0.477 1.3.1 0.0968 0.316 0.170 1.3.4 0.179 0.301 0.229 2.1.1 0.401 0.440 0.410 2.1.4 0.308 0.537 0.367 2.2.1 0.250 0.474 0.309 2.2.4 0.386 0.542 0.422 2.3.1 0.127 0.335 0.200 2.3.4 0.136 0.529 0.275 Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 22/52
  • 28. DPW 3 W1 - M∞ = 0.76, Re = 5 × 106 , α = 0.5◦ , p = 1 Cubic mesh generated by agglomerating linear cells. y+ ≈ 1 based on a flat-plate correlation. 804 CPU’s, 5 hours, maximum of 4k iterations. Mesh and pressure contours (29310 elements) Mach number and ρ˜ν contours Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 23/52
  • 29. DPW 3 W1 - M∞ = 0.76, Re = 5 × 106 , α = 0.5◦ , p = 1 Success of all runs: → converged, → timeout or max iterations, → CFL below minimum or non-physical. PTC CPTC MPC LS LS+G MPC LS LS+G EXP run 1.1.1 run 1.2.1 run 1.3.1 run 2.1.1 run 2.2.1 run 2.3.1 SER run 1.1.2 run 1.2.2 run 1.3.2 run 2.1.2 run 2.2.2 run 2.3.2 RDM run 1.1.3 run 1.2.3 run 1.3.3 run 2.1.3 run 2.2.3 run 2.3.3 mRDM run 1.1.4 run 1.2.4 run 1.3.4 run 2.1.4 run 2.2.4 run 2.3.4 Performance of converged runs. Run ID Nonlinear iterations GMRES iterations Wall time (seconds) 2.1.1 1.000 (1255) 1.000 (68253) 1.000 (5.694 × 103s) 2.1.4 0.897 0.935 0.845 2.2.1 0.880 0.944 1.021 2.2.4 0.751 1.002 1.127 Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 24/52
  • 30. Output-based hp-adaptation Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 25/52
  • 31. Error estimate and adaptive indicator uH,p will generally not satisfy the original PDE: R(uH,p, w) = 0 Instead, it satisfies the weak form: R(u, w) + δR(w) = 0 where δR(w) = −R(uH,p , w). ψ ∈ V relates the residual perturbation to an output perturbation: δJ = J(uH,p ) − J(u) ≈ −R(uH,p , ψ) We approximate ψ in a higher order space VH,p+1 ⊃ VH,p and estimate the error as: δJ ≈ − κH ∈TH RκH (uH,p , ψH,p+1 − ψH,p ), We assign an adaptive indicator to κH based on its contribution to the error estimate: ηκH = RκH (uH,p , ψH,p+1 − ψH,p ) . Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 25/52
  • 32. Output-based hp adaptation Select a fraction fadapt of the elements with largest ηκH . A set of discrete refinement options is considered, e.g.: pp (a) x p p (b) y p p p p (c) xy p+1 (d) p Rank the refinement options based on a merit function: m(i) = b(i) c(i) c(i) is a measure of the computational cost of refinement option i. b(i) measures the gain in accuracy due to the refinement option i. Balance between high-cost-low-error and low-cost-high-error options Choose the option with the highest m(i) Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 26/52
  • 33. Output-based hp adaptation The merit function is computed on local sub-problems that involve the element to be refined and its neighbors. We compare two measures of computational cost: Degrees of freedom cDOF(i) = κh∈κH (pκh (i) + 1)dim , Non-zeros in the Jacobian cNZ(i) = κh∈κH (pκh (i) + 1)2·dim + ∂κh∂D[(pκh (i) + 1) · (p− κh (i) + 1)]dim . Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 27/52
  • 34. Output-based hp adaptation The benefit is defined as an output sensitivity to a local residual perturbation due to a refinement i. b(i) = κh∈κH |Rκh (U(i))| · |Ψκh (i)| where Ψκh is the coarse adjoint injected in the semi-refined space. Observations: The benefit as defined is machine-zero if computed before refining the central element. In the limit of the discrete solution representing the exact solution to residual tolerance, εR, the benefit will also be ∼ εR. The refinement option with the largest b(i) is expected to be the option that produces the largest change in the output of interest. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 28/52
  • 35. DPW3 W1 - M∞ = 0.76, α = 0.5o , Re = 5 × 106 Drag-based hp adaptation results. p = 1 baseline solution. Initial cubic (q = 3) mesh generated by agglomerating 3 linear elements in each direction. Spalart-Allmaras model with Oliver’s modification [MIT PhD. Thesis - 2008]. Initial pressure contours (29310 cubic elements, p = 1). Pressure contours on the 1st level of uniform h-refinement (234480 cubic elements, p = 1). Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 29/52
  • 36. DPW3 W1 - M∞ = 0.76, α = 0.5o , Re = 5 × 106 Results computed with 180 Harpertown 8-core nodes. We limited the total wall time to 72 hours. cDOF cNZ Adaptation step iso-h sc-h dc-h iso-p iso-h sc-h dc-h iso-p 1 0.0 99.3 0.0 0.7 0.0 100.0 0.0 0.0 2 0.0 97.3 0.0 2.7 0.0 99.9 0.0 0.1 3 0.0 94.9 0.0 5.1 0.0 99.8 0.0 0.2 4 0.0 91.8 0.4 7.8 0.0 99.1 0.3 0.6 5 0.0 90.6 0.3 9.1 0.0 98.7 0.5 0.8 6 – – – – 0.0 98.6 0.5 0.9 7 – – – – 0.0 98.6 0.4 1.0 10 5 10 6 10 7 0.02 0.021 0.022 0.023 0.024 0.025 0.026 0.027 Dragcoefficient Number of degrees of freedom hp − cnz hp − cdof Uniform h 10 6 0.0206 0.0208 0.021 0.0212 0.0214 0.0216 10 4 10 5 10 6 0.02 0.021 0.022 0.023 0.024 0.025 0.026 0.027 Dragcoefficient CPU wall−time (seconds) 10 5 0.0206 0.0208 0.021 0.0212 0.0214 0.0216 Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 30/52
  • 37. DPW3 W1 - M∞ = 0.76, α = 0.5o , Re = 5 × 106 Final hp-adapted meshes with pressure contours (p = 1 → 5). Pressure contours on the 5th drag-adapted mesh using cDOF (59503 cubic elements). Pressure contours on the 7th drag-adapted mesh using cNZ (85377 cubic elements). Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 31/52
  • 38. NACA 0012, M∞ = 0.15, Re = 6 × 106 , drag polar Drag-based anisotropic h-adaptation with p = 2. Validation of Oliver’s SA modifications against Ladson’s experimental data. α = 0◦, 2◦, 4◦, 6◦, 8◦, 10◦, 12◦, and 15◦ Farfield at 500-chord-lengths. Initial mesh for α = 10◦ (720 quartic elements) Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 32/52
  • 39. NACA 0012, M∞ = 0.15, Re = 6 × 106 , drag polar Drag convergence: Continuous lines: drag output. Dashed lines: drag corrected by error estimate. Shaded region: sum of adaptive indicators. Largest final error estimate: 3 counts (∼ 3%) in the α = 15o case. Final DOF count: ∼12k. α = 10◦ α = 15◦ Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 33/52
  • 40. NACA 0012, M∞ = 0.15, Re = 6 × 106 , drag polar Comparison with experimental results with transition at ∼ 5%-chord location. Our results are within 3% of CFL3D results. NASA’s Turbulence Modeling Resource spread of results is 4%. CFL3D computed on a fine, ∼230k element, structured grid. −5 0 5 10 15 20 −0.5 0 0.5 1 1.5 2 CL Ladson 80grit Ladson 120grit Ladson 180grit CFL3D XFlow (drag adapted) −0.5 0 0.5 1 1.5 2 0.005 0.01 0.015 0.02 0.025 C L C D Ladson 80grit Ladson 120grit Ladson 180grit CFL3D XFlow (drag adapted) XFlow + error estimate Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 34/52
  • 41. NACA 0012, M∞ = 0.15, Re = 6 × 106 , drag polar The adjoint solution shows regions of the computational domain where discretization errors affect the output of interest. Final mesh and ˜ν contours for α = 10o x-mom. drag adjoint on final mesh for α = 10o Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 35/52
  • 42. DPW5 CRM - M∞ = 0.85, Re = 5 × 106 , CL = 0.5 Cubic (q = 3) mesh generated by agglomerating 3 linear cells in each direction. Drag-driven anisotropic h-adaptation at fixed lift with p = 1. y+ ≈ 100 based on a flat-plate correlation for Cf . Linear mesh (1218375 elements). Agglomerated cubic mesh (45125 elements). Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 36/52
  • 43. DPW5 CRM - M∞ = 0.85, Re = 5 × 106 , CL = 0.5 Adjoint-based parameter correction. General framework for computing sensitivities using adjoints. Fixed-lift adds an extra term to error estimate. Mesh Initial Conditions Jtarget, εtol, αguess Solve Solve R(α, U) = 0 |J − Jtarget| ≤ εtol Finished True False ∂R ∂U T Ψ = − ∂J ∂U Compute δR = R(α + δα, U) Update α ⇐ α + (J − Jtarget)δα ΨT δR Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 37/52
  • 44. DPW5 CRM - M∞ = 0.85, Re = 5 × 106 , CL = 0.5 Could not achieve CL = 0.5 on the initial mesh. Gray shaded region: range of DPW5 data computed on "fine" mesh (∼ 50M cells). Our last adapted mesh has a number of degrees of freedom close to the coarse meshes from the workshop. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 38/52
  • 45. DPW5 CRM - M∞ = 0.85, Re = 5 × 106 , CL = 0.5 Mach contours at 37% of the span. Separation appeared on coarse mesh due to lack of spatial resolution. Initial mesh (α = 2.8◦) 1st drag-adapted mesh (α = 2.675◦) Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 39/52
  • 46. DPW5 CRM - M∞ = 0.85, Re = 5 × 106 , CL = 0.5 Mach contours at 37% of the span. Smaller differences in the Mach contours after the first adaptive step. 1st drag-adapted mesh (α = 2.675◦) 5th drag-adapted mesh (α = 2.1598◦) Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 40/52
  • 47. DPW5 CRM - M∞ = 0.85, Re = 5 × 106 , CL = 0.5 Cp comparison with NASA’s experimental data. 13% of the reference span X/Chord -Cp 0 0.2 0.4 0.6 0.8 1 -0.5 0 0.5 Initial mesh 1st 2nd 3rd 4th 5th Exp. data 50% of the reference span X/Chord -Cp 0 0.2 0.4 0.6 0.8 1 -0.5 0 0.5 Initial mesh 1st 2nd 3rd 4th 5th Cp Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 41/52
  • 48. Weighted mesh partitioning Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 42/52
  • 49. Weighted mesh partitioning The mesh is represented as an irregular graph where elements are nodes and interior faces are edges. The sets in red represent lines of the line-Jacobi preconditioner. The inter-domain communication stores the data in one layer of fictitious elements neighboring each inter-domain boundary. We use the k-way partitioning algorithm implemented in ParMETIS. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 43/52
  • 50. Weighted mesh partitioning Node weights are based on the number of non-zeros in the self-blocks of the residual Jacobian: ωκH = (pκH + 1)2·dim . The edge weights are computed in the following sequence: 1 Loop through edges of the graph (faces of the mesh) and compute: ω∂κH ∂D = (p+ κH + 1)dim + (p− κH + 1)dim 2 Loop through lines of the preconditioner and augment ω∂κH ∂D based on the valence (connections per node) vκH : ω∂κH ∂D ⇐ ω∂κH ∂D · max(v+ κH , v− κH ). Step 1 assigns weights proportional to the amount of data transfer and step 2 increases the weight of connections between elements that are strongly coupled. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 44/52
  • 51. Is it worth doing this?...YES! NACA 0012 - M∞ = 0.5, Re = 5 × 103, α = 1◦, hp-adaptation on 8 CPU’s. Primal solution time 1400 1600 1800 2000 2200 2400 2600 2800 0 5 10 15 20 25 30 Number of degrees of freedom Primalsolvetime(seconds) c NZ unweighted cNZ weighted c DOF unweighted c DOF weighted Adjoint solution time 1400 1600 1800 2000 2200 2400 2600 2800 0 0.5 1 1.5 2 2.5 Number of degrees of freedom Adjointsolvetime(seconds) Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 45/52
  • 52. Is it worth doing this?...YES! NACA 0012 - M∞ = 0.5, Re = 5 × 103, α = 1◦, hp-adaptation on 8 CPU’s. Number of GMRES iterations is directly related to using the preconditioner lines in the partitioning. Adaptation time 1400 1600 1800 2000 2200 2400 2600 2800 1.5 2 2.5 3 3.5 4 4.5 5 5.5 Number of degrees of freedom Adaptationtime(seconds) cNZ unweighted c NZ weighted cDOF unweighted c DOF weighted GMRES iterations for primal and dual solves 1400 1600 1800 2000 2200 2400 2600 2800 1800 2000 2200 2400 2600 2800 3000 Number of degrees of freedom NumberofGMRESiterations Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 46/52
  • 53. Partition map NACA 0012 - M∞ = 0.5, Re = 5 × 103, α = 1◦, hp-adaptation on 8 CPU’s. Red: global preconditioner lines; Black dotted: partition boundary. Unweighted Weighted Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 47/52
  • 54. What about 3D?...Larger savings! DPW III Wing 1 - M∞ = 0.76, Re = 5 × 106, α = 0.5◦, hp-adaptation on 720 CPU’s. Challenge:what to do with empty partitions? Primal solution time 2 2.5 3 3.5 4 4.5 x 10 5 0 0.5 1 1.5 2 x 10 4 Number of degrees of freedom Primalsolvetime(seconds) cNZ unweighted cNZ weighted Adjoint solution time 2 2.5 3 3.5 4 4.5 x 10 5 0 1000 2000 3000 4000 5000 Number of degrees of freedom Adjointsolvetime(seconds) Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 48/52
  • 55. What about 3D?...Larger savings! DPW III Wing 1 - M∞ = 0.76, Re = 5 × 106, α = 0.5◦, hp-adaptation on 720 CPU’s. Number of GMRES iterations is directly related to using the preconditioner lines in the partitioning. Adaptation time 2 2.5 3 3.5 4 4.5 x 10 5 200 300 400 500 600 700 800 900 Number of degrees of freedom Adaptationtime(seconds) cNZ unweighted cNZ weighted GMRES iterations for primal and dual solves 2 2.5 3 3.5 4 4.5 x 10 5 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 x 10 5 Number of degrees of freedom NumberofGMRESiterations Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 49/52
  • 56. Conclusions RANS is still very challenging with DG (specially in 3D), inclusion of physicality constraints and better scaling of ˜ν helps in achieving residual convergence. Adjoints not only can be used to localize bad cells in the mesh but also can guide directional mesh refinement. Our hp-adaptation method is effective in achieving output convergence as demonstrated in challenging problems in the aeronautical industry. Significant savings in CPU time and degrees of freedom are observed with hp-adaptation. The proposed mesh partitioning algorithm significantly improves the parallel performance of both primal and dual solves. Many challenges still exist but we hope this work helps with increasing the presence of adaptive, high-order methods in industrial environments. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 50/52
  • 57. Some ideas for the future Better flow initialization strategies: CPTC + line-search is not bullet-proof. h and p coarsening: adaptation at ∼ fixed solution cost. Adaptive node movement: reduce dependence on the initial mesh topology. Other element types: simplices are better for more complicated geometries. µ-evolution in the constrained solver: other strategies may further improve the robustness of the solver. Extension to other DG methods: there are more cost-efficient DG discretizations. Weighted partitioning: not clear what is the best way to handle empty partitions. Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 51/52
  • 58. Thank you!... “Burgers are meant to be eaten, not solved!” Marco Ceze Doctoral Defense Robust hp-Adaptation Method for Discontinuous Galerkin Discretizations 52/52