The document discusses quantiles and quantile regression. It begins by defining quantiles as the inverse of a cumulative distribution function. Quantile regression models the relationship between covariates and conditional quantiles, similar to how ordinary least squares regression models the conditional mean. The document also discusses median regression, which estimates relationships using the 1-norm rather than the 2-norm used in OLS. Median regression provides consistent estimates when the error term has a symmetric distribution.
Fixed Point Results In Fuzzy Menger Space With Common Property (E.A.)IJERA Editor
This paper presents some common fixed point theorems for weakly compatible mappings via an implicit relation in Fuzzy Menger spaces satisfying the common property (E.A)
Existance Theory for First Order Nonlinear Random Dfferential Equartioninventionjournals
In this paper, the existence of a solution of nonlinear random differential equation of first order is proved under Caratheodory condition by using suitable fixed point theorem. 2000 Mathematics Subject Classification: 34F05, 47H10, 47H4
Talk at the modcov19 CNRS workshop, en France, to present our article COVID-19 pandemic control: balancing detection policy and lockdown intervention under ICU sustainability
Falcon stands out as a top-tier P2P Invoice Discounting platform in India, bridging esteemed blue-chip companies and eager investors. Our goal is to transform the investment landscape in India by establishing a comprehensive destination for borrowers and investors with diverse profiles and needs, all while minimizing risk. What sets Falcon apart is the elimination of intermediaries such as commercial banks and depository institutions, allowing investors to enjoy higher yields.
If you are looking for a pi coin investor. Then look no further because I have the right one he is a pi vendor (he buy and resell to whales in China). I met him on a crypto conference and ever since I and my friends have sold more than 10k pi coins to him And he bought all and still want more. I will drop his telegram handle below just send him a message.
@Pi_vendor_247
The secret way to sell pi coins effortlessly.DOT TECH
Well as we all know pi isn't launched yet. But you can still sell your pi coins effortlessly because some whales in China are interested in holding massive pi coins. And they are willing to pay good money for it. If you are interested in selling I will leave a contact for you. Just telegram this number below. I sold about 3000 pi coins to him and he paid me immediately.
Telegram: @Pi_vendor_247
how can i use my minded pi coins I need some funds.DOT TECH
If you are interested in selling your pi coins, i have a verified pi merchant, who buys pi coins and resell them to exchanges looking forward to hold till mainnet launch.
Because the core team has announced that pi network will not be doing any pre-sale. The only way exchanges like huobi, bitmart and hotbit can get pi is by buying from miners.
Now a merchant stands in between these exchanges and the miners. As a link to make transactions smooth. Because right now in the enclosed mainnet you can't sell pi coins your self. You need the help of a merchant,
i will leave the telegram contact of my personal pi merchant below. 👇 I and my friends has traded more than 3000pi coins with him successfully.
@Pi_vendor_247
Latino Buying Power - May 2024 Presentation for Latino CaucusDanay Escanaverino
Unlock the potential of Latino Buying Power with this in-depth SlideShare presentation. Explore how the Latino consumer market is transforming the American economy, driven by their significant buying power, entrepreneurial contributions, and growing influence across various sectors.
**Key Sections Covered:**
1. **Economic Impact:** Understand the profound economic impact of Latino consumers on the U.S. economy. Discover how their increasing purchasing power is fueling growth in key industries and contributing to national economic prosperity.
2. **Buying Power:** Dive into detailed analyses of Latino buying power, including its growth trends, key drivers, and projections for the future. Learn how this influential group’s spending habits are shaping market dynamics and creating opportunities for businesses.
3. **Entrepreneurial Contributions:** Explore the entrepreneurial spirit within the Latino community. Examine how Latino-owned businesses are thriving and contributing to job creation, innovation, and economic diversification.
4. **Workforce Statistics:** Gain insights into the role of Latino workers in the American labor market. Review statistics on employment rates, occupational distribution, and the economic contributions of Latino professionals across various industries.
5. **Media Consumption:** Understand the media consumption habits of Latino audiences. Discover their preferences for digital platforms, television, radio, and social media. Learn how these consumption patterns are influencing advertising strategies and media content.
6. **Education:** Examine the educational achievements and challenges within the Latino community. Review statistics on enrollment, graduation rates, and fields of study. Understand the implications of education on economic mobility and workforce readiness.
7. **Home Ownership:** Explore trends in Latino home ownership. Understand the factors driving home buying decisions, the challenges faced by Latino homeowners, and the impact of home ownership on community stability and economic growth.
This SlideShare provides valuable insights for marketers, business owners, policymakers, and anyone interested in the economic influence of the Latino community. By understanding the various facets of Latino buying power, you can effectively engage with this dynamic and growing market segment.
Equip yourself with the knowledge to leverage Latino buying power, tap into their entrepreneurial spirit, and connect with their unique cultural and consumer preferences. Drive your business success by embracing the economic potential of Latino consumers.
**Keywords:** Latino buying power, economic impact, entrepreneurial contributions, workforce statistics, media consumption, education, home ownership, Latino market, Hispanic buying power, Latino purchasing power.
Currently pi network is not tradable on binance or any other exchange because we are still in the enclosed mainnet.
Right now the only way to sell pi coins is by trading with a verified merchant.
What is a pi merchant?
A pi merchant is someone verified by pi network team and allowed to barter pi coins for goods and services.
Since pi network is not doing any pre-sale The only way exchanges like binance/huobi or crypto whales can get pi is by buying from miners. And a merchant stands in between the exchanges and the miners.
I will leave the telegram contact of my personal pi merchant. I and my friends has traded more than 6000pi coins successfully
Tele-gram
@Pi_vendor_247
Turin Startup Ecosystem 2024 - Ricerca sulle Startup e il Sistema dell'Innov...Quotidiano Piemontese
Turin Startup Ecosystem 2024
Una ricerca de il Club degli Investitori, in collaborazione con ToTeM Torino Tech Map e con il supporto della ESCP Business School e di Growth Capital
Introduction to Indian Financial System ()Avanish Goel
The financial system of a country is an important tool for economic development of the country, as it helps in creation of wealth by linking savings with investments.
It facilitates the flow of funds form the households (savers) to business firms (investors) to aid in wealth creation and development of both the parties
Even tho Pi network is not listed on any exchange yet.
Buying/Selling or investing in pi network coins is highly possible through the help of vendors. You can buy from vendors[ buy directly from the pi network miners and resell it]. I will leave the telegram contact of my personal vendor.
@Pi_vendor_247
how can I sell pi coins after successfully completing KYCDOT TECH
Pi coins is not launched yet in any exchange 💱 this means it's not swappable, the current pi displaying on coin market cap is the iou version of pi. And you can learn all about that on my previous post.
RIGHT NOW THE ONLY WAY you can sell pi coins is through verified pi merchants. A pi merchant is someone who buys pi coins and resell them to exchanges and crypto whales. Looking forward to hold massive quantities of pi coins before the mainnet launch.
This is because pi network is not doing any pre-sale or ico offerings, the only way to get my coins is from buying from miners. So a merchant facilitates the transactions between the miners and these exchanges holding pi.
I and my friends has sold more than 6000 pi coins successfully with this method. I will be happy to share the contact of my personal pi merchant. The one i trade with, if you have your own merchant you can trade with them. For those who are new.
Message: @Pi_vendor_247 on telegram.
I wouldn't advise you selling all percentage of the pi coins. Leave at least a before so its a win win during open mainnet. Have a nice day pioneers ♥️
#kyc #mainnet #picoins #pi #sellpi #piwallet
#pinetwork
USDA Loans in California: A Comprehensive Overview.pptxmarketing367770
USDA Loans in California: A Comprehensive Overview
If you're dreaming of owning a home in California's rural or suburban areas, a USDA loan might be the perfect solution. The U.S. Department of Agriculture (USDA) offers these loans to help low-to-moderate-income individuals and families achieve homeownership.
Key Features of USDA Loans:
Zero Down Payment: USDA loans require no down payment, making homeownership more accessible.
Competitive Interest Rates: These loans often come with lower interest rates compared to conventional loans.
Flexible Credit Requirements: USDA loans have more lenient credit score requirements, helping those with less-than-perfect credit.
Guaranteed Loan Program: The USDA guarantees a portion of the loan, reducing risk for lenders and expanding borrowing options.
Eligibility Criteria:
Location: The property must be located in a USDA-designated rural or suburban area. Many areas in California qualify.
Income Limits: Applicants must meet income guidelines, which vary by region and household size.
Primary Residence: The home must be used as the borrower's primary residence.
Application Process:
Find a USDA-Approved Lender: Not all lenders offer USDA loans, so it's essential to choose one approved by the USDA.
Pre-Qualification: Determine your eligibility and the amount you can borrow.
Property Search: Look for properties in eligible rural or suburban areas.
Loan Application: Submit your application, including financial and personal information.
Processing and Approval: The lender and USDA will review your application. If approved, you can proceed to closing.
USDA loans are an excellent option for those looking to buy a home in California's rural and suburban areas. With no down payment and flexible requirements, these loans make homeownership more attainable for many families. Explore your eligibility today and take the first step toward owning your dream home.
Resume
• Real GDP growth slowed down due to problems with access to electricity caused by the destruction of manoeuvrable electricity generation by Russian drones and missiles.
• Exports and imports continued growing due to better logistics through the Ukrainian sea corridor and road. Polish farmers and drivers stopped blocking borders at the end of April.
• In April, both the Tax and Customs Services over-executed the revenue plan. Moreover, the NBU transferred twice the planned profit to the budget.
• The European side approved the Ukraine Plan, which the government adopted to determine indicators for the Ukraine Facility. That approval will allow Ukraine to receive a EUR 1.9 bn loan from the EU in May. At the same time, the EU provided Ukraine with a EUR 1.5 bn loan in April, as the government fulfilled five indicators under the Ukraine Plan.
• The USA has finally approved an aid package for Ukraine, which includes USD 7.8 bn of budget support; however, the conditions and timing of the assistance are still unknown.
• As in March, annual consumer inflation amounted to 3.2% yoy in April.
• At the April monetary policy meeting, the NBU again reduced the key policy rate from 14.5% to 13.5% per annum.
• Over the past four weeks, the hryvnia exchange rate has stabilized in the UAH 39-40 per USD range.
Falcon stands out as a top-tier P2P Invoice Discounting platform in India, bridging esteemed blue-chip companies and eager investors. Our goal is to transform the investment landscape in India by establishing a comprehensive destination for borrowers and investors with diverse profiles and needs, all while minimizing risk. What sets Falcon apart is the elimination of intermediaries such as commercial banks and depository institutions, allowing investors to enjoy higher yields.
Empowering the Unbanked: The Vital Role of NBFCs in Promoting Financial Inclu...Vighnesh Shashtri
In India, financial inclusion remains a critical challenge, with a significant portion of the population still unbanked. Non-Banking Financial Companies (NBFCs) have emerged as key players in bridging this gap by providing financial services to those often overlooked by traditional banking institutions. This article delves into how NBFCs are fostering financial inclusion and empowering the unbanked.
1. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Advanced Econometrics #4 : Quantiles and Expectiles*
A. Charpentier (Université de Rennes 1)
Université de Rennes 1,
Graduate Course, 2018.
@freakonometrics 1
2. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
References
Motivation
Machado & Mata (2005). Counterfactual decomposition of changes in wage
distributions using quantile regression, JAE.
References
Givord & d’Haultfœuillle (2013) La régression quantile en pratique, INSEE
Koenker & Bassett (1978) Regression Quantiles, Econometrica.
Koenker (2005). Quantile Regression. Cambridge University Press.
Newey & Powell (1987) Asymmetric Least Squares Estimation and Testing,
Econometrica.
@freakonometrics 2
3. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantiles
Let Y denote a random variable with cumulative distribution function F,
F(y) = P[Y ≤ y]. The quantile is
Q(u) = inf x ∈ R, F(x) > u .
@freakonometrics 3
4. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Defining halfspace depth
Given y ∈ Rd
, and a direction u ∈ Rd
, define the closed half space
Hy,u = {x ∈ Rd
such that u x ≤ u y}
and define depth at point y by
depth(y) = inf
u,u=0
{P(Hy,u)}
i.e. the smallest probability of a closed half space containing y.
The empirical version is (see Tukey (1975)
depth(y) = min
u,u=0
1
n
n
i=1
1(Xi ∈ Hy,u)
For α > 0.5, define the depth set as
Dα = {y ∈ R ∈ Rd
such that ≥ 1 − α}.
The empirical version is can be related to the bagplot, Rousseeuw et al., 1999.
@freakonometrics 4
5. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Empirical sets extremely sentive to the algorithm
−2 −1 0 1
−1.5−1.0−0.50.00.51.0
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
−2 −1 0 1
−1.5−1.0−0.50.00.51.0
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
where the blue set is the empirical estimation for Dα, α = 0.5.
@freakonometrics 5
6. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
The bagplot tool
The depth function introduced here is the multivariate extension of standard
univariate depth measures, e.g.
depth(x) = min{F(x), 1 − F(x−
)}
which satisfies depth(Qα) = min{α, 1 − α}. But one can also consider
depth(x) = 2 · F(x) · [1 − F(x−
)] or depth(x) = 1 −
1
2
− F(x) .
Possible extensions to functional bagplot. Consider a set of functions fi(x),
i = 1, · · · , n, such that
fi(x) = µ(x) +
n−1
k=1
zi,kϕk(x)
(i.e. principal component decomposition) where ϕk(·) represents the
eigenfunctions. Rousseeuw et al., 1999 considered bivariate depth on the first two
scores, xi = (zi,1, zi,2). See Ferraty & Vieu (2006).
@freakonometrics 6
7. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantiles and Quantile Regressions
Quantiles are important quantities in many
areas (inequalities, risk, health, sports, etc).
Quantiles of the N(0, 1) distribution.
@freakonometrics 7
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
q
−3 0 1 2 3
−1.645
5%
8. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
A First Model for Conditional Quantiles
Consider a location model, y = β0 + xT
β + ε i.e.
E[Y |X = x] = xT
β
then one can consider
Q(τ|X = x) = β0 + Qε(τ) + xT
β
where Qε(·) is the quantile function of the residuals.
@freakonometrics 8
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
qq
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
qq
q
q
5 10 15 20 25 30
020406080100120
speed
dist
9. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
OLS Regression, 2 norm and Expected Value
Let y ∈ Rd
, y = argmin
m∈R
n
i=1
1
n
yi − m
εi
2
. It is the empirical version of
E[Y ] = argmin
m∈R
y − m
ε
2
dF(y)
= argmin
m∈R
E Y − m
ε
2
where Y is a random variable.
Thus, argmin
m(·):Rk→R
n
i=1
1
n
yi − m(xi)
εi
2
is the empirical version of E[Y |X = x].
See Legendre (1805) Nouvelles méthodes pour la détermination des orbites des
comètes and Gauβ (1809) Theoria motus corporum coelestium in sectionibus conicis
solem ambientium.
@freakonometrics 9
10. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
OLS Regression, 2 norm and Expected Value
Sketch of proof: (1) Let h(x) =
d
i=1
(x − yi)2
, then
h (x) =
d
i=1
2(x − yi)
and the FOC yields x =
1
n
d
i=1
yi = y.
(2) If Y is continuous, let h(x) =
R
(x − y)f(y)dy and
h (x) =
∂
∂x R
(x − y)2
f(y)dy =
R
∂
∂x
(x − y)2
f(y)dy
i.e. x =
R
xf(y)dy =
R
yf(y)dy = E[Y ]
0.0 0.2 0.4 0.6 0.8 1.0
0.51.01.52.02.5
0.0 0.2 0.4 0.6 0.8 1.0
0.51.01.52.02.5
@freakonometrics 10
11. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Median Regression, 1 norm and Median
Let y ∈ Rd
, median[y] ∈ argmin
m∈R
n
i=1
1
n
yi − m
εi
. It is the empirical version of
median[Y ] ∈ argmin
m∈R
y − m
ε
dF(y)
= argmin
m∈R
E Y − m
ε
1
where Y is a random variable, P[Y ≤ median[Y ]] ≥
1
2
and P[Y ≥ median[Y ]] ≥
1
2
.
argmin
m(·):Rk→R
n
i=1
1
n
yi − m(xi)
εi
is the empirical version of median[Y |X = x].
See Boscovich (1757) De Litteraria expeditione per pontificiam ditionem ad
dimetiendos duos meridiani and Laplace (1793) Sur quelques points du système du
monde.
@freakonometrics 11
12. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Median Regression, 1 norm and Median
Sketch of proof: (1) Let h(x) =
d
i=1
|x − yi|
(2) If F is absolutely continuous, dF(x) = f(x)dx, and the
median m is solution of
m
−∞
f(x)dx =
1
2
.
Set h(y) =
+∞
−∞
|x − y|f(x)dx
=
y
−∞
(−x + y)f(x)dx +
+∞
y
(x − y)f(x)dx
Then h (y) =
y
−∞
f(x)dx −
+∞
y
f(x)dx, and FOC yields
y
−∞
f(x)dx =
+∞
y
f(x)dx = 1 −
y
−∞
f(x)dx =
1
2
0.0 0.2 0.4 0.6 0.8 1.0
1.52.02.53.03.54.0
0.0 0.2 0.4 0.6 0.8 1.0
2.02.53.03.54.0
@freakonometrics 12
13. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
OLS vs. Median Regression (Least Absolute Deviation)
Consider some linear model, yi = β0 + xT
i β + εi ,and define
(βols
0 , β
ols
) = argmin
n
i=1
yi − β0 − xT
i β
2
(βlad
0 , β
lad
) = argmin
n
i=1
yi − β0 − xT
i β
Assume that ε|X has a symmetric distribution, E[ε|X] = median[ε|X] = 0, then
(βols
0 , β
ols
) and (βlad
0 , β
lad
) are consistent estimators of (β0, β).
Assume that ε|X does not have a symmetric distribution, but E[ε|X] = 0, then
β
ols
and β
lad
are consistent estimators of the slopes β.
If median[ε|X] = γ, then βlad
0 converges to β0 + γ.
@freakonometrics 13
14. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
OLS vs. Median Regression
Median regression is stable by monotonic transformation. If
log[yi] = β0 + xT
i β + εi with median[ε|X] = 0,
then
median[Y |X = x] = exp median[log(Y )|X = x] = exp β0 + xT
i β
while
E[Y |X = x] = exp E[log(Y )|X = x] (= exp E[log(Y )|X = x] ·[exp(ε)|X = x]
1 > ols <- lm(y~x, data=df)
2 > library(quantreg)
3 > lad <- rq(y~x, data=df , tau =.5)
@freakonometrics 14
15. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Notations
Cumulative distribution function FY (y) = P[Y ≤ y].
Quantile function QX(u) = inf y ∈ R : FY (y) ≥ u ,
also noted QX(u) = F−1
X u.
One can consider QX(u) = sup y ∈ R : FY (y) < u
For any increasing transformation t, Qt(Y )(τ) = t QY (τ)
F(y|x) = P[Y ≤ y|X = x]
QY |x(u) = F−1
(u|x)
@freakonometrics 15
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
0 1 2 3 4 5
0.00.20.40.60.81.0
q
q
q
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
0 1 2 3 4 5
0.00.20.40.60.81.0
q
q
qq
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
0 1 2 3 4 5
0.00.20.40.60.81.0
q
q
17. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile regression ?
In OLS regression, we try to evaluate E[Y |X = x] =
R
ydFY |X=x(y)
In quantile regression, we try to evaluate
Qu(Y |X = x) = inf y : FY |X=x(y) ≥ u
as introduced in Newey & Powell (1987) Asymmetric Least Squares Estimation and
Testing.
Li & Racine (2007) Nonparametric Econometrics: Theory and Practice suggested
Qu(Y |X = x) = inf y : FY |X=x(y) ≥ u
where FY |X=x(y) can be some kernel-based estimator.
@freakonometrics 17
18. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantiles and Expectiles
Consider the following risk functions
Rq
τ (u) = u · τ − 1(u < 0) , τ ∈ [0, 1]
with Rq
1/2(u) ∝ |u| = u 1
, and
Re
τ (u) = u2
· τ − 1(u < 0) , τ ∈ [0, 1]
with Re
1/2(u) ∝ u2
= u 2
2
.
QY (τ) = argmin
m
E Rq
τ (Y − m)
which is the median when τ = 1/2,
EY (τ) = argmin
m
E Re
τ (X − m) }
which is the expected value when τ = 1/2.
@freakonometrics 18
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
−1.5 −1.0 −0.5 0.0 0.5 1.0 1.5
0.00.51.01.5
qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq
−1.5 −1.0 −0.5 0.0 0.5 1.0 1.5
0.00.51.01.5
19. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantiles and Expectiles
One can also write
quantile: argmin
n
i=1
ωq
τ (εi) yi − qi
εi
where ωq
τ ( ) =
1 − τ if ≤ 0
τ if > 0
expectile: argmin
n
i=1
ωe
τ (εi) yi − qi
εi
2
where ωe
τ ( ) =
1 − τ if ≤ 0
τ if > 0
Expectiles are unique, not quantiles...
Quantiles satisfy E[sign(Y − QY (τ))] = 0
Expectiles satisfy τE (Y − eY (τ))+ = (1 − τ)E (Y − eY (τ))−
(those are actually the first order conditions of the optimization problem).
@freakonometrics 19
20. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantiles and M-Estimators
There are connections with M-estimators, as introduced in Serfling (1980)
Approximation Theorems of Mathematical Statistics, chapter 7.
For any function h(·, ·), the M-functional is the solution β of
h(y, β)dFY (y) = 0
, and the M-estimator is the solution of
h(y, β)dFn(y) =
1
n
n
i=1
h(yi, β) = 0
Hence, if h(y, β) = y − β, β = E[Y ] and β = y.
And if h(y, β) = 1(y < β) − τ, with τ ∈ (0, 1), then β = F−1
Y (τ).
@freakonometrics 20
21. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantiles, Maximal Correlation and Hardy-Littlewood-Polya
If x1 ≤ · · · ≤ xn and y1 ≤ · · · ≤ yn, then
n
i=1
xiyi ≥
n
i=1
xiyσ(i), ∀σ ∈ Sn, and x
and y are said to be comonotonic.
The continuous version is that X and Y are comonotonic if
E[XY ] ≥ E[X ˜Y ] where ˜Y
L
= Y,
One can prove that
Y = QY (FX(X)) = argmax
˜Y ∼FY
E[X ˜Y ]
@freakonometrics 21
22. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Expectiles as Quantiles
For every Y ∈ L1
, τ → eY (τ) is continuous, and striclty increasing
if Y is absolutely continuous,
∂eY (τ)
∂τ
=
E[|X − eY (τ)|]
(1 − τ)FY (eY (τ)) + τ(1 − FY (eY (τ)))
if X ≤ Y , then eX(τ) ≤ eY (τ) ∀τ ∈ (0, 1)
“Expectiles have properties that are similar to quantiles” Newey & Powell (1987)
Asymmetric Least Squares Estimation and Testing. The reason is that expectiles of
a distribution F are quantiles a distribution G which is related to F, see Jones
(1994) Expectiles and M-quantiles are quantiles: let
G(t) =
P(t) − tF(t)
2[P(t) − tF(t)] + t − µ
where P(s) =
s
−∞
ydF(y).
The expectiles of F are the quantiles of G.
1 > x <- rnorm (99)
2 > library(expectreg)
3 > e <- expectile(x, probs = seq(0, 1, 0.1))
@freakonometrics 22
24. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Elicitable Measures
“elicitable” means “being a minimizer of a suitable expected score”
T is an elicatable function if there exits a scoring function S : R × R → [0, ∞)
such that
T(Y ) = argmin
x∈R R
S(x, y)dF(y) = argmin
x∈R
E S(x, Y ) where Y ∼ F.
see Gneiting (2011) Making and evaluating point forecasts.
Example: mean, T(Y ) = E[Y ] is elicited by S(x, y) = x − y 2
2
Example: median, T(Y ) = median[Y ] is elicited by S(x, y) = x − y 1
Example: quantile, T(Y ) = QY (τ) is elicited by
S(x, y) = τ(y − x)+ + (1 − τ)(y − x)−
Example: expectile, T(Y ) = EY (τ) is elicited by
S(x, y) = τ(y − x)2
+ + (1 − τ)(y − x)2
−
@freakonometrics 24
25. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Elicitable Measures
Remark: all functionals are not necessarily elicitable, see Osband (1985)
Providing incentives for better cost forecasting
The variance is not elicitable
The elicitability property implies a property which is known as convexity of the
level sets with respect to mixtures (also called Betweenness property) : if two
lotteries F, and G are equivalent, then any mixture of the two lotteries is also
equivalent with F and G.
@freakonometrics 25
26. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Empirical Quantiles
Consider some i.id. sample {y1, · · · , yn} with distribution F. Set
Qτ = argmin E Rq
τ (Y − q) where Y ∼ F and Qτ ∈ argmin
n
i=1
Rq
τ (yi − q)
Then as n → ∞
√
n Qτ − Qτ
L
→ N 0,
τ(1 − τ)
f2(Qτ )
Sketch of the proof: yi = Qτ + εi, set hn(q) =
1
n
n
i=1
1(yi < q) − τ , which is a
non-decreasing function, with
E Qτ +
u
√
n
= FY Qτ +
u
√
n
∼ fY (Qτ )
u
√
n
Var Qτ +
u
√
n
∼
FY (Qτ )[1 − FY (Qτ )]
n
=
τ(1 − τ)
n
.
@freakonometrics 26
27. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Empirical Expectiles
Consider some i.id. sample {y1, · · · , yn} with distribution F. Set
µτ = argmin E Re
τ (Y − m) where Y ∼ F and µτ = argmin
n
i=1
Re
τ (yi − m)
Then as n → ∞
√
n µτ − µτ
L
→ N 0, s2
for some s2
, if Var[Y ] < ∞. Define the identification function
Iτ (x, y) = τ(y − x)+ + (1 − τ)(y − x)− (elicitable score for quantiles)
so that µτ is solution of E I(µτ , Y ) = 0. Then
s2
=
E[I(µτ , Y )2
]
(τ[1 − F(µτ )] + [1 − τ]F(µτ ))2
.
@freakonometrics 27
29. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Geometric Properties of the Quantile Regression
Observe that the median regression will always have
two supporting observations.
Start with some regression line, yi = β0 + β1xi
Consider small translations yi = (β0 ± ) + β1xi
We minimize
n
i=1
yi − (β0 + β1xi)
From line blue, a shift up decrease the sum by
until we meet point on the left
an additional shift up will increase the sum
We will necessarily pass through one point
(observe that the sum is piecwise linear in )
−4 −2 0 2 4 6
51015
H
D
@freakonometrics 29
q
q
q
0 1 2 3 4
0246810
x
y
30. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Geometric Properties of the Quantile Regression
Consider now rotations of the line around the support
point
If we rotate up, we increase the sum of absolute differ-
ence (large impact on the point on the right)
If we rotate down, we decrease the sum, until we reach
the point on the right
Thus, the median regression will always have two sup-
portting observations.
1 > library(quantreg)
2 > fit <- rq(dist~speed , data=cars , tau =.5)
3 > which(predict(fit)== cars$dist)
4 1 21 46
5 1 21 46
−4 −2 0 2 4 6
5101520
H
D
q
q
q
0 1 2 3 4
0246810
x
y
@freakonometrics 30
q
q
q
0 1 2 3 4
0246810
x
y
q
31. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Distributional Aspects
OLS are equivalent to MLE when Y − m(x) ∼ N(0, σ2
), with density
g( ) =
1
σ
√
2π
exp −
2
2σ2
Quantile regression is equivalent to Maximum Likelihood Estimation when
Y − m(x) has an asymmetric Laplace distribution
g( ) =
√
2
σ
κ
1 + κ2
exp −
√
2κ1( >0)
σκ1( <0)
| |
@freakonometrics 31
32. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression and Iterative Least Squares
start with some β(0)
e.g. βols
at stage k :
let ε
(k)
i = yi − xT
i β(k−1)
define weights ω
(k)
i = Rτ (ε
(k)
i )
compute weighted least square to estimate β(k)
One can also consider a smooth approximation of Rq
τ (·), and then use
Newton-Raphson.
@freakonometrics 32
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
qq
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
q
qq
q
q
5 10 15 20 25
020406080100120
speed
dist
33. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Optimization Algorithm
Primal problem is
min
β,u,v
τ1T
u + (1 − τ)1T
v s.t. y = Xβ + u − v, with u, v ∈ Rn
+
and the dual version is
max
d
yT
d s.t. XT
d = (1 − τ)XT
1 with d ∈ [0, 1]n
Koenker & D’Orey (1994) A Remark on Algorithm AS 229: Computing Dual
Regression Quantiles and Regression Rank Scores suggest to use the simplex
method (default method in R)
Portnoy & Koenker (1997) The Gaussian hare and the Laplacian tortoise suggest to
use the interior point method
@freakonometrics 33
34. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
The beer problem: we want to produce beer, either blonde, or brown
barley : 14kg
corn : 2kg
price : 30e
barley : 10kg
corn : 5kg
price : 40e
barley : 280kg
corn : 100kg
Admissible sets :
10qbrown + 14qblond ≤ 280 (10x1 + 14x2 ≤ 280)
2qbrown +5qblond ≤ 100 (2x1 +5x2 ≤ 100)
What should we produce to maximize the profit ?
max 40qbrown + 30qblond (max 40x1 + 30x2 )
@freakonometrics 34
0 5 10 15 20 25 30
01020304050
Brown Beer Barrel
BlondBeerBarrel
35. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
First step: enlarge the space, 10x1 + 14x2 ≤ 280 becomes 10x1 + 14x2 − u1 = 280
(so called slack variables)
max 40x1 + 30x2
s.t. 10x1 + 14x2 + u1 = 280
s.t. 2x1 + 5x2 + u2 = 100
s.t. x1, x2, u1, u2 ≥ 0
summarized in the following table, see wikibook
x1 x2 u1 u2
(1) 10 14 1 0 280
(2) 2 5 0 1 100
max 40 30 0 0
@freakonometrics 35
36. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
Consider a linear programming problem written in a standard form.
min cT
x (1)
subject to
Ax = b , (2)
x ≥ 0 . (3)
Where x ∈ Rn
, A is a m × n matrix, b ∈ Rm
and c ∈ Rn
.
Assume that rank(A) = m (rows of A are linearly independent)
Introduce slack variables to turn inequality constraints into equality constraints
with positive unknowns : any inequality a1 x1 + · · · + an xn ≤ c can be replaced
by a1 x1 + · · · + an xn + u = c with u ≥ 0.
Replace variables which are not sign-constrained by differences : any real number
x can be written as the difference of positive numbers x = u − v with u, v ≥ 0.
@freakonometrics 36
38. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
Write the coefficients of the problem into a tableau
x1 x2 u v s1 s2 s3
1 1 −1 1 0 0 0 1
2 −1 −2 2 1 0 0 5
1 −1 0 0 0 1 0 4
0 1 1 −1 0 0 1 5
−1 −2 −3 3 0 0 0 0
with constraints on top and coefficients of the objective function are written in a
separate bottom row (with a 0 in the right hand column)
we need to choose an initial set of basic variables which corresponds to a point in
the feasible region of the linear program-ming problem.
E.g. x1 and s1, s2, s3
@freakonometrics 38
39. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
Use Gaussian elimination to (1) reduce the selected columns to a permutation of
the identity matrix (2) eliminate the coefficients of the objective function
x1 x2 u v s1 s2 s3
1 1 −1 1 0 0 0 1
0 −3 0 0 1 0 0 3
0 −2 1 −1 0 1 0 3
0 1 1 −1 0 0 1 5
0 −1 −4 4 0 0 0 1
the objective function row has at least one negative entry
@freakonometrics 39
40. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
x1 x2 u v s1 s2 s3
1 1 −1 1 0 0 0 1
0 −3 0 0 1 0 0 3
0 −2 1 −1 0 1 0 3
0 1 1 −1 0 0 1 5
0 −1 −4 4 0 0 0 1
This new basic variable is called the entering variable. Correspondingly, one
formerly basic variable has then to become nonbasic, this variable is called the
leaving variable.
@freakonometrics 40
41. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
The entering variable shall correspond to the column which has the most
negative entry in the cost function row
the most negative cost function coefficient in column 3, thus u shall be the
entering variable
The leaving variable shall be chosen as follows : Compute for each row the ratio
of its right hand coefficient to the corresponding coefficient in the entering
variable column. Select the row with the smallest finite positive ratio. The
leaving variable is then determined by the column which currently owns the pivot
in this row.
The smallest positive ratio of right hand column to entering variable column is in
row 3, as
3
1
<
5
1
. The pivot in this row points to s2 as the leaving variable.
@freakonometrics 41
43. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
After going through the Gaussian elimination once more, we arrive at
x1 x2 u v s1 s2 s3
1 −1 0 0 0 1 0 4
0 −3 0 0 1 0 0 3
0 −2 1 −1 0 1 0 3
0 3 0 0 0 −1 1 2
0 −9 0 0 0 4 0 13
Here x2 will enter and s3 will leave
@freakonometrics 43
44. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
After Gaussian elimination, we find
x1 x2 u v s1 s2 s3
1 0 0 0 0 2
3
1
3
14
3
0 0 0 0 1 −1 1 5
0 0 1 −1 0 1
3
2
3
13
3
0 1 0 0 0 −1
3
1
3
2
3
0 0 0 0 0 1 3 19
There is no more negative entry in the last row, the cost cannot be lowered
@freakonometrics 44
45. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Simplex Method
The algorithm is over, we now have to read off the solution (in the last column)
x1 =
14
3
, x2 =
2
3
, x3 = u =
13
3
, s1 = 5, v = s2 = s3 = 0
and the minimal value is −19
@freakonometrics 45
46. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Duality
Consider a transportation problem.
Some good is available at location A (at no cost) and may be transported to
locations B, C, and D according to the following directed graph
B
4
!!
3
A
2
**
1
44
D
C
5
==
On each of the edges, the unit cost of transportation is cj for j = 1, . . . , 5.
At each of the vertices, bi units of the good are sold, where i = B, C, D.
How can the transport be done most efficiently?
@freakonometrics 46
47. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Duality
Let xj denotes the amount of good transported through edge j
We have to solve
minimize {c1 x1 + · · · + c5 x5} (4)
subject to
x1 − x3 − x4 = bB , (5)
x2 + x3 − x5 = bC , (6)
x4 + x5 = bD . (7)
Constraints mean here that nothing gets lost at nodes B, C, and D, except what
is sold.
@freakonometrics 47
48. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Duality
Alternatively, instead of looking at minimizing the cost of transportation, we seek
to maximize the income from selling the good.
maximize {yB bB + yC bC + yD bD} (8)
subject to
yB − yA ≤ c1 , (9)
yC − yA ≤ c2 , (10)
yC − yB ≤ c3 , (11)
yD − yB ≤ c4 , (12)
yD − yC ≤ c5 . (13)
Constraints mean here that the price difference cannot not exceed the cost of
transportation.
@freakonometrics 48
49. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Duality
Set
x =
x1
...
x5
, y =
yB
yC
yD
, and A =
1 0 −1 −1 0
0 1 1 0 −1
0 0 0 1 1
,
The first problem - primal problem - is here
minimize {cT
x}
subject to Ax = b, x ≥ 0 .
and the second problem - dual problem - is here
maximize {yT
b}
subject to yT
A ≤ cT
.
@freakonometrics 49
50. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Duality
The minimal cost and the maximal income coincide, i.e., the two problems are
equivalent. More precisely, there is a strong duality theorem
Theorem The primal problem has a nondegenerate solution x if and only if the
dual problem has a nondegenerate solution y. And in this case yT
b = cT
x.
See Dantzig Thapa (1997) Linear Programming
@freakonometrics 50
51. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Interior Point Method
See Vanderbei et al. (1986) A modification of Karmarkar’s linear programming
algorithm for a presentation of the algorithm, Potra Wright (2000) Interior-point
methods for a general survey, and and Meketon (1986) Least absolute value
regression for an application of the algorithm in the context of median regression.
Running time is of order n1+δ
k3
for some δ 0 and k = dim(β)
(it is (n + k)k2
for OLS, see wikipedia).
@freakonometrics 51
52. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression Estimators
OLS estimator β
ols
is solution of
β
ols
= argmin E E[Y |X = x] − xT
β
2
and Angrist, Chernozhukov Fernandez-Val (2006) Quantile Regression under
Misspecification proved that
βτ = argmin E ωτ (β) Qτ [Y |X = x] − xT
β
2
(under weak conditions) where
ωτ (β) =
1
0
(1 − u)fy|x(uxT
β + (1 − u)Qτ [Y |X = x])du
βτ is the best weighted mean square approximation of the tru quantile function,
where the weights depend on an average of the conditional density of Y over xT
β
and the true quantile regression function.
@freakonometrics 52
53. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Assumptions to get Consistency of Quantile Regression Estimators
As always, we need some assumptions to have consistency of estimators.
• observations (Yi, Xi) must (conditionnaly) i.id.
• regressors must have a bounded second moment, E Xi
2
∞
• error terms ε are continuously distributed given Xi, centered in the sense
that their median should be 0,
0
−∞
fε( )d =
1
2
.
• “local identification” property : fε(0)XXT
is positive definite
@freakonometrics 53
54. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression Estimators
Under those weak conditions, βτ is asymptotically normal:
√
n(βτ − βτ )
L
→ N(0, τ(1 − τ)D−1
τ ΩxD−1
τ ),
where
Dτ = E fε(0)XXT
and Ωx = E XT
X .
hence, the asymptotic variance of β is
Var βτ =
τ(1 − τ)
[fε(0)]2
1
n
n
i=1
xT
i xi
−1
where fε(0) is estimated using (e.g.) an histogram, as suggested in Powell (1991)
Estimation of monotonic regression models under quantile restrictions, since
Dτ = lim
h↓0
E
1(|ε| ≤ h)
2h
XXT
∼
1
2nh
n
i=1
1(|εi| ≤ h)xixT
i = Dτ .
@freakonometrics 54
55. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression Estimators
There is no first order condition, in the sense ∂Vn(β, τ)/∂β = 0 where
Vn(β, τ) =
n
i=1
Rq
τ (yi − xT
i β)
There is an asymptotic first order condition,
1
√
n
n
i=1
xiψτ (yi − xT
i β) = O(1), as n → ∞,
where ψτ (·) = 1(· 0) − τ, see Huber (1967) The behavior of maximum likelihood
estimates under nonstandard conditions.
One can also define a Wald test, a Likelihood Ratio test, etc.
@freakonometrics 55
56. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression Estimators
Then the confidence interval of level 1 − α is then
βτ ± z1−α/2 Var βτ
An alternative is to use a boostrap strategy (see #2)
• generate a sample (y
(b)
i , x
(b)
i ) from (yi, xi)
• estimate β(b)
τ by
β
(b)
τ = argmin Rq
τ y
(b)
i − x
(b)T
i β
• set Var βτ =
1
B
B
b=1
β
(b)
τ − βτ
2
For confidence intervals, we can either use Gaussian-type confidence intervals, or
empirical quantiles from bootstrap estimates.
@freakonometrics 56
57. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression Estimators
If τ = (τ1, · · · , τm), one can prove that
√
n(βτ − βτ )
L
→ N(0, Στ ),
where Στ is a block matrix, with
Στi,τj
= (min{τi, τj} − τiτj)D−1
τi
ΩxD−1
τj
see Kocherginsky et al. (2005) Practical Confidence Intervals for Regression
Quantiles for more details.
@freakonometrics 57
58. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression: Transformations
Scale equivariance
For any a 0 and τ ∈ [0, 1]
ˆβτ (aY, X) = aˆβτ (Y, X) and ˆβτ (−aY, X) = −aˆβ1−τ (Y, X)
Equivariance to reparameterization of design
Let A be any p × p nonsingular matrix and τ ∈ [0, 1]
ˆβτ (Y, XA) = A−1 ˆβτ (Y, X)
@freakonometrics 58
59. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Visualization, τ → βτ
See Abreveya (2001) The effects of demographics and maternal behavior...
1 base=read.table(http:// freakonometrics .free.fr/ natality2005 .txt)
20 40 60 80
−6−4−20246
probability level (%)
AGE
10 20 30 40 50
01000200030004000500060007000
Age (of the mother) AGE
BirthWeight(ing.)
1%
5%
10%
25%
50%
75%
90%
95%
@freakonometrics 59
61. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Visualization, τ → βτ
See Abreveya (2001) The effects of demographics and maternal behavior on the
distribution of birth outcomes
20 40 60 80
−6−4−20246
probability level (%)
AGE
20 40 60 80
708090100110120130140
probability level (%)
SEXM
20 40 60 80
−200−180−160−140−120
probability level (%)
SMOKERTRUE
20 40 60 80
3.54.04.5
probability level (%)
WEIGHTGAIN
20 40 60 80
20406080
probability level (%)
COLLEGETRUE
@freakonometrics 61
62. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Visualization, τ → βτ
See Abreveya (2001) The effects of demographics and maternal behavior...
1 base=read.table(http:// freakonometrics .free.fr/BWeight.csv)
20 40 60 80
−202468
probability level (%)
mom_age
20 40 60 80
406080100120140
probability level (%)
boy
20 40 60 80
−190−180−170−160−150−140
probability level (%)
smoke
20 40 60 80
−350−300−250−200−150
probability level (%)
black
20 40 60 80
−10−505
probability level (%)
ed
@freakonometrics 62
63. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression, with Non-Linear Effects
Rents in Munich, as a function of the area, from Fahrmeir et al. (2013)
Regression: Models, Methods and Applications
1 base=read.table(http:// freakonometrics .free.fr/rent98_00. txt)
50 100 150 200 250
050010001500
Area (m2
)
Rent(euros)
50%
10%
25%
75%
90%
50 100 150 200 250
050010001500
Area (m2
)
Rent(euros)
50%
10%
25%
75%
90%
@freakonometrics 63
64. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression, with Non-Linear Effects
Rents in Munich, as a function of the year of construction, from Fahrmeir et al.
(2013) Regression: Models, Methods and Applications
1920 1940 1960 1980 2000
050010001500
Year of Construction
Rent(euros)
50%
10%
25%
75%
90%
1920 1940 1960 1980 2000
050010001500
Year of Construction
Rent(euros)
50%
10%
25%
75%
90%
@freakonometrics 64
65. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression, with Non-Linear Effects
BMI as a function of the age, in New-Zealand, from Yee (2015) Vector Generalized
Linear and Additive Models, for Women and Men
1 library(VGAMdata); data(xs.nz)
20 40 60 80 100
15202530354045
Age (Women, ethnicity = European)
BMI
5%
25%
50%
75%
95%
20 40 60 80 100
15202530354045
Age (Men, ethnicity = European)
BMI 5%
25%
50%
75%
95%
@freakonometrics 65
66. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression, with Non-Linear Effects
BMI as a function of the age, in New-Zealand, from Yee (2015) Vector Generalized
Linear and Additive Models, for Women and Men
20 40 60 80 100
15202530354045
Age (Women)
BMI
50%
95%
50%
95%
Maori
European
20 40 60 80 100
15202530354045
Age (Men)
BMI
50%
95%
Maori
European
50%
95%
@freakonometrics 66
67. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression, with Non-Linear Effects
One can consider some local polynomial quantile regression, e.g.
min
n
i=1
ωi(x)Rq
τ yi − β0 − (xi − x)T
β1
for some weights ωi(x) = H−1
K(H−1
(xi − x)), see Fan, Hu Truong (1994)
Robust Non-Parametric Function Estimation.
@freakonometrics 67
68. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Asymmetric Maximum Likelihood Estimation
Introduced by Efron (1991) Regression percentiles using asymmetric squared error
loss. Consider a linear model, yi = xT
i β + εi. Let
S(β) =
n
i=1
Qω(yi − xT
i β), where Qω( ) =
2
if ≤ 0
w 2
if 0
where w =
ω
1 − ω
One might consider ωα = 1 +
zα
ϕ(zα) + (1 − α)zα
where zα = Φ−1
(α).
Efron (1992) Poisson overdispersion estimates based on the method of asymmetric
maximum likelihood introduced asymmetric maximum likelihood (AML)
estimation, considering
S(β) =
n
i=1
Qω(yi − xT
i β), where Qω( ) =
D(yi, xT
i β) if yi ≤ xT
i β
wD(yi, xT
i β) if yi xT
i β
where D(·, ·) is the deviance. Estimation is based on Newton-Raphson (gradient
descent).
@freakonometrics 68
69. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Noncrossing Solutions
See Bondell et al. (2010) Non-crossing quantile regression curve estimation.
Consider probabilities τ = (τ1, · · · , τq) with 0 τ1 · · · τq 1.
Use parallelism : add constraints in the optimization problem, such that
xT
i βτj
≥ xT
i βτj−1
∀i ∈ {1, · · · , n}, j ∈ {2, · · · , q}.
@freakonometrics 69
70. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression on Panel Data
In the context of panel data, consider some fixed effect, αi so that
yi,t = xT
i,tβτ + αi + εi,t where Qτ (εi,t|Xi) = 0
Canay (2011) A simple approach to quantile regression for panel data suggests an
estimator in two steps,
• use a standard OLS fixed-effect model yi,t = xT
i,tβ + αi + ui,t, i.e. consider a
within transformation, and derive the fixed effect estimate β
(yi,t − yi) = xi,t − xi,t
T
β + (ui,t − ui)
• estimate fixed effects as αi =
1
T
T
t=1
yi,t − xT
i,tβ
• finally, run a standard quantile regression of yi,t − αi on xi,t’s.
See rqpd package.
@freakonometrics 70
71. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression with Fixed Effects (QRFE)
In a panel linear regression model, yi,t = xT
i,tβ + ui + εi,t,
where u is an unobserved individual specific effect.
In a fixed effects models, u is treated as a parameter. Quantile Regression is
min
β,u
i,t
Rq
α(yi,t − [xT
i,tβ + ui])
Consider Penalized QRFE, as in Koenker Bilias (2001) Quantile regression for
duration data,
min
β1,··· ,βκ,u
k,i,t
ωkRq
αk
(yi,t − [xT
i,tβk + ui]) + λ
i
|ui|
where ωk is a relative weight associated with quantile of level αk.
@freakonometrics 71
72. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression with Random Effects (QRRE)
Assume here that yi,t = xT
i,tβ + ui + εi,t
=ηi,t
.
Quantile Regression Random Effect (QRRE) yields solving
min
β
i,t
Rq
α(yi,t − xT
i,tβ)
which is a weighted asymmetric least square deviation estimator.
Let Σ = [σs,t(α)] denote the matrix
σts(α) =
α(1 − α) if t = s
E[1{εit(α) 0, εis(α) 0}] − α2
if t = s
If (nT)−1
XT
{In ⊗ΣT ×T (α)}X → D0 as n → ∞ and (nT)−1
XT
Ωf X = D1, then
√
nT β
Q
(α) − βQ
(α)
L
−→ N 0, D−1
1 D0D−1
1 .
@freakonometrics 72
73. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Treatment Effects
Doksum (1974) Empirical Probability Plots and Statistical Inference for Nonlinear
Models introduced QTE - Quantile Treatement Effect - when a person might have
two Y ’s : either Y0 (without treatment, D = 0) or Y1 (with treatement, D = 1),
δτ = QY1
(τ) − QY0
(τ)
which can be studied on the context of covariates.
Run a quantile regression of y on (d, x),
y = β0 + δd + xT
i β + εi : shifting effect
y = β0 + xT
i β + δd + εi : scaling effect
−4 −2 0 2 4
0.00.20.40.60.81.0
@freakonometrics 73
74. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Quantile Regression for Time Series
Consider some GARCH(1,1) financial time series,
yt = σtεt where σt = α0 + α1 · |yt−1| + β1σt−1.
The quantile function conditional on the past - Ft−1 = Y t−1 - is
Qy|Ft−1
(τ) = α0F−1
ε (τ)
˜α0
+ α1F−1
ε (τ)
˜α1
·|yt−1| + β1Qy|Ft−2
(τ)
i.e. the conditional quantile has a GARCH(1,1) form, see Conditional
Autoregressive Value-at-Risk, see Manganelli Engle (2004) CAViaR: Conditional
Autoregressive Value at Risk by Regression Quantiles
@freakonometrics 74
76. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Expectile Regression
Quantile regression vs. Expectile regression, on the same dataset (cars)
20 40 60 80
23456
probability level (%)
Slope(quantileregression)
20 40 60 80
23456
probability level (%)
Slope(expectileregression)
see Koenker (2014) Living Beyond our Means for a comparison quantiles-expectiles
@freakonometrics 76
77. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Expectile Regression
Solve here min
β
n
i=1
Re
τ (yi − xT
i β) where Re
τ (u) = u2
· τ − 1(u 0)
“this estimator can be interpreted as a maximum likelihood estimator when the
disturbances arise from a normal distribution with unequal weight placed on
positive and negative disturbances” Aigner, Amemiya Poirier (1976)
Formulation and Estimation of Stochastic Frontier Production Function Models.
See Holzmann Klar (2016) Expectile Asymptotics for statistical properties.
Expectiles can (also) be related to Breckling Chambers (1988) M-Quantiles.
Comparison quantile regression and expectile regression, see Schulze-Waltrup et
al. (2014) Expectile and quantile regression - David and Goliath?
@freakonometrics 77
81. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Expectile Regression, with Random Effects (ERRE)
Quantile Regression Random Effect (QRRE) yields solving
min
β
i,t
Re
α(yi,t − xT
i,tβ)
One can prove that
β
e
(τ) =
n
i=1
T
t=1
ωi,t(τ)xitxT
it
−1 n
i=1
T
t=1
ωi,t(τ)xityit ,
where ωit(τ) = τ − 1(yit xT
itβ
e
(τ)) .
@freakonometrics 81
82. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Expectile Regression with Random Effects (ERRE)
If W = diag(ω11(τ), . . . ωnT (τ)), set
W = E(W), H = XT
WX and Σ = XT
E(WεεT
W)X.
and then
√
nT β
e
(τ) − βe
(τ)
L
−→ N(0, H−1
ΣH−1
),
see Barry et al. (2016) Quantile and Expectile Regression for random effects model.
See, for expectile regressions, with R,
1 library(expectreg)
2 fit - expectreg.ls(rent_euro ~ area , data=munich , expectiles =.75)
3 fit - expectreg.ls(rent_euro ~ rb(area ,pspline), data=munich ,
expectiles =.75)
@freakonometrics 82
84. Arthur CHARPENTIER, Advanced Econometrics Graduate Course
Extensions
The mean of Y is ν(FY ) =
+∞
−∞
ydFY (y)
The quantile of level τ for Y is ντ (FY ) = F−1
Y (τ)
More generaly, consider some functional ν(F) (Gini or Theil index, entropy, etc),
see Foresi Peracchi (1995) The Conditional Distribution of Excess Returns
Can we estimate ν(FY |x) ?
Firpo et al. (2009) Unconditional Quantile Regressions suggested to use influence
function regression
Machado Mata (2005) Counterfactual decomposition of changes in wage
distributions and Chernozhukov et al. (2013) Inference on counterfactual
distributions suggested indirect distribution function.
Influence function of index ν(F) at y is
IF(y, ν, F) = lim
ε↓0
ν((1 − )F + δy) − ν(F)
@freakonometrics 84