SlideShare a Scribd company logo
In Medias Res:
Fads, Trends, Bubbles and
Massively Scaled Analyses in RTW Fashion
Thomas Ball
NYIT
March 8, 2018
Highlights
• The importance and relevance of fashion
• Growth is king
• Watersheds in strategic thought
• Massively scaled analyses in the RTW fashion ecosystem
• Modeling of fads and trends: towards a protocol
• The bottom line
The Importance And Relevance Of Fashion
Fashion may be the world‘s largest and most important creative industry
• A global business with recent annual U.S. sales of more than $250 billion -- ~2% of GDP --
larger than that of books, movies, and music combined, hardly frivolous
- Has blended into the wider arena of “Entertainment”
• Greenhouse for the analysis of fads and trends
• Provides economists, sociologists and other cultural thinkers and critics with canonical
examples of consumption, conformity and consecration
• RTW fashion data possess all the computational challenges inherent in any massive analysis
Sources: Hemphill and Suk, The Law, Culture and Economics of Fashion, 2009; Aspers and Godart, Sociology of Fashion: Order and Change, 2013
Cattani, Ferriani and Allison, Insiders, Outsiders, and the Struggle for Consecration in Cultural Fields, 2014; Teri Agins, The End of Fashion, 2000
Non Gustibus Disputandum Est
Defining Fads And Trends
Some tentative definitions – a few terms with many synonyms
• A fad is a short-term burst in behavior usually starting with explosive growth that rises to a
peak followed by slower ebbing -- analogous to froth from waves breaking on a beach
– Bubbles are closely related to fads but are usually financial in nature and refer to
unrealistic prices detached from intrinsic value -- can be both positive and negative
• A trend is a long-term or enduring influence on behavior -- analogous to open ocean waves
– The Ancients had no concept of a “trend” viewing existence as eternal and static
– Population demographics are among the most important structural drivers of trends
Wave Motion Does Not Change With Water Depth
Sources: Daniel Bell, Personal communication, 2002; Didier Sornette, Financial Crisis Observatory, ETHZ; Robert Shiller, Irrational Exuberance, 1999; Eli Pariser, The Filter Bubble, 2011
Froth
Forms
“Fads”“Trends”
Sources: http://www.theworldeconomy.org/MaddisonTables/MaddisontableB-10.pdf, http://kk.org/thetechnium/archives/2008/10/the_expansion_o.php , http://smartregion.org/2011/03/creative-class
Daniel Bell, The Coming of Post-Industrial Society, 1974; Richard Florida, The Rise of the Creative Class, 2014; Deirdre McCloskey, Bourgeois Dignity, 2012; Google Ngrams Analysis
1500 1560 1600 1650 1690 1725 1775 1800 1850 1885 1925 1965 2010
In terms of the forces of history, we find ourselves in medias res…
Growth Is King
• Exponential growth of everything since the Industrial Revolution – GDP to double by 2050
• A “Knowledge Society” emerged when the Service Sector eclipsed Manufacturing in size and
growth of occupations
• The production and flow of ideas is a primary source of growth
Wealth and Population
1-2010 AD
$0
$10,000
$20,000
$30,000
1 1000 1500 1600 1700 1820 1870 1900 1950 1970 2010
0
2
4
6
Population
Year
(Discontinuous)
U.S. Occupational Change
1800-2010
Millions Billions
Wealth
Production of Ideas
1500-2010
Year
# Books Printed
Agriculture
Manufacturing
Low Wage
Service Sector
Knowledge
Workers
Millions Employed70
60
50
40
20
30
10
0
Service
Sector
Year
~Industrial
Revolution ~Knowledge
Society
~Industrial
Revolution
~Knowledge
Society
~Knowledge
Society
Swing towards greater uncertainty and disruptions to equilibrium in normative business practices
Quantifiable Risk, Unknowable Uncertainty and The Business Landscape
Watersheds In Strategic Thought
A Clear Enough Future
What can be
known?
Linear forecasts drive strategy
Change is gradual and incremental
Sustainability
Behavior is deterministic and predictable
Conformance with intuition
Six Sigma precision
Alternate Futures
A few options define the future
Discrete choice models assign
likelihoods to outcomes
A Range of Futures
A range of possible outcomes
No natural scenarios
“The Garden of Forking Paths”
From Risk to Greater Complexity and UncertaintyLow High
1
2
3
• Anomalies regarding Porterian assumptions of sustainability of competitive advantage
• Hypercompetition in a widened arena of business operations versus myopic industry silos
• Shift from moment-based, linear models rooted in “normality” and simple iid relationships to
models exploiting nonlinearity, complex dependence, power law distributions, infinite moments,
heavy tails
True Uncertainty
Nonlinear systems dominate
Extreme shifts can occur abruptly, without warning
Transience
Behavior is deterministic but not predictable
Expectancy violations
Arbitrage in ignorance, diffidence, approximation
?
Sources: Courtney, Kirkland and Viguerie, Strategy Under Uncertainty, HBR, 1999; Richard D’Aveni, Hypercompetition, 1991; Rita McGrath, The End of Competitive Advantage, 2012
Frank Knight, Risk, Uncertainty and Profit, 1921; Nissam Taleb, Silent Risk, 2014; Embrechts, et al., Modeling Extremal Events, 1996; John Deighton, The Value of Data, 2013
Arthur de Vany, Hollywood Economics, 2003; Anita Elberse, Blockbusters, 2013; David Hand, The Improbability Principle, 2014; Sarah Kaplan, Beyond Forecasting, 2014
Cosima Shalizi, The Statistical Analysis of Complex Systems Models, 2010; Aswath Damodoran, Living with noise: Investing under uncertainty, 2013
Human Curated Decisions
R&D-Tacit Knowledge
Met Gala
Prediction Markets
Continuous Tracking
Competitive Info from Online
Comparison Engines
Web Scraping
Hiring Trends
FEEDBACK/PROPAGATE
3 Years of
Sales
Decline
“Blooming, Buzzing Confusion”
ZeitgeistVisionaries
PlaceBets
Sources and Tools
Long-
Tailed
Product?Growth
Maturity
Decline
Decelerating
Sales
Performance
RDBMS Sales Data
Fast Fashion, e.g., Zara
Marketing Spend
Social Media OSIs
Competitive Info from Online
Comparison Engines
Web Scraping
eBay
Introduction
Accelerating
Sales
0
Innovation Pipeline Sales Curves and the Product Life CycleExecution
Paris’ Premiere Visione
Text and Image Mining
Patents, Academic Papers
Film, Books, Mags, Art, etc.
VC Investments
Demographics (Youth and
Agelessness)
Tech Conferences
Blogs
Go – No Go
Visionaries Originate While Markets Imitate, Diffuse and Consecrate
Rapidly Cycling Fads And Trends, Massive Classification Of
Fashion Styles Drive Need for Massively Scaled Analysis
Evidence-Based Decision-Making
Launch
Time
Scan,Monitor,Originate,Imitate
From Uncertainty to Risk
Data Mining
Predictive Modeling
Network and Diffusion Models
Agent-Based Models
Massively Categorical Models
Machine Learning Algorithms
Recommender Systems
Sources and Tools
Manufacturing
thePortfolio
Fads, Trends And Explosive Self-Generating Demand
Unrelated phenomena such as the explosive flow of water out of a breached dam versus “fad”
behaviors in Google search activity can be seen as structural homologues
Water Flow From A Breached Dam vs “Interest” in Justin Bieber
Sources: V. Seshadri, The Inverse Gaussian Distribution, 1994; Google Trends, March 2015
0
2 5
50
75
10 0
Jan-
09
Jul-
09
Jan-
10
Jul-
10
Jan-
11
Jul-11 Jan-
12
Jul-
12
Jan-
13
Jul-
13
Jan-
14
Jul-
14
Jan-
15
“JustinBieber”GTSearchInterest
• There are at least two challenges inherent in this:
- Separating wheat from chaff or epiphenomenal flotsam and jetsam from emerging trends
- Finding scalable computational solutions for massive numbers of “Biebers”
Tracking Fads And Trends With Machine Learning Algorithms
*Word-of-mouth, open source indicators
Sources: http://www.jingdaily.com/from-social-status-to-self-expression-the-rapid-evolution-of-chinas-street-style/42059; Renee Dye, The Buzz on Buzz, 1999
Personal communications: Svante Jerling, P1.cn; Karen Moon, Trendalytics.co; Josh Clark, BoazandClark.com; David Wolfe, Doneger Group
IARPA.gov papers on OSIs, in Google search window enter “D12PC00337 OR D12PC00285 OR D12PC00347”
- Structuring unstructured information in the wilderness of data is difficult to do at scale
- “Words slip and slide and never stay in place” and so do images
• The evolution of Chinese fashion styles based on algorithmic image mining of tens of thousands
of pictures taken on the streets of Shanghai and Beijing suggests:
- Tastes may have shifted from conspicuous status statements using big logo brands such
as LVMH to niche brands
- Slowing economic growth as well as crackdowns on corruption and pirating also contributed
Text and image mining of WOM*, social media OSIs* is an analytic “Wild, Wild West”
Tracking Pictures of Handbags With Louis Vuitton Logo in China
2008-2017
Modeling Fads And Trends
Fads and trends can be quantified using models of tech and new product innovation, diffusion,
adoption and evolution rooted in the analysis of nonlinear logistic growth
Sources: Jesse Ausubel, DRAMs as Model Organisms for Study of Technological Evolution, 2001; Steven Johnson, Where Good Ideas Come From, 2010; Jonah Berger, Contagious, 2013
Peres, Muller, Mahajan, Innovation diffusion and new product growth models: A critical review and research directions, 2009
Alex Pentland, Social Physics : How good ideas spread, 2014; Julie Cohen, Configuring the Networked Self, 2012; Harrison White, Markets from Networks, 2002
Lee Cooper, Market Share Analysis, 1989; Gelman and Hill, Data Analysis Using Regression and Multi-Level Models, 2007; Singer and Willet, Applied Longitudinal Data Analysis, 2003
“Small World” social networks, e.g., “I shook Frank Sinatra’s hand,” Six Degrees of Kevin Bacon, Six Degrees of Francis Bacon
• Classic models focused on univariate time series and diffusion processes based on cumulants
of new adopters or sales, e.g., Gompertz and Bass-Anderson models, Fisher-Pry transforms
- Aggregates of individual decisions give a normative description of the adoption life cycle
- S-shaped curves identify inflection points and carrying capacities (ceilings or asymptotes)
• Recent research generalizes this framework to more complex, disaggregate, multi-level and
multivariate growth processes leveraging, e.g., pooled time series, marketing mix or multi-level
regression potentially with multiple DVs, network analysis, information theoretic frameworks, etc.
Classic Diffusion and S-Shaped Curves
Eight Generations of DRAM Chips, 1970-2000
CumulativeDRAMUnitShipments(Million)
8000
6000
4000
2000
4K
16K
64K
256K
1M
4M
16M
64M
1970 1975 1980 1985 1990 1995 2000
Year
Social Networks
Differentiating Fads From Trends: Towards A Protocol
It is possible to distinguish fads from trends using a hybrid, generalized approach
- Based on pre-determined “burn-in” periods, partition products by phases of the life cycle
- Fads – “go, no go” phase for new products with time “zero” origin and data of short duration
- Use automated, cumulant diffusion models for insight into growth, ceilings or cancellation
- Early stages of an emergent fad have the least information and are the hardest to predict
-How much information (# data points) is needed for “go, no go” decisions?
- Trends – left-censored, pre-existing products with established sales curves
- Use actual sales, not cumulative, for insights into growth rates (slope, 1st derivative) and
acceleration or momentum (Hessian, 2nd derivative, the rate of change in the slope)
0
1,000
2,000
3,000
0
100
200
300
400
500
Time
Product Sales for “Fads” and “Trends”
Left Aligned, Past 12 months Cumulative
“Fad” Products
Cumulative Sales
“Go”
“Go?”
“No Go”
Cumulative
Units
Actual
Units
Actual
“Zero” Time
Origin
Left-
Censoring
“Trend”
Product
Sales
0
25
50
75
100
-21.4
-4.6
-3.2
-2.2
-1.2
-0.2
0.8
1.8
2.8
3.8
4.8
5.8
6.8
7.9
8.9
9.9
11.0
12.2
14.1
15.8
18.8
31.2
0
20
40
60
80
-2.8 -1.3 -0.3 0.7 1.7 2.7 3.7 4.7 5.7 6.7 8.6
Classifying Trajectories Based On Growth And Acceleration
Growth
Product Growth vs Acceleration Rates
Acceleration
A comparison of growth rates (slope or 1st derivative) with the rate of acceleration in those slopes
(Hessian, 2nd derivative) suggests strong association but qualitatively distinct information
- Model accuracy may not be impacted but are the insights greater from adding momentum?
-15
-10
-5
0
5
10
15
20
25
30
35
-4 -2 0 2 4 6 8 10
ILLUSTRATIVE
Distribution of Product Acceleration Rates
(Hessian, Second Derivative)
#
#
Distribution of Product Growth Rates
(Slope, First Derivative)
“0” Points “0” Point
n~2,000
Challenges In Developing Generalized Growth Models
Is the trend really your friend?
*Heteroscedasticity, autocorrelation consistent
Sources: Ainslie and Steenburgh, Massively Categorical Variables: Revealing the information in zip codes, Marketing Science, 2002; Anita Elberse, Blockbuster, 2013
Van Den Bulte and Lilien, Bias and Systematic Change in the Parameter Estimates of Macro-Level Diffusion Models, 1997; Edward Thorpe, Beat the Dealer, 1964
Ron Gallant, Nonlinear Models, 1988; Wang, Chen, Schifano, Wu and Yan, A Survey of Statistical Methods and Computing for Big Data
Emmert-Streib and Delmer, Information Theory and Statistical Learning, 2009; Bikhchandani, Hirshleifer and Welch, A Theory of Fads, Fashion, Custom, and Cultural Change as Informational
Cascades, 1992; Wang and Zhang, Reasons for Market Evolution and Budgeting Implications, 2008; Personal communications Mike Hanssens, Gary Lilien, Renana Peres, 2015
Chattopadhyay and Lipson, Data smashing: uncovering lurking order in data, 2015; Andreas Brandmaier, pdc: An R Package for Complexity-Based Clustering of Time Series, 2014
- Univariate diffusion models are simplistic
- Don’t capture important factors such as competition or the marketing mix (ex Extended Bass)
- Prima facie issues with HAC* and nonstationarity (cf. Box-Jenkins, “p’s and q’s”)
- Designed and built for successful new products -- but most new products fail(!)
- Hybrid, generalized models leverage multi-level, pooled, marketing mix, etc., robust regression
- Handle extreme value data in the original units of the dependent variable(s)
- Incorporate information related to competitive effects, marketing spend, market or consumer
heterogeneity, social media, social networks, etc., as appropriate and available
- Find nonlinearities in momentum of growth rate (slope, 1st derivative) based on the rate of
change or acceleration in that slope (Hessian, 2nd derivative)
- Exploit endogenous and combinatoric interactions inherent in massively categorical data to
estimate, e.g., the impact on sales in the infinite nuances of colors or button shapes, sizes
- ML algorithms,e.g., Random forests, Divide and Conquer, BLJs (bags of little jacknifes) compiled
on massively parallel CPUs are approximating workarounds for scalable statistical modeling
- Track the advent of featureless, pattern matching, machine learning, complexity-based algorithms,
e.g., permutation distribution clustering or “data smashing”
The Bottom Line
How can the analysis of fads, trends and bubbles be used to enhance business performance?
• Models are calibrated on a known world and projected into an unknown, uncertain future
– Model performance can be benchmarked several ways: 1) improvement over an
incumbent method, 2) % correct prediction in a portfolio over and above random
guessing and 3) prospective (not historic) predictive accuracy
• As in Vegas, beating the house 1%-4% of the time is pretty darn good
– That is, if one beats the house at all
– Relate to key corporate metrics such as YAG sales, stock price, financial ratios, etc.
• Stronger strategic planning, analysis and inventory control of new and existing products from
the insights available in hybrid, generalized growth and diffusion analysis
– Widened set of strategic, evaluative and validatory metrics of prospective performance
that go beyond purely data-based, historic predictive accuracy
– Evaluation of impact of marketing mix and other activities on product evolution
– Use in inventory control as an aid to answering questions related to potential market
size, depth of purchase, duration and timing for when to get in or out
– Early warning for explosive product growth, negative revenue surprises
– Track cross-product elasticities and interdependence for cross-sell
• Extreme value, power law nature of information suggests changing emphasis from predicting
averages to predicting quantiles, tantiles or the value of a heavy-tailed distribution
• Shifting views of growth as smooth and linear to recognition that growth is inherently
nonlinear, inefficient, lumpy, messy
Thank You!
Thomas Ball
t112x@yahoo.com

More Related Content

Similar to In medias res: Fads, Trends and Diffusion in RTW Fashion

The Rise of Networked Individuals and Their Role in the Life of Entrepreneurs
The Rise of Networked Individuals and Their Role in the Life of EntrepreneursThe Rise of Networked Individuals and Their Role in the Life of Entrepreneurs
The Rise of Networked Individuals and Their Role in the Life of Entrepreneurs
Pew Research Center's Internet & American Life Project
 
14.15 FundForumMILLENNIALS
14.15 FundForumMILLENNIALS14.15 FundForumMILLENNIALS
14.15 FundForumMILLENNIALSBrian Byrne
 
Chris hankin tril_presentation_pdf.pptx
Chris hankin tril_presentation_pdf.pptxChris hankin tril_presentation_pdf.pptx
Chris hankin tril_presentation_pdf.pptx
Centre for Information Rights, University of Winchester, UK
 
What's Next for the Future?
What's Next for the Future?What's Next for the Future?
What's Next for the Future?
Richard Lum
 
Big Data for Development: Opportunities and Challenges, Summary Slidedeck
Big Data for Development: Opportunities and Challenges, Summary SlidedeckBig Data for Development: Opportunities and Challenges, Summary Slidedeck
Big Data for Development: Opportunities and Challenges, Summary Slidedeck
UN Global Pulse
 
Ralph schroeder and eric meyer
Ralph schroeder and eric meyerRalph schroeder and eric meyer
Ralph schroeder and eric meyeroiisdp
 
Wake me up tomorrow has already happened !
Wake me up tomorrow has already happened !Wake me up tomorrow has already happened !
Wake me up tomorrow has already happened !
suresh sood
 
Using Data for Science Journalism
Using Data for Science JournalismUsing Data for Science Journalism
Using Data for Science Journalism
Liliana Bounegru
 
Using Data for Science Journalism
Using Data for Science JournalismUsing Data for Science Journalism
Using Data for Science Journalism
Jonathan Gray
 
Big data and development
Big data and developmentBig data and development
Big data and development
Simone Sala
 
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...Katie Whipkey
 
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the BeholderMichael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson
 
Unit 7 perspectives on development
Unit 7 perspectives on development Unit 7 perspectives on development
Unit 7 perspectives on development
Nadia Gabriela Dresscher
 
Presentation - Understanding the Landscape of Disinformation in the Media Ag...
Presentation - Understanding the Landscape  of Disinformation in the Media Ag...Presentation - Understanding the Landscape  of Disinformation in the Media Ag...
Presentation - Understanding the Landscape of Disinformation in the Media Ag...
Amir Jahangir
 
Quality vs. Access case study Complete a full paper outline incl.docx
Quality vs. Access case study Complete a full paper outline incl.docxQuality vs. Access case study Complete a full paper outline incl.docx
Quality vs. Access case study Complete a full paper outline incl.docx
makdul
 
I am not a Philanthropist!
I am not a Philanthropist!I am not a Philanthropist!
I am not a Philanthropist!
Place2Give Foundation/Karma & Cents Inc.
 
Why aren't Evaluators using Digital Media Analytics?
Why aren't Evaluators using Digital Media Analytics?Why aren't Evaluators using Digital Media Analytics?
Why aren't Evaluators using Digital Media Analytics?
CesToronto
 
M-Brain business intelligence seminar Oct 7 2010 final
M-Brain business intelligence seminar Oct 7 2010 finalM-Brain business intelligence seminar Oct 7 2010 final
M-Brain business intelligence seminar Oct 7 2010 final
Mark Linder
 
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...
Saurabh Mishra
 
Methods inventory jigsaw presentation
Methods inventory jigsaw presentationMethods inventory jigsaw presentation
Methods inventory jigsaw presentation
Wendy Schultz
 

Similar to In medias res: Fads, Trends and Diffusion in RTW Fashion (20)

The Rise of Networked Individuals and Their Role in the Life of Entrepreneurs
The Rise of Networked Individuals and Their Role in the Life of EntrepreneursThe Rise of Networked Individuals and Their Role in the Life of Entrepreneurs
The Rise of Networked Individuals and Their Role in the Life of Entrepreneurs
 
14.15 FundForumMILLENNIALS
14.15 FundForumMILLENNIALS14.15 FundForumMILLENNIALS
14.15 FundForumMILLENNIALS
 
Chris hankin tril_presentation_pdf.pptx
Chris hankin tril_presentation_pdf.pptxChris hankin tril_presentation_pdf.pptx
Chris hankin tril_presentation_pdf.pptx
 
What's Next for the Future?
What's Next for the Future?What's Next for the Future?
What's Next for the Future?
 
Big Data for Development: Opportunities and Challenges, Summary Slidedeck
Big Data for Development: Opportunities and Challenges, Summary SlidedeckBig Data for Development: Opportunities and Challenges, Summary Slidedeck
Big Data for Development: Opportunities and Challenges, Summary Slidedeck
 
Ralph schroeder and eric meyer
Ralph schroeder and eric meyerRalph schroeder and eric meyer
Ralph schroeder and eric meyer
 
Wake me up tomorrow has already happened !
Wake me up tomorrow has already happened !Wake me up tomorrow has already happened !
Wake me up tomorrow has already happened !
 
Using Data for Science Journalism
Using Data for Science JournalismUsing Data for Science Journalism
Using Data for Science Journalism
 
Using Data for Science Journalism
Using Data for Science JournalismUsing Data for Science Journalism
Using Data for Science Journalism
 
Big data and development
Big data and developmentBig data and development
Big data and development
 
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
Guidance for Incorporating Big Data into Humanitarian Operations - 2015 - web...
 
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the BeholderMichael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
 
Unit 7 perspectives on development
Unit 7 perspectives on development Unit 7 perspectives on development
Unit 7 perspectives on development
 
Presentation - Understanding the Landscape of Disinformation in the Media Ag...
Presentation - Understanding the Landscape  of Disinformation in the Media Ag...Presentation - Understanding the Landscape  of Disinformation in the Media Ag...
Presentation - Understanding the Landscape of Disinformation in the Media Ag...
 
Quality vs. Access case study Complete a full paper outline incl.docx
Quality vs. Access case study Complete a full paper outline incl.docxQuality vs. Access case study Complete a full paper outline incl.docx
Quality vs. Access case study Complete a full paper outline incl.docx
 
I am not a Philanthropist!
I am not a Philanthropist!I am not a Philanthropist!
I am not a Philanthropist!
 
Why aren't Evaluators using Digital Media Analytics?
Why aren't Evaluators using Digital Media Analytics?Why aren't Evaluators using Digital Media Analytics?
Why aren't Evaluators using Digital Media Analytics?
 
M-Brain business intelligence seminar Oct 7 2010 final
M-Brain business intelligence seminar Oct 7 2010 finalM-Brain business intelligence seminar Oct 7 2010 final
M-Brain business intelligence seminar Oct 7 2010 final
 
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...
 
Methods inventory jigsaw presentation
Methods inventory jigsaw presentationMethods inventory jigsaw presentation
Methods inventory jigsaw presentation
 

Recently uploaded

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Walaa Eldin Moustafa
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
rwarrenll
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
vikram sood
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
dwreak4tg
 
Influence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business PlanInfluence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business Plan
jerlynmaetalle
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
ahzuo
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
oz8q3jxlp
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
mbawufebxi
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
slg6lamcq
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
Roger Valdez
 
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
mzpolocfi
 
State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023
kuntobimo2016
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
74nqk8xf
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
javier ramirez
 
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdfUnleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Enterprise Wired
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
sameer shah
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
jerlynmaetalle
 
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
ahzuo
 

Recently uploaded (20)

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
 
My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.My burning issue is homelessness K.C.M.O.
My burning issue is homelessness K.C.M.O.
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
 
Influence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business PlanInfluence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business Plan
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
 
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
一比一原版(Dalhousie毕业证书)达尔豪斯大学毕业证如何办理
 
State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023State of Artificial intelligence Report 2023
State of Artificial intelligence Report 2023
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
 
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdfUnleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
Unleashing the Power of Data_ Choosing a Trusted Analytics Platform.pdf
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
 
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
 

In medias res: Fads, Trends and Diffusion in RTW Fashion

  • 1. In Medias Res: Fads, Trends, Bubbles and Massively Scaled Analyses in RTW Fashion Thomas Ball NYIT March 8, 2018
  • 2. Highlights • The importance and relevance of fashion • Growth is king • Watersheds in strategic thought • Massively scaled analyses in the RTW fashion ecosystem • Modeling of fads and trends: towards a protocol • The bottom line
  • 3. The Importance And Relevance Of Fashion Fashion may be the world‘s largest and most important creative industry • A global business with recent annual U.S. sales of more than $250 billion -- ~2% of GDP -- larger than that of books, movies, and music combined, hardly frivolous - Has blended into the wider arena of “Entertainment” • Greenhouse for the analysis of fads and trends • Provides economists, sociologists and other cultural thinkers and critics with canonical examples of consumption, conformity and consecration • RTW fashion data possess all the computational challenges inherent in any massive analysis Sources: Hemphill and Suk, The Law, Culture and Economics of Fashion, 2009; Aspers and Godart, Sociology of Fashion: Order and Change, 2013 Cattani, Ferriani and Allison, Insiders, Outsiders, and the Struggle for Consecration in Cultural Fields, 2014; Teri Agins, The End of Fashion, 2000 Non Gustibus Disputandum Est
  • 4. Defining Fads And Trends Some tentative definitions – a few terms with many synonyms • A fad is a short-term burst in behavior usually starting with explosive growth that rises to a peak followed by slower ebbing -- analogous to froth from waves breaking on a beach – Bubbles are closely related to fads but are usually financial in nature and refer to unrealistic prices detached from intrinsic value -- can be both positive and negative • A trend is a long-term or enduring influence on behavior -- analogous to open ocean waves – The Ancients had no concept of a “trend” viewing existence as eternal and static – Population demographics are among the most important structural drivers of trends Wave Motion Does Not Change With Water Depth Sources: Daniel Bell, Personal communication, 2002; Didier Sornette, Financial Crisis Observatory, ETHZ; Robert Shiller, Irrational Exuberance, 1999; Eli Pariser, The Filter Bubble, 2011 Froth Forms “Fads”“Trends”
  • 5. Sources: http://www.theworldeconomy.org/MaddisonTables/MaddisontableB-10.pdf, http://kk.org/thetechnium/archives/2008/10/the_expansion_o.php , http://smartregion.org/2011/03/creative-class Daniel Bell, The Coming of Post-Industrial Society, 1974; Richard Florida, The Rise of the Creative Class, 2014; Deirdre McCloskey, Bourgeois Dignity, 2012; Google Ngrams Analysis 1500 1560 1600 1650 1690 1725 1775 1800 1850 1885 1925 1965 2010 In terms of the forces of history, we find ourselves in medias res… Growth Is King • Exponential growth of everything since the Industrial Revolution – GDP to double by 2050 • A “Knowledge Society” emerged when the Service Sector eclipsed Manufacturing in size and growth of occupations • The production and flow of ideas is a primary source of growth Wealth and Population 1-2010 AD $0 $10,000 $20,000 $30,000 1 1000 1500 1600 1700 1820 1870 1900 1950 1970 2010 0 2 4 6 Population Year (Discontinuous) U.S. Occupational Change 1800-2010 Millions Billions Wealth Production of Ideas 1500-2010 Year # Books Printed Agriculture Manufacturing Low Wage Service Sector Knowledge Workers Millions Employed70 60 50 40 20 30 10 0 Service Sector Year ~Industrial Revolution ~Knowledge Society ~Industrial Revolution ~Knowledge Society ~Knowledge Society
  • 6. Swing towards greater uncertainty and disruptions to equilibrium in normative business practices Quantifiable Risk, Unknowable Uncertainty and The Business Landscape Watersheds In Strategic Thought A Clear Enough Future What can be known? Linear forecasts drive strategy Change is gradual and incremental Sustainability Behavior is deterministic and predictable Conformance with intuition Six Sigma precision Alternate Futures A few options define the future Discrete choice models assign likelihoods to outcomes A Range of Futures A range of possible outcomes No natural scenarios “The Garden of Forking Paths” From Risk to Greater Complexity and UncertaintyLow High 1 2 3 • Anomalies regarding Porterian assumptions of sustainability of competitive advantage • Hypercompetition in a widened arena of business operations versus myopic industry silos • Shift from moment-based, linear models rooted in “normality” and simple iid relationships to models exploiting nonlinearity, complex dependence, power law distributions, infinite moments, heavy tails True Uncertainty Nonlinear systems dominate Extreme shifts can occur abruptly, without warning Transience Behavior is deterministic but not predictable Expectancy violations Arbitrage in ignorance, diffidence, approximation ? Sources: Courtney, Kirkland and Viguerie, Strategy Under Uncertainty, HBR, 1999; Richard D’Aveni, Hypercompetition, 1991; Rita McGrath, The End of Competitive Advantage, 2012 Frank Knight, Risk, Uncertainty and Profit, 1921; Nissam Taleb, Silent Risk, 2014; Embrechts, et al., Modeling Extremal Events, 1996; John Deighton, The Value of Data, 2013 Arthur de Vany, Hollywood Economics, 2003; Anita Elberse, Blockbusters, 2013; David Hand, The Improbability Principle, 2014; Sarah Kaplan, Beyond Forecasting, 2014 Cosima Shalizi, The Statistical Analysis of Complex Systems Models, 2010; Aswath Damodoran, Living with noise: Investing under uncertainty, 2013
  • 7. Human Curated Decisions R&D-Tacit Knowledge Met Gala Prediction Markets Continuous Tracking Competitive Info from Online Comparison Engines Web Scraping Hiring Trends FEEDBACK/PROPAGATE 3 Years of Sales Decline “Blooming, Buzzing Confusion” ZeitgeistVisionaries PlaceBets Sources and Tools Long- Tailed Product?Growth Maturity Decline Decelerating Sales Performance RDBMS Sales Data Fast Fashion, e.g., Zara Marketing Spend Social Media OSIs Competitive Info from Online Comparison Engines Web Scraping eBay Introduction Accelerating Sales 0 Innovation Pipeline Sales Curves and the Product Life CycleExecution Paris’ Premiere Visione Text and Image Mining Patents, Academic Papers Film, Books, Mags, Art, etc. VC Investments Demographics (Youth and Agelessness) Tech Conferences Blogs Go – No Go Visionaries Originate While Markets Imitate, Diffuse and Consecrate Rapidly Cycling Fads And Trends, Massive Classification Of Fashion Styles Drive Need for Massively Scaled Analysis Evidence-Based Decision-Making Launch Time Scan,Monitor,Originate,Imitate From Uncertainty to Risk Data Mining Predictive Modeling Network and Diffusion Models Agent-Based Models Massively Categorical Models Machine Learning Algorithms Recommender Systems Sources and Tools Manufacturing thePortfolio
  • 8. Fads, Trends And Explosive Self-Generating Demand Unrelated phenomena such as the explosive flow of water out of a breached dam versus “fad” behaviors in Google search activity can be seen as structural homologues Water Flow From A Breached Dam vs “Interest” in Justin Bieber Sources: V. Seshadri, The Inverse Gaussian Distribution, 1994; Google Trends, March 2015 0 2 5 50 75 10 0 Jan- 09 Jul- 09 Jan- 10 Jul- 10 Jan- 11 Jul-11 Jan- 12 Jul- 12 Jan- 13 Jul- 13 Jan- 14 Jul- 14 Jan- 15 “JustinBieber”GTSearchInterest • There are at least two challenges inherent in this: - Separating wheat from chaff or epiphenomenal flotsam and jetsam from emerging trends - Finding scalable computational solutions for massive numbers of “Biebers”
  • 9. Tracking Fads And Trends With Machine Learning Algorithms *Word-of-mouth, open source indicators Sources: http://www.jingdaily.com/from-social-status-to-self-expression-the-rapid-evolution-of-chinas-street-style/42059; Renee Dye, The Buzz on Buzz, 1999 Personal communications: Svante Jerling, P1.cn; Karen Moon, Trendalytics.co; Josh Clark, BoazandClark.com; David Wolfe, Doneger Group IARPA.gov papers on OSIs, in Google search window enter “D12PC00337 OR D12PC00285 OR D12PC00347” - Structuring unstructured information in the wilderness of data is difficult to do at scale - “Words slip and slide and never stay in place” and so do images • The evolution of Chinese fashion styles based on algorithmic image mining of tens of thousands of pictures taken on the streets of Shanghai and Beijing suggests: - Tastes may have shifted from conspicuous status statements using big logo brands such as LVMH to niche brands - Slowing economic growth as well as crackdowns on corruption and pirating also contributed Text and image mining of WOM*, social media OSIs* is an analytic “Wild, Wild West” Tracking Pictures of Handbags With Louis Vuitton Logo in China 2008-2017
  • 10. Modeling Fads And Trends Fads and trends can be quantified using models of tech and new product innovation, diffusion, adoption and evolution rooted in the analysis of nonlinear logistic growth Sources: Jesse Ausubel, DRAMs as Model Organisms for Study of Technological Evolution, 2001; Steven Johnson, Where Good Ideas Come From, 2010; Jonah Berger, Contagious, 2013 Peres, Muller, Mahajan, Innovation diffusion and new product growth models: A critical review and research directions, 2009 Alex Pentland, Social Physics : How good ideas spread, 2014; Julie Cohen, Configuring the Networked Self, 2012; Harrison White, Markets from Networks, 2002 Lee Cooper, Market Share Analysis, 1989; Gelman and Hill, Data Analysis Using Regression and Multi-Level Models, 2007; Singer and Willet, Applied Longitudinal Data Analysis, 2003 “Small World” social networks, e.g., “I shook Frank Sinatra’s hand,” Six Degrees of Kevin Bacon, Six Degrees of Francis Bacon • Classic models focused on univariate time series and diffusion processes based on cumulants of new adopters or sales, e.g., Gompertz and Bass-Anderson models, Fisher-Pry transforms - Aggregates of individual decisions give a normative description of the adoption life cycle - S-shaped curves identify inflection points and carrying capacities (ceilings or asymptotes) • Recent research generalizes this framework to more complex, disaggregate, multi-level and multivariate growth processes leveraging, e.g., pooled time series, marketing mix or multi-level regression potentially with multiple DVs, network analysis, information theoretic frameworks, etc. Classic Diffusion and S-Shaped Curves Eight Generations of DRAM Chips, 1970-2000 CumulativeDRAMUnitShipments(Million) 8000 6000 4000 2000 4K 16K 64K 256K 1M 4M 16M 64M 1970 1975 1980 1985 1990 1995 2000 Year Social Networks
  • 11. Differentiating Fads From Trends: Towards A Protocol It is possible to distinguish fads from trends using a hybrid, generalized approach - Based on pre-determined “burn-in” periods, partition products by phases of the life cycle - Fads – “go, no go” phase for new products with time “zero” origin and data of short duration - Use automated, cumulant diffusion models for insight into growth, ceilings or cancellation - Early stages of an emergent fad have the least information and are the hardest to predict -How much information (# data points) is needed for “go, no go” decisions? - Trends – left-censored, pre-existing products with established sales curves - Use actual sales, not cumulative, for insights into growth rates (slope, 1st derivative) and acceleration or momentum (Hessian, 2nd derivative, the rate of change in the slope) 0 1,000 2,000 3,000 0 100 200 300 400 500 Time Product Sales for “Fads” and “Trends” Left Aligned, Past 12 months Cumulative “Fad” Products Cumulative Sales “Go” “Go?” “No Go” Cumulative Units Actual Units Actual “Zero” Time Origin Left- Censoring “Trend” Product Sales
  • 12. 0 25 50 75 100 -21.4 -4.6 -3.2 -2.2 -1.2 -0.2 0.8 1.8 2.8 3.8 4.8 5.8 6.8 7.9 8.9 9.9 11.0 12.2 14.1 15.8 18.8 31.2 0 20 40 60 80 -2.8 -1.3 -0.3 0.7 1.7 2.7 3.7 4.7 5.7 6.7 8.6 Classifying Trajectories Based On Growth And Acceleration Growth Product Growth vs Acceleration Rates Acceleration A comparison of growth rates (slope or 1st derivative) with the rate of acceleration in those slopes (Hessian, 2nd derivative) suggests strong association but qualitatively distinct information - Model accuracy may not be impacted but are the insights greater from adding momentum? -15 -10 -5 0 5 10 15 20 25 30 35 -4 -2 0 2 4 6 8 10 ILLUSTRATIVE Distribution of Product Acceleration Rates (Hessian, Second Derivative) # # Distribution of Product Growth Rates (Slope, First Derivative) “0” Points “0” Point n~2,000
  • 13. Challenges In Developing Generalized Growth Models Is the trend really your friend? *Heteroscedasticity, autocorrelation consistent Sources: Ainslie and Steenburgh, Massively Categorical Variables: Revealing the information in zip codes, Marketing Science, 2002; Anita Elberse, Blockbuster, 2013 Van Den Bulte and Lilien, Bias and Systematic Change in the Parameter Estimates of Macro-Level Diffusion Models, 1997; Edward Thorpe, Beat the Dealer, 1964 Ron Gallant, Nonlinear Models, 1988; Wang, Chen, Schifano, Wu and Yan, A Survey of Statistical Methods and Computing for Big Data Emmert-Streib and Delmer, Information Theory and Statistical Learning, 2009; Bikhchandani, Hirshleifer and Welch, A Theory of Fads, Fashion, Custom, and Cultural Change as Informational Cascades, 1992; Wang and Zhang, Reasons for Market Evolution and Budgeting Implications, 2008; Personal communications Mike Hanssens, Gary Lilien, Renana Peres, 2015 Chattopadhyay and Lipson, Data smashing: uncovering lurking order in data, 2015; Andreas Brandmaier, pdc: An R Package for Complexity-Based Clustering of Time Series, 2014 - Univariate diffusion models are simplistic - Don’t capture important factors such as competition or the marketing mix (ex Extended Bass) - Prima facie issues with HAC* and nonstationarity (cf. Box-Jenkins, “p’s and q’s”) - Designed and built for successful new products -- but most new products fail(!) - Hybrid, generalized models leverage multi-level, pooled, marketing mix, etc., robust regression - Handle extreme value data in the original units of the dependent variable(s) - Incorporate information related to competitive effects, marketing spend, market or consumer heterogeneity, social media, social networks, etc., as appropriate and available - Find nonlinearities in momentum of growth rate (slope, 1st derivative) based on the rate of change or acceleration in that slope (Hessian, 2nd derivative) - Exploit endogenous and combinatoric interactions inherent in massively categorical data to estimate, e.g., the impact on sales in the infinite nuances of colors or button shapes, sizes - ML algorithms,e.g., Random forests, Divide and Conquer, BLJs (bags of little jacknifes) compiled on massively parallel CPUs are approximating workarounds for scalable statistical modeling - Track the advent of featureless, pattern matching, machine learning, complexity-based algorithms, e.g., permutation distribution clustering or “data smashing”
  • 14. The Bottom Line How can the analysis of fads, trends and bubbles be used to enhance business performance? • Models are calibrated on a known world and projected into an unknown, uncertain future – Model performance can be benchmarked several ways: 1) improvement over an incumbent method, 2) % correct prediction in a portfolio over and above random guessing and 3) prospective (not historic) predictive accuracy • As in Vegas, beating the house 1%-4% of the time is pretty darn good – That is, if one beats the house at all – Relate to key corporate metrics such as YAG sales, stock price, financial ratios, etc. • Stronger strategic planning, analysis and inventory control of new and existing products from the insights available in hybrid, generalized growth and diffusion analysis – Widened set of strategic, evaluative and validatory metrics of prospective performance that go beyond purely data-based, historic predictive accuracy – Evaluation of impact of marketing mix and other activities on product evolution – Use in inventory control as an aid to answering questions related to potential market size, depth of purchase, duration and timing for when to get in or out – Early warning for explosive product growth, negative revenue surprises – Track cross-product elasticities and interdependence for cross-sell • Extreme value, power law nature of information suggests changing emphasis from predicting averages to predicting quantiles, tantiles or the value of a heavy-tailed distribution • Shifting views of growth as smooth and linear to recognition that growth is inherently nonlinear, inefficient, lumpy, messy