The document discusses trends and challenges in big data. It notes that big data is data that exceeds the processing capacity of conventional database systems due to its large size, speed, or structure. The big data market is expected to grow annually by 5-10% over the next 10 years. While the big data industry is growing rapidly, it faces shortages of big data specialists. Modern big data specialists need a combination of mathematical, programming, business, and communication skills.

1. Andrey Kazarinov
HSE, Big Data Systems
Big Data
trends & Challenges

2. 2
http://bit.ly/1xdCxbY
Data scientists want to build
things, not just give advice.
One describes being a
consultant as “the dead zone.”
Data scientists today are akin
to the Wall Street “quants” of
the 1980s and 1990s.
HBR: Data Scientist is the sexiest job of 21st century

3. 3
Big Data is data that exceeds the
processing capacity of conventional
database systems. The data is too big,
moves too fast, or doesn’t fit the structures
of your database architecture. To gain
value from this data, you must choose an
alternative way to process it
Ed Dumbill, O’Reilly

4. 4
Big Data market will annually grow 5-10% in the next 10 years
Russian market in 2015 is $350-500M (2%) with the 40% growth rate

5. 5Rapid growth of Big Data industry faces with the shortage of Big
Data specialists on the market
Number of data scientists jobs nearly doubled in 2015 and expected to
increase by 70% in 2016

6. 6Modern Big Data specialist should combine mathematical,
programming, business and communication skill
Business
Programming Mathematics
Communication
Big Data specialists are highly demanded on the market

7. 7
Data is growing at 40% annually, reaching nearly 44 ZB by 2020
44
Exponential growth of data requires new methods of collecting,
storing and processing data
X 300044ZB =

8. 8Big data came through all the stages of innovation and became a
mature tool for improving business
Source: Hype Cycle Gartner
2014
2015
2012
2013
Gartner’s hype cycle for emerging technologies 2012-2015
Big Data technology can help business in various fields

9. 9
Adjustment to the consumers’ preferences and enhancement of
customer experience will be the the most vital tasks for Big Data
Big Data creates vast opportunities to improve business, especially
customer experience

10. 10Increased accessibility has created an expectation that Millennials can
have whatever they want whenever they want it
Big Data development will be driven by consumer demand

11. 11
Big Data 2025 – Driven by consumer demand
Next generation of sharing economy
1
2
3
E-commerce efficiency
Connected and self-driving cars

12. 12
Conclusions
Business can be not ready for radical changes
1. unclear short-run benefits
2. huge investments
3. scattered IT environment
1
2
3
4
Neglect of qualified specialists
Unavailability of Big Data technologies
Big Data grows in near future will be mostly driven by
consumer demand

13. 13
Thank you!