SlideShare a Scribd company logo
1 of 40
Advanced Analytics and
Data Science Expertise
Iurii Milovanov
Lead Data Scientist
April, 2016
Today, SoftServe is a leading technology solutions company with 4,000 employees,
specializing in software product and application development and services.
Global Locations
29 offices
8 countries
Data Science Group
Data Science Group
Iurii Milovanov
Lead Data Scientist
Tetiana Gladkikh
Data Scientist,
Competency Manager
Roman Grubnyk
Data Scientist
Ihor Kostiuk
Data Scientist
Taras Hnot
Data Analyst
Volodymyr Solskyy
Data Analyst
Pavlo Kramarenko
Data Analyst,
BI Consultant
Core Competency
Artificial
Intelligence
State-of-the-art
Machine Learning
Deep human-level
Insight
Unstructured and
High-dimensional data
High Performance
Computing
Big Data
Apache Hadoop
Ecosystem
Data Collection
and Augmentation
Big Analytics
Real-time & Batch
Data Processing
Predictive
Analytics
Forecasting
Risk Analysis
Cluster Analysis
Decision Support
Systems
Data
Analysis
Data Exploration
Statistical Inference
Visualization
Business Intelligence
Domain-Specific Expertise
• Computer Vision – deep image and video understanding
• Natural Language Processing – human language
processing and understanding
• Speech Recognition – spoken language processing
(speech-to-text and text-to-speech)
• Social Media Analysis – web mining, behavioral analytics,
and social network analysis
• Recommender Engines – help users find content they
might like by making automatic personalized
recommendations
Data Science Toolkit
Methodology & Typical Roadmap
Initial Stage
Research
Phase
Prototyping
Data
Collection
Data
Exploration
Data
Modelling
Result
Communication
Performance
Tuning
Model
Integration
Deployment
Phase
Evaluation
Inputs:
• Problem definition
• Initial requirements
Outputs:
• Data processing model
• Final requirements
1
2
Tiny Neural Network Framework
TNNF – an open source GPU-friendly Deep Learning library developed by Data Science Group @ SoftServe
Data Science
Offerings for Business
Data Science in Retail
Business Area:
• Customer 360 view
• Product recommendation
• Direct marketing
• Opinion mining
• Sales analytics
• Logistics optimization
Improves customer and business insights, provides a deep understanding of
customer’s profile and behavior.
Data Science in Healthcare
Business Area:
• EMR processing
• Patient monitoring
• Biometric data analytics
• Decision support systems
• Computer-aided diagnosis
• Precision medicine
Helps physicians make better decisions across the board – from personalized
treatments to preventive care.
Data Science in Telecom
Business Area:
• CDR analytics
• Geospatial analysis
• Anomaly and fraud detection
• Network optimization
Applies real-time and batch predictive analytics to analyze subscriber behavior and
create individual network usage policies.
Data Science in HR
Business Area:
• Workforce analysis
• Capacity management
• Employee retention
• Talent analytics
• Resume screening
Provides a deep insight on company's employee profile in order to help HR
department in solving employee-focused challenges.
Data Science in Social Media Marketing
Business Area:
• Social profiling
• Information flow analysis
• Promotion optimization
• Community detection
• Behavioral analytics
Discovers hidden trends, patterns and relationships in social media in order to
enable micro-market campaign management, maximize engagement and optimize
social promotion strategy.
Data Science in IT & Security
Leverages ultra-large volumes of data from IT Infrastructure, improves overall
service availability and reduces time required for root cause analysis.
Business Area:
• Operations analytics • Network log analysis
• Anomaly and Intruder detection • Cloud optimization
Data Science in Finance
Gives a significant competitive advantage by incorporating new types of
unstructured and semi-unstructured data into financial decision-making, building
predictive models and live market simulations.
Business Area:
• Financial forecasting
• Price optimization
• Risk management
• Fraud detection
• Bitcoin analytics
Machine Learning
Overview
Premise of Machine Learning
Complex problems (such as image, text or
speech processing) usually are:
• High-dimensional (1000+ dimensions)
• Poorly defined, since we still don’t know how its
done in our brain
Therefore, hand-coding for such problems
suffers a 'complexity collapse' and is not really
feasible
Basic idea of Machine Learning
Training
Data
Learning
Algorithm
Model
Prediction
Engine
New
Data
Predictions
Instead of writing a program by hand, we use a set of observations to uncover an underlying
process which can be generalized to a new data
CAVEAT: Although Machine Learning has been already proved to be theoretically feasible,
we need efficient algorithms to uncover complex patterns and relationships in data
Testing
Data
AI & Deep Learning
Application Domains:
• Image Classification
• Object Recognition
• Motion Detection
• Speech-to-Text
• Emotion Recognition
• Robotics
Deep Learning – family of Machine Learning
techniques inspired by cognitive and neuroscience,
decent state-of-the-art in Artificial Intelligence
Successful applications of Deep Learning
• Apple, Google and Baidu use Deep Learning for speech
recognition
• Content recommendation engines at Amazon, Netflix
and Google highly rely on Deep Learning
• Facebook applies Deep Learning to facial detection and
recognition
• Twitter analyze their twit-database using DL techniques
• Deep Learning plays an important role in fraud
detection at PayPal
Biggest challenges in Machine Learning
• Training data
• Noisy and missing values
• Model generalization
• Non-convex optimization
• Hyperparameters tuning
• Result interpretation
• Computational resources
GPU-accelerated Computing
 Perfectly fits to iterative Machine Learning algorithms
 Gives an approximately up to 40x speedup on training time
 Inherently more energy efficient than other ways of
computation
 CUDA – general purpose processing framework developed
by NVIDIA
Where GPUs are deployed:
AI & Deep Learning
Case Studies
Case Study: X-Ray Image Recognition
Technologies:
 Matlab/Octave
 Python
 Deep Learning
 Probabilistic modeling
Business Area:
Healthcare. Computer-aided diagnosis system
(CADe) that can recognize human body part
on X-Ray image and detect broken or
fractured bones
Analytical Engine
This is a hand. Broken
bone detected
X-Ray
Image
Case Study: Image Object Recognition
Business Area:
Retail. Software solution to analyze and
recommend optimal products placement on store
shelves
Key Steps:
 Preprocessing – scaling, normalization etc.
 Segmentation – define areas of interest
 Recognition – where is the product located
 Classification – what kind of product we can see
Case Study: Smart Agents, DRLearner.org
Business Area:
DRLearner is SoftServe’s open source implementation of the
deep reinforcement learning algorithm for game playing,
invented by Google DeepMind. This is a successful approach to
mimic aspects of human brain to solve complex problems such
as autonomous car control
Techniques:
 Convolutional Neural Networks
 Reinforcement Learning
 Python
 TNNF/Theano
Big Data & Analytics
Case Studies
Case Study: Social Trends Analysis
Business Area:
Distributed solution to monitor and analyze
customers' opinion on Ukrainian banking industry
Key Steps:
 Web Crawling
 Data Transformation
 Sentiment Analysis
 Social Network Analysis (SNA)
 Time-series Analysis
 Data Visualization
Case Study: Social Trends Analysis
Learning-based Sentiment analysis:
• Collect a training set of positive and negative
examples
• Perform data cleaning and normalization on
unstructured textual data
• Build a model that generalizes to different domains
Social Network Analysis:
• Discover hidden social communities
• Perform bot-detection
• Discover social information flow
Time-series analysis:
• Calculate basic time-series statistics
• Discover hidden trends and fluctuations in time-series
• Compare time-series sequences
Case Study: Recommender Systems & SmartTraveler
Business Area:
Helps users find content they might like by
making automatic personalized
recommendations
Application Domains:
 E-commerce
 News
 Entertainment
 Social Networks
 Tourism and visitor guides
Case Study: Recommender Systems & SmartTraveler
Case Study: Log Analytics and Anomaly Detection
Business case:
• Discover hidden patterns and relationships in
Netflow logs in order to identify unusual
activity in corporate network infrastructure
Problem Statement:
Identify the items, events or observations which
do not conform to an expected pattern or
behavior
Case Study: Log Analytics and Anomaly Detection
Timestamp
Number of packets
Volume of packets (in bytes)
Source IP
Destination IP
Source port
Destination port
Protocol
Netflow Data:
Case Study: Log Analytics and Anomaly Detection
Time-Series SegmentationDynamic Thresholds
Check out our Data Science and Big Analytics web pages
For more details on our Advanced Analytics service line
USA HQ
Toll Free: 866-687-3588
Tel: +1-512-516-8880
Ukraine HQ
Tel: +380-32-240-9090
Bulgaria
Tel: +359-2-902-3760
Germany
Tel: +49-69-2602-5857
Netherlands
Tel: +31-20-262-33-23
Poland
Tel: +48-71-382-2800
UK
Tel: +44-207-544-8414
EMAIL
info@softserveinc.com
WEBSITE:
www.softserveinc.com
Thank You!

More Related Content

What's hot

Fraud Detection in Insurance with Machine Learning for WARTA - Artur Suchwalko
Fraud Detection in Insurance with Machine Learning for WARTA - Artur SuchwalkoFraud Detection in Insurance with Machine Learning for WARTA - Artur Suchwalko
Fraud Detection in Insurance with Machine Learning for WARTA - Artur SuchwalkoInstitute of Contemporary Sciences
 
Fraud detection ML
Fraud detection MLFraud detection ML
Fraud detection MLMaatougSelim
 
Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?Andrea Dal Pozzolo
 
Knowledge discovery thru data mining
Knowledge discovery thru data miningKnowledge discovery thru data mining
Knowledge discovery thru data miningDevakumar Jain
 
Machine Learning Real Life Applications By Examples
Machine Learning Real Life Applications By ExamplesMachine Learning Real Life Applications By Examples
Machine Learning Real Life Applications By ExamplesMario Cartia
 
Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...
Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...
Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...Edureka!
 
Introduction of Data Science
Introduction of Data ScienceIntroduction of Data Science
Introduction of Data ScienceJason Geng
 
How to Build a Rock-Solid Analytics and Business Intelligence Strategy
How to Build a Rock-Solid Analytics and Business Intelligence StrategyHow to Build a Rock-Solid Analytics and Business Intelligence Strategy
How to Build a Rock-Solid Analytics and Business Intelligence StrategySAP Analytics
 
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...Simplilearn
 
Introduction To Machine Learning
Introduction To Machine LearningIntroduction To Machine Learning
Introduction To Machine LearningKnoldus Inc.
 
Introduction to machine learning
Introduction to machine learningIntroduction to machine learning
Introduction to machine learningSangath babu
 
Big Data Analytics Powerpoint Presentation Slide
Big Data Analytics Powerpoint Presentation SlideBig Data Analytics Powerpoint Presentation Slide
Big Data Analytics Powerpoint Presentation SlideSlideTeam
 
Applications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesApplications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesT.S. Lim
 

What's hot (20)

Big data analytics
Big data analyticsBig data analytics
Big data analytics
 
Fraud Detection in Insurance with Machine Learning for WARTA - Artur Suchwalko
Fraud Detection in Insurance with Machine Learning for WARTA - Artur SuchwalkoFraud Detection in Insurance with Machine Learning for WARTA - Artur Suchwalko
Fraud Detection in Insurance with Machine Learning for WARTA - Artur Suchwalko
 
Big data
Big dataBig data
Big data
 
Presentation machine learning
Presentation machine learningPresentation machine learning
Presentation machine learning
 
Text MIning
Text MIningText MIning
Text MIning
 
Fraud detection ML
Fraud detection MLFraud detection ML
Fraud detection ML
 
Word embedding
Word embedding Word embedding
Word embedding
 
Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Knowledge discovery thru data mining
Knowledge discovery thru data miningKnowledge discovery thru data mining
Knowledge discovery thru data mining
 
Machine Learning Real Life Applications By Examples
Machine Learning Real Life Applications By ExamplesMachine Learning Real Life Applications By Examples
Machine Learning Real Life Applications By Examples
 
Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...
Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...
Data Science vs Machine Learning – What’s The Difference? | Data Science Cour...
 
Introduction of Data Science
Introduction of Data ScienceIntroduction of Data Science
Introduction of Data Science
 
How to Build a Rock-Solid Analytics and Business Intelligence Strategy
How to Build a Rock-Solid Analytics and Business Intelligence StrategyHow to Build a Rock-Solid Analytics and Business Intelligence Strategy
How to Build a Rock-Solid Analytics and Business Intelligence Strategy
 
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
 
Introduction To Machine Learning
Introduction To Machine LearningIntroduction To Machine Learning
Introduction To Machine Learning
 
Introduction to machine learning
Introduction to machine learningIntroduction to machine learning
Introduction to machine learning
 
Big Data Analytics Powerpoint Presentation Slide
Big Data Analytics Powerpoint Presentation SlideBig Data Analytics Powerpoint Presentation Slide
Big Data Analytics Powerpoint Presentation Slide
 
Applications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesApplications of Big Data Analytics in Businesses
Applications of Big Data Analytics in Businesses
 
Fraud Analytics
Fraud AnalyticsFraud Analytics
Fraud Analytics
 

Viewers also liked

Integrated Direct Response
Integrated Direct ResponseIntegrated Direct Response
Integrated Direct ResponseVladislav Bures
 
Papeleras Contenur
Papeleras ContenurPapeleras Contenur
Papeleras ContenurContenur
 
9 Gründe warum Creative Commons (nicht) geht
9 Gründe warum Creative Commons (nicht) geht9 Gründe warum Creative Commons (nicht) geht
9 Gründe warum Creative Commons (nicht) gehtDobusch Leonhard
 
Isomeros de clucosa y Glosario
Isomeros de clucosa y GlosarioIsomeros de clucosa y Glosario
Isomeros de clucosa y GlosarioSarita
 
Cross-border payment innovation for the caribbean
Cross-border payment innovation for the caribbeanCross-border payment innovation for the caribbean
Cross-border payment innovation for the caribbeanGermaine4IBIS
 
Consumer Insights en el Marketing: ¿qué son y cómo se generan?.
Consumer Insights en el Marketing: ¿qué son y cómo se generan?. Consumer Insights en el Marketing: ¿qué son y cómo se generan?.
Consumer Insights en el Marketing: ¿qué son y cómo se generan?. Consumer Truth - Insights & Planning
 
Marktbote2014
Marktbote2014Marktbote2014
Marktbote2014WMdN
 
Ebook
EbookEbook
Ebookcmn46
 
Newsletter Pages 1-32 April
Newsletter Pages 1-32 AprilNewsletter Pages 1-32 April
Newsletter Pages 1-32 AprilSpencer Byrd
 
DART Update September
DART Update SeptemberDART Update September
DART Update SeptemberUM_DART
 

Viewers also liked (20)

Integrated Direct Response
Integrated Direct ResponseIntegrated Direct Response
Integrated Direct Response
 
ISO_Auto&AGRANA
ISO_Auto&AGRANAISO_Auto&AGRANA
ISO_Auto&AGRANA
 
Papeleras Contenur
Papeleras ContenurPapeleras Contenur
Papeleras Contenur
 
#Redessocialesytlc
#Redessocialesytlc#Redessocialesytlc
#Redessocialesytlc
 
Tema enfermedad
Tema enfermedadTema enfermedad
Tema enfermedad
 
9 Gründe warum Creative Commons (nicht) geht
9 Gründe warum Creative Commons (nicht) geht9 Gründe warum Creative Commons (nicht) geht
9 Gründe warum Creative Commons (nicht) geht
 
Isomeros de clucosa y Glosario
Isomeros de clucosa y GlosarioIsomeros de clucosa y Glosario
Isomeros de clucosa y Glosario
 
Cross-border payment innovation for the caribbean
Cross-border payment innovation for the caribbeanCross-border payment innovation for the caribbean
Cross-border payment innovation for the caribbean
 
Problemas fisica
Problemas fisicaProblemas fisica
Problemas fisica
 
Web20 Bildung Jan08
Web20 Bildung Jan08Web20 Bildung Jan08
Web20 Bildung Jan08
 
Consumer Insights en el Marketing: ¿qué son y cómo se generan?.
Consumer Insights en el Marketing: ¿qué son y cómo se generan?. Consumer Insights en el Marketing: ¿qué son y cómo se generan?.
Consumer Insights en el Marketing: ¿qué son y cómo se generan?.
 
Diagrama de Pareto
Diagrama de Pareto Diagrama de Pareto
Diagrama de Pareto
 
Marktbote2014
Marktbote2014Marktbote2014
Marktbote2014
 
Conferencistas participantes en 10° Congreso CISC 2012
Conferencistas participantes en 10° Congreso CISC 2012Conferencistas participantes en 10° Congreso CISC 2012
Conferencistas participantes en 10° Congreso CISC 2012
 
Ebook
EbookEbook
Ebook
 
Newsletter Pages 1-32 April
Newsletter Pages 1-32 AprilNewsletter Pages 1-32 April
Newsletter Pages 1-32 April
 
Conservación del Medio Ambiente IEJVA
Conservación del Medio Ambiente IEJVAConservación del Medio Ambiente IEJVA
Conservación del Medio Ambiente IEJVA
 
Campañas RadiofóNicas
Campañas RadiofóNicasCampañas RadiofóNicas
Campañas RadiofóNicas
 
clase_9mayo_Curso Fotografia histórica (1)
clase_9mayo_Curso Fotografia histórica (1)clase_9mayo_Curso Fotografia histórica (1)
clase_9mayo_Curso Fotografia histórica (1)
 
DART Update September
DART Update SeptemberDART Update September
DART Update September
 

Similar to Advanced Analytics and Data Science Expertise

Gse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-sharedGse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-sharedcedrinemadera
 
Data science and business analytics
Data  science and business analyticsData  science and business analytics
Data science and business analyticsInbavalli Valli
 
Scaling Training Data for AI Applications
Scaling Training Data for AI ApplicationsScaling Training Data for AI Applications
Scaling Training Data for AI ApplicationsApplause
 
Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise deteo
 
Think Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceThink Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceData Science Milan
 
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017StampedeCon
 
Functionalities in AI Applications and Use Cases (OECD)
Functionalities in AI Applications and Use Cases (OECD)Functionalities in AI Applications and Use Cases (OECD)
Functionalities in AI Applications and Use Cases (OECD)AnandSRao1962
 
Civichub AI usos cívicos presentacion ignacio cabrero 20181120
Civichub AI usos cívicos presentacion ignacio cabrero 20181120Civichub AI usos cívicos presentacion ignacio cabrero 20181120
Civichub AI usos cívicos presentacion ignacio cabrero 20181120ignaciocabrero
 
Predictive Analytics: Context and Use Cases
Predictive Analytics: Context and Use CasesPredictive Analytics: Context and Use Cases
Predictive Analytics: Context and Use CasesKimberley Mitchell
 
[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...
[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...
[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...DataScienceConferenc1
 
Intro to Data Science Big Data
Intro to Data Science Big DataIntro to Data Science Big Data
Intro to Data Science Big DataIndu Khemchandani
 
An Introduction to Advanced analytics and data mining
An Introduction to Advanced analytics and data miningAn Introduction to Advanced analytics and data mining
An Introduction to Advanced analytics and data miningBarry Leventhal
 
predictive analysis and usage in procurement ppt 2017
predictive analysis and usage in procurement  ppt 2017predictive analysis and usage in procurement  ppt 2017
predictive analysis and usage in procurement ppt 2017Prashant Bhatmule
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big dataRaul Chong
 
Artificial Intelligence Primer
Artificial Intelligence PrimerArtificial Intelligence Primer
Artificial Intelligence PrimerImam Hoque
 

Similar to Advanced Analytics and Data Science Expertise (20)

Gse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-sharedGse uk-cedrinemadera-2018-shared
Gse uk-cedrinemadera-2018-shared
 
Data science and business analytics
Data  science and business analyticsData  science and business analytics
Data science and business analytics
 
Scaling Training Data for AI Applications
Scaling Training Data for AI ApplicationsScaling Training Data for AI Applications
Scaling Training Data for AI Applications
 
Big data Analytics
Big data AnalyticsBig data Analytics
Big data Analytics
 
Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise Deteo. Data science, Big Data expertise
Deteo. Data science, Big Data expertise
 
Think Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceThink Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial Intelligence
 
AI in the Enterprise at Scale
AI in the Enterprise at ScaleAI in the Enterprise at Scale
AI in the Enterprise at Scale
 
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017AI in the Enterprise: Past,  Present &  Future - StampedeCon AI Summit 2017
AI in the Enterprise: Past, Present & Future - StampedeCon AI Summit 2017
 
Functionalities in AI Applications and Use Cases (OECD)
Functionalities in AI Applications and Use Cases (OECD)Functionalities in AI Applications and Use Cases (OECD)
Functionalities in AI Applications and Use Cases (OECD)
 
Civichub AI usos cívicos presentacion ignacio cabrero 20181120
Civichub AI usos cívicos presentacion ignacio cabrero 20181120Civichub AI usos cívicos presentacion ignacio cabrero 20181120
Civichub AI usos cívicos presentacion ignacio cabrero 20181120
 
Predictive Analytics: Context and Use Cases
Predictive Analytics: Context and Use CasesPredictive Analytics: Context and Use Cases
Predictive Analytics: Context and Use Cases
 
[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...
[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...
[DSC Europe 22] On the Aspects of Artificial Intelligence and Robotic Autonom...
 
Knowledge Discovery
Knowledge DiscoveryKnowledge Discovery
Knowledge Discovery
 
Machine learning in Banks
Machine learning in BanksMachine learning in Banks
Machine learning in Banks
 
Intro to Data Science Big Data
Intro to Data Science Big DataIntro to Data Science Big Data
Intro to Data Science Big Data
 
An Introduction to Advanced analytics and data mining
An Introduction to Advanced analytics and data miningAn Introduction to Advanced analytics and data mining
An Introduction to Advanced analytics and data mining
 
predictive analysis and usage in procurement ppt 2017
predictive analysis and usage in procurement  ppt 2017predictive analysis and usage in procurement  ppt 2017
predictive analysis and usage in procurement ppt 2017
 
Analytics in Online Retail
Analytics in Online RetailAnalytics in Online Retail
Analytics in Online Retail
 
02 a holistic approach to big data
02 a holistic approach to big data02 a holistic approach to big data
02 a holistic approach to big data
 
Artificial Intelligence Primer
Artificial Intelligence PrimerArtificial Intelligence Primer
Artificial Intelligence Primer
 

More from SoftServe

Approaching Quality in Digital Era
Approaching Quality in Digital EraApproaching Quality in Digital Era
Approaching Quality in Digital EraSoftServe
 
Digital Product Security
Digital Product SecurityDigital Product Security
Digital Product SecuritySoftServe
 
Testing Tools and Tips
Testing Tools and TipsTesting Tools and Tips
Testing Tools and TipsSoftServe
 
Android Mobile Application Testing: Human Interface Guideline, Tools
Android Mobile Application Testing: Human Interface Guideline, ToolsAndroid Mobile Application Testing: Human Interface Guideline, Tools
Android Mobile Application Testing: Human Interface Guideline, ToolsSoftServe
 
Android Mobile Application Testing: Specific Functional, Performance, Device ...
Android Mobile Application Testing: Specific Functional, Performance, Device ...Android Mobile Application Testing: Specific Functional, Performance, Device ...
Android Mobile Application Testing: Specific Functional, Performance, Device ...SoftServe
 
How to Reduce Time to Market Using Microsoft DevOps Solutions
How to Reduce Time to Market Using Microsoft DevOps SolutionsHow to Reduce Time to Market Using Microsoft DevOps Solutions
How to Reduce Time to Market Using Microsoft DevOps SolutionsSoftServe
 
Containerization: The DevOps Revolution
Containerization: The DevOps Revolution Containerization: The DevOps Revolution
Containerization: The DevOps Revolution SoftServe
 
Essential Data Engineering for Data Scientist
Essential Data Engineering for Data Scientist Essential Data Engineering for Data Scientist
Essential Data Engineering for Data Scientist SoftServe
 
Rapid Prototyping for Big Data with AWS
Rapid Prototyping for Big Data with AWS Rapid Prototyping for Big Data with AWS
Rapid Prototyping for Big Data with AWS SoftServe
 
Implementing Test Automation: What a Manager Should Know
Implementing Test Automation: What a Manager Should KnowImplementing Test Automation: What a Manager Should Know
Implementing Test Automation: What a Manager Should KnowSoftServe
 
Using AWS Lambda for Infrastructure Automation and Beyond
Using AWS Lambda for Infrastructure Automation and BeyondUsing AWS Lambda for Infrastructure Automation and Beyond
Using AWS Lambda for Infrastructure Automation and BeyondSoftServe
 
Agile Big Data Analytics Development: An Architecture-Centric Approach
Agile Big Data Analytics Development: An Architecture-Centric ApproachAgile Big Data Analytics Development: An Architecture-Centric Approach
Agile Big Data Analytics Development: An Architecture-Centric ApproachSoftServe
 
Big Data as a Service: A Neo-Metropolis Model Approach for Innovation
Big Data as a Service: A Neo-Metropolis Model Approach for InnovationBig Data as a Service: A Neo-Metropolis Model Approach for Innovation
Big Data as a Service: A Neo-Metropolis Model Approach for InnovationSoftServe
 
Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...
Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...
Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...SoftServe
 
Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...
Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...
Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...SoftServe
 
Managing Requirements with Word and TFS by Max Markov
Managing Requirements with Word and TFS by Max MarkovManaging Requirements with Word and TFS by Max Markov
Managing Requirements with Word and TFS by Max MarkovSoftServe
 
How to Implement Hybrid Cloud Solutions Successfully
How to Implement Hybrid Cloud Solutions SuccessfullyHow to Implement Hybrid Cloud Solutions Successfully
How to Implement Hybrid Cloud Solutions SuccessfullySoftServe
 
Designing Big Data Systems Like a Pro
Designing Big Data Systems Like a ProDesigning Big Data Systems Like a Pro
Designing Big Data Systems Like a ProSoftServe
 
Product Management in Outsourcing by Roman Kolodchak and Roman Pavlyuk
Product Management in Outsourcing by Roman Kolodchak and Roman PavlyukProduct Management in Outsourcing by Roman Kolodchak and Roman Pavlyuk
Product Management in Outsourcing by Roman Kolodchak and Roman PavlyukSoftServe
 
From Sandbox to Production by Vadym Fedorov
From Sandbox to Production by Vadym FedorovFrom Sandbox to Production by Vadym Fedorov
From Sandbox to Production by Vadym FedorovSoftServe
 

More from SoftServe (20)

Approaching Quality in Digital Era
Approaching Quality in Digital EraApproaching Quality in Digital Era
Approaching Quality in Digital Era
 
Digital Product Security
Digital Product SecurityDigital Product Security
Digital Product Security
 
Testing Tools and Tips
Testing Tools and TipsTesting Tools and Tips
Testing Tools and Tips
 
Android Mobile Application Testing: Human Interface Guideline, Tools
Android Mobile Application Testing: Human Interface Guideline, ToolsAndroid Mobile Application Testing: Human Interface Guideline, Tools
Android Mobile Application Testing: Human Interface Guideline, Tools
 
Android Mobile Application Testing: Specific Functional, Performance, Device ...
Android Mobile Application Testing: Specific Functional, Performance, Device ...Android Mobile Application Testing: Specific Functional, Performance, Device ...
Android Mobile Application Testing: Specific Functional, Performance, Device ...
 
How to Reduce Time to Market Using Microsoft DevOps Solutions
How to Reduce Time to Market Using Microsoft DevOps SolutionsHow to Reduce Time to Market Using Microsoft DevOps Solutions
How to Reduce Time to Market Using Microsoft DevOps Solutions
 
Containerization: The DevOps Revolution
Containerization: The DevOps Revolution Containerization: The DevOps Revolution
Containerization: The DevOps Revolution
 
Essential Data Engineering for Data Scientist
Essential Data Engineering for Data Scientist Essential Data Engineering for Data Scientist
Essential Data Engineering for Data Scientist
 
Rapid Prototyping for Big Data with AWS
Rapid Prototyping for Big Data with AWS Rapid Prototyping for Big Data with AWS
Rapid Prototyping for Big Data with AWS
 
Implementing Test Automation: What a Manager Should Know
Implementing Test Automation: What a Manager Should KnowImplementing Test Automation: What a Manager Should Know
Implementing Test Automation: What a Manager Should Know
 
Using AWS Lambda for Infrastructure Automation and Beyond
Using AWS Lambda for Infrastructure Automation and BeyondUsing AWS Lambda for Infrastructure Automation and Beyond
Using AWS Lambda for Infrastructure Automation and Beyond
 
Agile Big Data Analytics Development: An Architecture-Centric Approach
Agile Big Data Analytics Development: An Architecture-Centric ApproachAgile Big Data Analytics Development: An Architecture-Centric Approach
Agile Big Data Analytics Development: An Architecture-Centric Approach
 
Big Data as a Service: A Neo-Metropolis Model Approach for Innovation
Big Data as a Service: A Neo-Metropolis Model Approach for InnovationBig Data as a Service: A Neo-Metropolis Model Approach for Innovation
Big Data as a Service: A Neo-Metropolis Model Approach for Innovation
 
Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...
Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...
Personalized Medicine in a Contemporary World by Eugene Borukhovich, SVP Heal...
 
Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...
Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...
Health 2.0 WinterTech: Will Artificial Intelligence change healthcare? by Eug...
 
Managing Requirements with Word and TFS by Max Markov
Managing Requirements with Word and TFS by Max MarkovManaging Requirements with Word and TFS by Max Markov
Managing Requirements with Word and TFS by Max Markov
 
How to Implement Hybrid Cloud Solutions Successfully
How to Implement Hybrid Cloud Solutions SuccessfullyHow to Implement Hybrid Cloud Solutions Successfully
How to Implement Hybrid Cloud Solutions Successfully
 
Designing Big Data Systems Like a Pro
Designing Big Data Systems Like a ProDesigning Big Data Systems Like a Pro
Designing Big Data Systems Like a Pro
 
Product Management in Outsourcing by Roman Kolodchak and Roman Pavlyuk
Product Management in Outsourcing by Roman Kolodchak and Roman PavlyukProduct Management in Outsourcing by Roman Kolodchak and Roman Pavlyuk
Product Management in Outsourcing by Roman Kolodchak and Roman Pavlyuk
 
From Sandbox to Production by Vadym Fedorov
From Sandbox to Production by Vadym FedorovFrom Sandbox to Production by Vadym Fedorov
From Sandbox to Production by Vadym Fedorov
 

Recently uploaded

Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfNicoChristianSunaryo
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelBoston Institute of Analytics
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...Dr Arash Najmaei ( Phd., MBA, BSc)
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...Jack Cole
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformationAnnie Melnic
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksdeepakthakur548787
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfnikeshsingh56
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaManalVerma4
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfPratikPatil591646
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etclalithasri22
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are successPratikSingh115843
 

Recently uploaded (17)

Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdf
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformation
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing works
 
Data Analysis Project: Stroke Prediction
Data Analysis Project: Stroke PredictionData Analysis Project: Stroke Prediction
Data Analysis Project: Stroke Prediction
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdf
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in India
 
2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdf
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etc
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are success
 

Advanced Analytics and Data Science Expertise

  • 1. Advanced Analytics and Data Science Expertise Iurii Milovanov Lead Data Scientist April, 2016
  • 2.
  • 3. Today, SoftServe is a leading technology solutions company with 4,000 employees, specializing in software product and application development and services.
  • 6. Data Science Group Iurii Milovanov Lead Data Scientist Tetiana Gladkikh Data Scientist, Competency Manager Roman Grubnyk Data Scientist Ihor Kostiuk Data Scientist Taras Hnot Data Analyst Volodymyr Solskyy Data Analyst Pavlo Kramarenko Data Analyst, BI Consultant
  • 7. Core Competency Artificial Intelligence State-of-the-art Machine Learning Deep human-level Insight Unstructured and High-dimensional data High Performance Computing Big Data Apache Hadoop Ecosystem Data Collection and Augmentation Big Analytics Real-time & Batch Data Processing Predictive Analytics Forecasting Risk Analysis Cluster Analysis Decision Support Systems Data Analysis Data Exploration Statistical Inference Visualization Business Intelligence
  • 8. Domain-Specific Expertise • Computer Vision – deep image and video understanding • Natural Language Processing – human language processing and understanding • Speech Recognition – spoken language processing (speech-to-text and text-to-speech) • Social Media Analysis – web mining, behavioral analytics, and social network analysis • Recommender Engines – help users find content they might like by making automatic personalized recommendations
  • 10. Methodology & Typical Roadmap Initial Stage Research Phase Prototyping Data Collection Data Exploration Data Modelling Result Communication Performance Tuning Model Integration Deployment Phase Evaluation Inputs: • Problem definition • Initial requirements Outputs: • Data processing model • Final requirements 1 2
  • 11. Tiny Neural Network Framework TNNF – an open source GPU-friendly Deep Learning library developed by Data Science Group @ SoftServe
  • 13. Data Science in Retail Business Area: • Customer 360 view • Product recommendation • Direct marketing • Opinion mining • Sales analytics • Logistics optimization Improves customer and business insights, provides a deep understanding of customer’s profile and behavior.
  • 14. Data Science in Healthcare Business Area: • EMR processing • Patient monitoring • Biometric data analytics • Decision support systems • Computer-aided diagnosis • Precision medicine Helps physicians make better decisions across the board – from personalized treatments to preventive care.
  • 15. Data Science in Telecom Business Area: • CDR analytics • Geospatial analysis • Anomaly and fraud detection • Network optimization Applies real-time and batch predictive analytics to analyze subscriber behavior and create individual network usage policies.
  • 16. Data Science in HR Business Area: • Workforce analysis • Capacity management • Employee retention • Talent analytics • Resume screening Provides a deep insight on company's employee profile in order to help HR department in solving employee-focused challenges.
  • 17. Data Science in Social Media Marketing Business Area: • Social profiling • Information flow analysis • Promotion optimization • Community detection • Behavioral analytics Discovers hidden trends, patterns and relationships in social media in order to enable micro-market campaign management, maximize engagement and optimize social promotion strategy.
  • 18. Data Science in IT & Security Leverages ultra-large volumes of data from IT Infrastructure, improves overall service availability and reduces time required for root cause analysis. Business Area: • Operations analytics • Network log analysis • Anomaly and Intruder detection • Cloud optimization
  • 19. Data Science in Finance Gives a significant competitive advantage by incorporating new types of unstructured and semi-unstructured data into financial decision-making, building predictive models and live market simulations. Business Area: • Financial forecasting • Price optimization • Risk management • Fraud detection • Bitcoin analytics
  • 21. Premise of Machine Learning Complex problems (such as image, text or speech processing) usually are: • High-dimensional (1000+ dimensions) • Poorly defined, since we still don’t know how its done in our brain Therefore, hand-coding for such problems suffers a 'complexity collapse' and is not really feasible
  • 22. Basic idea of Machine Learning Training Data Learning Algorithm Model Prediction Engine New Data Predictions Instead of writing a program by hand, we use a set of observations to uncover an underlying process which can be generalized to a new data CAVEAT: Although Machine Learning has been already proved to be theoretically feasible, we need efficient algorithms to uncover complex patterns and relationships in data Testing Data
  • 23. AI & Deep Learning Application Domains: • Image Classification • Object Recognition • Motion Detection • Speech-to-Text • Emotion Recognition • Robotics Deep Learning – family of Machine Learning techniques inspired by cognitive and neuroscience, decent state-of-the-art in Artificial Intelligence
  • 24. Successful applications of Deep Learning • Apple, Google and Baidu use Deep Learning for speech recognition • Content recommendation engines at Amazon, Netflix and Google highly rely on Deep Learning • Facebook applies Deep Learning to facial detection and recognition • Twitter analyze their twit-database using DL techniques • Deep Learning plays an important role in fraud detection at PayPal
  • 25. Biggest challenges in Machine Learning • Training data • Noisy and missing values • Model generalization • Non-convex optimization • Hyperparameters tuning • Result interpretation • Computational resources
  • 26. GPU-accelerated Computing  Perfectly fits to iterative Machine Learning algorithms  Gives an approximately up to 40x speedup on training time  Inherently more energy efficient than other ways of computation  CUDA – general purpose processing framework developed by NVIDIA Where GPUs are deployed:
  • 27. AI & Deep Learning Case Studies
  • 28. Case Study: X-Ray Image Recognition Technologies:  Matlab/Octave  Python  Deep Learning  Probabilistic modeling Business Area: Healthcare. Computer-aided diagnosis system (CADe) that can recognize human body part on X-Ray image and detect broken or fractured bones Analytical Engine This is a hand. Broken bone detected X-Ray Image
  • 29. Case Study: Image Object Recognition Business Area: Retail. Software solution to analyze and recommend optimal products placement on store shelves Key Steps:  Preprocessing – scaling, normalization etc.  Segmentation – define areas of interest  Recognition – where is the product located  Classification – what kind of product we can see
  • 30. Case Study: Smart Agents, DRLearner.org Business Area: DRLearner is SoftServe’s open source implementation of the deep reinforcement learning algorithm for game playing, invented by Google DeepMind. This is a successful approach to mimic aspects of human brain to solve complex problems such as autonomous car control Techniques:  Convolutional Neural Networks  Reinforcement Learning  Python  TNNF/Theano
  • 31. Big Data & Analytics Case Studies
  • 32. Case Study: Social Trends Analysis Business Area: Distributed solution to monitor and analyze customers' opinion on Ukrainian banking industry Key Steps:  Web Crawling  Data Transformation  Sentiment Analysis  Social Network Analysis (SNA)  Time-series Analysis  Data Visualization
  • 33. Case Study: Social Trends Analysis Learning-based Sentiment analysis: • Collect a training set of positive and negative examples • Perform data cleaning and normalization on unstructured textual data • Build a model that generalizes to different domains Social Network Analysis: • Discover hidden social communities • Perform bot-detection • Discover social information flow Time-series analysis: • Calculate basic time-series statistics • Discover hidden trends and fluctuations in time-series • Compare time-series sequences
  • 34. Case Study: Recommender Systems & SmartTraveler Business Area: Helps users find content they might like by making automatic personalized recommendations Application Domains:  E-commerce  News  Entertainment  Social Networks  Tourism and visitor guides
  • 35. Case Study: Recommender Systems & SmartTraveler
  • 36. Case Study: Log Analytics and Anomaly Detection Business case: • Discover hidden patterns and relationships in Netflow logs in order to identify unusual activity in corporate network infrastructure Problem Statement: Identify the items, events or observations which do not conform to an expected pattern or behavior
  • 37. Case Study: Log Analytics and Anomaly Detection Timestamp Number of packets Volume of packets (in bytes) Source IP Destination IP Source port Destination port Protocol Netflow Data:
  • 38. Case Study: Log Analytics and Anomaly Detection Time-Series SegmentationDynamic Thresholds
  • 39. Check out our Data Science and Big Analytics web pages For more details on our Advanced Analytics service line
  • 40. USA HQ Toll Free: 866-687-3588 Tel: +1-512-516-8880 Ukraine HQ Tel: +380-32-240-9090 Bulgaria Tel: +359-2-902-3760 Germany Tel: +49-69-2602-5857 Netherlands Tel: +31-20-262-33-23 Poland Tel: +48-71-382-2800 UK Tel: +44-207-544-8414 EMAIL info@softserveinc.com WEBSITE: www.softserveinc.com Thank You!