SlideShare a Scribd company logo
Schneider Electric –Telvent Global Services – 2014 
TELVENT 
Telvent Global Services 
TSIUC’14 
Retos en Big Data en la Universidad y la Investigación 
Telvent Big Data Approach and Case Studies
TELVENT 
Schneider Electric –- Telvent Global Services – 2014 
Introduction
Schneider Electric 
–- Telvent Global Services – 2014 
Bringing together IT with OT to increase business performance through: Consulting, Integration and Outsourcing Services 
Our Mission: Technology Integration & Real Time Architectures 
+250 end customers worldwide in 2013 
More than 30,000 m2 of Data Centers managed 
24/7 IT Support for more than +30,000 users 
+1,500 Network devices 
+5,000 Servers 
+3.5 Managed Pbyte 
+250 VHost 
About Telvent ….
TELVENT 
Schneider Electric –- Telvent Global Services – 2014 
Big Data
Schneider Electric 
–- Telvent Global Services – 2014 
Requirements…. 
Today, data business needs to satisfy 4 characteristics: 
Solution: BIG DATA
Schneider Electric 
–- Telvent Global Services – 2014 
Consulting Services 
Managed 
Services 
Big Data Landscape 
Data Collection 
Communications 
& Networks 
Data Centers & 
Critical Infrastructures 
Applications & Business Processes 
IT Systems 
DataProcessing 
DataAnalytics 
Managed 
Services 
Consulting Services 
Integration 
Services
TELVENT 
Schneider Electric –- Telvent Global Services – 2014 
Telvent Case Studies
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study I 
Bottleneck 
Background 
Carriers must save all the information related to the phone calls and navigation (CDRs) due to a new regulation law. 
IT Architecture 
Architecture was based on a relational database that manages more than 50 TB of data. Capacity planning expects to triple the data in less than two years. 
Options Analyzed
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study ISolution 
•Exadata was rejected due to its cost and performance. 
•Hadoop cluster design and implementation in order to save and manage all the traffic coming from the calls and navigation. 
•Relational database is only used for reporting and dashboard. Its size is limited to 5TB
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study IIBackground 
•Carriers must save all the information related to an user navigation (Public IP and private IP) due to a new regulation law. 
Options Analyzed 
IT Architecture 
•There is a Teradata database but it has not enough capacity, so investment is needed. 
•Architecture was not implemented yet, but it has been estimated that it would be needed more than 600TB in normal storage.
Schneider Electric –- Telvent Global Services – 2014 
Case Study II 
Hadoop as a Service 
Front End 
Routers Acceso 
Plataforma IaaS 
Telvent 
Servidor 
Integrador 
(TGC) 
Back End 
Cluster 
namenodes 
Crecimiento Neto 
garantizado 
Cluster 
Datanodes 
Servidor 
Monitorización 
(TGC) 
Solution 
• Hadoop cluster that assure a response time of 60 seconds per user. 
• Web Application development that let the user make their requests.
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study IIIBackground 
•Marketing department needs a platform that help it to know, what products are the most suitable for each person  User Segmentation, looking for a pattern on behavior. 
•High security protocols due to the level of confidentiality needed. IT Architecture 
•Current database has not enough process power. 
•BI system are not so effective in predictions but analyzing past data.
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study IIISolution 
•Working with a partner for the analytics scope. 
•SPARK service use by data analyst, working on cluster memory. . 
•Firstly a dedicated platform and once they test it, we transform the service to “Telvent Hadoop as a Service.” 
• Volume: 5 TB 
•New potential users appears once Big data si working.
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study IVBackground 
•In “Free-Flow” motorways there is a platform that takes a picture to each user that crosses the toll. With this image and using OCR systems, it is recognized the 'number plate' and then, it is searched its bank account associated  So, no vehicle has to stop at toll. Scope 
•Number of images: 1.300.000.000 
•Image size: From 90K to150K 
•Retention: From 1 to 5 years IT Architecture 
•SAMFS solution 
•Based on a hierarchical storage that only keeps online the images for the last 6 months. The previous images are saved in tapes 
Restricted
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study IVIT Architecture 
•New platform based on Hadoop, composed by 8 servers (namenodes and datanodes) and 384 GB RAM. 
•New platform allows the company to keep all the images online. Current hierarchical storage disappears Advantages 
•Efficiency in fraud management default improved. 
•Performance in image processing improved. 
•Every sattelite application can be centralized 
Restricted
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study VBackground 
•New Smart Meters are managed from a centralized platform, that should be able to receive and send information to each one. Also, all the information (measures) has to be recorded, at least, for two years. Scope: 
•.More than 11 M smart meters  1 measure per hour  198.000 M measures 
• Platform should be used also like a dashboard IT Architecture: 
• Current IT Infrastructure is mainly Oracle 
Restricted
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study VIT Architecture 
•Exadata infrastructure provisioning. This solutions was considered the best due to its performance for: 
•Data loading (it receives lots of measures) 
•Requests (Ex: repeat the measure, change de power, electricity switch off …). Proof of Concept 
•Based on smart meter remote management, switch off about 100.000 homes in 40 minutes.
TELVENT 
Schneider Electric –- Telvent Global Services – 2014 
Education
Schneider Electric 
–- Telvent Global Services – 2014 
Case Study 
•Recomendador de documentación para un alumno basado en datos de otros alumnos con el mismo perfil (Filtro colaborativo) 
•Previsión y planificación de recursos internos de la universidad en función de variables oferta/demanda (Forecast) 
•Segmentación de alumnos en función de las campañas de marketing lanzadas (Clustering) 
• Alumno  Alumno; cruce de búsqueda para usuarios similares que compartan experiencias con los nuevos alumnos 
•Dimensionamiento servicio y calidad del servicio. Estimación de llamadas Call Center 
•Detección de abandono /suspenso de una alumno de un curso (Decisor)
Schneider Electric 
–- Telvent Global Services – 2014 
Conclusions 
The growth of digital information and the need to manage and analyze the data will not change its exponential path (both structured and unstructured). Usual tools, applications, or databases does not work with this amount of data. Business requeriments: 
•Cost reductions 
•Time reductions 
•New product development and optimized offerings 
•Smarter business decision making 
Big Data is a new way to face IT Infrastructure problems 
IT Transformation
TELVENT 
Make the most of 
your energy™ 
Marta de Mesa Rincón – Solution Consulting Director 
Marta.demesa@telvent.com 
Jesús Gironda Díaz – Open System Manager 
Jesus.gironda@telvent.com

More Related Content

What's hot

What's hot (19)

Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
 
Making Enterprise Big Data Small with Ease
Making Enterprise Big Data Small with EaseMaking Enterprise Big Data Small with Ease
Making Enterprise Big Data Small with Ease
 
Yield Improvement Through Data Analysis using TIBCO Spotfire
Yield Improvement Through Data Analysis using TIBCO SpotfireYield Improvement Through Data Analysis using TIBCO Spotfire
Yield Improvement Through Data Analysis using TIBCO Spotfire
 
Postgres Vision 2018: How to Consume your Database Platform On-premises
Postgres Vision 2018: How to Consume your Database Platform On-premisesPostgres Vision 2018: How to Consume your Database Platform On-premises
Postgres Vision 2018: How to Consume your Database Platform On-premises
 
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use CasesGlobal Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
Global Big Data Conference Hyderabad-2Aug2013- Finance/Manufacturing Use Cases
 
Data Center Site Selection
Data Center Site SelectionData Center Site Selection
Data Center Site Selection
 
Embedding Insight through Prediction Driven Logistics
Embedding Insight through Prediction Driven LogisticsEmbedding Insight through Prediction Driven Logistics
Embedding Insight through Prediction Driven Logistics
 
Databricks University Alliance Meetup - Data + AI Summit EU 2020
Databricks University Alliance Meetup - Data + AI Summit EU 2020Databricks University Alliance Meetup - Data + AI Summit EU 2020
Databricks University Alliance Meetup - Data + AI Summit EU 2020
 
Handling Big Data in Ship Performance & Navigation Monitoring.
Handling Big Data in Ship Performance & Navigation Monitoring.Handling Big Data in Ship Performance & Navigation Monitoring.
Handling Big Data in Ship Performance & Navigation Monitoring.
 
Penguin Computing Designing and Deploying End to End HPC and AI Solutions
Penguin Computing Designing and Deploying End to End HPC and AI SolutionsPenguin Computing Designing and Deploying End to End HPC and AI Solutions
Penguin Computing Designing and Deploying End to End HPC and AI Solutions
 
The Single Most Important Formula for Business Success
The Single Most Important Formula for Business SuccessThe Single Most Important Formula for Business Success
The Single Most Important Formula for Business Success
 
ttec - ParStream
ttec - ParStreamttec - ParStream
ttec - ParStream
 
Momentum in Big Data, IoT and Machine Intelligence
Momentum in Big Data, IoT and Machine IntelligenceMomentum in Big Data, IoT and Machine Intelligence
Momentum in Big Data, IoT and Machine Intelligence
 
Big data analytics and machine intelligence v5.0
Big data analytics and machine intelligence   v5.0Big data analytics and machine intelligence   v5.0
Big data analytics and machine intelligence v5.0
 
Big data and Blockchain in HealthIT
Big data and Blockchain in HealthITBig data and Blockchain in HealthIT
Big data and Blockchain in HealthIT
 
Michael Hummel - Stop Storing Data! - Parstream
Michael Hummel - Stop Storing Data! - ParstreamMichael Hummel - Stop Storing Data! - Parstream
Michael Hummel - Stop Storing Data! - Parstream
 
Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense
Delivering Real-Time Streaming Data for Healthcare Customers: ClearsenseDelivering Real-Time Streaming Data for Healthcare Customers: Clearsense
Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense
 
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
How a Media Data Platform Drives Real-time Insights & Analytics using Apache ...
 
The New and Improved Partner Program
The New and Improved Partner ProgramThe New and Improved Partner Program
The New and Improved Partner Program
 

Similar to Telvent Big Data Approach and Case Studies

Monetizing Big Data at Telecom Service Providers
Monetizing Big Data at Telecom Service ProvidersMonetizing Big Data at Telecom Service Providers
Monetizing Big Data at Telecom Service Providers
DataWorks Summit
 
REP.01 NETW3205 Network Management
REP.01 NETW3205 Network ManagementREP.01 NETW3205 Network Management
REP.01 NETW3205 Network Management
Ricardo Pereira
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
Paul Barsch
 
Smart Enterprise Big Data Bus for the Modern Responsive Enterprise
Smart Enterprise Big Data Bus for the Modern Responsive EnterpriseSmart Enterprise Big Data Bus for the Modern Responsive Enterprise
Smart Enterprise Big Data Bus for the Modern Responsive Enterprise
DataWorks Summit
 
UnitOnePresentationSlides.pptx
UnitOnePresentationSlides.pptxUnitOnePresentationSlides.pptx
UnitOnePresentationSlides.pptx
BLACKSPAROW
 
Cyient-APAC FTTH Show Presentation_Kiran Solipuram
Cyient-APAC FTTH Show Presentation_Kiran SolipuramCyient-APAC FTTH Show Presentation_Kiran Solipuram
Cyient-APAC FTTH Show Presentation_Kiran Solipuram
Kiran Solipuram. DEP, CFHP
 

Similar to Telvent Big Data Approach and Case Studies (20)

Hadoop and Your Enterprise Data Warehouse
Hadoop and Your Enterprise Data WarehouseHadoop and Your Enterprise Data Warehouse
Hadoop and Your Enterprise Data Warehouse
 
High Scalability Network Performance Management for Enterprises
High Scalability Network Performance Management for EnterprisesHigh Scalability Network Performance Management for Enterprises
High Scalability Network Performance Management for Enterprises
 
th1330-1410effectenbeurszaal4-3v2-140424180955-phpapp01 (1).pdf
th1330-1410effectenbeurszaal4-3v2-140424180955-phpapp01 (1).pdfth1330-1410effectenbeurszaal4-3v2-140424180955-phpapp01 (1).pdf
th1330-1410effectenbeurszaal4-3v2-140424180955-phpapp01 (1).pdf
 
Monetizing Big Data at Telecom Service Providers
Monetizing Big Data at Telecom Service ProvidersMonetizing Big Data at Telecom Service Providers
Monetizing Big Data at Telecom Service Providers
 
RECAP at ETSI Experiential Network Intelligence (ENI) Meeting
RECAP at ETSI Experiential Network Intelligence (ENI) MeetingRECAP at ETSI Experiential Network Intelligence (ENI) Meeting
RECAP at ETSI Experiential Network Intelligence (ENI) Meeting
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
 
REP.01 NETW3205 Network Management
REP.01 NETW3205 Network ManagementREP.01 NETW3205 Network Management
REP.01 NETW3205 Network Management
 
GraphTalk Berlin - Einführung in Graphdatenbanken
GraphTalk Berlin - Einführung in GraphdatenbankenGraphTalk Berlin - Einführung in Graphdatenbanken
GraphTalk Berlin - Einführung in Graphdatenbanken
 
Big Data Case study - caixa bank
Big Data Case study - caixa bankBig Data Case study - caixa bank
Big Data Case study - caixa bank
 
Digital Business Transformation for Energy & Utility company
Digital Business Transformation for Energy & Utility companyDigital Business Transformation for Energy & Utility company
Digital Business Transformation for Energy & Utility company
 
Harnessing Big Data_UCLA
Harnessing Big Data_UCLAHarnessing Big Data_UCLA
Harnessing Big Data_UCLA
 
Data-as-a-Service: DataGraft
Data-as-a-Service: DataGraftData-as-a-Service: DataGraft
Data-as-a-Service: DataGraft
 
Smart Enterprise Big Data Bus for the Modern Responsive Enterprise
Smart Enterprise Big Data Bus for the Modern Responsive EnterpriseSmart Enterprise Big Data Bus for the Modern Responsive Enterprise
Smart Enterprise Big Data Bus for the Modern Responsive Enterprise
 
High Scalability Network Monitoring for Communications Service Providers
High Scalability Network Monitoring for Communications Service ProvidersHigh Scalability Network Monitoring for Communications Service Providers
High Scalability Network Monitoring for Communications Service Providers
 
Vertica Analytics Database general overview
Vertica Analytics Database general overviewVertica Analytics Database general overview
Vertica Analytics Database general overview
 
Bridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItBridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need It
 
UnitOnePresentationSlides.pptx
UnitOnePresentationSlides.pptxUnitOnePresentationSlides.pptx
UnitOnePresentationSlides.pptx
 
Build and Manage Hadoop & Oracle NoSQL DB Solutions- Impetus Webinar
Build and Manage Hadoop & Oracle NoSQL DB Solutions- Impetus WebinarBuild and Manage Hadoop & Oracle NoSQL DB Solutions- Impetus Webinar
Build and Manage Hadoop & Oracle NoSQL DB Solutions- Impetus Webinar
 
Cyient-APAC FTTH Show Presentation_Kiran Solipuram
Cyient-APAC FTTH Show Presentation_Kiran SolipuramCyient-APAC FTTH Show Presentation_Kiran Solipuram
Cyient-APAC FTTH Show Presentation_Kiran Solipuram
 
Single cloud
Single cloudSingle cloud
Single cloud
 

More from CSUC - Consorci de Serveis Universitaris de Catalunya

More from CSUC - Consorci de Serveis Universitaris de Catalunya (20)

Tendencias en herramientas de monitorización de redes y modelo de madurez en ...
Tendencias en herramientas de monitorización de redes y modelo de madurez en ...Tendencias en herramientas de monitorización de redes y modelo de madurez en ...
Tendencias en herramientas de monitorización de redes y modelo de madurez en ...
 
Quantum Computing Master Class 2024 (Quantum Day)
Quantum Computing Master Class 2024 (Quantum Day)Quantum Computing Master Class 2024 (Quantum Day)
Quantum Computing Master Class 2024 (Quantum Day)
 
Publicar dades de recerca amb el Repositori de Dades de Recerca
Publicar dades de recerca amb el Repositori de Dades de RecercaPublicar dades de recerca amb el Repositori de Dades de Recerca
Publicar dades de recerca amb el Repositori de Dades de Recerca
 
In sharing we trust. Taking advantage of a diverse consortium to build a tran...
In sharing we trust. Taking advantage of a diverse consortium to build a tran...In sharing we trust. Taking advantage of a diverse consortium to build a tran...
In sharing we trust. Taking advantage of a diverse consortium to build a tran...
 
Formació RDM: com fer un pla de gestió de dades amb l’eiNa DMP?
Formació RDM: com fer un pla de gestió de dades amb l’eiNa DMP?Formació RDM: com fer un pla de gestió de dades amb l’eiNa DMP?
Formació RDM: com fer un pla de gestió de dades amb l’eiNa DMP?
 
Com pot ajudar la gestió de les dades de recerca a posar en pràctica la ciènc...
Com pot ajudar la gestió de les dades de recerca a posar en pràctica la ciènc...Com pot ajudar la gestió de les dades de recerca a posar en pràctica la ciènc...
Com pot ajudar la gestió de les dades de recerca a posar en pràctica la ciènc...
 
Security Human Factor Sustainable Outputs: The Network eAcademy
Security Human Factor Sustainable Outputs: The Network eAcademySecurity Human Factor Sustainable Outputs: The Network eAcademy
Security Human Factor Sustainable Outputs: The Network eAcademy
 
The Research Portal of Catalonia: Growing more (information) & more (services)
The Research Portal of Catalonia: Growing more (information) & more (services)The Research Portal of Catalonia: Growing more (information) & more (services)
The Research Portal of Catalonia: Growing more (information) & more (services)
 
Facilitar la gestión, visibilidad y reutilización de los datos de investigaci...
Facilitar la gestión, visibilidad y reutilización de los datos de investigaci...Facilitar la gestión, visibilidad y reutilización de los datos de investigaci...
Facilitar la gestión, visibilidad y reutilización de los datos de investigaci...
 
La gestión de datos de investigación en las bibliotecas universitarias españolas
La gestión de datos de investigación en las bibliotecas universitarias españolasLa gestión de datos de investigación en las bibliotecas universitarias españolas
La gestión de datos de investigación en las bibliotecas universitarias españolas
 
Disposes de recursos il·limitats? Prioritza estratègicament els teus projecte...
Disposes de recursos il·limitats? Prioritza estratègicament els teus projecte...Disposes de recursos il·limitats? Prioritza estratègicament els teus projecte...
Disposes de recursos il·limitats? Prioritza estratègicament els teus projecte...
 
Les persones i les seves capacitats en el nucli de la transformació digital. ...
Les persones i les seves capacitats en el nucli de la transformació digital. ...Les persones i les seves capacitats en el nucli de la transformació digital. ...
Les persones i les seves capacitats en el nucli de la transformació digital. ...
 
Enginyeria Informàtica: una cursa de fons
Enginyeria Informàtica: una cursa de fonsEnginyeria Informàtica: una cursa de fons
Enginyeria Informàtica: una cursa de fons
 
Transformació de rols i habilitats en un món ple d'IA
Transformació de rols i habilitats en un món ple d'IATransformació de rols i habilitats en un món ple d'IA
Transformació de rols i habilitats en un món ple d'IA
 
Difusió del coneixement a l'Il·lustre Col·legi de l'Advocacia de Barcelona
Difusió del coneixement a l'Il·lustre Col·legi de l'Advocacia de BarcelonaDifusió del coneixement a l'Il·lustre Col·legi de l'Advocacia de Barcelona
Difusió del coneixement a l'Il·lustre Col·legi de l'Advocacia de Barcelona
 
Fons de discos perforats de cartró
Fons de discos perforats de cartróFons de discos perforats de cartró
Fons de discos perforats de cartró
 
Biblioteca Digital Gencat
Biblioteca Digital GencatBiblioteca Digital Gencat
Biblioteca Digital Gencat
 
El fons Enrique Tierno Galván: recepció, tractament i difusió
El fons Enrique Tierno Galván: recepció, tractament i difusióEl fons Enrique Tierno Galván: recepció, tractament i difusió
El fons Enrique Tierno Galván: recepció, tractament i difusió
 
El CIDMA: més enllà dels espais físics
El CIDMA: més enllà dels espais físicsEl CIDMA: més enllà dels espais físics
El CIDMA: més enllà dels espais físics
 
Els serveis del CSUC per a la comunitat CCUC
Els serveis del CSUC per a la comunitat CCUCEls serveis del CSUC per a la comunitat CCUC
Els serveis del CSUC per a la comunitat CCUC
 

Recently uploaded

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Recently uploaded (20)

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 

Telvent Big Data Approach and Case Studies

  • 1. Schneider Electric –Telvent Global Services – 2014 TELVENT Telvent Global Services TSIUC’14 Retos en Big Data en la Universidad y la Investigación Telvent Big Data Approach and Case Studies
  • 2. TELVENT Schneider Electric –- Telvent Global Services – 2014 Introduction
  • 3. Schneider Electric –- Telvent Global Services – 2014 Bringing together IT with OT to increase business performance through: Consulting, Integration and Outsourcing Services Our Mission: Technology Integration & Real Time Architectures +250 end customers worldwide in 2013 More than 30,000 m2 of Data Centers managed 24/7 IT Support for more than +30,000 users +1,500 Network devices +5,000 Servers +3.5 Managed Pbyte +250 VHost About Telvent ….
  • 4. TELVENT Schneider Electric –- Telvent Global Services – 2014 Big Data
  • 5. Schneider Electric –- Telvent Global Services – 2014 Requirements…. Today, data business needs to satisfy 4 characteristics: Solution: BIG DATA
  • 6. Schneider Electric –- Telvent Global Services – 2014 Consulting Services Managed Services Big Data Landscape Data Collection Communications & Networks Data Centers & Critical Infrastructures Applications & Business Processes IT Systems DataProcessing DataAnalytics Managed Services Consulting Services Integration Services
  • 7. TELVENT Schneider Electric –- Telvent Global Services – 2014 Telvent Case Studies
  • 8. Schneider Electric –- Telvent Global Services – 2014 Case Study I Bottleneck Background Carriers must save all the information related to the phone calls and navigation (CDRs) due to a new regulation law. IT Architecture Architecture was based on a relational database that manages more than 50 TB of data. Capacity planning expects to triple the data in less than two years. Options Analyzed
  • 9. Schneider Electric –- Telvent Global Services – 2014 Case Study ISolution •Exadata was rejected due to its cost and performance. •Hadoop cluster design and implementation in order to save and manage all the traffic coming from the calls and navigation. •Relational database is only used for reporting and dashboard. Its size is limited to 5TB
  • 10. Schneider Electric –- Telvent Global Services – 2014 Case Study IIBackground •Carriers must save all the information related to an user navigation (Public IP and private IP) due to a new regulation law. Options Analyzed IT Architecture •There is a Teradata database but it has not enough capacity, so investment is needed. •Architecture was not implemented yet, but it has been estimated that it would be needed more than 600TB in normal storage.
  • 11. Schneider Electric –- Telvent Global Services – 2014 Case Study II Hadoop as a Service Front End Routers Acceso Plataforma IaaS Telvent Servidor Integrador (TGC) Back End Cluster namenodes Crecimiento Neto garantizado Cluster Datanodes Servidor Monitorización (TGC) Solution • Hadoop cluster that assure a response time of 60 seconds per user. • Web Application development that let the user make their requests.
  • 12. Schneider Electric –- Telvent Global Services – 2014 Case Study IIIBackground •Marketing department needs a platform that help it to know, what products are the most suitable for each person  User Segmentation, looking for a pattern on behavior. •High security protocols due to the level of confidentiality needed. IT Architecture •Current database has not enough process power. •BI system are not so effective in predictions but analyzing past data.
  • 13. Schneider Electric –- Telvent Global Services – 2014 Case Study IIISolution •Working with a partner for the analytics scope. •SPARK service use by data analyst, working on cluster memory. . •Firstly a dedicated platform and once they test it, we transform the service to “Telvent Hadoop as a Service.” • Volume: 5 TB •New potential users appears once Big data si working.
  • 14. Schneider Electric –- Telvent Global Services – 2014 Case Study IVBackground •In “Free-Flow” motorways there is a platform that takes a picture to each user that crosses the toll. With this image and using OCR systems, it is recognized the 'number plate' and then, it is searched its bank account associated  So, no vehicle has to stop at toll. Scope •Number of images: 1.300.000.000 •Image size: From 90K to150K •Retention: From 1 to 5 years IT Architecture •SAMFS solution •Based on a hierarchical storage that only keeps online the images for the last 6 months. The previous images are saved in tapes Restricted
  • 15. Schneider Electric –- Telvent Global Services – 2014 Case Study IVIT Architecture •New platform based on Hadoop, composed by 8 servers (namenodes and datanodes) and 384 GB RAM. •New platform allows the company to keep all the images online. Current hierarchical storage disappears Advantages •Efficiency in fraud management default improved. •Performance in image processing improved. •Every sattelite application can be centralized Restricted
  • 16. Schneider Electric –- Telvent Global Services – 2014 Case Study VBackground •New Smart Meters are managed from a centralized platform, that should be able to receive and send information to each one. Also, all the information (measures) has to be recorded, at least, for two years. Scope: •.More than 11 M smart meters  1 measure per hour  198.000 M measures • Platform should be used also like a dashboard IT Architecture: • Current IT Infrastructure is mainly Oracle Restricted
  • 17. Schneider Electric –- Telvent Global Services – 2014 Case Study VIT Architecture •Exadata infrastructure provisioning. This solutions was considered the best due to its performance for: •Data loading (it receives lots of measures) •Requests (Ex: repeat the measure, change de power, electricity switch off …). Proof of Concept •Based on smart meter remote management, switch off about 100.000 homes in 40 minutes.
  • 18. TELVENT Schneider Electric –- Telvent Global Services – 2014 Education
  • 19. Schneider Electric –- Telvent Global Services – 2014 Case Study •Recomendador de documentación para un alumno basado en datos de otros alumnos con el mismo perfil (Filtro colaborativo) •Previsión y planificación de recursos internos de la universidad en función de variables oferta/demanda (Forecast) •Segmentación de alumnos en función de las campañas de marketing lanzadas (Clustering) • Alumno  Alumno; cruce de búsqueda para usuarios similares que compartan experiencias con los nuevos alumnos •Dimensionamiento servicio y calidad del servicio. Estimación de llamadas Call Center •Detección de abandono /suspenso de una alumno de un curso (Decisor)
  • 20. Schneider Electric –- Telvent Global Services – 2014 Conclusions The growth of digital information and the need to manage and analyze the data will not change its exponential path (both structured and unstructured). Usual tools, applications, or databases does not work with this amount of data. Business requeriments: •Cost reductions •Time reductions •New product development and optimized offerings •Smarter business decision making Big Data is a new way to face IT Infrastructure problems IT Transformation
  • 21. TELVENT Make the most of your energy™ Marta de Mesa Rincón – Solution Consulting Director Marta.demesa@telvent.com Jesús Gironda Díaz – Open System Manager Jesus.gironda@telvent.com