SlideShare a Scribd company logo
1
Jim Silva – Director
Kimberly Butler – Lead Data Engineer
3 October 2019, Pfizer, Inc.
Elastic as a Fundamental
Core to Pfizer’s Scientific
Data Cloud
2
Our Purpose
Our Company
$53.6BILLION
in revenue in 2018
40MANUFACTURING
sites worldwide
MORE THAN
125COUNTRIES
in which Pfizer sells products
8PRODUCTS
with sales greater
than $1 billion in 2018
MORE THAN
180NEW R&D
COLLABORATIONS
in 2018
90,000
COLLEAGUES
around the world
3
Worldwide Research and Development
Research and Development is at the heart of fulfilling Pfizer’s purpose
as we work to translate advanced science and technologies into
therapies that matter for patients in need.
We focus our resources in disease areas with the best chance of
scientific and commercial success:
Oncology Internal Medicine Inflammation
& Immunology
Vaccines Rare Disease
4
Introduction to the Scientific Data Cloud (SDC)
Goals
• Accelerate timelines through exploratory analysis and predictive modelling
• Modeling helped to accelerate a previous project discovery and development project.
• Physical experiments can be avoided through data reuse enabling faster decisions
• Satisfy regulatory requirements for secure data retention
• Regulators expect immediate response to data requests and demonstration of audit trail
5
SDC’s Elastic Core
• File Metadata
• Line-Specific Metadata
• Line-Specific Configuration
• Search
• Usage Reports
• Audit Reports
• Files and Metadata to
Populate Analytics Layer• File Download Logs
• Agent Downtime Logs
• Search Logs
• S3 Logs
Config
Search
Amazon
Redshift
Amazon S3
6
Search Interface
App Menu
File Details and File
Download
2
Filter on Metadata
1
3
7
Configuration of Search Interface
PUT sdc-config/masterconfig/invivo
{"metadata": [{
"metadataName": "experimentID",
"caption": "Experiment ID",
"searchable": true,
"filterable": true,
"filterType": "CheckBoxList"
}],
"resultsPage": [{
"metadataName": "experimentID"
}],
"apps": [{
" link": "https://sdctickets.pfizer.com",
"display": "Submit Ticket"
}]
}
8
Design Principles
"dynamic": "strict",
"analysis": {
"filter": {
"id_word_delimiter": {
"catenate_all": "false",
"preserve_original": "true",
"split_on_numerics": "false",
"catenate_numbers": "false",
"type": "word_delimiter_graph"
}
}
}
9
Audit & Usage Reports
SDC
S3 Bucket
Audit Reports
Custom Plugin
Amazon
CloudWatch
Pfizer Logging S3
Bucket
File Activity Logs
Tomcat
Webserver
BEATS KIBANALOGSTASH ELASTICSEARCH
Usage Reports
Native Kibana
File Download Logs
Search Logs
+
10
Elastic Upgrade Remediation Plan
Upgrade from ELK version 5.3 to 6.4
1 2 3 4 5
Build ELK 6.4 Sandbox Rebuild Indices Run Queries Install Custom Kibana
Plugin and Import
Visualizations
Point Applications to
Sandbox

More Related Content

Similar to Elastic as a Fundamental Core to Pfizer’s Scientific Data Cloud

The Role of Data Lakes in Healthcare
The Role of Data Lakes in HealthcareThe Role of Data Lakes in Healthcare
The Role of Data Lakes in Healthcare
Perficient, Inc.
 
Cybersecurity Challenges in Healthcare
Cybersecurity Challenges in HealthcareCybersecurity Challenges in Healthcare
Cybersecurity Challenges in Healthcare
Doug Copley
 
Detroit ISSA Healthcare Cybersecurity
Detroit ISSA Healthcare CybersecurityDetroit ISSA Healthcare Cybersecurity
Detroit ISSA Healthcare Cybersecurity
Doug Copley
 
Go to the market
Go to the marketGo to the market
Go to the market
ProFAX
 
Information Security Forum (ISF) Congress 2013
Information Security Forum (ISF) Congress 2013 Information Security Forum (ISF) Congress 2013
Information Security Forum (ISF) Congress 2013
NIHR Clinical Research Network
 
Data Virtualization Modernizes Biobanking
Data Virtualization Modernizes BiobankingData Virtualization Modernizes Biobanking
Data Virtualization Modernizes Biobanking
Denodo
 
SMi Group's 4th annual Biosimilars & Biobetters conference
SMi Group's 4th annual Biosimilars & Biobetters conferenceSMi Group's 4th annual Biosimilars & Biobetters conference
SMi Group's 4th annual Biosimilars & Biobetters conference
Dale Butler
 
2016 Thermo Fisher Scientific Company Overview
2016 Thermo Fisher Scientific Company Overview2016 Thermo Fisher Scientific Company Overview
2016 Thermo Fisher Scientific Company Overview
Josie Zheng
 
SILS 2015 - Innovation at GE Healthcare
SILS 2015 - Innovation at GE HealthcareSILS 2015 - Innovation at GE Healthcare
SILS 2015 - Innovation at GE Healthcare
Sherbrooke Innopole
 
Data & Technology in Clinical Trials
Data & Technology in Clinical TrialsData & Technology in Clinical Trials
Data & Technology in Clinical Trials
Nassim Azzi, MBA
 
Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell
Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell
Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell
All_about_business
 
BFRG Presentation
BFRG PresentationBFRG Presentation
BFRG Presentation
RedChip Companies, Inc.
 
MAGNATAS AUGUST 2015
MAGNATAS AUGUST 2015MAGNATAS AUGUST 2015
MAGNATAS AUGUST 2015
Dr. Michael Ackermann, PhD, MBA
 
Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...
Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...
Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...
Databricks
 
Data Science In Pharmaceutical.pdf
Data Science In Pharmaceutical.pdfData Science In Pharmaceutical.pdf
Data Science In Pharmaceutical.pdf
SophiaKelly6
 
ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...
ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...
ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...
ELIXIR-Europe
 
Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)
Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)
Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)
Hellmuth Broda
 
Sutherland and International Institute for Analytics HIStalk Webinar - Charti...
Sutherland and International Institute for Analytics HIStalk Webinar - Charti...Sutherland and International Institute for Analytics HIStalk Webinar - Charti...
Sutherland and International Institute for Analytics HIStalk Webinar - Charti...
Sutherland Healthcare
 
Predictive Analytics.pdf
Predictive Analytics.pdfPredictive Analytics.pdf
Predictive Analytics.pdf
AmirKhan811717
 
Applications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdf
Applications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdfApplications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdf
Applications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdf
ArunPrasad880048
 

Similar to Elastic as a Fundamental Core to Pfizer’s Scientific Data Cloud (20)

The Role of Data Lakes in Healthcare
The Role of Data Lakes in HealthcareThe Role of Data Lakes in Healthcare
The Role of Data Lakes in Healthcare
 
Cybersecurity Challenges in Healthcare
Cybersecurity Challenges in HealthcareCybersecurity Challenges in Healthcare
Cybersecurity Challenges in Healthcare
 
Detroit ISSA Healthcare Cybersecurity
Detroit ISSA Healthcare CybersecurityDetroit ISSA Healthcare Cybersecurity
Detroit ISSA Healthcare Cybersecurity
 
Go to the market
Go to the marketGo to the market
Go to the market
 
Information Security Forum (ISF) Congress 2013
Information Security Forum (ISF) Congress 2013 Information Security Forum (ISF) Congress 2013
Information Security Forum (ISF) Congress 2013
 
Data Virtualization Modernizes Biobanking
Data Virtualization Modernizes BiobankingData Virtualization Modernizes Biobanking
Data Virtualization Modernizes Biobanking
 
SMi Group's 4th annual Biosimilars & Biobetters conference
SMi Group's 4th annual Biosimilars & Biobetters conferenceSMi Group's 4th annual Biosimilars & Biobetters conference
SMi Group's 4th annual Biosimilars & Biobetters conference
 
2016 Thermo Fisher Scientific Company Overview
2016 Thermo Fisher Scientific Company Overview2016 Thermo Fisher Scientific Company Overview
2016 Thermo Fisher Scientific Company Overview
 
SILS 2015 - Innovation at GE Healthcare
SILS 2015 - Innovation at GE HealthcareSILS 2015 - Innovation at GE Healthcare
SILS 2015 - Innovation at GE Healthcare
 
Data & Technology in Clinical Trials
Data & Technology in Clinical TrialsData & Technology in Clinical Trials
Data & Technology in Clinical Trials
 
Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell
Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell
Establishing an Irish Biotech Company, Kieran Curran, CEO of Gen Cell
 
BFRG Presentation
BFRG PresentationBFRG Presentation
BFRG Presentation
 
MAGNATAS AUGUST 2015
MAGNATAS AUGUST 2015MAGNATAS AUGUST 2015
MAGNATAS AUGUST 2015
 
Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...
Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...
Commercial Analytics at Scale in Pharma: From Hackathon to MVP with Azure Dat...
 
Data Science In Pharmaceutical.pdf
Data Science In Pharmaceutical.pdfData Science In Pharmaceutical.pdf
Data Science In Pharmaceutical.pdf
 
ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...
ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...
ELIXIR and Industry presentation given by Jerome Wojcik, CEO, Quartz Bio at E...
 
Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)
Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)
Big Data and its Impact on Industry (Example of the Pharmaceutical Industry)
 
Sutherland and International Institute for Analytics HIStalk Webinar - Charti...
Sutherland and International Institute for Analytics HIStalk Webinar - Charti...Sutherland and International Institute for Analytics HIStalk Webinar - Charti...
Sutherland and International Institute for Analytics HIStalk Webinar - Charti...
 
Predictive Analytics.pdf
Predictive Analytics.pdfPredictive Analytics.pdf
Predictive Analytics.pdf
 
Applications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdf
Applications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdfApplications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdf
Applications-of-AI-in-Drug-Discovery-and-Development-PreScouter.pdf
 

More from Elasticsearch

An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolbox
Elasticsearch
 
From MSP to MSSP using Elastic
From MSP to MSSP using ElasticFrom MSP to MSSP using Elastic
From MSP to MSSP using Elastic
Elasticsearch
 
Cómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios webCómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios web
Elasticsearch
 
Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas
Elasticsearch
 
Tirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic CloudTirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic Cloud
Elasticsearch
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
Elasticsearch
 
Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.
Elasticsearch
 
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Elasticsearch
 
An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolbox
Elasticsearch
 
Welcome to a new state of find
Welcome to a new state of findWelcome to a new state of find
Welcome to a new state of find
Elasticsearch
 
Building great website search experiences
Building great website search experiencesBuilding great website search experiences
Building great website search experiences
Elasticsearch
 
Keynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified searchKeynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified search
Elasticsearch
 
Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisiones
Elasticsearch
 
Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud
Elasticsearch
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
Elasticsearch
 
Transforming data into actionable insights
Transforming data into actionable insightsTransforming data into actionable insights
Transforming data into actionable insights
Elasticsearch
 
Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?
Elasticsearch
 
Empowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside GovernmentEmpowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside Government
Elasticsearch
 
The opportunities and challenges of data for public good
The opportunities and challenges of data for public goodThe opportunities and challenges of data for public good
The opportunities and challenges of data for public good
Elasticsearch
 
Enterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and ElasticEnterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and Elastic
Elasticsearch
 

More from Elasticsearch (20)

An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolbox
 
From MSP to MSSP using Elastic
From MSP to MSSP using ElasticFrom MSP to MSSP using Elastic
From MSP to MSSP using Elastic
 
Cómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios webCómo crear excelentes experiencias de búsqueda en sitios web
Cómo crear excelentes experiencias de búsqueda en sitios web
 
Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas Te damos la bienvenida a una nueva forma de realizar búsquedas
Te damos la bienvenida a una nueva forma de realizar búsquedas
 
Tirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic CloudTirez pleinement parti d'Elastic grâce à Elastic Cloud
Tirez pleinement parti d'Elastic grâce à Elastic Cloud
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
 
Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.Plongez au cœur de la recherche dans tous ses états.
Plongez au cœur de la recherche dans tous ses états.
 
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
Modernising One Legal Se@rch with Elastic Enterprise Search [Customer Story]
 
An introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolboxAn introduction to Elasticsearch's advanced relevance ranking toolbox
An introduction to Elasticsearch's advanced relevance ranking toolbox
 
Welcome to a new state of find
Welcome to a new state of findWelcome to a new state of find
Welcome to a new state of find
 
Building great website search experiences
Building great website search experiencesBuilding great website search experiences
Building great website search experiences
 
Keynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified searchKeynote: Harnessing the power of Elasticsearch for simplified search
Keynote: Harnessing the power of Elasticsearch for simplified search
 
Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisiones
 
Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud Explore relève les défis Big Data avec Elastic Cloud
Explore relève les défis Big Data avec Elastic Cloud
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
 
Transforming data into actionable insights
Transforming data into actionable insightsTransforming data into actionable insights
Transforming data into actionable insights
 
Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?Opening Keynote: Why Elastic?
Opening Keynote: Why Elastic?
 
Empowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside GovernmentEmpowering agencies using Elastic as a Service inside Government
Empowering agencies using Elastic as a Service inside Government
 
The opportunities and challenges of data for public good
The opportunities and challenges of data for public goodThe opportunities and challenges of data for public good
The opportunities and challenges of data for public good
 
Enterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and ElasticEnterprise search and unstructured data with CGI and Elastic
Enterprise search and unstructured data with CGI and Elastic
 

Recently uploaded

System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
Hiike
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
alexjohnson7307
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
HarisZaheer8
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Tatiana Kojar
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
LucaBarbaro3
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
SitimaJohn
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024
Intelisync
 

Recently uploaded (20)

System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024
 

Elastic as a Fundamental Core to Pfizer’s Scientific Data Cloud

  • 1. 1 Jim Silva – Director Kimberly Butler – Lead Data Engineer 3 October 2019, Pfizer, Inc. Elastic as a Fundamental Core to Pfizer’s Scientific Data Cloud
  • 2. 2 Our Purpose Our Company $53.6BILLION in revenue in 2018 40MANUFACTURING sites worldwide MORE THAN 125COUNTRIES in which Pfizer sells products 8PRODUCTS with sales greater than $1 billion in 2018 MORE THAN 180NEW R&D COLLABORATIONS in 2018 90,000 COLLEAGUES around the world
  • 3. 3 Worldwide Research and Development Research and Development is at the heart of fulfilling Pfizer’s purpose as we work to translate advanced science and technologies into therapies that matter for patients in need. We focus our resources in disease areas with the best chance of scientific and commercial success: Oncology Internal Medicine Inflammation & Immunology Vaccines Rare Disease
  • 4. 4 Introduction to the Scientific Data Cloud (SDC) Goals • Accelerate timelines through exploratory analysis and predictive modelling • Modeling helped to accelerate a previous project discovery and development project. • Physical experiments can be avoided through data reuse enabling faster decisions • Satisfy regulatory requirements for secure data retention • Regulators expect immediate response to data requests and demonstration of audit trail
  • 5. 5 SDC’s Elastic Core • File Metadata • Line-Specific Metadata • Line-Specific Configuration • Search • Usage Reports • Audit Reports • Files and Metadata to Populate Analytics Layer• File Download Logs • Agent Downtime Logs • Search Logs • S3 Logs Config Search Amazon Redshift Amazon S3
  • 6. 6 Search Interface App Menu File Details and File Download 2 Filter on Metadata 1 3
  • 7. 7 Configuration of Search Interface PUT sdc-config/masterconfig/invivo {"metadata": [{ "metadataName": "experimentID", "caption": "Experiment ID", "searchable": true, "filterable": true, "filterType": "CheckBoxList" }], "resultsPage": [{ "metadataName": "experimentID" }], "apps": [{ " link": "https://sdctickets.pfizer.com", "display": "Submit Ticket" }] }
  • 8. 8 Design Principles "dynamic": "strict", "analysis": { "filter": { "id_word_delimiter": { "catenate_all": "false", "preserve_original": "true", "split_on_numerics": "false", "catenate_numbers": "false", "type": "word_delimiter_graph" } } }
  • 9. 9 Audit & Usage Reports SDC S3 Bucket Audit Reports Custom Plugin Amazon CloudWatch Pfizer Logging S3 Bucket File Activity Logs Tomcat Webserver BEATS KIBANALOGSTASH ELASTICSEARCH Usage Reports Native Kibana File Download Logs Search Logs +
  • 10. 10 Elastic Upgrade Remediation Plan Upgrade from ELK version 5.3 to 6.4 1 2 3 4 5 Build ELK 6.4 Sandbox Rebuild Indices Run Queries Install Custom Kibana Plugin and Import Visualizations Point Applications to Sandbox