SlideShare a Scribd company logo
1 of 40
Acoustic Time Series in Industry 4.0
Improved Reliability and Cyber-Security Vulnerabilities
Philip Brisk
Professor
Department of Computer Science and Engineering
University of California, Riverside
Four Industrial Revolutions
1780s 1870s 1970s
Today
(Industry 4.0)
http://www.secondwavemedia.com/metromode/innovationnews/TechnologyInIndustry2018.aspx
IoT +
Machine Learning
Industry 4.0 IoT Capabilities
• Optimize industrial throughput and efficiency
• Increase product quality
• Increase manufacturing throughput
• Reduce manufacturing cost
• Reduce manufacturing variability
• Monitor the reliability/degradation of industrial equipment
• Accurately predict failures before they occur
Example: Anheuser-Busch InBev
• Ft. Collins CO Brewery: ultrasonic wireless sensors can predict when
machines needed maintenance
• Variations in ultrasonic acoustic signals observed days in advance
• Can accurately predict failure hours in advance
https://www.wsj.com/articles/beer-maker-uses-machine-learning-to-keep-beverages-flowing-11548239401
• Newark, NJ Brewery: optimized filtration process
• Increase length of each filter run by 40-50%
• Increase barrelage per filter run by 60%
• Optimize beer taste
https://cloud.google.com/customers/abinbev-pluto7/
IoT Cyber-Security in Industry 4.0
• Challenge: The same data analytics techniques that can assess
physical equipment can also reverse engineer its operation
• Solution: Secure access to physical equipment
• Ensure that only trusted parties may access the sensor
• Solution: Secure access to sensory data
• Ensure that only trusted parties may analyze sensory data at all stages of
analytics processing
Let’s play “Guess the Sound”
And the culprit is…
Applied Biosciences 3400 DNA Synthesizer
I Bet You Didn’t See This Coming!!!
• I can recover with 100% accuracy what
DNA is being synthesized using acoustic
measurements and domain knowledge
exclusively.
Sina Faezi, Sujit Rokka Chhetri, Arnav Vaibhav Malawade, John
Charles Chaput, William H. Grover, Philip Brisk, Mohammad
Abdullah Al Faruque: Oligo-Snoop: A Non-Invasive Side Channel
Attack Against DNA Synthesis Machines. NDSS 2019
There is a Market for Synthetic DNA!
Drug Discovery
Crop Optimization
Medical Treatment
Archival Data Storage
$38.7 billion by 20201
1R. Singh. (2014) Synthetic
biology market by products (dna
synthesis, oligonucleotide
synthesis, synthetic dna,
synthetic genes, synthetic cells,
xna) and technology (genome
engineering, microfluidics
technologies, dna synthesis and
sequencing technologies) –
global opportunity analysis and
industry forecast, 2013 - 2020
Intellectual Property Concerns
• The relevant intellectual property is rarely the synthetic DNA itself
• It is often an organism derived from the DNA
• Knowing the DNA sequence might allow an attacker to infer a
valuable property about your billion-dollar organism
Oligonucleotide Synthesis
From Oligos to DNA
• An AB 3400 can synthesize two
complementary oligo strands, not
the actual DNA
• Someone else has to “combine” the
complementary oligos to form the
double-helix structure of DNA
• Synthetic oligo length is 200-300
bases, which is much shorter than
naturally occurring DNA
https://en.wikipedia.org/wiki/Directionality_(molecular_biology)
Attack
Model
• Adversary intent
• Outcome
• Target system
and known
vulnerabilities
• Attack medium
• Attacker
capabilities
• Attacker
resources
• Cost
Attacker Capabilities and Resources
• Has domain knowledge of DNA synthesis process
• Has access to the AB 3400 user manual
• Explains machine-specific procedures
• Has access to an AB 3400
• Profiling needed to build an accurate model
• Can place microphone close to the DNA synthesizer
• Wireless transmission: one-time-access
• Otherwise, a second physical visit is needed to retrieve the recording
Oligonucleotide Synthesis
AB 3400
Setup
• User guide
• Available online
• Findable via
Google search
• Site preparation
and safety guide
• Available online
• Findable via
Google search
AB 3400 Acoustic Side-Channel
Each valve occupies a unique position in the AB 3400
• The surface area that causes reflections is unique for
each valve
• Reverberation time is unique for each valve
• Collected acoustic signal is unique for each valve
Acoustic sources
• Solenoid valves opening and closing
• Fluid flowing through pipes
• Cooling system fans
• Pressure regulators
Attack Methodology
Attack Model Design (Physics)
• Principle-based equation (ideal, but unrealistic)
• Inverse estimates the sequence (ideal, but unrealistic)
𝐴 = 𝑓(𝑆)
𝑆 = 𝑓−1(𝐴)
S: System state
A: Acoustic side channel
Data-driven Approach
𝑆 = 𝑓(𝐴, 𝜃)
𝑆 = 𝑆1, 𝑆2, … , 𝑆 𝑛
Base: 𝑆𝑖 ∈ 𝑎, 𝑐, 𝑔, 𝑡
Acoustic Emission: 𝐴𝑖 = 𝐴𝑖1
, 𝐴𝑖2
, … , 𝐴𝑖 𝑘
Classifier Function: 𝑆𝑖 = 𝑓(𝐴𝑖, 𝜃)
Use supervised learning to train the classifier function 𝑓
𝜃: Parameter to train
Key Steps
Preprocessing: eliminate background noise
Preliminary feature extraction: isolate acoustics for each valve
Signal segmentation: isolate acoustics for base delivery
Feature extraction: convert acoustic signal to a set of features
Nucleotide base classifier: train a classifier that correlates a set of
features to one of the four nucleotide bases
Post-processing: Apply domain-knowledge to correct misprediction errors
𝐴𝑖 = 𝐴𝑖1
, 𝐴𝑖2
, … , 𝐴𝑖 𝑘
→ 𝑓𝑖 = 𝑓𝑖1
, 𝑓𝑖2
, … , 𝑓𝑖 𝑙
, 𝑙 ≪ 𝑘
𝑆𝑖 = 𝑓(𝑓𝑖, 𝜃)
Experimental Setup
AB 3400 DNA Synthesizer
Record signals through three
simultaneous channels at 48 kHz
with 24 bits per sample resolution
Zoom H6 audio recorder
• Similar to iPhone 4 microphone
Also use a contact microphone to
record acoustic signals with almost
no environmental noise
Training and Evaluation
• Synthesized seven synthetic oligos
• Each with 60-base with 15 A’s, C’s, G’s, and T’s in varying orders
• Each run took 7 hours, 29 minutes, 53 seconds
• Label acquired signal into stages, exploiting information from the AB
3400 user manual
• Initialization (787 seconds)
• Repetitive cycle (463 seconds)
• Base delivery (5 seconds within the repetitive cycle)
Machine preparation steps
Nucleotide Base Addition Cycles
Delivery of Base A Delivery of Base C Delivery of Base G
Time (Minute)
Magnitude
Time (second)
Magnitude
Magnitude
Magnitude
Time (second) Time (second)
Base Delivery
• Identify peak locations in signal using continuous wavelet transforms
• Use the cycle script to identify sequences of distances that
correspond to base delivery stage
• For each stage, extract the segment that corresponds to the base
delivery valve operation
Feature Extraction
• 57,018 time domain, frequency domain, and wavelet-based features
• Initial Feature selection
• Calculate significance of each feature and select the 75 most relevant features
with the lowest dependency scores
• Improved Feature selection
• Calculate the frequency components with 200 MHz accuracy at frequencies
above 300 Hz with local peaks in the frequency transform
• Calculate significance of each feature and select the 310 most relevant
features with the lowest dependency scores
Classifier Training Without Post-Processing
• 200 samples used to train each classifier
• 80% of data set for training, 20% for validation
• 10-fold cross validation
Experimental Tradeoffs
• Classifier accuracy degrades when less than 70 samples used for
training
• Classifier accuracy is susceptible to noise
• White noise at 56 dB or higher
• People in the room taking at 65 dB or higher
• Classifier accuracy depends on microphone distance from the DNA
synthesizer
• Degradation occurs at 0.7 meters and further
Biologically Relevant DNA Sequences
• Assumptions:
• DNA sequence to be implanted in an living organism to create a protein
• Every 3 bases translates to a certain amino acid
• Four DNA sequences synthesized
• Contoxin: Translates to a lethal protein; highly regulated
• Human Insulin: Originally extracted from pig pancreases; in 1979, DNA encoding
human insulin added to bacteria to produce actual human insulin. Led to
founding of Genentech (multi-$Billion pharmaceutical company)
• 2 peptides: isolated by in vitro selection to bind the protein target streptavidin
Domain Knowledge
• Extra Assumption:
• The attacker desires the intended purpose of a reconstructed DNA sequence
• This is more valuable than the actual sequence itself
• BLAST software
• Stores DNA sequences and their functionality
• Can determine the most similar known DNA sequence along with its
application, for a given amino application sequence
• An attacker is satisfied with a positive BLAST match
Classification Accuracy
Open Issues
• Different microphones varying in cost/capabilities/distance
• Different AB 3400s used for training/attack
• Variability in acoustic emissions over the lifetime of an AB 3400
• Other DNA synthesis machines
• Possible countermeasures (e.g., internal acoustic padding)
• Similar attacks on other biological laboratory instruments
Conclusion
• Industry 4.0 integrates IoT sensing + machine learning into all scales
of manufacturing to improve reliability and efficiency
• While it’s easy to think about heavy industry, don’t ignore
manufacturing in biotech, nanotech, etc.
• Sensing opens up new side channel attack vectors, often coupled with
social engineering
• Successful attacks can benefit significantly from domain knowledge
• Must secure access to physical equipment and sensory data
Collaborators
Sujit R. Chhetri (UC Irvine)
Sina Faezi (UC Irvine)
Arnav V. Malawade (UC Irvine)
Mohammad Al Faruque
(UC Irvine)
John C. Chaput
(UC Irvine)
William H. Grover
(UC Riverside)
Evidence of the Conspiracy
Acknowledgment
This material is based upon work supported by the
National Science Foundation under Grant No.
1740052. Any opinions, findings, and
conclusions or recommendations expressed in
this material are those of the author(s) and do
not necessarily reflect the views of the National
Science Foundation
Extra Slides
Classifier Learning Curve
Impact of Noise on Classifier Accuracy
Impact of Microphone Distance from DNA
Synthesizer on Classifier Accuracy

More Related Content

Similar to Acoustic Time Series in Industry 4.0: Improved Reliability and Cyber-Security Vulnerabilities

Frequency toutorial
Frequency toutorial Frequency toutorial
Frequency toutorial ruwaghmare
 
Tektronix and Keithley mainstream product and application update q4 2016
Tektronix and Keithley mainstream product and application update q4 2016 Tektronix and Keithley mainstream product and application update q4 2016
Tektronix and Keithley mainstream product and application update q4 2016 Jeff Sable
 
ASHG sequencing workshop
ASHG sequencing workshopASHG sequencing workshop
ASHG sequencing workshopruthburton
 
lesson 2 digital data acquisition and data processing
lesson 2 digital data acquisition and data processinglesson 2 digital data acquisition and data processing
lesson 2 digital data acquisition and data processingMathew John
 
Tektronix keithley Product and Application update Q2 2016
Tektronix keithley Product and Application update Q2 2016Tektronix keithley Product and Application update Q2 2016
Tektronix keithley Product and Application update Q2 2016Jeff Sable
 
Track 2 session 4 - st dev con 2016 - opensoftwarex
Track 2   session 4 - st dev con 2016 - opensoftwarexTrack 2   session 4 - st dev con 2016 - opensoftwarex
Track 2 session 4 - st dev con 2016 - opensoftwarexST_World
 
Hablemos de ALMA — Wideband Sensitivity Upgrade
Hablemos de ALMA — Wideband Sensitivity UpgradeHablemos de ALMA — Wideband Sensitivity Upgrade
Hablemos de ALMA — Wideband Sensitivity UpgradeJoint ALMA Observatory
 
Cygan Resume Senior Systems Engineer LinkedIn
Cygan Resume Senior Systems Engineer LinkedInCygan Resume Senior Systems Engineer LinkedIn
Cygan Resume Senior Systems Engineer LinkedInCarl Cygan, MSEE
 
Cygan Resume Senior Systems Engineer
Cygan Resume Senior Systems EngineerCygan Resume Senior Systems Engineer
Cygan Resume Senior Systems EngineerCarl Cygan, MSEE
 
Innovate in new and exciting optical sensing applications in industrial marke...
Innovate in new and exciting optical sensing applications in industrial marke...Innovate in new and exciting optical sensing applications in industrial marke...
Innovate in new and exciting optical sensing applications in industrial marke...Design World
 
BellaDati Platform for Vibration Analysis.pptx
BellaDati Platform for Vibration Analysis.pptxBellaDati Platform for Vibration Analysis.pptx
BellaDati Platform for Vibration Analysis.pptxMSDianRahulShinde
 
Automotive Days 2015 by InterLatin &
Automotive Days 2015 by InterLatin & Automotive Days 2015 by InterLatin &
Automotive Days 2015 by InterLatin & Interlatin
 
cochlear corporation.pptx
cochlear corporation.pptxcochlear corporation.pptx
cochlear corporation.pptxZareenAhad
 
Audio_Overview.pptx
Audio_Overview.pptxAudio_Overview.pptx
Audio_Overview.pptxBinhHoang71
 
Advanced Oscilloscope Technologies enabling Terabit Optical Communications
Advanced Oscilloscope Technologies enabling Terabit Optical CommunicationsAdvanced Oscilloscope Technologies enabling Terabit Optical Communications
Advanced Oscilloscope Technologies enabling Terabit Optical CommunicationsCPqD
 
An audio quality evaluation of digital radio system
An audio quality evaluation of digital radio systemAn audio quality evaluation of digital radio system
An audio quality evaluation of digital radio systemRojith Thomas
 
An audio quality evaluation of digital radio system
An audio quality evaluation of digital radio systemAn audio quality evaluation of digital radio system
An audio quality evaluation of digital radio systemRojith Thomas
 
SteveBrassResume_LinkedIn
SteveBrassResume_LinkedInSteveBrassResume_LinkedIn
SteveBrassResume_LinkedInSteve Brass
 
Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Adrian Waltho
 

Similar to Acoustic Time Series in Industry 4.0: Improved Reliability and Cyber-Security Vulnerabilities (20)

Frequency toutorial
Frequency toutorial Frequency toutorial
Frequency toutorial
 
Tektronix and Keithley mainstream product and application update q4 2016
Tektronix and Keithley mainstream product and application update q4 2016 Tektronix and Keithley mainstream product and application update q4 2016
Tektronix and Keithley mainstream product and application update q4 2016
 
Eshg sequencing workshop
Eshg sequencing workshopEshg sequencing workshop
Eshg sequencing workshop
 
ASHG sequencing workshop
ASHG sequencing workshopASHG sequencing workshop
ASHG sequencing workshop
 
lesson 2 digital data acquisition and data processing
lesson 2 digital data acquisition and data processinglesson 2 digital data acquisition and data processing
lesson 2 digital data acquisition and data processing
 
Tektronix keithley Product and Application update Q2 2016
Tektronix keithley Product and Application update Q2 2016Tektronix keithley Product and Application update Q2 2016
Tektronix keithley Product and Application update Q2 2016
 
Track 2 session 4 - st dev con 2016 - opensoftwarex
Track 2   session 4 - st dev con 2016 - opensoftwarexTrack 2   session 4 - st dev con 2016 - opensoftwarex
Track 2 session 4 - st dev con 2016 - opensoftwarex
 
Hablemos de ALMA — Wideband Sensitivity Upgrade
Hablemos de ALMA — Wideband Sensitivity UpgradeHablemos de ALMA — Wideband Sensitivity Upgrade
Hablemos de ALMA — Wideband Sensitivity Upgrade
 
Cygan Resume Senior Systems Engineer LinkedIn
Cygan Resume Senior Systems Engineer LinkedInCygan Resume Senior Systems Engineer LinkedIn
Cygan Resume Senior Systems Engineer LinkedIn
 
Cygan Resume Senior Systems Engineer
Cygan Resume Senior Systems EngineerCygan Resume Senior Systems Engineer
Cygan Resume Senior Systems Engineer
 
Innovate in new and exciting optical sensing applications in industrial marke...
Innovate in new and exciting optical sensing applications in industrial marke...Innovate in new and exciting optical sensing applications in industrial marke...
Innovate in new and exciting optical sensing applications in industrial marke...
 
BellaDati Platform for Vibration Analysis.pptx
BellaDati Platform for Vibration Analysis.pptxBellaDati Platform for Vibration Analysis.pptx
BellaDati Platform for Vibration Analysis.pptx
 
Automotive Days 2015 by InterLatin &
Automotive Days 2015 by InterLatin & Automotive Days 2015 by InterLatin &
Automotive Days 2015 by InterLatin &
 
cochlear corporation.pptx
cochlear corporation.pptxcochlear corporation.pptx
cochlear corporation.pptx
 
Audio_Overview.pptx
Audio_Overview.pptxAudio_Overview.pptx
Audio_Overview.pptx
 
Advanced Oscilloscope Technologies enabling Terabit Optical Communications
Advanced Oscilloscope Technologies enabling Terabit Optical CommunicationsAdvanced Oscilloscope Technologies enabling Terabit Optical Communications
Advanced Oscilloscope Technologies enabling Terabit Optical Communications
 
An audio quality evaluation of digital radio system
An audio quality evaluation of digital radio systemAn audio quality evaluation of digital radio system
An audio quality evaluation of digital radio system
 
An audio quality evaluation of digital radio system
An audio quality evaluation of digital radio systemAn audio quality evaluation of digital radio system
An audio quality evaluation of digital radio system
 
SteveBrassResume_LinkedIn
SteveBrassResume_LinkedInSteveBrassResume_LinkedIn
SteveBrassResume_LinkedIn
 
Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3
 

More from J On The Beach

Massively scalable ETL in real world applications: the hard way
Massively scalable ETL in real world applications: the hard wayMassively scalable ETL in real world applications: the hard way
Massively scalable ETL in real world applications: the hard wayJ On The Beach
 
Big Data On Data You Don’t Have
Big Data On Data You Don’t HaveBig Data On Data You Don’t Have
Big Data On Data You Don’t HaveJ On The Beach
 
Pushing it to the edge in IoT
Pushing it to the edge in IoTPushing it to the edge in IoT
Pushing it to the edge in IoTJ On The Beach
 
Drinking from the firehose, with virtual streams and virtual actors
Drinking from the firehose, with virtual streams and virtual actorsDrinking from the firehose, with virtual streams and virtual actors
Drinking from the firehose, with virtual streams and virtual actorsJ On The Beach
 
How do we deploy? From Punched cards to Immutable server pattern
How do we deploy? From Punched cards to Immutable server patternHow do we deploy? From Punched cards to Immutable server pattern
How do we deploy? From Punched cards to Immutable server patternJ On The Beach
 
When Cloud Native meets the Financial Sector
When Cloud Native meets the Financial SectorWhen Cloud Native meets the Financial Sector
When Cloud Native meets the Financial SectorJ On The Beach
 
The big data Universe. Literally.
The big data Universe. Literally.The big data Universe. Literally.
The big data Universe. Literally.J On The Beach
 
Streaming to a New Jakarta EE
Streaming to a New Jakarta EEStreaming to a New Jakarta EE
Streaming to a New Jakarta EEJ On The Beach
 
The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...
The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...
The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...J On The Beach
 
Pushing AI to the Client with WebAssembly and Blazor
Pushing AI to the Client with WebAssembly and BlazorPushing AI to the Client with WebAssembly and Blazor
Pushing AI to the Client with WebAssembly and BlazorJ On The Beach
 
Axon Server went RAFTing
Axon Server went RAFTingAxon Server went RAFTing
Axon Server went RAFTingJ On The Beach
 
The Six Pitfalls of building a Microservices Architecture (and how to avoid t...
The Six Pitfalls of building a Microservices Architecture (and how to avoid t...The Six Pitfalls of building a Microservices Architecture (and how to avoid t...
The Six Pitfalls of building a Microservices Architecture (and how to avoid t...J On The Beach
 
Madaari : Ordering For The Monkeys
Madaari : Ordering For The MonkeysMadaari : Ordering For The Monkeys
Madaari : Ordering For The MonkeysJ On The Beach
 
Servers are doomed to fail
Servers are doomed to failServers are doomed to fail
Servers are doomed to failJ On The Beach
 
Interaction Protocols: It's all about good manners
Interaction Protocols: It's all about good mannersInteraction Protocols: It's all about good manners
Interaction Protocols: It's all about good mannersJ On The Beach
 
A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...
A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...
A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...J On The Beach
 
Leadership at every level
Leadership at every levelLeadership at every level
Leadership at every levelJ On The Beach
 
Machine Learning: The Bare Math Behind Libraries
Machine Learning: The Bare Math Behind LibrariesMachine Learning: The Bare Math Behind Libraries
Machine Learning: The Bare Math Behind LibrariesJ On The Beach
 
Getting started with Deep Reinforcement Learning
Getting started with Deep Reinforcement LearningGetting started with Deep Reinforcement Learning
Getting started with Deep Reinforcement LearningJ On The Beach
 

More from J On The Beach (20)

Massively scalable ETL in real world applications: the hard way
Massively scalable ETL in real world applications: the hard wayMassively scalable ETL in real world applications: the hard way
Massively scalable ETL in real world applications: the hard way
 
Big Data On Data You Don’t Have
Big Data On Data You Don’t HaveBig Data On Data You Don’t Have
Big Data On Data You Don’t Have
 
Pushing it to the edge in IoT
Pushing it to the edge in IoTPushing it to the edge in IoT
Pushing it to the edge in IoT
 
Drinking from the firehose, with virtual streams and virtual actors
Drinking from the firehose, with virtual streams and virtual actorsDrinking from the firehose, with virtual streams and virtual actors
Drinking from the firehose, with virtual streams and virtual actors
 
How do we deploy? From Punched cards to Immutable server pattern
How do we deploy? From Punched cards to Immutable server patternHow do we deploy? From Punched cards to Immutable server pattern
How do we deploy? From Punched cards to Immutable server pattern
 
Java, Turbocharged
Java, TurbochargedJava, Turbocharged
Java, Turbocharged
 
When Cloud Native meets the Financial Sector
When Cloud Native meets the Financial SectorWhen Cloud Native meets the Financial Sector
When Cloud Native meets the Financial Sector
 
The big data Universe. Literally.
The big data Universe. Literally.The big data Universe. Literally.
The big data Universe. Literally.
 
Streaming to a New Jakarta EE
Streaming to a New Jakarta EEStreaming to a New Jakarta EE
Streaming to a New Jakarta EE
 
The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...
The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...
The TIPPSS Imperative for IoT - Ensuring Trust, Identity, Privacy, Protection...
 
Pushing AI to the Client with WebAssembly and Blazor
Pushing AI to the Client with WebAssembly and BlazorPushing AI to the Client with WebAssembly and Blazor
Pushing AI to the Client with WebAssembly and Blazor
 
Axon Server went RAFTing
Axon Server went RAFTingAxon Server went RAFTing
Axon Server went RAFTing
 
The Six Pitfalls of building a Microservices Architecture (and how to avoid t...
The Six Pitfalls of building a Microservices Architecture (and how to avoid t...The Six Pitfalls of building a Microservices Architecture (and how to avoid t...
The Six Pitfalls of building a Microservices Architecture (and how to avoid t...
 
Madaari : Ordering For The Monkeys
Madaari : Ordering For The MonkeysMadaari : Ordering For The Monkeys
Madaari : Ordering For The Monkeys
 
Servers are doomed to fail
Servers are doomed to failServers are doomed to fail
Servers are doomed to fail
 
Interaction Protocols: It's all about good manners
Interaction Protocols: It's all about good mannersInteraction Protocols: It's all about good manners
Interaction Protocols: It's all about good manners
 
A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...
A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...
A race of two compilers: GraalVM JIT versus HotSpot JIT C2. Which one offers ...
 
Leadership at every level
Leadership at every levelLeadership at every level
Leadership at every level
 
Machine Learning: The Bare Math Behind Libraries
Machine Learning: The Bare Math Behind LibrariesMachine Learning: The Bare Math Behind Libraries
Machine Learning: The Bare Math Behind Libraries
 
Getting started with Deep Reinforcement Learning
Getting started with Deep Reinforcement LearningGetting started with Deep Reinforcement Learning
Getting started with Deep Reinforcement Learning
 

Recently uploaded

The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfPower Karaoke
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWave PLM
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
XpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsXpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsMehedi Hasan Shohan
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
Engage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyEngage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyFrank van der Linden
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number SystemsJheuzeDellosa
 

Recently uploaded (20)

The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdf
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
XpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software SolutionsXpertSolvers: Your Partner in Building Innovative Software Solutions
XpertSolvers: Your Partner in Building Innovative Software Solutions
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
Engage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyEngage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The Ugly
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number Systems
 

Acoustic Time Series in Industry 4.0: Improved Reliability and Cyber-Security Vulnerabilities

  • 1. Acoustic Time Series in Industry 4.0 Improved Reliability and Cyber-Security Vulnerabilities Philip Brisk Professor Department of Computer Science and Engineering University of California, Riverside
  • 2. Four Industrial Revolutions 1780s 1870s 1970s Today (Industry 4.0) http://www.secondwavemedia.com/metromode/innovationnews/TechnologyInIndustry2018.aspx IoT + Machine Learning
  • 3. Industry 4.0 IoT Capabilities • Optimize industrial throughput and efficiency • Increase product quality • Increase manufacturing throughput • Reduce manufacturing cost • Reduce manufacturing variability • Monitor the reliability/degradation of industrial equipment • Accurately predict failures before they occur
  • 4. Example: Anheuser-Busch InBev • Ft. Collins CO Brewery: ultrasonic wireless sensors can predict when machines needed maintenance • Variations in ultrasonic acoustic signals observed days in advance • Can accurately predict failure hours in advance https://www.wsj.com/articles/beer-maker-uses-machine-learning-to-keep-beverages-flowing-11548239401 • Newark, NJ Brewery: optimized filtration process • Increase length of each filter run by 40-50% • Increase barrelage per filter run by 60% • Optimize beer taste https://cloud.google.com/customers/abinbev-pluto7/
  • 5. IoT Cyber-Security in Industry 4.0 • Challenge: The same data analytics techniques that can assess physical equipment can also reverse engineer its operation • Solution: Secure access to physical equipment • Ensure that only trusted parties may access the sensor • Solution: Secure access to sensory data • Ensure that only trusted parties may analyze sensory data at all stages of analytics processing
  • 6. Let’s play “Guess the Sound”
  • 8. Applied Biosciences 3400 DNA Synthesizer
  • 9. I Bet You Didn’t See This Coming!!! • I can recover with 100% accuracy what DNA is being synthesized using acoustic measurements and domain knowledge exclusively. Sina Faezi, Sujit Rokka Chhetri, Arnav Vaibhav Malawade, John Charles Chaput, William H. Grover, Philip Brisk, Mohammad Abdullah Al Faruque: Oligo-Snoop: A Non-Invasive Side Channel Attack Against DNA Synthesis Machines. NDSS 2019
  • 10. There is a Market for Synthetic DNA! Drug Discovery Crop Optimization Medical Treatment Archival Data Storage $38.7 billion by 20201 1R. Singh. (2014) Synthetic biology market by products (dna synthesis, oligonucleotide synthesis, synthetic dna, synthetic genes, synthetic cells, xna) and technology (genome engineering, microfluidics technologies, dna synthesis and sequencing technologies) – global opportunity analysis and industry forecast, 2013 - 2020
  • 11. Intellectual Property Concerns • The relevant intellectual property is rarely the synthetic DNA itself • It is often an organism derived from the DNA • Knowing the DNA sequence might allow an attacker to infer a valuable property about your billion-dollar organism
  • 13. From Oligos to DNA • An AB 3400 can synthesize two complementary oligo strands, not the actual DNA • Someone else has to “combine” the complementary oligos to form the double-helix structure of DNA • Synthetic oligo length is 200-300 bases, which is much shorter than naturally occurring DNA https://en.wikipedia.org/wiki/Directionality_(molecular_biology)
  • 14. Attack Model • Adversary intent • Outcome • Target system and known vulnerabilities • Attack medium • Attacker capabilities • Attacker resources • Cost
  • 15. Attacker Capabilities and Resources • Has domain knowledge of DNA synthesis process • Has access to the AB 3400 user manual • Explains machine-specific procedures • Has access to an AB 3400 • Profiling needed to build an accurate model • Can place microphone close to the DNA synthesizer • Wireless transmission: one-time-access • Otherwise, a second physical visit is needed to retrieve the recording
  • 17. AB 3400 Setup • User guide • Available online • Findable via Google search • Site preparation and safety guide • Available online • Findable via Google search
  • 18. AB 3400 Acoustic Side-Channel Each valve occupies a unique position in the AB 3400 • The surface area that causes reflections is unique for each valve • Reverberation time is unique for each valve • Collected acoustic signal is unique for each valve Acoustic sources • Solenoid valves opening and closing • Fluid flowing through pipes • Cooling system fans • Pressure regulators
  • 20. Attack Model Design (Physics) • Principle-based equation (ideal, but unrealistic) • Inverse estimates the sequence (ideal, but unrealistic) 𝐴 = 𝑓(𝑆) 𝑆 = 𝑓−1(𝐴) S: System state A: Acoustic side channel
  • 21. Data-driven Approach 𝑆 = 𝑓(𝐴, 𝜃) 𝑆 = 𝑆1, 𝑆2, … , 𝑆 𝑛 Base: 𝑆𝑖 ∈ 𝑎, 𝑐, 𝑔, 𝑡 Acoustic Emission: 𝐴𝑖 = 𝐴𝑖1 , 𝐴𝑖2 , … , 𝐴𝑖 𝑘 Classifier Function: 𝑆𝑖 = 𝑓(𝐴𝑖, 𝜃) Use supervised learning to train the classifier function 𝑓 𝜃: Parameter to train
  • 22. Key Steps Preprocessing: eliminate background noise Preliminary feature extraction: isolate acoustics for each valve Signal segmentation: isolate acoustics for base delivery Feature extraction: convert acoustic signal to a set of features Nucleotide base classifier: train a classifier that correlates a set of features to one of the four nucleotide bases Post-processing: Apply domain-knowledge to correct misprediction errors 𝐴𝑖 = 𝐴𝑖1 , 𝐴𝑖2 , … , 𝐴𝑖 𝑘 → 𝑓𝑖 = 𝑓𝑖1 , 𝑓𝑖2 , … , 𝑓𝑖 𝑙 , 𝑙 ≪ 𝑘 𝑆𝑖 = 𝑓(𝑓𝑖, 𝜃)
  • 23. Experimental Setup AB 3400 DNA Synthesizer Record signals through three simultaneous channels at 48 kHz with 24 bits per sample resolution Zoom H6 audio recorder • Similar to iPhone 4 microphone Also use a contact microphone to record acoustic signals with almost no environmental noise
  • 24. Training and Evaluation • Synthesized seven synthetic oligos • Each with 60-base with 15 A’s, C’s, G’s, and T’s in varying orders • Each run took 7 hours, 29 minutes, 53 seconds • Label acquired signal into stages, exploiting information from the AB 3400 user manual • Initialization (787 seconds) • Repetitive cycle (463 seconds) • Base delivery (5 seconds within the repetitive cycle)
  • 25. Machine preparation steps Nucleotide Base Addition Cycles Delivery of Base A Delivery of Base C Delivery of Base G Time (Minute) Magnitude Time (second) Magnitude Magnitude Magnitude Time (second) Time (second) Base Delivery • Identify peak locations in signal using continuous wavelet transforms • Use the cycle script to identify sequences of distances that correspond to base delivery stage • For each stage, extract the segment that corresponds to the base delivery valve operation
  • 26. Feature Extraction • 57,018 time domain, frequency domain, and wavelet-based features • Initial Feature selection • Calculate significance of each feature and select the 75 most relevant features with the lowest dependency scores • Improved Feature selection • Calculate the frequency components with 200 MHz accuracy at frequencies above 300 Hz with local peaks in the frequency transform • Calculate significance of each feature and select the 310 most relevant features with the lowest dependency scores
  • 27. Classifier Training Without Post-Processing • 200 samples used to train each classifier • 80% of data set for training, 20% for validation • 10-fold cross validation
  • 28. Experimental Tradeoffs • Classifier accuracy degrades when less than 70 samples used for training • Classifier accuracy is susceptible to noise • White noise at 56 dB or higher • People in the room taking at 65 dB or higher • Classifier accuracy depends on microphone distance from the DNA synthesizer • Degradation occurs at 0.7 meters and further
  • 29. Biologically Relevant DNA Sequences • Assumptions: • DNA sequence to be implanted in an living organism to create a protein • Every 3 bases translates to a certain amino acid • Four DNA sequences synthesized • Contoxin: Translates to a lethal protein; highly regulated • Human Insulin: Originally extracted from pig pancreases; in 1979, DNA encoding human insulin added to bacteria to produce actual human insulin. Led to founding of Genentech (multi-$Billion pharmaceutical company) • 2 peptides: isolated by in vitro selection to bind the protein target streptavidin
  • 30. Domain Knowledge • Extra Assumption: • The attacker desires the intended purpose of a reconstructed DNA sequence • This is more valuable than the actual sequence itself • BLAST software • Stores DNA sequences and their functionality • Can determine the most similar known DNA sequence along with its application, for a given amino application sequence • An attacker is satisfied with a positive BLAST match
  • 32. Open Issues • Different microphones varying in cost/capabilities/distance • Different AB 3400s used for training/attack • Variability in acoustic emissions over the lifetime of an AB 3400 • Other DNA synthesis machines • Possible countermeasures (e.g., internal acoustic padding) • Similar attacks on other biological laboratory instruments
  • 33. Conclusion • Industry 4.0 integrates IoT sensing + machine learning into all scales of manufacturing to improve reliability and efficiency • While it’s easy to think about heavy industry, don’t ignore manufacturing in biotech, nanotech, etc. • Sensing opens up new side channel attack vectors, often coupled with social engineering • Successful attacks can benefit significantly from domain knowledge • Must secure access to physical equipment and sensory data
  • 34. Collaborators Sujit R. Chhetri (UC Irvine) Sina Faezi (UC Irvine) Arnav V. Malawade (UC Irvine) Mohammad Al Faruque (UC Irvine) John C. Chaput (UC Irvine) William H. Grover (UC Riverside)
  • 35. Evidence of the Conspiracy
  • 36. Acknowledgment This material is based upon work supported by the National Science Foundation under Grant No. 1740052. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation
  • 39. Impact of Noise on Classifier Accuracy
  • 40. Impact of Microphone Distance from DNA Synthesizer on Classifier Accuracy