SlideShare a Scribd company logo
1 of 15
How do I perform Cloud
Discovery with Microsoft Cloud
App Security (MCAS)?
Five methods to inject cloud discovery data
into MCAS
Option 1 – Snapshot Report (e.g. a one-time assessment or a Proof of Concept)
Firewall/Proxy Upload Single
Log File to
MCAS
Create snapshot reports of Cloud Discovery cloud app use |
Microsoft Docs
Option 2 – Microsoft Defender for Endpoint
Win 10 device
running Microsoft
Defender for
Endpoint
Integrate Microsoft Defender for Endpoint with Cloud App
Security | Microsoft Docs
Automatic Upload to
MCAS
Option 3 – Secure Web Gateway (SWG)
Supported SWGs
Auto uploads traffic
data to MCAS
Integrate Cloud App Security with Zscaler | Microsoft Docs
Integrate Cloud App Security with iboss | Microsoft Docs
Integrate Cloud App Security with Corrata | Microsoft Docs
Integrate Cloud App Security with Menlo Security | Microsoft Docs
Option 4 – Cloud Discovery API (REST API)
MCAS REST API
Auto uploads traffic
data to MCAS
Cloud App Security Cloud Discovery API | Microsoft Docs
Option 5 – Automatic Log Upload for Continuous Reports (aka “Log Collector”)
Firewall/Proxy
Auto upload to
MCAS
Configure automatic log upload for continuous reports in Cloud App Security | Microsoft Docs
Firewall/Proxy (Data Source)
Syslog or FTP
Logs
Log Collector(s)
OPTIONAL: Firewall/proxy logs from a
Security Information & Event
Management system (SIEM)
How does a Log Collector work?
• Receives logs over Syslog or FTP from firewalls/proxies
• Each log is automatically processed, compressed, and transmitted to MCAS
• FTP logs are uploaded to MCAS after the file finished the FTP transfer to the Log
Collector
• For Syslog, the Log Collector writes the received logs to the disk. Then the collector
uploads the file to Cloud App Security when the file size is larger than 40 KB.
• After a log is uploaded to Cloud App Security, it's moved to a backup directory
• The backup directory stores the last 20 logs
• When new logs arrive, the old ones are deleted.
• Whenever the log collector disk space is full, the log collector drops new logs until it has
more free disk space. You'll receive a warning on the Log collectors tab in the MCAS
portal.
• IMPORTANT: The log collector will compress data before it’s uploaded. Outbound traffic
is 10% the size of the original log.
What are the prerequisites?
• Logs must be forwarded in their original format
• Logs must either be sent over Syslog or FTP
• The more verbose in the log, the better the visibility in MCAS. MCAS requires web-traffic data with the following attributes:
• Date of the transaction
• Source IP
• Source user - highly recommended
• Destination IP address
• Destination URL recommended (URLs provide higher accuracy for cloud app detection than IP addresses)
• Total amount of data (data information is highly valuable)
• Amount of uploaded or downloaded data (provides insights about the usage patterns of the cloud apps)
• Action taken (allowed/blocked)
• It is recommended to ensure the log contains upload/download transaction sizes, usernames and target URL. The more verbose
the log, the better!
• Log events aren't more than 90 days old.
• The log file is valid and includes outbound traffic information.
• Log data source is supported.
Network Requirements
To enable Cloud Discovery features using a log collector and detect Shadow IT in your organization, open the following items:
• Allow the log collector to receive inbound FTP and Syslog traffic.
• Allow the log collector to initiate outbound traffic to the MCAS portal (for example contoso.cloudappsecurity.com) on port 443.
• Allow the log collector to initiate outbound traffic to the Azure blob storage on port 443:
• US1 https://adaprodconsole.blob.core.windows.net/
• US2 https://prod03use2console1.blob.core.windows.net/
• US3 https://prod5usw2console1.blob.core.windows.net/
• EU1 https://prod02euwconsole1.blob.core.windows.net/
• EU2 https://prod4uksconsole1.blob.core.windows.net/
• Gov US1 https://gprd1usgvconsole1.blob.core.usgovcloudapi.net/
• Note: If your firewall requires a static IP address access list and does not support allowing based on URL, allow the log collector to
initiate outbound traffic to the Microsoft Azure datacenter IP ranges on port 443.
• If you didn't specify a proxy when you set up the log collector, you need to allow http connections on port 80 for the URLs listed on
the Azure TLS certificate changes page. This is used for checking certificate revocation status when you connect to the Cloud App
Security portal.
Supported firewalls/proxies
• Barracuda - Web App Firewall (W3C)
• Blue Coat Proxy SG - Access log (W3C)
• Check Point
• Cisco ASA with FirePOWER
• Cisco ASA Firewall (For Cisco ASA firewalls, it's necessary to set the
information level to 6)
• Cisco Cloud Web Security
• Cisco FWSM
• Cisco IronPort WSA
• Cisco Meraki – URLs log
• Clavister NGFW (Syslog)
• ContentKeeper
• Corrata
• Digital Arts i-FILTER
• Websense - Web Security Solutions - Investigative detail report (CSV)
• Websense - Web Security Solutions - Internet activity log (CEF)
• Forcepoint
• Fortinet Fortigate
• iboss Secure Cloud Gateway
• Juniper SRX
• Juniper SSG
• McAfee Secure Web Gateway
• Menlo Security (CEF)
• Microsoft Forefront Threat Management Gateway (W3C)
• Palo Alto series Firewall
• Sonicwall (formerly Dell)
• Sophos SG
• Sophos XG
• Sophos Cyberoam
• Squid (Common)
• Squid (Native)
• Stormshield
• WatchGuard
• Zscaler
Deploy Cloud Discovery | Microsoft Docs
Supported firewalls/proxies (cont’d)
• If your log isn't supported, or if you are using a newly
released log format from one of the supported data
sources and the upload is failing:
• Select Other as the Data source and specify the appliance and
log you're trying to upload.
• Your log will be reviewed by the Cloud App Security cloud
analyst team and you'll be notified if support for your log type
is added.
• Alternatively, you can define a custom parser that
matches your format. For more information, see Use a
custom log parser.
• Note: Generic CEF,LEEF,W3C formats are also supported.
Deploy Cloud Discovery | Microsoft Docs
What is a Log Collector?
• A Docker server that runs on Windows, Ubuntu, Red Hat Enterprise or Cent
OS
• Can be located on-premises or in Azure
• Minimum requirements:
• Disk space: 250 GB
• CPU: 2
• RAM: 4 GB
• Each OS will have additional minimum requirements. See the
following for more details:
• Docker on Windows on-premises
• Docker on Linux on-premises
• Docker on Linux in Azure
Log Collector Performance
The Log collector can successfully handle log capacity of up to 50 GB per hour. The main
bottlenecks in the log collection process are:
• Network bandwidth - Your network bandwidth determines the log upload speed.
• I/O performance of the virtual machine - Determines the speed at which logs are written
to the log collector's disk.
• The log collector has a built-in safety mechanism that monitors the rate at which logs arrive and
compares it to the upload rate.
• In cases of congestion, the log collector starts to drop log files.
• If your setup typically exceeds 50 GB per hour, it's recommended that you split the traffic between
multiple log collectors.
• If more than 10 data sources, consider splitting the sources among multiple log collectors
How do I deploy a Log Collector?
• Docker on Windows on-premises
• Docker on Linux on-premises
• Docker on Linux in Azure

More Related Content

What's hot

20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...
20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...
20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...Amazon Web Services Japan
 
Asterisk High Availability Design Guide
Asterisk High Availability Design GuideAsterisk High Availability Design Guide
Asterisk High Availability Design GuideMichelle Dupuis
 
Azureの学習にオススメな動画コンテンツまとめ.pptx
Azureの学習にオススメな動画コンテンツまとめ.pptxAzureの学習にオススメな動画コンテンツまとめ.pptx
Azureの学習にオススメな動画コンテンツまとめ.pptxmizuhiro
 
OpenStack Ironic - Bare Metal-as-a-Service
OpenStack Ironic - Bare Metal-as-a-ServiceOpenStack Ironic - Bare Metal-as-a-Service
OpenStack Ironic - Bare Metal-as-a-ServiceRamon Acedo Rodriguez
 
20190424 AWS Black Belt Online Seminar Amazon Aurora MySQL
20190424 AWS Black Belt Online Seminar Amazon Aurora MySQL20190424 AWS Black Belt Online Seminar Amazon Aurora MySQL
20190424 AWS Black Belt Online Seminar Amazon Aurora MySQLAmazon Web Services Japan
 
The Evolution of OpenStack – From Infancy to Enterprise
The Evolution of OpenStack – From Infancy to EnterpriseThe Evolution of OpenStack – From Infancy to Enterprise
The Evolution of OpenStack – From Infancy to EnterpriseRackspace
 
こわくない!Azure 運用管理
こわくない!Azure 運用管理こわくない!Azure 運用管理
こわくない!Azure 運用管理Miho Yamamoto
 
Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會
Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會
Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會Jason Cheng
 
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティスAmazon Web Services Japan
 
JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」
JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」
JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」Takakiyo Tanaka
 
Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身Amazon Web Services Japan
 
AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~
AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~
AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~Amazon Web Services Japan
 
NW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がる ネットワークアーキテクチャ
NW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がるネットワークアーキテクチャNW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がるネットワークアーキテクチャ
NW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がる ネットワークアーキテクチャShuji Kikuchi
 
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)Amazon Web Services Japan
 
Amplify Consoleで かんたん!Webサイト公開
Amplify Consoleで かんたん!Webサイト公開Amplify Consoleで かんたん!Webサイト公開
Amplify Consoleで かんたん!Webサイト公開Daisuke Yagi
 
AWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNS
AWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNSAWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNS
AWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNSAmazon Web Services Japan
 
Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)
Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)
Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)Amazon Web Services Japan
 
多要素認証による Amazon WorkSpaces の利用
多要素認証による Amazon WorkSpaces の利用多要素認証による Amazon WorkSpaces の利用
多要素認証による Amazon WorkSpaces の利用Amazon Web Services Japan
 
AWS初心者向けWebinar AWSからのEメール送信
AWS初心者向けWebinar AWSからのEメール送信AWS初心者向けWebinar AWSからのEメール送信
AWS初心者向けWebinar AWSからのEメール送信Amazon Web Services Japan
 
Awsでのsql高可用構成 Always On
Awsでのsql高可用構成 Always OnAwsでのsql高可用構成 Always On
Awsでのsql高可用構成 Always OnShinodaYukihiro
 

What's hot (20)

20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...
20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...
20190828 AWS Black Belt Online Seminar Amazon Aurora with PostgreSQL Compatib...
 
Asterisk High Availability Design Guide
Asterisk High Availability Design GuideAsterisk High Availability Design Guide
Asterisk High Availability Design Guide
 
Azureの学習にオススメな動画コンテンツまとめ.pptx
Azureの学習にオススメな動画コンテンツまとめ.pptxAzureの学習にオススメな動画コンテンツまとめ.pptx
Azureの学習にオススメな動画コンテンツまとめ.pptx
 
OpenStack Ironic - Bare Metal-as-a-Service
OpenStack Ironic - Bare Metal-as-a-ServiceOpenStack Ironic - Bare Metal-as-a-Service
OpenStack Ironic - Bare Metal-as-a-Service
 
20190424 AWS Black Belt Online Seminar Amazon Aurora MySQL
20190424 AWS Black Belt Online Seminar Amazon Aurora MySQL20190424 AWS Black Belt Online Seminar Amazon Aurora MySQL
20190424 AWS Black Belt Online Seminar Amazon Aurora MySQL
 
The Evolution of OpenStack – From Infancy to Enterprise
The Evolution of OpenStack – From Infancy to EnterpriseThe Evolution of OpenStack – From Infancy to Enterprise
The Evolution of OpenStack – From Infancy to Enterprise
 
こわくない!Azure 運用管理
こわくない!Azure 運用管理こわくない!Azure 運用管理
こわくない!Azure 運用管理
 
Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會
Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會
Proxmox VE 功能概觀、案例分享與實用工具 [2019/12/07] @Proxmox VE 中文使用者社團 2019 年會
 
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
 
JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」
JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」
JJUGナイトセミナー OpenJDK祭り「OpenJ9+OpenJDK」
 
Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身
 
AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~
AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~
AWS Black Belt Online Seminar 2017 AWS体験ハンズオン~Amazon S3 バックアップ~
 
NW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がる ネットワークアーキテクチャ
NW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がるネットワークアーキテクチャNW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がるネットワークアーキテクチャ
NW-JAWS x Tech-on勉強会:AWS Transit Gateway で広がる ネットワークアーキテクチャ
 
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
 
Amplify Consoleで かんたん!Webサイト公開
Amplify Consoleで かんたん!Webサイト公開Amplify Consoleで かんたん!Webサイト公開
Amplify Consoleで かんたん!Webサイト公開
 
AWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNS
AWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNSAWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNS
AWS Black Belt Tech シリーズ 2016 - Amazon SQS / Amazon SNS
 
Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)
Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)
Amazon Aurora Deep Dive (re:Invent 2015 DAT405 日本語翻訳版)
 
多要素認証による Amazon WorkSpaces の利用
多要素認証による Amazon WorkSpaces の利用多要素認証による Amazon WorkSpaces の利用
多要素認証による Amazon WorkSpaces の利用
 
AWS初心者向けWebinar AWSからのEメール送信
AWS初心者向けWebinar AWSからのEメール送信AWS初心者向けWebinar AWSからのEメール送信
AWS初心者向けWebinar AWSからのEメール送信
 
Awsでのsql高可用構成 Always On
Awsでのsql高可用構成 Always OnAwsでのsql高可用構成 Always On
Awsでのsql高可用構成 Always On
 

Similar to Deploy Cloud Discovery with MCAS Log Collector

Oracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle CloudOracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle Cloudpasalapudi
 
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCPSimpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCPDaniel Zivkovic
 
How to accelerate docker adoption with a simple and powerful user experience
How to accelerate docker adoption with a simple and powerful user experienceHow to accelerate docker adoption with a simple and powerful user experience
How to accelerate docker adoption with a simple and powerful user experienceDocker, Inc.
 
FIWARE Wednesday Webinars - Short Term History within Smart Systems
FIWARE Wednesday Webinars - Short Term History within Smart SystemsFIWARE Wednesday Webinars - Short Term History within Smart Systems
FIWARE Wednesday Webinars - Short Term History within Smart SystemsFIWARE
 
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud PlatformonMárton Kodok
 
Stream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NETStream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NETconfluent
 
Crypt tech technical-presales
Crypt tech technical-presalesCrypt tech technical-presales
Crypt tech technical-presalesMustafa Kuğu
 
DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...
DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...
DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...Docker, Inc.
 
Boris Stoyanov - Troubleshooting the Virtual Router - Run and Get Diagnostics
Boris Stoyanov - Troubleshooting the Virtual Router - Run and Get DiagnosticsBoris Stoyanov - Troubleshooting the Virtual Router - Run and Get Diagnostics
Boris Stoyanov - Troubleshooting the Virtual Router - Run and Get DiagnosticsShapeBlue
 
Scale Your Data Tier with Windows Server AppFabric
Scale Your Data Tier with Windows Server AppFabricScale Your Data Tier with Windows Server AppFabric
Scale Your Data Tier with Windows Server AppFabricWim Van den Broeck
 
Cloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerizationCloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerizationMárton Kodok
 
AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...
AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...
AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...Amazon Web Services
 
Openstack Summit Vancouver 2018 - Multicloud Networking
Openstack Summit Vancouver 2018 - Multicloud NetworkingOpenstack Summit Vancouver 2018 - Multicloud Networking
Openstack Summit Vancouver 2018 - Multicloud NetworkingShannon McFarland
 
26.1.7 lab snort and firewall rules
26.1.7 lab   snort and firewall rules26.1.7 lab   snort and firewall rules
26.1.7 lab snort and firewall rulesFreddy Buenaño
 
Digital Forensics and Incident Response in The Cloud Part 3
Digital Forensics and Incident Response in The Cloud Part 3Digital Forensics and Incident Response in The Cloud Part 3
Digital Forensics and Incident Response in The Cloud Part 3Velocidex Enterprises
 
Docker Logging and analysing with Elastic Stack - Jakub Hajek
Docker Logging and analysing with Elastic Stack - Jakub Hajek Docker Logging and analysing with Elastic Stack - Jakub Hajek
Docker Logging and analysing with Elastic Stack - Jakub Hajek PROIDEA
 
Docker Logging and analysing with Elastic Stack
Docker Logging and analysing with Elastic StackDocker Logging and analysing with Elastic Stack
Docker Logging and analysing with Elastic StackJakub Hajek
 
Installing Cognos 10.2.1: Tips and Tricks from the Trenches
Installing Cognos 10.2.1: Tips and Tricks from the TrenchesInstalling Cognos 10.2.1: Tips and Tricks from the Trenches
Installing Cognos 10.2.1: Tips and Tricks from the TrenchesSenturus
 

Similar to Deploy Cloud Discovery with MCAS Log Collector (20)

Oracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle CloudOracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle Cloud
 
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCPSimpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
 
How to accelerate docker adoption with a simple and powerful user experience
How to accelerate docker adoption with a simple and powerful user experienceHow to accelerate docker adoption with a simple and powerful user experience
How to accelerate docker adoption with a simple and powerful user experience
 
FIWARE Wednesday Webinars - Short Term History within Smart Systems
FIWARE Wednesday Webinars - Short Term History within Smart SystemsFIWARE Wednesday Webinars - Short Term History within Smart Systems
FIWARE Wednesday Webinars - Short Term History within Smart Systems
 
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon6. DISZ - Webalkalmazások skálázhatósága  a Google Cloud Platformon
6. DISZ - Webalkalmazások skálázhatósága a Google Cloud Platformon
 
Stream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NETStream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NET
 
Crypt tech technical-presales
Crypt tech technical-presalesCrypt tech technical-presales
Crypt tech technical-presales
 
DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...
DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...
DCEU 18: Use Cases and Practical Solutions for Docker Container Storage on Sw...
 
Autopilot : Securing Cloud Native Storage
Autopilot : Securing Cloud Native StorageAutopilot : Securing Cloud Native Storage
Autopilot : Securing Cloud Native Storage
 
Boris Stoyanov - Troubleshooting the Virtual Router - Run and Get Diagnostics
Boris Stoyanov - Troubleshooting the Virtual Router - Run and Get DiagnosticsBoris Stoyanov - Troubleshooting the Virtual Router - Run and Get Diagnostics
Boris Stoyanov - Troubleshooting the Virtual Router - Run and Get Diagnostics
 
Scale Your Data Tier with Windows Server AppFabric
Scale Your Data Tier with Windows Server AppFabricScale Your Data Tier with Windows Server AppFabric
Scale Your Data Tier with Windows Server AppFabric
 
Cloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerizationCloud Run - the rise of serverless and containerization
Cloud Run - the rise of serverless and containerization
 
AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...
AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...
AWS re:Invent 2016: Amazon CloudFront Flash Talks: Best Practices on Configur...
 
Openstack Summit Vancouver 2018 - Multicloud Networking
Openstack Summit Vancouver 2018 - Multicloud NetworkingOpenstack Summit Vancouver 2018 - Multicloud Networking
Openstack Summit Vancouver 2018 - Multicloud Networking
 
App Deployment on Cloud
App Deployment on CloudApp Deployment on Cloud
App Deployment on Cloud
 
26.1.7 lab snort and firewall rules
26.1.7 lab   snort and firewall rules26.1.7 lab   snort and firewall rules
26.1.7 lab snort and firewall rules
 
Digital Forensics and Incident Response in The Cloud Part 3
Digital Forensics and Incident Response in The Cloud Part 3Digital Forensics and Incident Response in The Cloud Part 3
Digital Forensics and Incident Response in The Cloud Part 3
 
Docker Logging and analysing with Elastic Stack - Jakub Hajek
Docker Logging and analysing with Elastic Stack - Jakub Hajek Docker Logging and analysing with Elastic Stack - Jakub Hajek
Docker Logging and analysing with Elastic Stack - Jakub Hajek
 
Docker Logging and analysing with Elastic Stack
Docker Logging and analysing with Elastic StackDocker Logging and analysing with Elastic Stack
Docker Logging and analysing with Elastic Stack
 
Installing Cognos 10.2.1: Tips and Tricks from the Trenches
Installing Cognos 10.2.1: Tips and Tricks from the TrenchesInstalling Cognos 10.2.1: Tips and Tricks from the Trenches
Installing Cognos 10.2.1: Tips and Tricks from the Trenches
 

More from Matt Soseman

MCAS High Level Architecture May 2021
MCAS High Level Architecture May 2021MCAS High Level Architecture May 2021
MCAS High Level Architecture May 2021Matt Soseman
 
Azure Sentinel Jan 2021 overview deck
Azure Sentinel Jan 2021 overview deck Azure Sentinel Jan 2021 overview deck
Azure Sentinel Jan 2021 overview deck Matt Soseman
 
Using m365 defender to protect against solorigate
Using m365 defender to protect against solorigateUsing m365 defender to protect against solorigate
Using m365 defender to protect against solorigateMatt Soseman
 
Document fingerprinting in Microsoft 365 Compliance
Document fingerprinting in Microsoft 365 ComplianceDocument fingerprinting in Microsoft 365 Compliance
Document fingerprinting in Microsoft 365 ComplianceMatt Soseman
 
Intune MDM Enrollment: Android enterprise work profile
Intune MDM Enrollment: Android enterprise work profile Intune MDM Enrollment: Android enterprise work profile
Intune MDM Enrollment: Android enterprise work profile Matt Soseman
 
iOS/iPad OS Intune MDM Enrollment
iOS/iPad OS Intune MDM EnrollmentiOS/iPad OS Intune MDM Enrollment
iOS/iPad OS Intune MDM EnrollmentMatt Soseman
 

More from Matt Soseman (6)

MCAS High Level Architecture May 2021
MCAS High Level Architecture May 2021MCAS High Level Architecture May 2021
MCAS High Level Architecture May 2021
 
Azure Sentinel Jan 2021 overview deck
Azure Sentinel Jan 2021 overview deck Azure Sentinel Jan 2021 overview deck
Azure Sentinel Jan 2021 overview deck
 
Using m365 defender to protect against solorigate
Using m365 defender to protect against solorigateUsing m365 defender to protect against solorigate
Using m365 defender to protect against solorigate
 
Document fingerprinting in Microsoft 365 Compliance
Document fingerprinting in Microsoft 365 ComplianceDocument fingerprinting in Microsoft 365 Compliance
Document fingerprinting in Microsoft 365 Compliance
 
Intune MDM Enrollment: Android enterprise work profile
Intune MDM Enrollment: Android enterprise work profile Intune MDM Enrollment: Android enterprise work profile
Intune MDM Enrollment: Android enterprise work profile
 
iOS/iPad OS Intune MDM Enrollment
iOS/iPad OS Intune MDM EnrollmentiOS/iPad OS Intune MDM Enrollment
iOS/iPad OS Intune MDM Enrollment
 

Recently uploaded

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 

Recently uploaded (20)

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 

Deploy Cloud Discovery with MCAS Log Collector

  • 1. How do I perform Cloud Discovery with Microsoft Cloud App Security (MCAS)?
  • 2. Five methods to inject cloud discovery data into MCAS
  • 3. Option 1 – Snapshot Report (e.g. a one-time assessment or a Proof of Concept) Firewall/Proxy Upload Single Log File to MCAS Create snapshot reports of Cloud Discovery cloud app use | Microsoft Docs
  • 4. Option 2 – Microsoft Defender for Endpoint Win 10 device running Microsoft Defender for Endpoint Integrate Microsoft Defender for Endpoint with Cloud App Security | Microsoft Docs Automatic Upload to MCAS
  • 5. Option 3 – Secure Web Gateway (SWG) Supported SWGs Auto uploads traffic data to MCAS Integrate Cloud App Security with Zscaler | Microsoft Docs Integrate Cloud App Security with iboss | Microsoft Docs Integrate Cloud App Security with Corrata | Microsoft Docs Integrate Cloud App Security with Menlo Security | Microsoft Docs
  • 6. Option 4 – Cloud Discovery API (REST API) MCAS REST API Auto uploads traffic data to MCAS Cloud App Security Cloud Discovery API | Microsoft Docs
  • 7. Option 5 – Automatic Log Upload for Continuous Reports (aka “Log Collector”) Firewall/Proxy Auto upload to MCAS Configure automatic log upload for continuous reports in Cloud App Security | Microsoft Docs Firewall/Proxy (Data Source) Syslog or FTP Logs Log Collector(s) OPTIONAL: Firewall/proxy logs from a Security Information & Event Management system (SIEM)
  • 8. How does a Log Collector work? • Receives logs over Syslog or FTP from firewalls/proxies • Each log is automatically processed, compressed, and transmitted to MCAS • FTP logs are uploaded to MCAS after the file finished the FTP transfer to the Log Collector • For Syslog, the Log Collector writes the received logs to the disk. Then the collector uploads the file to Cloud App Security when the file size is larger than 40 KB. • After a log is uploaded to Cloud App Security, it's moved to a backup directory • The backup directory stores the last 20 logs • When new logs arrive, the old ones are deleted. • Whenever the log collector disk space is full, the log collector drops new logs until it has more free disk space. You'll receive a warning on the Log collectors tab in the MCAS portal. • IMPORTANT: The log collector will compress data before it’s uploaded. Outbound traffic is 10% the size of the original log.
  • 9. What are the prerequisites? • Logs must be forwarded in their original format • Logs must either be sent over Syslog or FTP • The more verbose in the log, the better the visibility in MCAS. MCAS requires web-traffic data with the following attributes: • Date of the transaction • Source IP • Source user - highly recommended • Destination IP address • Destination URL recommended (URLs provide higher accuracy for cloud app detection than IP addresses) • Total amount of data (data information is highly valuable) • Amount of uploaded or downloaded data (provides insights about the usage patterns of the cloud apps) • Action taken (allowed/blocked) • It is recommended to ensure the log contains upload/download transaction sizes, usernames and target URL. The more verbose the log, the better! • Log events aren't more than 90 days old. • The log file is valid and includes outbound traffic information. • Log data source is supported.
  • 10. Network Requirements To enable Cloud Discovery features using a log collector and detect Shadow IT in your organization, open the following items: • Allow the log collector to receive inbound FTP and Syslog traffic. • Allow the log collector to initiate outbound traffic to the MCAS portal (for example contoso.cloudappsecurity.com) on port 443. • Allow the log collector to initiate outbound traffic to the Azure blob storage on port 443: • US1 https://adaprodconsole.blob.core.windows.net/ • US2 https://prod03use2console1.blob.core.windows.net/ • US3 https://prod5usw2console1.blob.core.windows.net/ • EU1 https://prod02euwconsole1.blob.core.windows.net/ • EU2 https://prod4uksconsole1.blob.core.windows.net/ • Gov US1 https://gprd1usgvconsole1.blob.core.usgovcloudapi.net/ • Note: If your firewall requires a static IP address access list and does not support allowing based on URL, allow the log collector to initiate outbound traffic to the Microsoft Azure datacenter IP ranges on port 443. • If you didn't specify a proxy when you set up the log collector, you need to allow http connections on port 80 for the URLs listed on the Azure TLS certificate changes page. This is used for checking certificate revocation status when you connect to the Cloud App Security portal.
  • 11. Supported firewalls/proxies • Barracuda - Web App Firewall (W3C) • Blue Coat Proxy SG - Access log (W3C) • Check Point • Cisco ASA with FirePOWER • Cisco ASA Firewall (For Cisco ASA firewalls, it's necessary to set the information level to 6) • Cisco Cloud Web Security • Cisco FWSM • Cisco IronPort WSA • Cisco Meraki – URLs log • Clavister NGFW (Syslog) • ContentKeeper • Corrata • Digital Arts i-FILTER • Websense - Web Security Solutions - Investigative detail report (CSV) • Websense - Web Security Solutions - Internet activity log (CEF) • Forcepoint • Fortinet Fortigate • iboss Secure Cloud Gateway • Juniper SRX • Juniper SSG • McAfee Secure Web Gateway • Menlo Security (CEF) • Microsoft Forefront Threat Management Gateway (W3C) • Palo Alto series Firewall • Sonicwall (formerly Dell) • Sophos SG • Sophos XG • Sophos Cyberoam • Squid (Common) • Squid (Native) • Stormshield • WatchGuard • Zscaler Deploy Cloud Discovery | Microsoft Docs
  • 12. Supported firewalls/proxies (cont’d) • If your log isn't supported, or if you are using a newly released log format from one of the supported data sources and the upload is failing: • Select Other as the Data source and specify the appliance and log you're trying to upload. • Your log will be reviewed by the Cloud App Security cloud analyst team and you'll be notified if support for your log type is added. • Alternatively, you can define a custom parser that matches your format. For more information, see Use a custom log parser. • Note: Generic CEF,LEEF,W3C formats are also supported. Deploy Cloud Discovery | Microsoft Docs
  • 13. What is a Log Collector? • A Docker server that runs on Windows, Ubuntu, Red Hat Enterprise or Cent OS • Can be located on-premises or in Azure • Minimum requirements: • Disk space: 250 GB • CPU: 2 • RAM: 4 GB • Each OS will have additional minimum requirements. See the following for more details: • Docker on Windows on-premises • Docker on Linux on-premises • Docker on Linux in Azure
  • 14. Log Collector Performance The Log collector can successfully handle log capacity of up to 50 GB per hour. The main bottlenecks in the log collection process are: • Network bandwidth - Your network bandwidth determines the log upload speed. • I/O performance of the virtual machine - Determines the speed at which logs are written to the log collector's disk. • The log collector has a built-in safety mechanism that monitors the rate at which logs arrive and compares it to the upload rate. • In cases of congestion, the log collector starts to drop log files. • If your setup typically exceeds 50 GB per hour, it's recommended that you split the traffic between multiple log collectors. • If more than 10 data sources, consider splitting the sources among multiple log collectors
  • 15. How do I deploy a Log Collector? • Docker on Windows on-premises • Docker on Linux on-premises • Docker on Linux in Azure