Dataswft has been running several benchmarks at Intel Labs, Bangalore. Dataswft team is immensely thankful to the technical staff at Intel Labs Bangalore for providing access to their facilities and guidance.
This presentation presents cost effective options when running large workloads on Hadoop and the benefits using Dataswft.
The Proto-Burst Buffer: Experience with the flash-based file system on SDSC's...Glenn K. Lockwood
Comparing the burst buffers of today, such as the Cray DataWarp-based burst buffer implemented on NERSC Cori, to the proto-burst buffer deployed on SDSC's Gordon supercomputer in 2012.
The Proto-Burst Buffer: Experience with the flash-based file system on SDSC's...Glenn K. Lockwood
Comparing the burst buffers of today, such as the Cray DataWarp-based burst buffer implemented on NERSC Cori, to the proto-burst buffer deployed on SDSC's Gordon supercomputer in 2012.
How We Use MongoDB in Our Advertising SystemMongoDB
This talk will go over why we chose to use MongoDB for storing billions of documents with only 3 replset nodes, and why we choose MongoDB for our report data store instead of MySQL.
In cases of data loss, erasure coding is an alternative form of data protection in which data is broken into fragments and stored across a set of different locations or storage media, like object storage
AppOS: PostgreSQL Extension for Scalable File I/O @ PGConf.Asia 2019Sangwook Kim
General-purpose operating systems sacrifice database performance in order to preserve generality. This performance impact has become particularly salient with modern hardware, such as high-performance SSDs. On the other hand, substantial effort is required to customize or construct operating system-like functionalities, such as user-level CPU and disk I/O scheduling, inside a database engine to meet the performance need. In this talk, I will present AppOS, a library OS implemented as a PostgreSQL extension for scalable file I/O. AppOS improves PostgreSQL throughput up to 13x and 99th response time up to 32x for a write-intensive workload, without code changes nor hardware updates. Specifically, I will explain why Linux I/O stack is problematic for the PostgreSQL performance. Next, I will introduce the core concepts and the internals of AppOS. Finally, I will share several use cases and performance results of AppOS for PostgreSQL.
Data Science in DevOps/SysOps - Boaz Shuster - DevOpsDays Tel Aviv 2018DevOpsDays Tel Aviv
I will explain how collecting data from your continuous integration and delivery environments can help improve production releases. This talk is inspired by my previous job where I had the chance to boost the release pipeline using metrics and data.
Apresentação dos produtos desenvolvidos pela 8D Games, produtora de games e aplicativos digitais divertidos da 8D Digital, localizada em São Paulo -Brazil.
How We Use MongoDB in Our Advertising SystemMongoDB
This talk will go over why we chose to use MongoDB for storing billions of documents with only 3 replset nodes, and why we choose MongoDB for our report data store instead of MySQL.
In cases of data loss, erasure coding is an alternative form of data protection in which data is broken into fragments and stored across a set of different locations or storage media, like object storage
AppOS: PostgreSQL Extension for Scalable File I/O @ PGConf.Asia 2019Sangwook Kim
General-purpose operating systems sacrifice database performance in order to preserve generality. This performance impact has become particularly salient with modern hardware, such as high-performance SSDs. On the other hand, substantial effort is required to customize or construct operating system-like functionalities, such as user-level CPU and disk I/O scheduling, inside a database engine to meet the performance need. In this talk, I will present AppOS, a library OS implemented as a PostgreSQL extension for scalable file I/O. AppOS improves PostgreSQL throughput up to 13x and 99th response time up to 32x for a write-intensive workload, without code changes nor hardware updates. Specifically, I will explain why Linux I/O stack is problematic for the PostgreSQL performance. Next, I will introduce the core concepts and the internals of AppOS. Finally, I will share several use cases and performance results of AppOS for PostgreSQL.
Data Science in DevOps/SysOps - Boaz Shuster - DevOpsDays Tel Aviv 2018DevOpsDays Tel Aviv
I will explain how collecting data from your continuous integration and delivery environments can help improve production releases. This talk is inspired by my previous job where I had the chance to boost the release pipeline using metrics and data.
Apresentação dos produtos desenvolvidos pela 8D Games, produtora de games e aplicativos digitais divertidos da 8D Digital, localizada em São Paulo -Brazil.
In this session I will tell you what Hortonworks and IBM Power solutions are and how we can realize significant business value development and prompt use of open innovation in future cognitive utilization. In addition, I will introduce the value added unique to IBM that can be provided by IBM and Hortonworks partnership from the viewpoint of storage, analytics, data science and streaming analysis.
This tutorial will guide you how to experiment with XAP 10 MemoryXtend
We will use EC2 to start a VM with a Flash Drive.
You may use any other machine running Linux 6.x with SSD Flash Drive with this tutorial.
Palestra realizada por Luciano Palma no Intel Software Day 2013 (22/10/2013)
Conheça a arquitetura do Intel Xeon Phi, um coprocessador capaz de entregar mais de 2 TFlops de processamento para sua solução de HPC (High Performance Computing).
CTX138217 - IntelliCache Reduction in IOPS: XenDesktop 5.6 FP1 on XenServer 6.1 - Citrix Knowledge Center http://ow.ly/o3Ma4
The purpose of this document is to provide testing results based on MCS-delivered streamed virtual desktops leveraging IntelliCache
Watch the full webinar here: http://bit.ly/1TUuUCK
When considering flash storage, there are many misconceptions and outright myths. Especially when equating consumer-grade flash (USB sticks) to enterprise-grade SSDs. In this webinar SanDisk Chief Architect, Adam Roberts, will discuss 5 myths of flash storage and highlight what you need to look out for when choosing a storage device to accelerate your data center storage. This webinar will cover:
1.Data Protection
2.Power Fail Protection
3.Temperature Throttling/Overheating
4.QoS for Performance
5.SSD Endurance
Stay tuned for future webinars which will look at the benefits of flash beyond performance…busting a few more myths on flash.
2018 Infortrend All Flash Arrays Introduction (GS3025A)infortrendgroup
Infortrend All Flash Array Storages deliver lightning speed performance and enable users to optimize SSDs and energy efficiency. It also provides all the benefits of SAN, NAS and Cloud Gateway storage together in one single system, making it the ideal choice for enterprise applications (such as database, virtualization, video editing, file sharing, backup, and cloud data integration). For hardware, all flash array storage features a 2U-25bay form factor, flexible host boards to choose from, and stable, reliable modular design with high expandability; as for software, it comes with complete data services and simple, intuitive management interfaces.
More Information:
https://www.infortrend.com/global/products/FS
Recommended Product:
https://www.infortrend.com/global/products/families/fs/all-flash-arrays
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
1. Assessing Market Risk
of an Investment Portfolio involving
15 billion
calculations
This presentation is the result of benchmarks run at Intel Innovation Labs in
Bangalore, India in 2013.
We would like to thank all the technical staff at the labs for providing us all their
facilities and guidance
2. Big Join in Hadoop
3 million positions x 5000 risk models
Each model consists 2M products.
To achieve =>6 months of historical
data to be readily available while
calculating risk.
Current Status=> Only 5 days of
prior data is immediately available,
rest in archives.
3. Business Benefit
• Allows more broader time based
risk assessment
• Solution avoids costly architectures
such as in memory JVM cache
based computing.
8. First Run: 120Sec (No-Cache), 98Sec(Cache)
Setup
1250 Models / Machine with 1 SSD /Machine.
1 Dataswft instance/machine and max 64 threads/instance
Results
120 Sec with OS Cache Disabled. 98 Sec with OS Cache
Enabled.
Observation
High I/O wait and Low CPU usage.
Software bottleneck with sequential I/O reads.
Action Taken
Code modified to parallelized I/O reads
9. Second Run: 115Sec (No-Cache), 90Sec(Cache)
Setup
1250 Models / Machine with 1 SSD /Machine.
1 Dataswft instance/machine and max 64 threads/instance
Results
115 Sec with OS Cache Disabled. 90 Sec with OS Cache
Enabled.
Observation
After app log analysis we found DFSClient bottleneck.
Action Taken
Introduced 2 Dataswft Instances/Machines
10. Third Run: 70 Sec (No-Cache), 34 Sec(Cache)
Setup
1250 Models / Machine with 1 SSD /Machine.
2 Dataswft instance/machine and max 32 threads/instance
Results
70 Sec with OS Cache Disabled. 33.8 Sec with OS Cache
Enabled.
Observation (No Cache)
Average CPU Usage 32%, max 43%, Avg interrupt 17245 and
avg context switch 6365 and avg I/O wait 9.16.
Action Taken
4 SSD drives in a single machine.
11. Fourth Run: 32.8Sec (No-Cache) 30.3Sec(Cache)
Setup
1250 Models / Machine with 2 instance/machine.
4 SSDs/Machine. Max 32 threads / instance
40ms Delay on parallel thread launch
Results
32.8 Sec with OS Cache disabled. 30.3 Sec on cache enabled.
Observation (No Cache)
Average CPU Usage 75%, max 97%, Avg interrupt 48921 and
avg context switch 23376 and avg I/O wait 2.5.
Action Taken
More Delay is introduced to reduce contention.
12. Fifth Run: 32.5 Sec (No-Cache), 32Sec(Cache)
Setup
1250 Models / Machine with 2 instance/machine.
4 SSDs/Machine. Max 32 threads / instance
45ms Delay on parallel thread launch
Results
32.504 Sec with OS Cache Disabled. 32.060 Sec with OS
Cache Enabled.
Observation (No Cache)
Average CPU Usage 55%, max 82%, Avg interrupt 37564
and avg context switch 9419 and avg I/O wait 1.0.
Action Taken
None
