OpenCL Kernel Optimization Tips
•
5 likes•1,964 views
The document provides optimization tips for OpenCL kernels that focus on finding a balance between the device, toolchain, and problem being solved. It discusses considering the device type and memory characteristics, using profiling tools suited for the target platform, ensuring the problem is data parallel, and manually optimizing aspects like work group size and memory access patterns rather than relying on automatic features. Optimization requires understanding tradeoffs between these elements rather than taking a single-minded approach.
Report
Share
Report
Share
Download to read offline
Recommended
Scaling machine learning as a service at Uber — Li Erran Li at #papis2016
Machine learning as a service (MLaS) is imperative to the success of many companies as many internal teams and organizations need to gain business intelligence from big data. Building a scalable MLaS in a very challenging problem. In this paper, we present the scalable MLaS we built for a company that operates globally. We focus on several scalability challenges and our technical solutions.
Video at https://www.youtube.com/watch?v=MpnszJ_3Ong
Couldn't attend PAPIs '16? Get access to the other presentations' slides and videos at https://gumroad.com/products/fehon/
Simd programming introduction
This document provides an introduction to SIMD (Single Instruction Multiple Data) programming. It discusses what SIMD is and why it is useful for software optimization. It then covers SIMD support in different processors like CPUs, GPUs, and DSPs. The document discusses different techniques for SIMD optimization including using auto-vectorization, compiler intrinsics, specific frameworks, and assembly coding. It notes some difficult aspects of SIMD programming and concludes by discussing important considerations like ISA design, memory model, execution model, scalability, and trends in SIMD.
Video Compression Standards - History & Introduction
This document provides an overview of several video compression standards including MPEG-1/2, MPEG-4, H.264, and HEVC/H.265. It discusses the key concepts of video coding such as entropy coding, quantization, transformation, and intra- and inter-prediction. For each standard, it describes the main coding tools and improvements over previous standards, focusing on techniques for more efficient prediction and extraction of redundant spatial and temporal information while maintaining quality. The development of these standards has moved towards more fine-grained partitioning and new coding ideas and tools to reduce bitrates further.
Kernel Recipes 2014 - Performance Does Matter
Deploying clouds is in everybody’s mind but how to make an efficient deployment ?
After setting up the hardware, it’s mandatory to make a deep inspection of server’s performance.
In a farm of supposed identical servers, many miss-{installation|configuration} could seriously degrade performance. If you want to discovery such counter-performance before users complains of their VMs, you have to be detect them before installing any software. Another performance metric to know is “how many VMs could I load on top of my servers ?”. By using the same methodology it is possible the compare how a set of VMs performs regarding the bare metal capabilities.
The challenge is here: How do detect automatically servers that under perform ? How to insure that a new server entering a farm will not degrade it ? How to measure the overhead of all the virtualization layers from the VM point of view ?
Erwan Velu – Performance Engineer @eNovance
OutSystems Tips and Tricks
When setting up a new project we have some tips and tricks to help you do this in the best way possible, incl. infrastructure, database, standard attributes, logging, code alignment, and service center.
Machine learning and big data @ uber a tale of two systems
This document discusses machine learning and big data at Uber. It describes Uber's mission to provide reliable transportation everywhere. It then discusses Uber's use of Kafka for data infrastructure and Hadoop/Spark for batch processing and machine learning. The document outlines pain points with the current system and proposes addressing them by building machine learning capabilities directly into Presto, an interactive SQL query engine, to improve efficiency and allow machine learning and data analytics to leverage shared resources. Key benefits of this approach are reducing complexity for data scientists and improving performance of machine learning pipelines.
Benchmarks, performance, scalability, and capacity what s behind the numbers...
Baron Schwartz gave a presentation on analyzing database performance beyond surface-level metrics and benchmarks. He discussed how ideal benchmarks provide full system specifications and metrics over time to understand response times and throughput. Little's Law and queueing theory can predict concurrency, response times, and capacity given arrival rates and service times. While tools like Erlang C model queues, the assumptions must be validated. True scalability is nonlinear due to bottlenecks, and debunking performance claims requires examining raw data.
Benchmarks, performance, scalability, and capacity what's behind the numbers
Baron Schwartz gave a presentation on analyzing database performance beyond surface-level metrics and benchmarks. He discussed how ideal benchmarks provide full system specifications and metrics over time to understand response times and throughput. Little's Law and queueing theory can predict concurrency, response times, and capacity given arrival rates and service times. While tools like Erlang C model queues, the assumptions must be validated. True scalability is nonlinear due to bottlenecks, and debunking performance claims requires examining raw data.
Recommended
Scaling machine learning as a service at Uber — Li Erran Li at #papis2016
Machine learning as a service (MLaS) is imperative to the success of many companies as many internal teams and organizations need to gain business intelligence from big data. Building a scalable MLaS in a very challenging problem. In this paper, we present the scalable MLaS we built for a company that operates globally. We focus on several scalability challenges and our technical solutions.
Video at https://www.youtube.com/watch?v=MpnszJ_3Ong
Couldn't attend PAPIs '16? Get access to the other presentations' slides and videos at https://gumroad.com/products/fehon/
Simd programming introduction
This document provides an introduction to SIMD (Single Instruction Multiple Data) programming. It discusses what SIMD is and why it is useful for software optimization. It then covers SIMD support in different processors like CPUs, GPUs, and DSPs. The document discusses different techniques for SIMD optimization including using auto-vectorization, compiler intrinsics, specific frameworks, and assembly coding. It notes some difficult aspects of SIMD programming and concludes by discussing important considerations like ISA design, memory model, execution model, scalability, and trends in SIMD.
Video Compression Standards - History & Introduction
This document provides an overview of several video compression standards including MPEG-1/2, MPEG-4, H.264, and HEVC/H.265. It discusses the key concepts of video coding such as entropy coding, quantization, transformation, and intra- and inter-prediction. For each standard, it describes the main coding tools and improvements over previous standards, focusing on techniques for more efficient prediction and extraction of redundant spatial and temporal information while maintaining quality. The development of these standards has moved towards more fine-grained partitioning and new coding ideas and tools to reduce bitrates further.
Kernel Recipes 2014 - Performance Does Matter
Deploying clouds is in everybody’s mind but how to make an efficient deployment ?
After setting up the hardware, it’s mandatory to make a deep inspection of server’s performance.
In a farm of supposed identical servers, many miss-{installation|configuration} could seriously degrade performance. If you want to discovery such counter-performance before users complains of their VMs, you have to be detect them before installing any software. Another performance metric to know is “how many VMs could I load on top of my servers ?”. By using the same methodology it is possible the compare how a set of VMs performs regarding the bare metal capabilities.
The challenge is here: How do detect automatically servers that under perform ? How to insure that a new server entering a farm will not degrade it ? How to measure the overhead of all the virtualization layers from the VM point of view ?
Erwan Velu – Performance Engineer @eNovance
OutSystems Tips and Tricks
When setting up a new project we have some tips and tricks to help you do this in the best way possible, incl. infrastructure, database, standard attributes, logging, code alignment, and service center.
Machine learning and big data @ uber a tale of two systems
This document discusses machine learning and big data at Uber. It describes Uber's mission to provide reliable transportation everywhere. It then discusses Uber's use of Kafka for data infrastructure and Hadoop/Spark for batch processing and machine learning. The document outlines pain points with the current system and proposes addressing them by building machine learning capabilities directly into Presto, an interactive SQL query engine, to improve efficiency and allow machine learning and data analytics to leverage shared resources. Key benefits of this approach are reducing complexity for data scientists and improving performance of machine learning pipelines.
Benchmarks, performance, scalability, and capacity what s behind the numbers...
Baron Schwartz gave a presentation on analyzing database performance beyond surface-level metrics and benchmarks. He discussed how ideal benchmarks provide full system specifications and metrics over time to understand response times and throughput. Little's Law and queueing theory can predict concurrency, response times, and capacity given arrival rates and service times. While tools like Erlang C model queues, the assumptions must be validated. True scalability is nonlinear due to bottlenecks, and debunking performance claims requires examining raw data.
Benchmarks, performance, scalability, and capacity what's behind the numbers
Baron Schwartz gave a presentation on analyzing database performance beyond surface-level metrics and benchmarks. He discussed how ideal benchmarks provide full system specifications and metrics over time to understand response times and throughput. Little's Law and queueing theory can predict concurrency, response times, and capacity given arrival rates and service times. While tools like Erlang C model queues, the assumptions must be validated. True scalability is nonlinear due to bottlenecks, and debunking performance claims requires examining raw data.
Machine Learning & Graph Processing w/ Spark and Accumulo
This presentation was co-delivered by Matthew Purdy of Purdy Good Engineering, an expert on Accumulo and Big Data batch processing, and Rahul Singh of Anant, an expert on streamlining, organizing and unifying business information. They spoke about how Accumulo and Spark can be used to create highly-secure and highly-available data processing systems that leverage GraphX and MLLib
Software Design Practices for Large-Scale Automation
Design practices for large-scale, high-performance, distributed system for complex algorithms such as graph, optimization, prediction, and machine learning etc.
Ad109 - XPages Performance and Scalability
Understanding the XPages architecture is key to building performant scalable enterprise-ready Lotus Domino web applications. We'll show how to go under the hood to discover functional features that help your application perform and scale well. You'll learn about design patterns and techniques that ensure your applications are optimally tuned for your business requirements, and we'll show how to integrate existing business logic -- without increasing performance cost.
Programming for Problem Solving
While compiled by the book have made every effort to avoid any mistakes or omissions
and have used their skill, expertise, and knowledge to the best of my capacity to provide accurate and
updated information. Any mistake, or error noted may be brought to the notice of the book provider
which shall be taken care of in the next edition.
The compiled book expressly disclaims all and any liability/ responsibility to any person whether a
purchaser or reader of this book or not. In respect of anything and everything forming part of the
content of this book. It is notified that neither that book provider nor the Compiled by book will be
responsible for any damage or loss to anyone of any kind in any manner therefrom
How To Get The Most Out Of Your Hibernate, JBoss EAP 7 Application (Ståle Ped...
The fifth major release of Hibernate sports contains many internal changes developed in collaboration between the Hibernate team and the Red Hat middleware performance team. Efficient access to databases is crucial to get scalable and responsive applications. Hibernate 5 received much attention in this area. You’ll benefit from many of these improvements by merely upgrading. But it's important to understand some of these new, performance-boosting features because you will need to explicitly enable them. We'll explain the development background on all of these powerful new features and the investigation process for performance improvements. Our aim is to provide good guidance so you can make the most of it on your own applications. We'll also peek at other performance improvements made on JBoss EAP 7, like on the caching layer, the connection manager, and the web tier. We want to make sure you can all enjoy better-performing applications—that require less power and less servers—without compromising on your developer’s productivity.
Multicore
This document discusses multi-core programming and how the architecture of modern multi-core CPUs affects programming. It covers key topics like how adding more cores introduces bottlenecks due to shared resources, the differences between multi-CPU and multi-core machines, how memory is shared between cores, and how features like caches, pipelines and non-uniform memory access impact programming. The document provides guidance on how to optimize code for multi-core CPUs by avoiding delays from shared resources and improving instruction scheduling.
2016-01-16 03 Денис Нелюбин. How to test a million
The document discusses how to build an asynchronous distributed loader to test a database cluster with millions of operations per second. Key points include using technologies like Node.js, Ansible, Diamond and Graphite to build a flexible loader, distribute tests across clusters, collect system and test metrics, compare snapshots before and after tests, and visualize results for analysis. The goal is to iterate on tests to optimize performance.
Dfrws eu 2014 rekall workshop
The document provides an overview of memory forensics and the Rekall memory analysis tool. It discusses why memory forensics is useful, describes how Rekall supports multiple operating systems through profiles, and covers memory imaging, virtual memory concepts, and analyzing live memory. Rekall's interfaces like the command line, console, notebook, and web console are also introduced.
Apache Singa AI
This presentation gives an overview of the Apache Singa AI project. It explains Apache Singa in terms of it's architecture, distributed training and functionality.
Links for further information and connecting
http://www.amazon.com/Michael-Frampton/e/B00NIQDOOM/
https://nz.linkedin.com/pub/mike-frampton/20/630/385
https://open-source-systems.blogspot.com/
Monitoring and automation
This document discusses monitoring and automation from an operations and development perspective. It suggests measuring hardware usage, locating bottlenecks, anomalous behavior, and operational characteristics to optimize resources and understand costs. Standards like Prometheus are recommended for visualization. Automation is important for repeatability, consistency and reducing mistakes. Infrastructure as code with versioning enables testing deployments and lifecycles. Ultimately, the document argues that bringing operations and development together through cooperation, shared insights, and reconciling priorities around a shared mission is key to success.
Why Concurrency is hard ?
Here are a few steps I would take to troubleshoot this issue:
1. Generate a thread dump of the application to see the state of all threads. This will show any threads that may be blocked or in an unexpected state.
2. Analyze the thread dump to look for threads that are in a "RUNNABLE" state but not making progress. These could be spinning threads wasting CPU.
3. Check for threads blocked on locks, monitors or other synchronization primitives. These indicate possible deadlocks.
4. Trace the code path for the package management service to see where it may be spinning or blocking unexpectedly.
5. Check application and server logs for any errors or exceptions that could cause blocking
Concurrency - Why it's hard ?
Here are a few steps I would take to analyze the issue:
1. Collect a thread dump of the application to see what threads are currently running and in what state. This will give clues about any threads that may be blocked or spinning.
2. Analyze the thread dump looking for threads that are in a RUNNABLE or BLOCKED state long-term. These could indicate spinning or long waits.
3. Check for threads waiting on locks, semaphores or other synchronization primitives. This could point to a potential deadlock.
4. Trace the code path and logic for threads of interest to understand what they are trying to accomplish and why they may be spinning or blocked.
5. Check
C3 w3
This is the week 3 of the course 3 - Machine Learning Pipelines in Production of the MLOps specialization
Liferay portals in real projects
See what pitfalls companies are facing when running Liferay portal. In the previous year, our company has audited 5 real-life projects based on Liferay Portal which are now running in production mode and serving many users. The audits were focused on architecture, infrastructure, technical design and implementation. During the presentation, we will show you common anti-patterns we have found during the audits and their impacts and consequences on the portal.
Anurag Awasthi - Machine Learning applications for CloudStack
While Machine learning and data mining has had profound impact on how we model applications and use data for better product consumption, there is scope for extending prediction algorithms to lower levels as well. Some useful applications of machine learning in ACS could be exploring better resource allocation that is aware of usage statistics, predicting faults, load balancing, etc. In this talk we will * take a broad overview of what Machine Learning/Data mining is and how it is being used in today's tech ecosystemn* explore ways in which we can make ACS more efficientn* discuss some recent advancements in how ML can benefit datacenters from research community
Memory Management in Amoeba
The document discusses memory management in the Amoeba distributed operating system. Key points:
- Amoeba uses a simple memory model where processes are divided into segments that are stored contiguously in physical memory, with no paging or swapping. This allows for high performance but limits processes to the available physical memory.
- Segments act as addressable blocks of memory that can contain code or data and have capabilities controlling access. Processes map and unmap segments in their virtual address space as needed.
- Shared memory communications and a main memory file server are enabled through segments that can be read or written by any process with the right capabilities.
Lecture01 algorithm analysis
The document discusses an algorithms analysis and design course. The major objectives are to design and analyze modern algorithms, compare their efficiencies, and solve real-world problems. Students will learn to prove algorithm correctness, analyze running times, and apply techniques like dynamic programming and graph algorithms. While algorithms can differ in efficiency, even on faster hardware, the computational model used makes reasonable assumptions for comparing algorithms asymptotically.
Lessons learned from designing a QA Automation for analytics databases (big d...
Have a big data product / database / DBMS? need to test it? don't know where to start? some things to consider while you design your Automation QA.
Link to Video
https://www.youtube.com/watch?v=MlT4pP7BGFQ
Voxxed Athens 2018 - Methods and Practices for Guaranteed Failure in Big Data
The document provides guidance on practices that can lead to failure in big data systems. It warns against assumptions that schemas are unnecessary, that databases can scale reads and writes infinitely, and that network connections and hardware will always be available. Instead, it recommends defining schemas and metadata, understanding database models, preparing for failures through testing, and managing resources and data pipelines. Proper data governance, partitioning, replication, and understanding of consistency and transaction models can help avoid failures.
Effective cplusplus
This document discusses micro optimizations in C++ and their effectiveness. It begins by defining micro optimizations and noting that the real bottlenecks are often not within one's own code. It then discusses reasons both for and against micro optimizations, noting they can improve performance if used judiciously but also complicate code. The document covers measuring efficiency and complications that arise in C, C++ and higher-level languages. It emphasizes the importance of understanding what languages do behind the scenes and focusing optimizations on the "fast path" code used most frequently.
Halide tutorial 2019
This document provides an introduction to Halide, a domain specific language for image and signal processing. It discusses why Halide was created by decoupling the algorithm from the scheduling to make it easier for programmers to build pipelines, specify optimizations, and for compilers to generate fast code. It provides examples of Halide concepts like functions, variables, expressions, reduction domains, and data types. It also covers scheduling techniques like reordering, splitting, tiling, fusion, vectorization and parallelization. Finally, it discusses ahead-of-time compilation and code generation workflows as well as examples for image processing and matrix multiplication.
Linux SD/MMC Driver Stack
Linux SD/MMC driver stack explainaton.
Original uploaded file on slideshare disappeared due to site crash. So I re-upload.
More Related Content
Similar to OpenCL Kernel Optimization Tips
Machine Learning & Graph Processing w/ Spark and Accumulo
This presentation was co-delivered by Matthew Purdy of Purdy Good Engineering, an expert on Accumulo and Big Data batch processing, and Rahul Singh of Anant, an expert on streamlining, organizing and unifying business information. They spoke about how Accumulo and Spark can be used to create highly-secure and highly-available data processing systems that leverage GraphX and MLLib
Software Design Practices for Large-Scale Automation
Design practices for large-scale, high-performance, distributed system for complex algorithms such as graph, optimization, prediction, and machine learning etc.
Ad109 - XPages Performance and Scalability
Understanding the XPages architecture is key to building performant scalable enterprise-ready Lotus Domino web applications. We'll show how to go under the hood to discover functional features that help your application perform and scale well. You'll learn about design patterns and techniques that ensure your applications are optimally tuned for your business requirements, and we'll show how to integrate existing business logic -- without increasing performance cost.
Programming for Problem Solving
While compiled by the book have made every effort to avoid any mistakes or omissions
and have used their skill, expertise, and knowledge to the best of my capacity to provide accurate and
updated information. Any mistake, or error noted may be brought to the notice of the book provider
which shall be taken care of in the next edition.
The compiled book expressly disclaims all and any liability/ responsibility to any person whether a
purchaser or reader of this book or not. In respect of anything and everything forming part of the
content of this book. It is notified that neither that book provider nor the Compiled by book will be
responsible for any damage or loss to anyone of any kind in any manner therefrom
How To Get The Most Out Of Your Hibernate, JBoss EAP 7 Application (Ståle Ped...
The fifth major release of Hibernate sports contains many internal changes developed in collaboration between the Hibernate team and the Red Hat middleware performance team. Efficient access to databases is crucial to get scalable and responsive applications. Hibernate 5 received much attention in this area. You’ll benefit from many of these improvements by merely upgrading. But it's important to understand some of these new, performance-boosting features because you will need to explicitly enable them. We'll explain the development background on all of these powerful new features and the investigation process for performance improvements. Our aim is to provide good guidance so you can make the most of it on your own applications. We'll also peek at other performance improvements made on JBoss EAP 7, like on the caching layer, the connection manager, and the web tier. We want to make sure you can all enjoy better-performing applications—that require less power and less servers—without compromising on your developer’s productivity.
Multicore
This document discusses multi-core programming and how the architecture of modern multi-core CPUs affects programming. It covers key topics like how adding more cores introduces bottlenecks due to shared resources, the differences between multi-CPU and multi-core machines, how memory is shared between cores, and how features like caches, pipelines and non-uniform memory access impact programming. The document provides guidance on how to optimize code for multi-core CPUs by avoiding delays from shared resources and improving instruction scheduling.
2016-01-16 03 Денис Нелюбин. How to test a million
The document discusses how to build an asynchronous distributed loader to test a database cluster with millions of operations per second. Key points include using technologies like Node.js, Ansible, Diamond and Graphite to build a flexible loader, distribute tests across clusters, collect system and test metrics, compare snapshots before and after tests, and visualize results for analysis. The goal is to iterate on tests to optimize performance.
Dfrws eu 2014 rekall workshop
The document provides an overview of memory forensics and the Rekall memory analysis tool. It discusses why memory forensics is useful, describes how Rekall supports multiple operating systems through profiles, and covers memory imaging, virtual memory concepts, and analyzing live memory. Rekall's interfaces like the command line, console, notebook, and web console are also introduced.
Apache Singa AI
This presentation gives an overview of the Apache Singa AI project. It explains Apache Singa in terms of it's architecture, distributed training and functionality.
Links for further information and connecting
http://www.amazon.com/Michael-Frampton/e/B00NIQDOOM/
https://nz.linkedin.com/pub/mike-frampton/20/630/385
https://open-source-systems.blogspot.com/
Monitoring and automation
This document discusses monitoring and automation from an operations and development perspective. It suggests measuring hardware usage, locating bottlenecks, anomalous behavior, and operational characteristics to optimize resources and understand costs. Standards like Prometheus are recommended for visualization. Automation is important for repeatability, consistency and reducing mistakes. Infrastructure as code with versioning enables testing deployments and lifecycles. Ultimately, the document argues that bringing operations and development together through cooperation, shared insights, and reconciling priorities around a shared mission is key to success.
Why Concurrency is hard ?
Here are a few steps I would take to troubleshoot this issue:
1. Generate a thread dump of the application to see the state of all threads. This will show any threads that may be blocked or in an unexpected state.
2. Analyze the thread dump to look for threads that are in a "RUNNABLE" state but not making progress. These could be spinning threads wasting CPU.
3. Check for threads blocked on locks, monitors or other synchronization primitives. These indicate possible deadlocks.
4. Trace the code path for the package management service to see where it may be spinning or blocking unexpectedly.
5. Check application and server logs for any errors or exceptions that could cause blocking
Concurrency - Why it's hard ?
Here are a few steps I would take to analyze the issue:
1. Collect a thread dump of the application to see what threads are currently running and in what state. This will give clues about any threads that may be blocked or spinning.
2. Analyze the thread dump looking for threads that are in a RUNNABLE or BLOCKED state long-term. These could indicate spinning or long waits.
3. Check for threads waiting on locks, semaphores or other synchronization primitives. This could point to a potential deadlock.
4. Trace the code path and logic for threads of interest to understand what they are trying to accomplish and why they may be spinning or blocked.
5. Check
C3 w3
This is the week 3 of the course 3 - Machine Learning Pipelines in Production of the MLOps specialization
Liferay portals in real projects
See what pitfalls companies are facing when running Liferay portal. In the previous year, our company has audited 5 real-life projects based on Liferay Portal which are now running in production mode and serving many users. The audits were focused on architecture, infrastructure, technical design and implementation. During the presentation, we will show you common anti-patterns we have found during the audits and their impacts and consequences on the portal.
Anurag Awasthi - Machine Learning applications for CloudStack
While Machine learning and data mining has had profound impact on how we model applications and use data for better product consumption, there is scope for extending prediction algorithms to lower levels as well. Some useful applications of machine learning in ACS could be exploring better resource allocation that is aware of usage statistics, predicting faults, load balancing, etc. In this talk we will * take a broad overview of what Machine Learning/Data mining is and how it is being used in today's tech ecosystemn* explore ways in which we can make ACS more efficientn* discuss some recent advancements in how ML can benefit datacenters from research community
Memory Management in Amoeba
The document discusses memory management in the Amoeba distributed operating system. Key points:
- Amoeba uses a simple memory model where processes are divided into segments that are stored contiguously in physical memory, with no paging or swapping. This allows for high performance but limits processes to the available physical memory.
- Segments act as addressable blocks of memory that can contain code or data and have capabilities controlling access. Processes map and unmap segments in their virtual address space as needed.
- Shared memory communications and a main memory file server are enabled through segments that can be read or written by any process with the right capabilities.
Lecture01 algorithm analysis
The document discusses an algorithms analysis and design course. The major objectives are to design and analyze modern algorithms, compare their efficiencies, and solve real-world problems. Students will learn to prove algorithm correctness, analyze running times, and apply techniques like dynamic programming and graph algorithms. While algorithms can differ in efficiency, even on faster hardware, the computational model used makes reasonable assumptions for comparing algorithms asymptotically.
Lessons learned from designing a QA Automation for analytics databases (big d...
Have a big data product / database / DBMS? need to test it? don't know where to start? some things to consider while you design your Automation QA.
Link to Video
https://www.youtube.com/watch?v=MlT4pP7BGFQ
Voxxed Athens 2018 - Methods and Practices for Guaranteed Failure in Big Data
The document provides guidance on practices that can lead to failure in big data systems. It warns against assumptions that schemas are unnecessary, that databases can scale reads and writes infinitely, and that network connections and hardware will always be available. Instead, it recommends defining schemas and metadata, understanding database models, preparing for failures through testing, and managing resources and data pipelines. Proper data governance, partitioning, replication, and understanding of consistency and transaction models can help avoid failures.
Effective cplusplus
This document discusses micro optimizations in C++ and their effectiveness. It begins by defining micro optimizations and noting that the real bottlenecks are often not within one's own code. It then discusses reasons both for and against micro optimizations, noting they can improve performance if used judiciously but also complicate code. The document covers measuring efficiency and complications that arise in C, C++ and higher-level languages. It emphasizes the importance of understanding what languages do behind the scenes and focusing optimizations on the "fast path" code used most frequently.
Similar to OpenCL Kernel Optimization Tips (20)
Machine Learning & Graph Processing w/ Spark and Accumulo
Machine Learning & Graph Processing w/ Spark and Accumulo
Software Design Practices for Large-Scale Automation
Software Design Practices for Large-Scale Automation
How To Get The Most Out Of Your Hibernate, JBoss EAP 7 Application (Ståle Ped...
How To Get The Most Out Of Your Hibernate, JBoss EAP 7 Application (Ståle Ped...
2016-01-16 03 Денис Нелюбин. How to test a million
2016-01-16 03 Денис Нелюбин. How to test a million
Anurag Awasthi - Machine Learning applications for CloudStack
Anurag Awasthi - Machine Learning applications for CloudStack
Lessons learned from designing a QA Automation for analytics databases (big d...
Lessons learned from designing a QA Automation for analytics databases (big d...
Voxxed Athens 2018 - Methods and Practices for Guaranteed Failure in Big Data
Voxxed Athens 2018 - Methods and Practices for Guaranteed Failure in Big Data
More from Champ Yen
Halide tutorial 2019
This document provides an introduction to Halide, a domain specific language for image and signal processing. It discusses why Halide was created by decoupling the algorithm from the scheduling to make it easier for programmers to build pipelines, specify optimizations, and for compilers to generate fast code. It provides examples of Halide concepts like functions, variables, expressions, reduction domains, and data types. It also covers scheduling techniques like reordering, splitting, tiling, fusion, vectorization and parallelization. Finally, it discusses ahead-of-time compilation and code generation workflows as well as examples for image processing and matrix multiplication.
Linux SD/MMC Driver Stack
Linux SD/MMC driver stack explainaton.
Original uploaded file on slideshare disappeared due to site crash. So I re-upload.
OpenGL ES 2.x Programming Introduction
The document provides an introduction to OpenGL ES 2.0/3.0 programming, covering topics such as 3D mathematics, OpenGL ES 2.0 overview, vertex and fragment shaders, and further study areas. It reviews basic matrix and vector operations, OpenGL ES 1.x and 2.0 pipelines, shader creation and usage, and techniques like textures, uniforms, and depth testing. The goal is to give programmers a basic understanding of OpenGL ES fundamentals for mobile 3D graphics development.
Chrome OS Observation
The document discusses Google's Chrome OS operating system. It notes that Chrome OS is designed to be fast by using solid state drives and optimized hardware initialization. It is also simple, relying entirely on web applications and requiring an internet connection. Additionally, it is secure due to read-only file systems that prevent viruses and malware. However, it may face challenges replacing Windows and Linux due to limitations of web applications and a lack of local storage and offline use. The document considers how Chrome OS devices could be used primarily for public internet access in locations like airports and coffee shops.
Play With Android
The document discusses various topics related to developing and customizing the Android operating system, including its architecture, how to get started, software development practices, API levels, building the system, kernel versions, customization, and optimization. It provides resources for porting Android to different hardware platforms like x86, ARM, and MIPS devices.
Linux Porting
This document provides an overview of porting Linux to a new ARM platform. It discusses setting up the GNU toolchain, kernel prerequisites and configuration, creating machine-specific files and code, initializing drivers and boot options. Key steps include registering the new machine, adding architecture-specific code and configuration files, initializing I/O mapping and IRQs, and creating an initramfs image to test bootability. References for further information on ARM Linux boot sequences and porting are also provided.
More from Champ Yen (6)
Recently uploaded
Microservice Teams - How the cloud changes the way we work
A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams?
Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
No one wants their application to drag like a car stuck in the slow lane! Yet it’s all too common to encounter bumpy, pothole-filled solutions that slow the speed of any application. Symfony apps are not an exception.
In this talk, I will take you for a spin around the performance racetrack. We’ll explore common pitfalls - those hidden potholes on your application that can cause unexpected slowdowns. Learn how to spot these performance bumps early, and more importantly, how to navigate around them to keep your application running at top speed.
We will focus in particular on tuning your engine at the application level, making the right adjustments to ensure that your system responds like a well-oiled, high-performance race car.
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
This session covers GraalVM & Spring Boot, Spring AOT, performance optimizations and using libraries
May Marketo Masterclass, London MUG May 22 2024.pdf
Can't make Adobe Summit in Vegas? No sweat because the EMEA Marketo Engage Champions are coming to London to share their Summit sessions, insights and more!
This is a MUG with a twist you don't want to miss.
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/
Transform Your Communication with Cloud-Based IVR Solutions
Discover the power of Cloud-Based IVR Solutions to streamline communication processes. Embrace scalability and cost-efficiency while enhancing customer experiences with features like automated call routing and voice recognition. Accessible from anywhere, these solutions integrate seamlessly with existing systems, providing real-time analytics for continuous improvement. Revolutionize your communication strategy today with Cloud-Based IVR Solutions. Learn more at: https://thesmspoint.com/channel/cloud-telephony
Graspan: A Big Data System for Big Code Analysis
We built a disk-based parallel graph system, Graspan, that uses a novel edge-pair centric computation model to compute dynamic transitive closures on very large program graphs.
We implement context-sensitive pointer/alias and dataflow analyses on Graspan. An evaluation of these analyses on large codebases such as Linux shows that their Graspan implementations scale to millions of lines of code and are much simpler than their original implementations.
These analyses were used to augment the existing checkers; these augmented checkers found 132 new NULL pointer bugs and 1308 unnecessary NULL tests in Linux 4.4.0-rc5, PostgreSQL 8.3.9, and Apache httpd 2.2.18.
- Accepted in ASPLOS ‘17, Xi’an, China.
- Featured in the tutorial, Systemized Program Analyses: A Big Data Perspective on Static Analysis Scalability, ASPLOS ‘17.
- Invited for presentation at SoCal PLS ‘16.
- Invited for poster presentation at PLDI SRC ‘16.
DDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS Security Version 1.2 was adopted in 2024. This revision strengthens support for long runnings systems adding new cryptographic algorithms, certificate revocation, and hardness against DoS attacks.
GreenCode-A-VSCode-Plugin--Dario-Jurisic
Presentation about a VSCode plugin from Dario Jurisic at the GSD Community Stage meetup
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
WhatsApp offers simple, reliable, and private messaging and calling services for free worldwide. With end-to-end encryption, your personal messages and calls are secure, ensuring only you and the recipient can access them. Enjoy voice and video calls to stay connected with loved ones or colleagues. Express yourself using stickers, GIFs, or by sharing moments on Status. WhatsApp Business enables global customer outreach, facilitating sales growth and relationship building through showcasing products and services. Stay connected effortlessly with group chats for planning outings with friends or staying updated on family conversations.
Mobile App Development Company In Noida | Drona Infotech
Looking for a reliable mobile app development company in Noida? Look no further than Drona Infotech. We specialize in creating customized apps for your business needs.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版一模一样【微信：741003700 】【美国纽约州立大学奥尔巴尼分校毕业证学位证书】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
Empowering Growth with Best Software Development Company in Noida - Deuglo
Do you want Software for your Business? Visit Deuglo
Deuglo has top Software Developers in India. They are experts in software development and help design and create custom Software solutions.
Deuglo follows seven steps methods for delivering their services to their customers. They called it the Software development life cycle process (SDLC).
Requirement — Collecting the Requirements is the first Phase in the SSLC process.
Feasibility Study — after completing the requirement process they move to the design phase.
Design — in this phase, they start designing the software.
Coding — when designing is completed, the developers start coding for the software.
Testing — in this phase when the coding of the software is done the testing team will start testing.
Installation — after completion of testing, the application opens to the live server and launches!
Maintenance — after completing the software development, customers start using the software.
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation:
Selenium, Cypress, Puppeteer, and Playwright. Ministry of Testing Athens. Meetup on the Beach. 30 May 2024.
Webinar On-Demand: Using Flutter for Embedded
Flutter is a popular open source, cross-platform framework developed by Google. In this webinar we'll explore Flutter and its architecture, delve into the Flutter Embedder and Flutter’s Dart language, discover how to leverage Flutter for embedded device development, learn about Automotive Grade Linux (AGL) and its consortium and understand the rationale behind AGL's choice of Flutter for next-gen IVI systems. Don’t miss this opportunity to discover whether Flutter is right for your project.
E-commerce Development Services- Hornet Dynamics
For any business hoping to succeed in the digital age, having a strong online presence is crucial. We offer Ecommerce Development Services that are customized according to your business requirements and client preferences, enabling you to create a dynamic, safe, and user-friendly online store.
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
Charla impartida en el evento de "KuberTENes Birthday Bash Guadalajara" para celebrar el 10mo. aniversario de Kubernetes #kuberTENes #celebr8k8s #k8s
Recently uploaded (20)
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
DDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systems
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
KuberTENes Birthday Bash Guadalajara - Introducción a Argo CD
OpenCL Kernel Optimization Tips
- 1. OpenCL Kernel Optimization Tips Champ Yen (champ.yen@gmail.com) http://champyen.blogspot.com ver.20140820
- 2. Optimization - a form of balance Device/Platform Features Runtime Toolchain Problem Algorithm Optimization Optimization is not only greedy searching in single direction. It is more like to find a good balance point between device, toolchain and the problem.
- 3. Device - Computation ● device type ○ cpu - powerful single thread performance ○ gpu - many threads, great total throughput ● ISA design ○ scalar-based ○ vector-based ● # of compute unit/processing elements ● estimate impact of using divergence & barrier ● capability of asynchronous data transfer
- 4. Device - Memory ● get basic memory characteristics: ○ size ○ latency ○ throughput ○ coalescing effect ○ addressing mode ● global memory - unified or not ● local memory - real or not ● penalty of oversize
- 5. Toolchain/Runtime ● document/tutorial/guide for debugging, profiling and optimization. ● there is no perfect runtime/toolchain ● profiling/debugging tools. ● it is not always a good idea to debug/optimization on different platforms. ● automatic optimization MAY NOT HELP the thinking of optimization ● tricky forms of computation/memory operations. ○ MAD operations ○ memory access mode
- 6. Problem/Algorithms ● DATA PARALLEL! ● multi-stages is not always bad. ○ doing all things together uses more memory resource in one workitem. ● vectorized is not always a good idea ● use appropriate work group size ○ bad memory access pattern, less coalescing ○ may cause lower cache hit rate ○ less local memory for each workitem ○ may be less private memory for each workitem. ● different form of implementation ● do optimization things manually. ○ DO NOT relies on automatic features.
- 7. Q & A