SIMD extensions have been used since early 70’s in vector programming. They are mainly CPU specific and not Oracle specific. Nevertheless, they are used by Oracle and especially by In-Memory option to perform operations against Oracle In-Memory Compression Units. Oracle exploits SIMD extensions to perform data parallelism but without concurrency.
In this presentation, the data structure (vectors), CPU Registers, SIMD instructions and how they are used outside Oracle will be presented. As a consequence, we will see how the combination of both (data structure and instructions) can significantly reduce the number of operations. During this part, code samples written in C will be presented and executed to demonstrate it.
Then, a focus will be made on SIMD instructions inside Oracle and how it uses them: usage of specific libraries and Oracle kernel components that should use SIMD instructions.
The GNU Linux debugger helps us in this way to detect internal procedures usage that are based on SIMD instructions. It helps us to establish the link between SIMD instructions and Oracle operations like filters and aggregates. Then, it will be showed how SIMD instructions are involved in performance improvement.
Finally, a conclusion will be made on “why Oracle In-Memory performances would be improved in future versions”.
This presentation will help user to understand, by a bottom up analysis, how non-specific programming techniques are used by Oracle to improve performance with In-Memory Option and how the column format can benefit from this improvement.
Oracle 12c comes with a new Security offer, and a set of new features related to. By default, Oracle is not very well secured but it comes with a lot of tools and options to improve the security inside the database. The presentation will show to attendees that building a strong security policy based on 4 security topics can improve the data security. These ones are Authentication, Authorization, Encryption and Audit. Each of these four topics will be detailed by presenting Oracle 12c new security features, for example: privilege analysis, transparent network encryption and checksumming, unified auditing etc. Finally, a presentation on Database Vault will be made to show how a "divide and conquer" policy can improve the global security of Oracle databases.
Security Best Practice: Oracle passwords, but secure!Stefan Oehrli
Authentication is an integral part of database security. If authentication or passwords are insufficient or inadequate, all further security measures are generally useless. But how do you ensure that passwords are complex and authentication is secure? In this presentation, the password hashes will be explained and it will be shown how to make sure passwords and authentication are state of the art. Focusing on the current versions of the Oracle database, the following topics will be discussed:
– Oracle database authentication
– Password verification and hashes
– Where can I find password hashes?
– Check and password hashes.
– Discussion of various risks related to authentication.
– Discussion of password policies and strong passwords.
– Customer Use Case in the DB Vault environment "ups we have forgotten the passwords"
Authentication is an integral part of security. If authentication or passwords are insufficient, all further security measures are obsolete. But how do you ensure that passwords are complex? We will explain the different password hashes and show how to make sure authentication is secure.
The Oracle Cloud allows to build and configure various infrastructure resources. But you won't get far by just using "click acrobatics" via Web Console, especially if you want to build several similar and complex environments. A mouse click cannot be saved just like that. Oracle offers several API's to create and manage objects in OCI, e.g. Oracle OCI commandline utility, OCI SDK, Terraform Provider etc. This presentation will explain how to implement Infrastructure as Code in OCI using Terraform and the Oracle Terraform Provider. Using a training environment as an example, it will be shown how to build components with Terraform Server, databases and network components and how to scale them in terms of resources or number.
IaC MeetUp Active Directory Setup for Oracle Security LABStefan Oehrli
There is always that one problem that you want to analyze or that new feature that you briefly want to test. But often you lack a corresponding LAB environment. Especially if several systems and services like MS Active Directory have to be tested in combination. In this presentation we will show how IaC, scripts etc. can be used to create LAB environments quickly and easily. We will show how to configure VMs with Vagrant to test specific topics like Oracle Database Integration with Active Directory. In addition to Vagrant, we will also take a brief look at Docker Containers and Terraform Deployment on OCI, and see how you can create a corresponding LAB environment with moderate effort. The presentation will be complemented by corresponding demos and examples.
Oracle 12c comes with a new Security offer, and a set of new features related to. By default, Oracle is not very well secured but it comes with a lot of tools and options to improve the security inside the database. The presentation will show to attendees that building a strong security policy based on 4 security topics can improve the data security. These ones are Authentication, Authorization, Encryption and Audit. Each of these four topics will be detailed by presenting Oracle 12c new security features, for example: privilege analysis, transparent network encryption and checksumming, unified auditing etc. Finally, a presentation on Database Vault will be made to show how a "divide and conquer" policy can improve the global security of Oracle databases.
Security Best Practice: Oracle passwords, but secure!Stefan Oehrli
Authentication is an integral part of database security. If authentication or passwords are insufficient or inadequate, all further security measures are generally useless. But how do you ensure that passwords are complex and authentication is secure? In this presentation, the password hashes will be explained and it will be shown how to make sure passwords and authentication are state of the art. Focusing on the current versions of the Oracle database, the following topics will be discussed:
– Oracle database authentication
– Password verification and hashes
– Where can I find password hashes?
– Check and password hashes.
– Discussion of various risks related to authentication.
– Discussion of password policies and strong passwords.
– Customer Use Case in the DB Vault environment "ups we have forgotten the passwords"
Authentication is an integral part of security. If authentication or passwords are insufficient, all further security measures are obsolete. But how do you ensure that passwords are complex? We will explain the different password hashes and show how to make sure authentication is secure.
The Oracle Cloud allows to build and configure various infrastructure resources. But you won't get far by just using "click acrobatics" via Web Console, especially if you want to build several similar and complex environments. A mouse click cannot be saved just like that. Oracle offers several API's to create and manage objects in OCI, e.g. Oracle OCI commandline utility, OCI SDK, Terraform Provider etc. This presentation will explain how to implement Infrastructure as Code in OCI using Terraform and the Oracle Terraform Provider. Using a training environment as an example, it will be shown how to build components with Terraform Server, databases and network components and how to scale them in terms of resources or number.
IaC MeetUp Active Directory Setup for Oracle Security LABStefan Oehrli
There is always that one problem that you want to analyze or that new feature that you briefly want to test. But often you lack a corresponding LAB environment. Especially if several systems and services like MS Active Directory have to be tested in combination. In this presentation we will show how IaC, scripts etc. can be used to create LAB environments quickly and easily. We will show how to configure VMs with Vagrant to test specific topics like Oracle Database Integration with Active Directory. In addition to Vagrant, we will also take a brief look at Docker Containers and Terraform Deployment on OCI, and see how you can create a corresponding LAB environment with moderate effort. The presentation will be complemented by corresponding demos and examples.
This presentation is an overview of things all IT management team needs to consider before upgrading to Oracle Database 12c and were presented in a webinar: bit.ly/1yzSdsd
Oracle ACE Director Dan Morgan was a 12c beta tester and is intimately familiar with changes in architecture and how they will impact existing infrastructure and planning and budgeting considerations.
In 2015, most organizations will begin to migrate to the latest version of Oracle Database 12c, but few are aware of the challenges to management, planning and budgeting that need to be addressed before executing such a project. Dan Morgan presents what needs to be considered and shares a few tips about 12c new features.
If you have any questions regarding your future Oracle migrations and upgrades, feel free to visit Performance Tuning Corporation at www.perftuning.com
Security Best Practice: Oracle passwords, but secure!Stefan Oehrli
Authentication is an integral part of database security. If authentication or passwords are insufficient or inadequate, all further security measures are generally useless. But how do you ensure that passwords are complex and authentication is secure? In this presentation, the password hashes will be explained and it will be shown how to make sure passwords and authentication are state of the art. Focusing on the current versions of the Oracle database, the following topics will be discussed:
- Oracle database authentication
- Password verification and hashes
- Where can I find password hashes?
- Check and password hashes.
- Discussion of various risks related to authentication.
- Discussion of password policies and strong passwords.
- Customer Use Case in the DB Vault environment "ups we have forgotten the passwords".
The presentation will be supplemented by corresponding examples and live demos.
SSL, more strictly called Transport Layer Security (TLS), is a means to encrypt data that is in flight between software components, whether within your data center or between that and your end users' devices. This prevents eavesdroppers seeing confidential information, such as credit card numbers or database passwords, and ensures that components are communicating with who they they think they are. So why isn't SSL/TLS used for all electronic communications? Firstly it is, almost by definition, "slightly tricky" to configure and errors are not terribly informative when things don't work (why would you help a hacker?!). Secondly there is a performance overhead for running TLS, although with modern hardware this is probably less of a concern than it used to be.
This session describes how to configure TLS at all layers within a Fusion Middleware stack - from the front-end Oracle HTTP Server, right through to communications with the database.
This platform was first given by Simon Haslam (eProseed UK) and Jacco Landlust (ING) at the OGh Fusion Middleware Experience event in February 2016.
SOUG Oracle Unified Audit for Multitenant DatabasesStefan Oehrli
Oracle Audit is a proven database functionality. Or maybe not? How does auditing look like in combination with Oracle Multitenant DBs? Does DB and Unified Audit work analogous to existing configurations? In the context of this lecture audit in Container DBs (19c/20c) will be discussed more closely. We will shown where to pay attention and how to adapt an audit concept to the new architecture. Specific problems and workarounds will be shown. The presentation will be complemented by demos.
DOAG Oracle Unified Audit in Multitenant EnvironmentsStefan Oehrli
Oracle Audit is a well-known and proven database functionality. Or maybe not? What does auditing look like in combination with Oracle Multitenant Databases? Does database and Unified Audit work analogous to existing configurations? In the context of this presentation the auditing in the environment of container databases will be examined more closely. It will be shown what has to be considered and how an auditing concept has to be adapted to the new architecture. With focus on the current versions of the Oracle database, specific problems and workarounds in the area of Unified Audit will be shown. The presentation will be complemented by corresponding examples and live demos.
This presentation is an overview of things all IT management team needs to consider before upgrading to Oracle Database 12c and were presented in a webinar: bit.ly/1yzSdsd
Oracle ACE Director Dan Morgan was a 12c beta tester and is intimately familiar with changes in architecture and how they will impact existing infrastructure and planning and budgeting considerations.
In 2015, most organizations will begin to migrate to the latest version of Oracle Database 12c, but few are aware of the challenges to management, planning and budgeting that need to be addressed before executing such a project. Dan Morgan presents what needs to be considered and shares a few tips about 12c new features.
If you have any questions regarding your future Oracle migrations and upgrades, feel free to visit Performance Tuning Corporation at www.perftuning.com
Security Best Practice: Oracle passwords, but secure!Stefan Oehrli
Authentication is an integral part of database security. If authentication or passwords are insufficient or inadequate, all further security measures are generally useless. But how do you ensure that passwords are complex and authentication is secure? In this presentation, the password hashes will be explained and it will be shown how to make sure passwords and authentication are state of the art. Focusing on the current versions of the Oracle database, the following topics will be discussed:
- Oracle database authentication
- Password verification and hashes
- Where can I find password hashes?
- Check and password hashes.
- Discussion of various risks related to authentication.
- Discussion of password policies and strong passwords.
- Customer Use Case in the DB Vault environment "ups we have forgotten the passwords".
The presentation will be supplemented by corresponding examples and live demos.
SSL, more strictly called Transport Layer Security (TLS), is a means to encrypt data that is in flight between software components, whether within your data center or between that and your end users' devices. This prevents eavesdroppers seeing confidential information, such as credit card numbers or database passwords, and ensures that components are communicating with who they they think they are. So why isn't SSL/TLS used for all electronic communications? Firstly it is, almost by definition, "slightly tricky" to configure and errors are not terribly informative when things don't work (why would you help a hacker?!). Secondly there is a performance overhead for running TLS, although with modern hardware this is probably less of a concern than it used to be.
This session describes how to configure TLS at all layers within a Fusion Middleware stack - from the front-end Oracle HTTP Server, right through to communications with the database.
This platform was first given by Simon Haslam (eProseed UK) and Jacco Landlust (ING) at the OGh Fusion Middleware Experience event in February 2016.
SOUG Oracle Unified Audit for Multitenant DatabasesStefan Oehrli
Oracle Audit is a proven database functionality. Or maybe not? How does auditing look like in combination with Oracle Multitenant DBs? Does DB and Unified Audit work analogous to existing configurations? In the context of this lecture audit in Container DBs (19c/20c) will be discussed more closely. We will shown where to pay attention and how to adapt an audit concept to the new architecture. Specific problems and workarounds will be shown. The presentation will be complemented by demos.
DOAG Oracle Unified Audit in Multitenant EnvironmentsStefan Oehrli
Oracle Audit is a well-known and proven database functionality. Or maybe not? What does auditing look like in combination with Oracle Multitenant Databases? Does database and Unified Audit work analogous to existing configurations? In the context of this presentation the auditing in the environment of container databases will be examined more closely. It will be shown what has to be considered and how an auditing concept has to be adapted to the new architecture. With focus on the current versions of the Oracle database, specific problems and workarounds in the area of Unified Audit will be shown. The presentation will be complemented by corresponding examples and live demos.
Various processor architectures are described in this presentation. It could be useful for people working for h/w selection and processor identification.
Leveraging Cassandra for real-time multi-datacenter public cloud analyticsJulien Anguenot
iland has built a global data warehouse across multiple data centers, collecting and aggregating data from core cloud services including compute, storage and network as well as chargeback and compliance. iland's warehouse brings actionable intelligence that customers can use to manipulate resources, analyze trends, define alerts and share information.
In this session, we would like to present the lessons learned around Cassandra, both at the development and operations level, but also the technology and architecture we put in action on top of Cassandra such as Redis, syslog-ng, RabbitMQ, Java EE, etc.
Finally, we would like to share insights on how we are currently extending our platform with Spark and Kafka and what our motivations are.
iland Internet Solutions: Leveraging Cassandra for real-time multi-datacenter...DataStax Academy
iland has built a global data warehouse across multiple data centers, collecting and aggregating data from core cloud services including compute, storage and network as well as chargeback and compliance. iland's warehouse brings actionable intelligence that customers can use to manipulate resources, analyze trends, define alerts and share information.
In this session, we would like to present the lessons learned around Cassandra, both at the development and operations level, but also the technology and architecture we put in action on top of Cassandra such as Redis, syslog-ng, RabbitMQ, Java EE, etc.
Finally, we would like to share insights on how we are currently extending our platform with Spark and Kafka and what our motivations are.
Media parsing is known as one of the weakest components of every consumer system. It often operates complex data structures in the most performant way possible, which is at odds with security requirements, such as attack surface minimization, compartmentalization, and privilege separation. Compared to other operating systems, video decoding on MacOS/iOS is an interesting case for two different reasons. First, instead of running in usermode, a considerable portion of format parsing is implemented in a kernel extension called AppleAVD, exposing the kernel to additional remote attack vectors. Second, recent anonymous reports suggest that AppleAVD may have been exploited in the wild. Our talk investigates AppleAVD kernel extension in-depth, covering video decoding subsystem internals, analysis of vulnerabilities, and ways to exploit them.
6 months/weeks training in Vlsi,jalandhardeepikakaler1
E2marix is leading Training & Certification Company offering Corporate Training Programs, IT Education Courses in diversified areas.Since its inception, E2matrix educational Services have trained and certified many students and professionals.
TECHNOLOGIES PROVIDED -
MATLAB
NS2
IMAGE PROCESSING
.NET
SOFTWARE TESTING
DATA MINING
NEURAL networks
HFSS
WEKA
ANDROID
CLOUD computing
COMPUTER NETWORKS
FUZZY LOGIC
ARTIFICIAL INTELLIGENCE
LABVIEW
EMBEDDED
VLSI
Address
Opp. Phagwara Bus Stand, Above Bella
Pizza, Handa City Center, Phagwara
email-e2matrixphagwara@gmail.com
jalandhare2matrix@gmail.com
Web site-www.e2matrix.com
CONTACT NUMBER --
07508509730
09041262727
7508509709
6 weeks/months summer training in vlsi,ludhianadeepikakaler1
E2matrix offer our assistance, writing and consulting services with your research assignments particularly in the areas of thesis, dissertations, journals, online forum discussions, FYP, and so on.
We also provide training for the different technologies and are involved in a wide diversity of subject areas ranging from management,engineering up to programming and designs; and our team of research experts and professional consultants are readily available to help you towards your successful completion of your assignments.
Engage us today at our e2matrixphagwara@gmail.com
jalandhare2matrix@gmail.com
and can visit our web site-www.e2matrix.com
contact us-7508509709
07508509730
Summer training embedded system and its scopeArshit Rai
CETPA INFOTECH PVT LTD is one of the IT education and training service provider brands of India that is preferably working in 3 most important domains. It includes IT Training services, software and embedded product development and consulting services.
slides from a joint presentation at UKOUG with Björn Rost about the Renaissance of SPARC. SPARC and Solaris are back in the game continuing to build on a rich feature set a reliable, 64bit platform which offers lots of flexibity and virtualization features
Summer training embedded system and its scopeArshit Rai
CETPA INFOTECH PVT LTD is one of the IT education and training service provider brands of India that is preferably working in 3 most important domains. It includes IT Training services, software and embedded product development and consulting services.
http://www.cetpainfotech.com
Migrating ETL Workflow to Apache Spark at Scale in PinterestDatabricks
Pinterest is moving all batch processing to Apache Spark, which includes a large amount of legacy ETL workflows written in Cascading/Scalding. In this talk, we will share the challenges and solutions we experienced during this migration, which includes the motivation of the migration, how to fill the semantic gap between different engines, the difficulty dealing with thrift objects widely used in Pinterest, how we improve Spark accumulators, how to tune the Spark performance after migration using our innovative Spark profiler, and also the performance improvements and cost saving we have achieved after the migration.
Similar to SIMD inside and outside oracle 12c (20)
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...informapgpstrackings
Keep tabs on your field staff effortlessly with Informap Technology Centre LLC. Real-time tracking, task assignment, and smart features for efficient management. Request a live demo today!
For more details, visit us : https://informapuae.com/field-staff-tracking/
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
Developing Distributed High-performance Computing Capabilities of an Open Sci...Globus
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among public health practitioners, mathematical modelers, and scientific computing specialists, while revealing critical gaps in exploiting advanced computing systems to support urgent decision making. Informed by our team’s work in applying high-performance computing in support of public health decision makers during the COVID-19 pandemic, we present how Globus technologies are enabling the development of an open science platform for robust epidemic analysis, with the goal of collaborative, secure, distributed, on-demand, and fast time-to-solution analyses to support public health.
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ?
Venez le découvrir lors de cette session ignite
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey.
Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience.
Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system.
Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
2. Whoami
•Oracle Consultant since 2001
•Former developer (C, Java, perl, PL/SQL)
•Owner@Premiseo: Data Management on Premise and in the Cloud
•Blogger since 2004
• http://laurent.leturgez.free.fr (In french and discontinued)
• http://laurent-leturgez.com
•Twitter : @lleturgez
3. Agenda
•SIMD Instructions, outside Oracle 12c
•What is a SIMD instruction ?
•Will my application use SIMD ?
•Raw Performance
•SIMD Instructions, inside Oracle 12c
•How SIMD instructions are used inside Oracle 12c
•Tracing SIMD in Oracle 12c
4. Caveats
•Most of the topics are from
• My own researches
• My past life as a developer
•Some of the topics are about internals, so:
• Analysis and conclusion may be incomplete
• Future versions of Oracle may change the features
•Tests have been done with Oracle 12.1.0.2, Oracle Enterprise
Linux 7.3 (UEKR3), VMWare Fusion 8 (And VirtualBox)
5. Before we start …
•Some fundamentals (from Dennis Yurichev’s book)
• CPU register : […]The easiest way to understand a register is to think of it as an
untyped temporary variable. Imagine if you were working with high-level PL1
and could only use eight 32-bit (or 64-bit) variables. Yet a lot can be done using
just these!
• Instruction : A primitive CPU command. The simplest examples include:
moving data between registers, working with memory and arithmetic
primitives. As a rule, each CPU has its own instruction set architecture (ISA).
• Assembly language : Mnemonic code and some extensions like macros which
are intended to make a programmer’s life easier.
http://beginners.re/Reverse_Engineering_for_Beginners-en.pdf
6. Agenda
•SIMD Instructions, outside Oracle 12c
•What is a SIMD instruction ?
•Will my application use SIMD ?
•Raw Performance
•SIMD Instructions, inside Oracle 12c
•How SIMD instructions are used inside Oracle 12c
•Tracing SIMD in Oracle 12c
7. SIMD instructions … outside Oracle 12c
• SIMD stands for Single Instruction Multiple Data
• Process multiple data
• In one CPU instruction
• Based on
• Specific registers
• Specific CPU instructions and sets of instructions
• Not Oracle specific
• CPU Architecture specific
• Intel
• IBM (Altivec)
• Sparc v9 (VIS)
• This presentation is mainly about Intel architecture
8. SIMD instructions … outside Oracle 12c
•What is a SIMD register ?
•It’s a CPU register
•Wider than traditional registers (RDI, RSI, R8, R9 etc.)
• 128 up to 512 bits wide
• Contains many data
9. SIMD instructions … outside Oracle 12c
•How does it work ? Scalar operation
• an array of 4 integers {1,2,3,4}
• add 1 to each value
Reg1
Reg2
Reg3
CPU
RAM
In
Out
2 3 41
1
Reg1
Reg2
Reg3
CPU
RAM
In
Out
2 3 41
1
1
Reg1
Reg2
Reg3
CPU
RAM
In
Out
2 3 41
1
1
2
Reg1
Reg2
Reg3
CPU
RAM
In
Out
2 3 41
1
1
2
2
Reg1
Reg2
Reg3
CPU
RAM
In
Out
2 3 41
4
1
5
3 4 52
…/…
LOAD ADD SAVE
4 LOAD
4 ADD
4 SAVE
10. SIMD instructions … outside Oracle 12c
•How does it work ? SIMD operation
• an array of 4 integers {1,2,3,4}
• add 1 to each value
SIMD Reg1
CPU
RAM
In
Out
2 3 41
1 1 11SIMD Reg2
SIMD Reg3
SIMD Reg1
CPU
RAM
In
Out
2 3 41
2 3 41
1 1 11SIMD Reg2
SIMD Reg3
SIMD Reg1
CPU
RAM
In
Out
2 3 41
2 3 41
1 1 11
3 4 52
SIMD Reg2
SIMD Reg3
SIMD Reg1
CPU
RAM
In
Out
2 3 41
3 4 52
2 3 41
1 1 11
3 4 52
SIMD Reg2
SIMD Reg3
LOAD ADD SAVE
11. SIMD instructions … outside Oracle 12c
Instruction set MMX SSE SSE2/SSE3/SSSE3/SSE
4
AVX/AVX2 AVX3 or AVX512
Register Size 64 Bits 128 bits 128 bits 256 Bits 512 bits
# Registers 8 8 16 16 32
Register Name MM0 to MM7 XMM0 to XMM7 XMM0 to XMM15 YMM0 to YMM15 ZMM0 to ZMM31
Processors Pentium II Pentium III Pentium IV to Nehalem Sandy Bridge - Haswell Skylake (initially
announced but not
available yet)
Maybe on Kaby Lake Xeon
chip
Other Only four 32 bits single
precision floating point
numbers
Usage expansion (two 64
bits double precision,
four 32 bits integers and
up to sixteen 8 bits bytes)
Three operand
instructions (non
destructive) : A+B=C
rather than A=A+B
Alignments requirements
relaxed
13. Agenda
•SIMD Instructions, outside Oracle 12c
•What is a SIMD instruction ?
•Will my application use SIMD ?
•Raw Performance
•SIMD Instructions, inside Oracle 12c
•How SIMD instructions are used inside Oracle 12c
•Tracing SIMD in Oracle 12c
14. •It depends on :
•Hardware
• Consult processors datasheets to see which instruction set extensions are
used (if many)
• http://ark.intel.com/#@Processors
•Hypervisor
• Some (old) hypervisors do not support modern extensions
• VirtualBox versions <5.0 don’t support SSE4, AVX and AVX2
• Hyper-V on W2008R2-SP1 needs patch for specific processors to support
AVX
Will my application use SIMD registers and instructions ?
15. •It depends on the Operating System
•AVX (256 bits) is supported from
• Linux Kernel >= 2.6.30
• Redhat EL5 : 2.6.18
• Oracle EL5 w/UEK : 2.6.32
AVX needs xsave kernel parameter
• Solaris 10 upd 10 and Solaris 11 (x86-64)
• Windows 2008 R2 SP1
Will my application use SIMD registers and instructions ?
16. •It depends on the compiler
•GCC
• > 4.6 for AVX support
• Use of specific switches (-msse2, -msse4.1, msse4.2, -mavx, -mavx2 …)
•Intel C/C++ Compiler (ICC)
• > 11.1 for AVX Support and > 13.0 for AVX2 support
• Use of specific switches (-xsse4.2, -xavx, -xCORE-AVX2 …)
•Beware of optimization switches (-O1,-O2, -O3)
•More … disassemble (if you are allowed to )
• Registers
• Assembly language instructions
Will my application use SIMD registers and instructions ?
17. Agenda
•SIMD Instructions, outside Oracle 12c
•What is a SIMD instruction ?
•Will my application use SIMD ?
•Raw Performance
•SIMD Instructions, inside Oracle 12c
•How SIMD instructions are used inside Oracle 12c
•Tracing SIMD in Oracle 12c
18. • Based on a C program
• Used CPU: Haswell microarchitecture (Core i7-4960HQ). AVX/AVX2
enabled
• 3 tests : No SIMD, SSE4, AVX
• Input: one array containing 1Million values.
• Goal: Add 1 to each value, each million values repeated 4k, 8k, 16k and
32k times
• CPU Time(s) = f(#rows)
“Quick and Dirty” Sample code available here:
https://app.box.com/s/ibmnbblpho4xtbeq2x8ir60nrk37208v
Raw Performance
20. Agenda
•SIMD Instructions, outside Oracle 12c
•What is a SIMD instruction ?
•Will my application use SIMD ?
•Raw Performance
•SIMD Instructions, inside Oracle 12c
•How SIMD instructions are used inside Oracle 12c
•Tracing SIMD in Oracle 12c
21. SIMD instructions … inside Oracle 12c
•In Memory Data Structure
• In Memory Compression Unit : IMCU
• IMCU is the unit of column store allocation
• Target size is 1M rows
(controlled by _inmemory_imcu_target_rows in 12.1, replaced by
_inmemory_imcu_target_maxrows in 12.2 (?))
• One IMCU can contain more than one column
• Each column in one IMCU is a column unit (CU)
22. SIMD instructions … inside Oracle 12c
•In memory column store storage indexes
• For each column unit, min and max values are maintained in a
storage index
• Storage Indexes provide CU pruning
• Information about CU available in GV$IM_COL_CU
(Undocumented. See Bug ID 19361690)
IMCU Pruning
23. SIMD instructions … inside Oracle 12c
• The way your data is sorted matters for best IMCU pruning
24. SIMD instructions … inside Oracle 12c
•SIMD extensions are used with In Memory storage indexes
for efficient filtering
1. IM Storage Indexes do IMCU pruning
2. SIMD instructions apply efficiently filter predicates
IMCU
Pruning
Prod-id
10
10
14
14
10
Filtering
with SIMD
25. SIMD instructions … inside Oracle 12c
•Oracle 12c uses specific libraries for SIMD (and compression)
•Located in $ORACLE_HOME/lib
• libshpksse4212.so for SSE4.2 extensions
Compiled with ICC v12 with specific xsse4.2 switch
• libshpkavx12.so for AVX extensions
Compiled with ICC v12 with specific xavx switch
• libshpkavx212.so for AVX2 extensions
Not totally implemented (8 functions implemented in 12.1, 824 in 12.2)
No ICC avx2 switch used because ICC v12 doesn’t support AVX2
•Thanks Tanel Pöder for this
26. SIMD instructions … inside Oracle 12c
•Oracle SIMD related functions
• Located in kdzk kernel module (HPK)
• Part of Advanced Compression library (ADVCMP)
• Easily tracked with systemtap
28. SIMD instructions … inside Oracle 12c
•How Oracle uses SIMD extensions ?
It depends on many parameters
• OS Level : /proc/cpuinfo
• AVX and AVX2 support
• SSE4 Support only
29. SIMD instructions … inside Oracle 12c
•Which library am I using ?
•pmap
• AVX support
• SSE4 support
30. SIMD instructions … inside Oracle 12c
•Which compiler options have been used ?
• Read “comment” section in ELF
• Read the corresponding compiler documentation
[oracle@oel7 conf]$ readelf -p .comment $ORACLE_HOME/lib/libshpkavx12.so |
> | egrep -i 'intel|gcc' | egrep 'xavx|mavx’
[ 2c] -?comment:Intel(R) C Intel(R) 64 Compiler XE for applications running on
Intel(R) 64, Version 12.0 Build 20120731
…/…
-DNTEV_USE_EPOLL -DNET_USE_LDAP -xavx
31. SIMD instructions … inside Oracle 12c
•How are SIMD registers used by Oracle ?
• GDB
• To get and know the call stack (backtrace)
• To set breakpoints on interesting functions
• To view register contents (traditional and SIMD)
• “Info registers” for traditional registers
• “Info all-registers” for all registers (SIMD reg included)
• (gdb) print $ymmX.<format>
Format can be v8_float, v4_double, v32_int8, v16_int16, v8_int32, v4_int64, or v2_int128
32. SIMD instructions … inside Oracle 12c
break kdzk_gt_dynp_32bit
commands 1
bt
continue
end;
Breakpoint 1, 0x00007f2a341b2e30 in kdzk_gt_dynp_32bit () from
/u01/app/oracle/product/12.1.0/dbhome_1/lib/libshpkavx12.so
#0 0x00007f2a341b2e30 in kdzk_gt_dynp_32bit () from
/u01/app/oracle/product/12.1.0/dbhome_1/lib/libshpkavx12.so
#1 0x000000000b7041bc in kdzk_cmp ()
#2 0x000000000b4deada in kdzdcol_theta_imc_sep ()
#3 0x00000000038a075f in kdzdcol_theta ()
#4 0x000000000b577726 in kdpEvalTheta ()
#5 0x000000000b57bad0 in kdpPredEval ()
#6 0x00000000038a02ef in kdzt_acmp_predeval ()
#7 0x0000000009fb9758 in kdstf11101010001101km ()
#8 0x000000000cd2de55 in kdsttgr ()
#9 0x000000000cd73576 in qertbFetch ()
#10 0x000000000cd9ed50 in qergsFetch ()
#11 0x000000000cbd424b in opifch2 ()
#12 0x0000000002207899 in kpoal8 ()
#13 0x000000000cbdaecd in opiodr ()
#14 0x000000000ce0ffab in ttcpip ()
#15 0x0000000001bcd8b6 in opitsk ()
#16 0x0000000001bd2241 in opiino ()
#17 0x000000000cbdaecd in opiodr ()
#18 0x0000000001bc9a0b in opidrv ()
#19 0x00000000026d9f91 in sou2o ()
#20 0x0000000000bd680a in opimai_real ()
#21 0x00000000026e46dc in ssthrdmain ()
34. SIMD instructions … inside Oracle 12c
In red, register content has
been modified
In blue, the second part of
the SIMD registers (128 bits)
is empty
35. SIMD instructions … inside Oracle 12c
•Oracle (12.1) IM can use AVX or SSE4 extensions for SIMD operations
•When AVX is used
It uses only 128 bits out of 256 bits wide registers
• AVX adds new register-state through the 256-bit wide YMM register file
• Explicit operating system support is required to properly save and restore AVX's
expanded registers between context switches
• Without this, only AVX 128-bit is supported
36. SIMD instructions … inside Oracle 12c
•The culprit
•Oracle 12.1.0.2 is supported from EL5 onwards
•EL5 Redhat Kernel is 2.6.18 and this flag (xsave) is supported from
2.6.30 kernels
•For compatibility reasons, Oracle has had to compile its code on
2.6.18 kernels
37. Agenda
•SIMD Instructions, outside Oracle 12c
•What is a SIMD instruction ?
•Will my application use SIMD ?
•Raw Performance
•SIMD Instructions, inside Oracle 12c
•How SIMD instructions are used inside Oracle 12c
•Tracing SIMD in Oracle 12c
38. Tracing SIMD in Oracle 12c
•Interesting components to trace for SIMD and/or
IMCU Pruning are :
•ADVCMP_DECOMP.*
• ADVCMP_DECOMP_HPK : SIMD functions
• ADVCMP_DECOMP_PCODE : Portable Code Machine (usually not
related to specific CPU instructions)
•IM_optimizer
• Gives information about CBO calculation related to IM
39. Tracing SIMD in Oracle 12c
•IM_optimizer
• Information available in trace file
• IMCU Pruning ratio
• CU decompression costing (per IMCU)
• Predicate evaluation costing (per row)
• Statement has to be parsed to get results
40. Tracing SIMD in Oracle 12c
select prod_id,cust_id,time_id from laurent.s_capa_high where amount_sold=20;
41. Tracing SIMD in Oracle 12c
• This information is reported in CBO trace file (10053 or SQL_costing event)
42. Tracing SIMD in Oracle 12c
•ADVCMP_DECOMP
• ADVCMP_DECOMP_HPK
• Information is available in the trace file (for each IMCU processed)
• Used library and function
• Number of rows and counting algorithm
• Processing rate (comparison and decompression if relevant)
• But nothing on the results of the processing
43. Tracing SIMD in Oracle 12c
•ADVCMP_DECOMP
• ADVCMP_DECOMP_HPK
• Gives information about SIMD function usage and filtering (after IMCU
pruning)
• Example: inmemory table with NO MEMCOMPRESS or DML compression
44. Tracing SIMD in Oracle 12c
•ADVCMP_DECOMP
• ADVCMP_DECOMP_HPK
• Example: inmemory compressed table
• SIMD are used only in the kdzk_eq_dict functions
45. Tracing SIMD in Oracle 12c
•My thoughts about compression/decompression
• NO MEMCOMPRESS / COMPRESS FOR DML
• kdzk*dynp* functions (ex: kdzk_eq_dynp_16bit, kdzk_le_dynp_32bit etc.)
• FOR QUERY LOW / QUERY HIGH
• Dictionary Encoding (LZW ?) : kdzk_*dict* functions (ex: kdzk_eq_dict_7bit,
kdzk_le_dict_4bit etc.)
• Run Length Encoding: kdzk_burst_rle* functions (ex: kdzk_burst_rle_8bit,
kdzk_burst_rle_16bit …)
• Bit packing compression: kdzk*fixed* functions (ex: kdzk_ge_lt_fixed_32bit,
kdzk_lt_fixed_8bit …)
46. Tracing SIMD in Oracle 12c
•My thoughts about compression/decompression
• FOR CAPACITY LOW
• FOR QUERY LOW + additional proprietary compression (OZIP)
• Functions: ozip_decode_dict*, kdzk_ozip_decode* (Ex:
kdzk_ozip_decode_dydi, ozip_decode_dict_9_bit etc.)
• FOR CAPACITY HIGH
• FOR QUERY HIGH + heavy weigth compression algorithm
•Compression/decompression method depends on:
• Datatype
• Column Compression Unit size
• Column contents
AVX adds new register-state through the 256-bit wide YMM register file, so explicit operating system support is required to properly save and restore AVX's expanded registers between context switches; without this, only AVX 128-bit is supported[citation needed].
Actual Size depends on size of row, compression factor
Updated by background process
Triggered by IMC0
W00x : processes that populate IM Column store
Contains list of rowid
Depends on how data are sorted inside the extents because, loading data into IMCU reads table extents sequentially
More than 1400 functions implemented in AVX and SSE42 libraries (1500 in 12.2)
Xavx (diff mavx) has specific optimization
HPK : High Performance Compression ?
HPK : High Performance Compression ?
/proc/cpuinfo gives information depending on Hardware, kernel, kernel options, and hypervisor used (if used)
For other OS, use tools that uses CPUID function and read EAX, EBX, ECX and EDX registers
CPUINFO depends on Hardware, Kernel and its options, used hypervisor