NetApp storage layering
•
0 likes•87 views
NetApp provides storage layering that allows organizations to separate data from physical storage infrastructure. This approach helps optimize storage resources and reduces costs by enabling data to be moved seamlessly between different storage technologies like flash, disk, and cloud. Storage layering gives organizations flexibility and freedom of choice in their IT infrastructure investments.
Report
Share
Report
Share
Download to read offline
Recommended
Big Data LDN 2017: Your flight is boarding now!
Date: 16th November 2017
Location: AI Lab Theatre
Time: 14:30 - 15:00
Speaker: Rosaria Silipo
Organisation: KNIME
Data meadow 00
The document describes a carbon capture garden called DataMeadow located at Newcastle Science Central. It aims to show how gardening can locally compensate for climate change by sequestering carbon in soil. Updates on the garden include initial groundwork in March 2017, a 3D LIDAR scan and growing seedlings with installed sensors in June, and photos from August 2017 showing flowers blooming and attracting butterflies and bees.
Incorporating JanusGraph into your Scylla Ecosystem
JanusGraph (janusgraph.org) is a leading open source graph database that offers a pluggable storage layer and Scylla is becoming the storage layer of choice. This talk will outline how JanusGraph leverages Scylla under the covers and then explore potential use cases that can be built once you have the ecosystem in place.
Precisition Agriculture - (Stephan Vormbrock, CLAAS)
Precisition Agriculture - (Stephan Vormbrock, CLAAS)
Sustainable Land Management Session - EU Space Week 2018
Scoring Metrics for Classification Models
You have trained a classification model with a highly sophisticated Machine Learning algorithm. Right. It is now time to evaluate its performance on test data, i.e. to score it.
A number of scoring metrics have been proposed over the years in different domains: sensitivity and specificity, precision and recall, accuracy, area under the curve, Cohen’s Kappa, and many more. Generally, they are based on values reported in a confusion matrix.
These slides are from a webinar we presented where we explore the concept of confusion matrix, true/false positives/negatives, and the related, most commonly used scoring metrics for classification models. We also demonstrate how to calculate all those metrics within KNIME Analytics Platform. https://www.knime.com/knime-software/knime-analytics-platform
View the webinar here: https://youtu.be/dOqRjeOv1VA
Machine Learning - Classification
This document discusses machine learning libraries in Python. It covers Scikit-learn, a popular machine learning library built on NumPy, SciPy, and Matplotlib. Scikit-learn contains algorithms and tools for classification, regression, clustering and dimensionality reduction. The document also describes loading and visualizing datasets, including the Digits dataset of images of handwritten numbers, and performing operations like preprocessing data, selecting features and labels, fitting a classifier, and making predictions.
Python ml-libraries -day 9
This document outlines an online training on machine learning covering Pandas. It discusses Pandas as an open source Python library for data manipulation, analysis and cleaning. It covers topics like Pandas operations, creating and slicing data frames, merging columns, joining indexes, importing CSV files and changing indexes and column names. The training is being conducted by NSIC in association with Harmonizer over 5 days from September 1st to 3rd.
Python Machine Learning - Day 11
This document outlines an online machine learning training that will cover classification and clustering techniques. It will introduce machine learning fundamentals and common Python libraries. Learners will work with sample datasets to practice preprocessing data, choosing features and labels, and using classifiers and clustering algorithms like K-means. Examples of classification models include eigenfaces and support vector machines, while iris data will be used for clustering demos.
Recommended
Big Data LDN 2017: Your flight is boarding now!
Date: 16th November 2017
Location: AI Lab Theatre
Time: 14:30 - 15:00
Speaker: Rosaria Silipo
Organisation: KNIME
Data meadow 00
The document describes a carbon capture garden called DataMeadow located at Newcastle Science Central. It aims to show how gardening can locally compensate for climate change by sequestering carbon in soil. Updates on the garden include initial groundwork in March 2017, a 3D LIDAR scan and growing seedlings with installed sensors in June, and photos from August 2017 showing flowers blooming and attracting butterflies and bees.
Incorporating JanusGraph into your Scylla Ecosystem
JanusGraph (janusgraph.org) is a leading open source graph database that offers a pluggable storage layer and Scylla is becoming the storage layer of choice. This talk will outline how JanusGraph leverages Scylla under the covers and then explore potential use cases that can be built once you have the ecosystem in place.
Precisition Agriculture - (Stephan Vormbrock, CLAAS)
Precisition Agriculture - (Stephan Vormbrock, CLAAS)
Sustainable Land Management Session - EU Space Week 2018
Scoring Metrics for Classification Models
You have trained a classification model with a highly sophisticated Machine Learning algorithm. Right. It is now time to evaluate its performance on test data, i.e. to score it.
A number of scoring metrics have been proposed over the years in different domains: sensitivity and specificity, precision and recall, accuracy, area under the curve, Cohen’s Kappa, and many more. Generally, they are based on values reported in a confusion matrix.
These slides are from a webinar we presented where we explore the concept of confusion matrix, true/false positives/negatives, and the related, most commonly used scoring metrics for classification models. We also demonstrate how to calculate all those metrics within KNIME Analytics Platform. https://www.knime.com/knime-software/knime-analytics-platform
View the webinar here: https://youtu.be/dOqRjeOv1VA
Machine Learning - Classification
This document discusses machine learning libraries in Python. It covers Scikit-learn, a popular machine learning library built on NumPy, SciPy, and Matplotlib. Scikit-learn contains algorithms and tools for classification, regression, clustering and dimensionality reduction. The document also describes loading and visualizing datasets, including the Digits dataset of images of handwritten numbers, and performing operations like preprocessing data, selecting features and labels, fitting a classifier, and making predictions.
Python ml-libraries -day 9
This document outlines an online training on machine learning covering Pandas. It discusses Pandas as an open source Python library for data manipulation, analysis and cleaning. It covers topics like Pandas operations, creating and slicing data frames, merging columns, joining indexes, importing CSV files and changing indexes and column names. The training is being conducted by NSIC in association with Harmonizer over 5 days from September 1st to 3rd.
Python Machine Learning - Day 11
This document outlines an online machine learning training that will cover classification and clustering techniques. It will introduce machine learning fundamentals and common Python libraries. Learners will work with sample datasets to practice preprocessing data, choosing features and labels, and using classifiers and clustering algorithms like K-means. Examples of classification models include eigenfaces and support vector machines, while iris data will be used for clustering demos.
16TB Max file size.pdf
NetApp's All SAN Arrays (ASAs) allow for maximum file sizes of 128TB, compared to 16TB for other FAS and AFF systems running ONTAP. ASAs are all-flash SAN-only solutions based on AFF platforms and available starting with ONTAP 9.7. Documentation for AFF systems can also be used for the corresponding ASA system for cabling and other information.
Our 5 senses can only perceive representation of reality but not the actual r...
Perceived reality exists within space and time, but actual reality is being discovered through quantum physics, though ancient sages in Asia have known it for thousands of years. Quantum theory shows particles can be in different states simultaneously, though humans can only perceive one state at a time as we move through time. Devotees of Indian gurus have demonstrated being in different states at once, documented for years but not widely accepted until quantum physics. Reaching this state requires going beyond the five senses and spending years in realization, as it is not something outside us but a matter of inner realization.
E=C+O
Consciousness is a constant that witnesses events and objects which are variables. One comes to know themselves by understanding what they are not through experiencing events which are a function of consciousness and objects. Experience is defined as consciousness plus an object that is witnessed by the constant of consciousness.
SnapDiff
SnapDiff is NetApp's proprietary indexing engine that identifies file differences between two snapshots. It compares the base and diff snapshots using inode-walk and returns a list of added, deleted, modified, and renamed files. Backup software vendors can integrate their solutions with SnapDiff through its API to perform incremental backups using snapshots. SnapDiff provides faster indexing compared to traditional file system crawlers or NDMP backups by identifying file changes at the inode level rather than performing a full tree walk.
Oracle database might have problems with stale NFSv3 locks upon restart
The document discusses stale NFS locks that can occur upon Oracle database restart with NFSv3. The issue is caused by lockd and rpc.statd using different name resolution methods to create and clear locks, resulting in non-matching host names. The solution is to change the order of host names in /etc/hosts so the same host name is used for lock creation and clearance.
Is it possible to upgrade or revert ontap versions on a Simulator
Is it possible to upgrade or revert ontap versions on a Simulator!
https://www.slideshare.net/AshwinPawar/how-to-upgrade-ontap-simulator
Cannot split clone snapcenter 4.3
The document discusses an error when attempting to perform a SQL backup clone using SnapCenter 4.3 on a NetApp cDOT storage system using iSCSI. The error references SMB even though iSCSI was being used, because the SnapCenter storage connections were using the cluster management LIF instead of the data SVM management LIF, which is required for SAN protocols like iSCSI. The solution is to add the data SVM directly in SnapCenter using the SVM management LIF.
Network port administrative speed does not display correctly on NetApp storage
The document discusses a bug where the administrative speed of network ports on NetApp storage incorrectly displays as 1000 instead of 10000, even though the operational speed is 10000. This bug was fixed in ONTAP version 9.6RC1 and later. The writer observed this same issue on their FAS8200 running ONTAP 9.1, where the administrative speed of ports e0c and e0d both displayed as 1000 although the operational speed was 10000.
How to connect to NetApp FILER micro-USB console port
The document discusses how to connect to the console port of a NetApp Filer using a micro-USB cable and configure Putty serial terminal software. It explains that 115,200 baud rate with N-8-1 refers to transferring up to 115,200 bits per second with no parity, 8 data bits, and 1 stop bit. The steps are to connect the micro-USB cable from the Filer to a laptop, identify the detected COM port in the device manager, open Putty, select the correct COM port and baud rate settings, and click open under the session tab rather than the incorrect arrow shown.
NDMP backup models
Intercluster LIFs are preferred over data LIFs for NDMP control and data communication to ensure firewall access. If only data LIFs can be used, connection depends on the order interfaces appear in ifconfig output, not a hardcoded selection. More details are available at the provided KB article on properly configuring LIFs and firewall policies for NDMP backups.
How to use Active IQ tool to access filer information
This document provides instructions for using NetApp's Active IQ tool to access various types of information about a FILER, including cable diagrams, stack diagrams, RAID configuration visualization, hardware capacity headroom, and storage summaries. Users can log into the NetApp support site, enter the FILER name, click on the Configuration button, and select Visualization to view diagrams and other data pulled from the last AutoSupport report. The Active IQ tool extracts valuable information from a FILER's AutoSupport reports with some patience during loading of dynamic visualizations and data.
San vs Nas fun series
A SAN provides block-level storage to clients that they can then use to build their own file systems, similar to a real estate provider giving a plot of land. A NAS provides a complete file system to clients similar to a real estate agent providing a ready-made home, with the NAS appearing as a file server and the SAN appearing as a raw disk to the client operating system. The key difference is that a SAN provides raw disks while a NAS provides a complete file system.
Steps to identify ONTAP latency related issues
The document provides steps to identify and understand latency issues on a NetApp ONTAP system. It analyzes sysstat output showing CPU utilization across various domains. While overall CPU usage is high at 97%, no single domain is fully utilized, indicating CPU is not the root cause of latency. It recommends investigating service level latency for specific LUNs, volumes, or protocols. Using ONTAP QoS commands, it identifies disk latency of 3ms on one aggregate which is within normal limits and not likely the root cause. The aggregate is 89% full which is also not yet concerning given its flash composition.
SnapDiff
SnapDiff is NetApp's proprietary file differencing engine that identifies files changed between snapshots. It compares block-level changes rather than traversing the entire file system, improving backup performance. The SnapDiff API allows backup applications to integrate with SnapDiff. SnapDiff performance is measured in files processed per hour and is impacted by very large or deeply nested directory structures rather than total storage size.
SnapDiff process flow chart
The SnapDiff process flowchart first takes a baseline backup snapshot of a volume. Next, it takes an incremental snapshot once it has the required information. It then begins the SnapDiff process to compare the snapshots and backup changed data.
SnapDiff performance issue
The document discusses troubleshooting a SnapDiff performance issue. Key factors that can affect SnapDiff throughput include hardware resources, Data ONTAP version, disk I/O latency, number of files in volumes, parallel SnapDiff sessions, and overlapping backup jobs. Symptoms of timeouts between ONTAP and the media agent during the indexing phase suggest the indexing is taking too long. The document provides workarounds like skipping cataloging and running it later, and using live browse for restores if needed before investigation is complete.
Volume level restore fails with error transient snapshot copy is not supported
A volume level restore failed with an error message indicating that a transient snapshot was not supported for the operation. The error occurred because the snapshot being used was a temporary one created during a SnapVault transfer where deduplication was enabled, making it an invalid snapshot. To resolve it, ensure the snapshot is a valid Snapmirror base snapshot without special characters in the name.
Disk reports predicted failure event
A predictive failure alert was reported for disk 1c.xx.xx in NetApp cluster node Cluster-02. The disk reported a predicted failure event. If a matching spare disk is available, rapid RAID recovery will begin by copying the data from the pre-failed disk to the spare. If no spares are available, the disk will eventually fail and cause the RAID group to degrade until a spare is available to reconstruct the data. Proactive assignment of a partner node's spare disk is recommended.
OCUM shows ONTAP cluster health degraded
The document discusses a degraded cluster health status shown in OCUM after adding a cDOT ONTAP controller. While the node pairing status was good, the cluster health showed as degraded. This was because OCUM only marks cluster health as OK after subsystem checks return OK, and one subsystem here showed as degraded, causing the overall cluster health to display as degraded. The solution is to ensure the cluster show and system health subsystem show both return OK.
NDMPCOPY lun from 7-mode NetApp to cDOT
The document describes how to copy archived SQL database LUNs from a 7-mode SnapVault snapshot to a cDOT SAN volume using NDMPCOPY in two phases. Phase 1 uses NDMPCOPY to transfer the LUN from the 7-mode snapshot to the cDOT destination volume. Phase 2 presents the copied LUN to the SQL box by mapping, rescaning disks, and bringing the LUN online so the databases can be retrieved.
Microsoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.More Related Content
More from Ashwin Pawar
16TB Max file size.pdf
NetApp's All SAN Arrays (ASAs) allow for maximum file sizes of 128TB, compared to 16TB for other FAS and AFF systems running ONTAP. ASAs are all-flash SAN-only solutions based on AFF platforms and available starting with ONTAP 9.7. Documentation for AFF systems can also be used for the corresponding ASA system for cabling and other information.
Our 5 senses can only perceive representation of reality but not the actual r...
Perceived reality exists within space and time, but actual reality is being discovered through quantum physics, though ancient sages in Asia have known it for thousands of years. Quantum theory shows particles can be in different states simultaneously, though humans can only perceive one state at a time as we move through time. Devotees of Indian gurus have demonstrated being in different states at once, documented for years but not widely accepted until quantum physics. Reaching this state requires going beyond the five senses and spending years in realization, as it is not something outside us but a matter of inner realization.
E=C+O
Consciousness is a constant that witnesses events and objects which are variables. One comes to know themselves by understanding what they are not through experiencing events which are a function of consciousness and objects. Experience is defined as consciousness plus an object that is witnessed by the constant of consciousness.
SnapDiff
SnapDiff is NetApp's proprietary indexing engine that identifies file differences between two snapshots. It compares the base and diff snapshots using inode-walk and returns a list of added, deleted, modified, and renamed files. Backup software vendors can integrate their solutions with SnapDiff through its API to perform incremental backups using snapshots. SnapDiff provides faster indexing compared to traditional file system crawlers or NDMP backups by identifying file changes at the inode level rather than performing a full tree walk.
Oracle database might have problems with stale NFSv3 locks upon restart
The document discusses stale NFS locks that can occur upon Oracle database restart with NFSv3. The issue is caused by lockd and rpc.statd using different name resolution methods to create and clear locks, resulting in non-matching host names. The solution is to change the order of host names in /etc/hosts so the same host name is used for lock creation and clearance.
Is it possible to upgrade or revert ontap versions on a Simulator
Is it possible to upgrade or revert ontap versions on a Simulator!
https://www.slideshare.net/AshwinPawar/how-to-upgrade-ontap-simulator
Cannot split clone snapcenter 4.3
The document discusses an error when attempting to perform a SQL backup clone using SnapCenter 4.3 on a NetApp cDOT storage system using iSCSI. The error references SMB even though iSCSI was being used, because the SnapCenter storage connections were using the cluster management LIF instead of the data SVM management LIF, which is required for SAN protocols like iSCSI. The solution is to add the data SVM directly in SnapCenter using the SVM management LIF.
Network port administrative speed does not display correctly on NetApp storage
The document discusses a bug where the administrative speed of network ports on NetApp storage incorrectly displays as 1000 instead of 10000, even though the operational speed is 10000. This bug was fixed in ONTAP version 9.6RC1 and later. The writer observed this same issue on their FAS8200 running ONTAP 9.1, where the administrative speed of ports e0c and e0d both displayed as 1000 although the operational speed was 10000.
How to connect to NetApp FILER micro-USB console port
The document discusses how to connect to the console port of a NetApp Filer using a micro-USB cable and configure Putty serial terminal software. It explains that 115,200 baud rate with N-8-1 refers to transferring up to 115,200 bits per second with no parity, 8 data bits, and 1 stop bit. The steps are to connect the micro-USB cable from the Filer to a laptop, identify the detected COM port in the device manager, open Putty, select the correct COM port and baud rate settings, and click open under the session tab rather than the incorrect arrow shown.
NDMP backup models
Intercluster LIFs are preferred over data LIFs for NDMP control and data communication to ensure firewall access. If only data LIFs can be used, connection depends on the order interfaces appear in ifconfig output, not a hardcoded selection. More details are available at the provided KB article on properly configuring LIFs and firewall policies for NDMP backups.
How to use Active IQ tool to access filer information
This document provides instructions for using NetApp's Active IQ tool to access various types of information about a FILER, including cable diagrams, stack diagrams, RAID configuration visualization, hardware capacity headroom, and storage summaries. Users can log into the NetApp support site, enter the FILER name, click on the Configuration button, and select Visualization to view diagrams and other data pulled from the last AutoSupport report. The Active IQ tool extracts valuable information from a FILER's AutoSupport reports with some patience during loading of dynamic visualizations and data.
San vs Nas fun series
A SAN provides block-level storage to clients that they can then use to build their own file systems, similar to a real estate provider giving a plot of land. A NAS provides a complete file system to clients similar to a real estate agent providing a ready-made home, with the NAS appearing as a file server and the SAN appearing as a raw disk to the client operating system. The key difference is that a SAN provides raw disks while a NAS provides a complete file system.
Steps to identify ONTAP latency related issues
The document provides steps to identify and understand latency issues on a NetApp ONTAP system. It analyzes sysstat output showing CPU utilization across various domains. While overall CPU usage is high at 97%, no single domain is fully utilized, indicating CPU is not the root cause of latency. It recommends investigating service level latency for specific LUNs, volumes, or protocols. Using ONTAP QoS commands, it identifies disk latency of 3ms on one aggregate which is within normal limits and not likely the root cause. The aggregate is 89% full which is also not yet concerning given its flash composition.
SnapDiff
SnapDiff is NetApp's proprietary file differencing engine that identifies files changed between snapshots. It compares block-level changes rather than traversing the entire file system, improving backup performance. The SnapDiff API allows backup applications to integrate with SnapDiff. SnapDiff performance is measured in files processed per hour and is impacted by very large or deeply nested directory structures rather than total storage size.
SnapDiff process flow chart
The SnapDiff process flowchart first takes a baseline backup snapshot of a volume. Next, it takes an incremental snapshot once it has the required information. It then begins the SnapDiff process to compare the snapshots and backup changed data.
SnapDiff performance issue
The document discusses troubleshooting a SnapDiff performance issue. Key factors that can affect SnapDiff throughput include hardware resources, Data ONTAP version, disk I/O latency, number of files in volumes, parallel SnapDiff sessions, and overlapping backup jobs. Symptoms of timeouts between ONTAP and the media agent during the indexing phase suggest the indexing is taking too long. The document provides workarounds like skipping cataloging and running it later, and using live browse for restores if needed before investigation is complete.
Volume level restore fails with error transient snapshot copy is not supported
A volume level restore failed with an error message indicating that a transient snapshot was not supported for the operation. The error occurred because the snapshot being used was a temporary one created during a SnapVault transfer where deduplication was enabled, making it an invalid snapshot. To resolve it, ensure the snapshot is a valid Snapmirror base snapshot without special characters in the name.
Disk reports predicted failure event
A predictive failure alert was reported for disk 1c.xx.xx in NetApp cluster node Cluster-02. The disk reported a predicted failure event. If a matching spare disk is available, rapid RAID recovery will begin by copying the data from the pre-failed disk to the spare. If no spares are available, the disk will eventually fail and cause the RAID group to degrade until a spare is available to reconstruct the data. Proactive assignment of a partner node's spare disk is recommended.
OCUM shows ONTAP cluster health degraded
The document discusses a degraded cluster health status shown in OCUM after adding a cDOT ONTAP controller. While the node pairing status was good, the cluster health showed as degraded. This was because OCUM only marks cluster health as OK after subsystem checks return OK, and one subsystem here showed as degraded, causing the overall cluster health to display as degraded. The solution is to ensure the cluster show and system health subsystem show both return OK.
NDMPCOPY lun from 7-mode NetApp to cDOT
The document describes how to copy archived SQL database LUNs from a 7-mode SnapVault snapshot to a cDOT SAN volume using NDMPCOPY in two phases. Phase 1 uses NDMPCOPY to transfer the LUN from the 7-mode snapshot to the cDOT destination volume. Phase 2 presents the copied LUN to the SQL box by mapping, rescaning disks, and bringing the LUN online so the databases can be retrieved.
More from Ashwin Pawar (20)
Our 5 senses can only perceive representation of reality but not the actual r...
Our 5 senses can only perceive representation of reality but not the actual r...
Oracle database might have problems with stale NFSv3 locks upon restart
Oracle database might have problems with stale NFSv3 locks upon restart
Is it possible to upgrade or revert ontap versions on a Simulator
Is it possible to upgrade or revert ontap versions on a Simulator
Network port administrative speed does not display correctly on NetApp storage
Network port administrative speed does not display correctly on NetApp storage
How to connect to NetApp FILER micro-USB console port
How to connect to NetApp FILER micro-USB console port
How to use Active IQ tool to access filer information
How to use Active IQ tool to access filer information
Volume level restore fails with error transient snapshot copy is not supported
Volume level restore fails with error transient snapshot copy is not supported
Recently uploaded
Microsoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
CAKE: Sharing Slices of Confidential Data on Blockchain
Presented at the CAiSE 2024 Forum, Intelligent Information Systems, June 6th, Limassol, Cyprus.
Synopsis: Cooperative information systems typically involve various entities in a collaborative process within a distributed environment. Blockchain technology offers a mechanism for automating such processes, even when only partial trust exists among participants. The data stored on the blockchain is replicated across all nodes in the network, ensuring accessibility to all participants. While this aspect facilitates traceability, integrity, and persistence, it poses challenges for adopting public blockchains in enterprise settings due to confidentiality issues. In this paper, we present a software tool named Control Access via Key Encryption (CAKE), designed to ensure data confidentiality in scenarios involving public blockchains. After outlining its core components and functionalities, we showcase the application of CAKE in the context of a real-world cyber-security project within the logistics domain.
Paper: https://doi.org/10.1007/978-3-031-61000-4_16
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Mind map of terminologies used in context of Generative AI
Mind map of common terms used in context of Generative AI.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
OpenID AuthZEN Interop Read Out - Authorization
During Identiverse 2024 and EIC 2024, members of the OpenID AuthZEN WG got together and demoed their authorization endpoints conforming to the AuthZEN API
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays, June 2024 with Maria Copot 20
Removing Uninteresting Bytes in Software Fuzzing
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Recently uploaded (20)
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
CAKE: Sharing Slices of Confidential Data on Blockchain
CAKE: Sharing Slices of Confidential Data on Blockchain
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides