Why AI Certification is needed?
There seems to be a global consensus on AI is influencing our personal and societal lives
AI Technology is for most of the people a mystery and creates fears
AI Technology is for its creators also in many ways a mystery, not really understanding all the relevant consequences of its use
…therefore it is necessary to regulate AI Technology to remove fears and to make it trustful
Towards an operational AI Technology CertificationMarko Grobelnik
Modes of certification of an AI System
Methodological review (manual)
…detecting possible flaws in construction of a system
Offline testing review (semi automatic)
…simulating real-live usage to test response under varying conditions
Online monitoring review (automatic)
…real-live observation to monitor behavior
Review reports expressed in a form of measurable KPIs
…many of the KPIs are already well established in scientific community
…some KPIs might need further elaboration to measure relevant aspects (e.g., in particular in relation to soft concepts like Human Rights)
Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriyaVijiPriya Jeyamani
Chapter 1 Introduction to AI
Chapter 2 Introduction to Expert Systems
Chapter 3 Knowledge Representation
Chapter 4 Inference Methods and Reasoning
Chapter 5 Expert System Design and Pattern Matching
Towards an operational AI Technology CertificationMarko Grobelnik
Modes of certification of an AI System
Methodological review (manual)
…detecting possible flaws in construction of a system
Offline testing review (semi automatic)
…simulating real-live usage to test response under varying conditions
Online monitoring review (automatic)
…real-live observation to monitor behavior
Review reports expressed in a form of measurable KPIs
…many of the KPIs are already well established in scientific community
…some KPIs might need further elaboration to measure relevant aspects (e.g., in particular in relation to soft concepts like Human Rights)
Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriyaVijiPriya Jeyamani
Chapter 1 Introduction to AI
Chapter 2 Introduction to Expert Systems
Chapter 3 Knowledge Representation
Chapter 4 Inference Methods and Reasoning
Chapter 5 Expert System Design and Pattern Matching
This follow up post on the subject of Artificial Intelligence focuses on Expert Systems and the role of traditional experts in their design and development. It explores four main themes:
What do we mean by Expert?
How do experts work?
Expert Systems Application Domains, and
Features of rule based Expert (KB) Systems
PowerPoint Presentation on the topic "Artificial Intelligence" including the brief history,information about the founders and pioneers of the concept and the varied applications and future of Artificial Intelligence.
SmartData Webinar: Commercial Cognitive Computing -- How to choose and build ...DATAVERSITY
In the next five years, consumers and businesses will begin to demand more intelligence from the applications they use as they are exposed to smarter, more personalized systems in a variety of industries. Ranging from natural language tools to interact more naturally with users, to machine learning algorithms that discover untapped patterns and relationships in big data, the potential for these technologies is great but most firms don't have a roadmap for building their first cognitive computing solution. This webinar will help participants discover:
- What is cognitive computing(CC), and what can it do for my business?
- Which of my current applications would benefit from CC technologies?
- What new applications could we develop to disrupt our industry using CC?
- How do we know which CC vendors, products and services are really ready for prime-time?
- What are our competitors doing about it?
- How do we get started?
The presentation looks at the following: 1) Long range view of fundamental trends and shifts in computing and User Experience, 2)
What does IoT and context mean for ambient conversational AI?, 3)
How does Conversational AI work?
Self-Learning: Implicit and explicit customer feedback based learning.
This follow up post on the subject of Artificial Intelligence focuses on Expert Systems and the role of traditional experts in their design and development. It explores four main themes:
What do we mean by Expert?
How do experts work?
Expert Systems Application Domains, and
Features of rule based Expert (KB) Systems
PowerPoint Presentation on the topic "Artificial Intelligence" including the brief history,information about the founders and pioneers of the concept and the varied applications and future of Artificial Intelligence.
SmartData Webinar: Commercial Cognitive Computing -- How to choose and build ...DATAVERSITY
In the next five years, consumers and businesses will begin to demand more intelligence from the applications they use as they are exposed to smarter, more personalized systems in a variety of industries. Ranging from natural language tools to interact more naturally with users, to machine learning algorithms that discover untapped patterns and relationships in big data, the potential for these technologies is great but most firms don't have a roadmap for building their first cognitive computing solution. This webinar will help participants discover:
- What is cognitive computing(CC), and what can it do for my business?
- Which of my current applications would benefit from CC technologies?
- What new applications could we develop to disrupt our industry using CC?
- How do we know which CC vendors, products and services are really ready for prime-time?
- What are our competitors doing about it?
- How do we get started?
The presentation looks at the following: 1) Long range view of fundamental trends and shifts in computing and User Experience, 2)
What does IoT and context mean for ambient conversational AI?, 3)
How does Conversational AI work?
Self-Learning: Implicit and explicit customer feedback based learning.
Impact of Technology on Profession: Human Vs. AI + BotVinod Kashyap
Innovations in technologies in auditing and assurance profession and its impact on the auditing profession which included Artificial Intelligence (AI), Robotic Process Automation (RPA), Audit Data Standards (ADS), Intelligent Process Automation (IPA) and Blockchain and Distributed Ledger Technologies (DLT) Systems.
Rise of the machines -- Owasp israel -- June 2014 meetupShlomo Yona
Rise of the machines -- Owasp israel -- June 2014 meetup
Shlomo Yona presents why it is a good idea to use Machine Learning in Security and explains some Machine Learning jargon and demonstraits with two fingerprinting examples: a wifi device (PHY) and a browser (L7)
Language as social sensor - Marko Grobelnik - Dubrovnik - HrTAL2016 - 30 Sep ...Marko Grobelnik
At the HrTAL2016 conference I presented the talk on "Language as a Social Sensor to operate with Knowledge". The talk included a section on language as an interface between physical nature and the world of human mind and human society. The role of language as a 'sensor'has several consequences in uncertainties and inexactness of the language evolution, as we know it. The talk was accompanies with several live demonstrations of the systems on semantic annotation (wikifier.org) and media monitoring (eventregistry.org).
Global Media Monitoring presented through several systems for collecting, extracting and enriching data, forming and exploring events across languages in real-time - ...resulting in the system Event Registry (http://eventregistry.org/)
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Subhajit Sahu
Abstract — Levelwise PageRank is an alternative method of PageRank computation which decomposes the input graph into a directed acyclic block-graph of strongly connected components, and processes them in topological order, one level at a time. This enables calculation for ranks in a distributed fashion without per-iteration communication, unlike the standard method where all vertices are processed in each iteration. It however comes with a precondition of the absence of dead ends in the input graph. Here, the native non-distributed performance of Levelwise PageRank was compared against Monolithic PageRank on a CPU as well as a GPU. To ensure a fair comparison, Monolithic PageRank was also performed on a graph where vertices were split by components. Results indicate that Levelwise PageRank is about as fast as Monolithic PageRank on the CPU, but quite a bit slower on the GPU. Slowdown on the GPU is likely caused by a large submission of small workloads, and expected to be non-issue when the computation is performed on massive graphs.
Opendatabay - Open Data Marketplace.pptxOpendatabay
Opendatabay.com unlocks the power of data for everyone. Open Data Marketplace fosters a collaborative hub for data enthusiasts to explore, share, and contribute to a vast collection of datasets.
First ever open hub for data enthusiasts to collaborate and innovate. A platform to explore, share, and contribute to a vast collection of datasets. Through robust quality control and innovative technologies like blockchain verification, opendatabay ensures the authenticity and reliability of datasets, empowering users to make data-driven decisions with confidence. Leverage cutting-edge AI technologies to enhance the data exploration, analysis, and discovery experience.
From intelligent search and recommendations to automated data productisation and quotation, Opendatabay AI-driven features streamline the data workflow. Finding the data you need shouldn't be a complex. Opendatabay simplifies the data acquisition process with an intuitive interface and robust search tools. Effortlessly explore, discover, and access the data you need, allowing you to focus on extracting valuable insights. Opendatabay breaks new ground with a dedicated, AI-generated, synthetic datasets.
Leverage these privacy-preserving datasets for training and testing AI models without compromising sensitive information. Opendatabay prioritizes transparency by providing detailed metadata, provenance information, and usage guidelines for each dataset, ensuring users have a comprehensive understanding of the data they're working with. By leveraging a powerful combination of distributed ledger technology and rigorous third-party audits Opendatabay ensures the authenticity and reliability of every dataset. Security is at the core of Opendatabay. Marketplace implements stringent security measures, including encryption, access controls, and regular vulnerability assessments, to safeguard your data and protect your privacy.
Show drafts
volume_up
Empowering the Data Analytics Ecosystem: A Laser Focus on Value
The data analytics ecosystem thrives when every component functions at its peak, unlocking the true potential of data. Here's a laser focus on key areas for an empowered ecosystem:
1. Democratize Access, Not Data:
Granular Access Controls: Provide users with self-service tools tailored to their specific needs, preventing data overload and misuse.
Data Catalogs: Implement robust data catalogs for easy discovery and understanding of available data sources.
2. Foster Collaboration with Clear Roles:
Data Mesh Architecture: Break down data silos by creating a distributed data ownership model with clear ownership and responsibilities.
Collaborative Workspaces: Utilize interactive platforms where data scientists, analysts, and domain experts can work seamlessly together.
3. Leverage Advanced Analytics Strategically:
AI-powered Automation: Automate repetitive tasks like data cleaning and feature engineering, freeing up data talent for higher-level analysis.
Right-Tool Selection: Strategically choose the most effective advanced analytics techniques (e.g., AI, ML) based on specific business problems.
4. Prioritize Data Quality with Automation:
Automated Data Validation: Implement automated data quality checks to identify and rectify errors at the source, minimizing downstream issues.
Data Lineage Tracking: Track the flow of data throughout the ecosystem, ensuring transparency and facilitating root cause analysis for errors.
5. Cultivate a Data-Driven Mindset:
Metrics-Driven Performance Management: Align KPIs and performance metrics with data-driven insights to ensure actionable decision making.
Data Storytelling Workshops: Equip stakeholders with the skills to translate complex data findings into compelling narratives that drive action.
Benefits of a Precise Ecosystem:
Sharpened Focus: Precise access and clear roles ensure everyone works with the most relevant data, maximizing efficiency.
Actionable Insights: Strategic analytics and automated quality checks lead to more reliable and actionable data insights.
Continuous Improvement: Data-driven performance management fosters a culture of learning and continuous improvement.
Sustainable Growth: Empowered by data, organizations can make informed decisions to drive sustainable growth and innovation.
By focusing on these precise actions, organizations can create an empowered data analytics ecosystem that delivers real value by driving data-driven decisions and maximizing the return on their data investment.
Towards an operational AI Technology Certification
1. Towards an operational
AI Technology Certification
Marko Grobelnik
(Marko.Grobelnik@ijs.si)
Artificial Intelligence Lab, Jozef Stefan Institute
Digital Champion of Slovenia at EC
UN Legal Week, UN Hq, Oct 28th 2019
2. Three key questions: Why, What and How?
• Why AI Certification is needed?
• What AI Certification should include?
• How AI Certification could be implemented?
3. Why AI Certification is needed?
There seems to be a global consensus on AI is
influencing our personal and societal lives
• AI Technology is for most of the people a mystery
and creates fears
• AI Technology is for its creators also in many ways
a mystery, not really understanding all the
relevant consequences of its use
…therefore it is necessary to regulate AI Technology
to remove fears and to make it trustful
4. What AI Certification should include?
Two levels of certification needed:
(1) Is the AI System actually doing what its creators are claiming?
• …what kind of guarantees and uncertainties does it have?
• E.g., performance, robustness, transparency, and others
(2) Is the AI System compatible with a particular value standard?
• …like Ethical, Social and Legal norms, regulations, principles, criteria
• E.g., UN Human Rights Declaration, OECD AI Principles, EC Ethics
guidelines for trustworthy AI and others
5. How AI Certification could be implemented?
Where to start?
• We need an operational AI definition
• e.g., “AI System” as defined by OECD could serve as a good start
• Check how science developed standards to verify its claims
• …preventing scientists to lie and mislead themselves
• AI Systems need a standardized API backdoor for testing and monitoring
• …allowing an operational technical certification
6. Informal definition of AI
• AI is exactly the opposite from
what is happening in the video…
• …instead of living beings
mimicking machines, AI is
supposed to make machines
imitating living beings.
7. AI System
Environment State
• An environment has its state, not
necessarily fully observable
• An environment can change its
state with or without explicit
actions by the AI System
Environment State Observability
• Environments are real (physical,
social, mental) or artificial (e.g.,
games like chess)
• Real environments are typically
too complex to be observable in its
entirety (like physical or social)
• Artificial environments can be fully
observable (like chess)
• Environments are observable
through ‘percepts’ in a form of raw
data
Environment
Perceiving
(Percepts /
Raw Data)
Sensors: (§1)
• Machine (§2)
• Human (§3)
Actuators: (§13)
• Machine (§14)
• Human (§15) Acting
(Physical or
Informational
Influence)
Model (§8)
(e.g., rules or
analytical
function)
Model
Construction
Algorithm (§4)
(e.g., machine
learning)
Structured Data
Recommendations
Model
Interpretation
Algorithm (§10)
(e.g., classification
or logic reasoning)
Processed by Machine
Processed by Human
Objective(§5)
Human Interpretable
or Uninterpretable
Representation (§9)
Objective (§11)
Historicaldata/
memory(§7)
AI Operational Logic
Performance
Measure (§12)
Performance
Measure(§6)
AI System as defined by OECD
8. AI System
Environment State
• An environment has its state, not
necessarily fully observable
• An environment can change its
state with or without explicit
actions by the AI System
Environment State Observability
• Environments are real (physical,
social, mental) or artificial (e.g.,
games like chess)
• Real environments are typically
too complex to be observable in its
entirety (like physical or social)
• Artificial environments can be fully
observable (like chess)
• Environments are observable
through ‘percepts’ in a form of raw
data
Environment
Perceiving
(Percepts /
Raw Data)
Sensors: (§1)
• Machine (§2)
• Human (§3)
Actuators: (§13)
• Machine (§14)
• Human (§15) Acting
(Physical or
Informational
Influence)
Model (§8)
(e.g., rules or
analytical
function)
Model
Construction
Algorithm (§4)
(e.g., machine
learning)
Structured Data
Recommendations
Model
Interpretation
Algorithm (§10)
(e.g., classification
or logic reasoning)
Processed by Machine
Processed by Human
Objective(§5)
Human Interpretable
or Uninterpretable
Representation (§9)
Objective (§11)
Historicaldata/
memory(§7)
AI Operational Logic
Performance
Measure (§12)
Performance
Measure(§6)
AI System as defined by OECD
9. AI System
Environment State
• An environment has its state, not
necessarily fully observable
• An environment can change its
state with or without explicit
actions by the AI System
Environment State Observability
• Environments are real (physical,
social, mental) or artificial (e.g.,
games like chess)
• Real environments are typically
too complex to be observable in its
entirety (like physical or social)
• Artificial environments can be fully
observable (like chess)
• Environments are observable
through ‘percepts’ in a form of raw
data
Environment
Perceiving
(Percepts /
Raw Data)
Sensors: (§1)
• Machine (§2)
• Human (§3)
Actuators: (§13)
• Machine (§14)
• Human (§15) Acting
(Physical or
Informational
Influence)
Model (§8)
(e.g., rules or
analytical
function)
Model
Construction
Algorithm (§4)
(e.g., machine
learning)
Structured Data
Recommendations
Model
Interpretation
Algorithm (§10)
(e.g., classification
or logic reasoning)
Processed by Machine
Processed by Human
Objective(§5)
Human Interpretable
or Uninterpretable
Representation (§9)
Objective (§11)
Historicaldata/
memory(§7)
AI Operational Logic
Performance
Measure (§12)
Performance
Measure(§6)
AI System as defined by OECD
10. AI System
Environment State
• An environment has its state, not
necessarily fully observable
• An environment can change its
state with or without explicit
actions by the AI System
Environment State Observability
• Environments are real (physical,
social, mental) or artificial (e.g.,
games like chess)
• Real environments are typically
too complex to be observable in its
entirety (like physical or social)
• Artificial environments can be fully
observable (like chess)
• Environments are observable
through ‘percepts’ in a form of raw
data
Environment
Perceiving
(Percepts /
Raw Data)
Sensors: (§1)
• Machine (§2)
• Human (§3)
Actuators: (§13)
• Machine (§14)
• Human (§15) Acting
(Physical or
Informational
Influence)
Model (§8)
(e.g., rules or
analytical
function)
Model
Construction
Algorithm (§4)
(e.g., machine
learning)
Structured Data
Recommendations
Model
Interpretation
Algorithm (§10)
(e.g., classification
or logic reasoning)
Processed by Machine
Processed by Human
Objective(§5)
Human Interpretable
or Uninterpretable
Representation (§9)
Objective (§11)
Historicaldata/
memory(§7)
AI Operational Logic
Performance
Measure (§12)
Performance
Measure(§6)
AI System as defined by OECD
13. Modes of certification of an AI System
• Methodological review (manual)
• …detecting possible flaws in construction of a system
• Offline testing review (semi automatic)
• …simulating real-live usage to test response under varying conditions
• Online monitoring review (automatic)
• …real-live observation to monitor behavior
• Review reports expressed in a form of measurable KPIs
• …many of the KPIs are already well established in scientific community
• …some KPIs might need further elaboration to measure relevant aspects (e.g., in
particular in relation to soft concepts like Human Rights)
14. …so, what are the first technical steps to
get an operational AI System certification
1. Agree on classes of AI Systems which are possible to certify
• …some types of systems might be beyond the scope of certification
2. Define and agree on hard and soft KPIs describing an AI System
• …some KPIs could be taken from research, some need development
3. Standardize backdoor API for testing and monitoring
• …enabler to observe AI Systems in action
4. Build a prototype certification system to allow (semi)automatic
verification of AI Systems
• …useful AI certification system could be constructed without a big investment
5. Get a series of success stories to gain trust on certification