SlideShare a Scribd company logo
1 of 56
Topik 1
Definisi, Topik, dan Terminologi
Kecerdasan Buatan
Dr. Sunu Wibirama
Modul Kuliah Kecerdasan Buatan
Kode mata kuliah: UGMx 001001132012
March 31, 2022
March 31, 2022
1 Capaian Pembelajaran Mata Kuliah
Topik ini akan memenuhi CPMK 1, yakni mampu mendefinisikan pengertian sistem cer-
das, berbagai macam terminologi di bidang kecerdasan buatan, dan berbagai macam aplikasi
sistem berbasis kecerdasan buatan. Adapun indikator tercapainya CPMK tersebut adalah
mampu membedakan konsep narrow AI dan general AI, mengerti konsep umum machine
learning (supervised, unsupervised, reinforcement learning), mengerti contoh penerapan AI
dan peluang AI di dunia kerja.
2 Cakupan Materi
Cakupan materi dalam topik ini sebagai berikut:
a) What is AI: mengenal konsep dasar kecerdasan buatan dan aplikasinya dalam kehidu-
pan sehari-hari.
b) AI and The Future of Jobs: mengenal dampak dari penerapan kecerdasan buatan
terhadap dunia kerja dan peluang digantikannya sumber daya manusia dengan mesin.
c) Learning AI: materi ini berisi seputar berbagai macam cara untuk mempelajari kecer-
dasan buatan, mulai dari pendekatan secara konseptual (conceptual approach), secara
algoritmis (algorithmic approach), secara matematis (mathematical approach), sampai
dengan melaui praktik nyata untuk memecahkan permasalahan tertentu (real case
study).
d) Machine Intelligence Continuum: materi ini berisi tentang pembagian kecerdasan
mesin menjadi beberapa tingkatan. Kecerdasan mesin dibagi berdasarkan kemam-
puan mesin untuk menyelesaikan tuga dalam domain pengetahuan yang sempit, luas,
dan bagaimana mesin mampu beradaptasi dengan domain pengetahuan yang baru.
e) Expert Systems and Machine Learning: materi ini berisi penjelasan tentang teknologi
kecerdasan buatan paling awal, yang dikenal dengan expert systems. Kelemahan expert
systems pada akhirnya mendorong para peneliti untuk menemukan teknik lain yang
dapat digunakan untuk melatih mesin melakukan suatu tugas secara otomatis tanpa
harus diprogram secara eksplisit. Metode inilah yang disebut dengan machine learning.
f) Supervised Learning, Unsupervised Learning and Reinforcement Learning: materi ini
membahas tipe-tipe machine learning yang sering dijumpai dalam pemecahan problem-
problem praktis. Tipe-tipe machine learning ini dijelaskan dengan ilustrasi yang in-
tuitif untuk memudahkan pemahaman.
g) Various AI Applications: materi ini menjelaskan tentang berbagai implementasi ke-
cerdasan buatan di bidang kesehatan (healthcare), pengawasan lalu-lintas (traffic mon-
itoring), keamanan (security), dan interaksi manusia-komputer (human-computer in-
teraction).
1
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
What is Artificial Intelligence?
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
AI and your daily activities
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Artificial intelligence (AI)
ā€¢ Intelligence: the ability to acquire and apply knowledge
ā€¢ Artificial intelligence is created to simulates human
intelligence processes by machines, especially computer
systems.
ā€¢ These processes include learning, decision-making, and
self-correction. Particular applications of AI include expert
systems (e.g., Google Maps), speech recognition
(e.g.,: Apple Siri) and machine vision (e.g., Facebookā€™s face
recognition).
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
[Source: Frost and Sullivan, ā€œArtificial Intelligence-R&D and Applications Road Mapā€, 2016]
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Artificial Intelligence and Future Jobs
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
5
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Businesses affected by AI
AI value creation by 2030:
$13 trillion
[Source: McKinsey and Co, ā€œNotes from the AI frontier: Applications and value of deep learningā€, 2018]
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
How AI improves business
[Source: Marco K., Medium, 2019] [Source: World Economic Forum, Future of Jobs Report, 2020]
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
[Source: Harvard Business Review, 2017]
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
End of File
9
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Learning AI: How to Get Started
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
Approaches on learning AI
Conceptual approach
Illustrations and
visualizations are helpful
Pros:
ā€¢ Intuitive understanding
ā€¢ The easiest way to learn AI
ā€¢ Helping you explaining AI
to non-specialist
Cons:
ā€¢ Shallow understanding, not
enough if you aim for career as
ML researcher/engineer/data
scientist
ā€¢ No practical experience (coding,
algorithm design, etc.)
Algorithmic approach
Learn from pseudocode
or source code
Pros:
ā€¢ Understanding both concept and
process in AI techniques
ā€¢ Fastest way to get your hands wet
with programming exercise
ā€¢ Entry point for most AI professional
career
Cons:
ā€¢ Rarely uncovering whatā€™s under the
hood (math), which is important if
you want to be
ML researcher/academician
Mathematical approach
Demystifying AI using
mathematics
Pros:
ā€¢ Providing strong theoretical
background of AI techniques
ā€¢ Necessary if you aim for career in
academia / RnD division in tech
industry.
Cons:
ā€¢ You have to be strong in at least
three parts of mathematics:
probability and statistics, linear
algebra, and calculus
Case study
Real case problem solving
Pros:
ā€¢ Developing strong practical skills
ā€¢ You may need to blend other three
approaches to be successful in
solving problem
ā€¢ Widening experience, useful in
professional career
Cons:
ā€¢ Real world dataset with
noises/errors may be not so easy to
obtain
ā€¢ You need strong background in
programming, conceptual
understanding, and math
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Learning AI: How to Get Started (Part 2)
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Conceptual approach
[Source: Annalyn Ng, Decision Trees Tutorial, Algobeans.Com, 2015]
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Algorithmic approach
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Mathematical approach
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
Case study
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
More recommended resources (1)
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
https://www.kdnuggets.com/
More recommended resources (2)
9
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10
https://www.coursera.org/learn/machine-learning
More recommended resources (3)
10
3/31/22
6
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama
https://machinelearningmastery.com/start-here/
More recommended resources (4)
11
11
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 12
Online datasets
https://archive.ics.uci.edu/ml/index.php
12
3/31/22
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 13
Live coding courses
http://datacamp.com
13
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 14
End of File
14
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Machine Intelligence Continuum (Part 1)
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
Narrow vs. General AI
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Machine Intelligence Continuum
3
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Level 1: Systems that act
ā€¢ Lowest level of the continuum: rule-based
automatons.
ā€¢ Hand engineered, following if-then rules.
ā€¢ Cruise control in your car:
ā€¢ The system monitors your automobileā€™s
speed and uses a motor to vary throttle
position to maintain a constant speed
ā€¢ Remember: this is not a ā€œself-driving carā€,
you cannot take your hands off the wheel.
4
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Level 2: Systems that predict
ā€¢ The system analyzes the data and produces
probabilistic predictions based on the data.
ā€¢ Prediction does not necessarily need to be a
future event, but rather a mapping of known
information to unknown information
ā€¢ If your data is flawed, or you choose a sample
set to analyze that does not represent your
target population as a whole, you will get
erroneous results (case study: The US 2016
election polls).
5
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Level 3: Systems that learn
ā€¢ The system performs particular tasks
without being explicitly programmed.
ā€¢ These systems are mostly powered by two
notorious AI branches: machine learning
and deep learning.
ā€¢ The systems are used in many enterprise
applications to improve the process of
turning data into predictions:
ā€¢ Predictive marketing
ā€¢ Netflixā€™s movies recommendation
6
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
End of File
7
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Machine Intelligence Continuum (Part 2)
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
Machine Intelligence Continuum
2
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Level 4: Systems that create
ā€¢ Recent breakthroughs in neural network
models have inspired a resurgence of
computational creativity, with computers
now capable of producing original writing,
imagery, music, and industrial designs.
ā€¢ A profound example is ā€œautomated
image-based story tellerā€ using deep
neural networks.
ā€¢ Berlin-based engineer Samim trained a
neural network on 14 million lines of
passages from romance novels and
asked the model to generate stories
about images.
3
[Source: Samim, ā€œGenerating Stories about Imagesā€, Medium.Com, 2015]
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Level 5: Systems that relate
ā€¢ Since digital assistants like Appleā€™s Siri and Amazon
Echoā€™s Alexa infiltrate our personal lives, machines will
also need to be emotionally intelligent to succeed in our
society.
ā€¢ Sentiment analysis, also known as opinion mining or
emotion AI, extracts and quantifies emotional states from
our text, voice, facial expressions, and body language.
ā€¢ This AI systems are commonly used in user experience
research and AI-powered interview software.
ā€¢ Affectivaā€”a leading emotion AI companyā€”helps
advertisers improve the effectiveness of brand content by
assessing and adapting to consumer reactions.
4
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Level 6: Systems that master
ā€¢ A human toddler only needs to see a single tiger to develop a
mental construct of the animal and recognize other tigers.
ā€¢ If humans needed to see thousands of tigers before learning to
run away, our species would have died out long ago.
ā€¢ By contrast a deep learning algorithm needs to process
thousands of tiger images to recognizing them in images and
video. Even, the algorithm does not reliably recognize other
abstractions and representations of tigers, such as cartoons or
costumes.
ā€¢ A ā€œSystem That Mastersā€ is an intelligent agent capable of
constructing abstract concepts and strategic plans from sparse
data. By creating modular conceptual representations of the
world around us, humans are able to transfer knowledge from
one domain to another.
5
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Level 7: Systems that evolve
ā€¢ This final category refers to systems that exhibit
superhuman intelligence and capabilities.
ā€¢ ā€œSystems That Evolveā€ are entities capable of
dynamically changing their own architecture and
design to adapt to environmental needs.
ā€¢ Computers are currently constrained by both hardware
and software, while humans and other biological
organisms are constrained by wetware.
ā€¢ Some futurists hypothesize that we may be able to
achieve superhuman intelligence by augmenting
biological brains with synthesized technologies, but
currently this research is more science fiction than
science.
6
[Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017]
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
[Source: Michael Copeland, 2016]
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
End of File
8
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Expert Systems and Machine Learning
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama
[Source: Michael Copeland, 2016]
2
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Early AI: Expert Systems
Suppose you want to recognize a digit of 7
You can tell computer three rules
on how to write a ā€œ7ā€
[Source: Andrew Glassner, 2021]
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Early AI: Expert Systems
Suddenly, your computer sees this number.
Do you think the computer can recognize
this number?
I donā€™t think so.
You have to ā€œteachā€ the computer to
recognize an object automatically without
being explicitly programmed Ć  machine
learning
[Source: Andrew Glassner, 2021]
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Machine Learning
ā€œA computer program is said to
learn from experience (E) with
some class of tasks (T) and a
performance measure (P) if its
performance at tasks in T as
measured by P improves with Eā€
(Tom Mitchell, 1997)
[Source: Andrew Glassner, 2021]
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Some important terminologies
ā€¢ Training/Evolution set
Set of data to discover potentially predictive relationships.
ā€¢ Instances
A sample is an item to process (e.g. classify). It can be a document, a picture, a sound, a
video, a row in database or CSV file, or whatever you can describe with a fixed set of
quantitative traits.
ā€¢ Features / attributes
The number of features or distinct traits that can be used to describe each item in a
quantitative manner.
ā€¢ Feature vector
is an n-dimensional vector of numerical features that represent some object.
ā€¢ Feature extraction
Preparation of feature vector, transforms the data in the high-dimensional space to a
space of fewer dimensions.
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama
(class / label)
(features)
(instance)
7
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama
(class / label)
(features)
(instance)
8
?
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
End of File
9
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Supervised Learning
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
How students learn
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Can we treat machine with same process?
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama
Apple
What do you mean by
Simple example
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Define how apple looks
Features:
1. Color: Radish/Red
2. Type: Fruit
3. Shape: Round
Features:
1. Color: Sky Blue
2. Type: Logo
3. Shape: Half-bitten
Features:
1. Color: Yellow
2. Type: Fruit
3. Shape: Round
Label : red apple Label : apple logo Label : green apple
Notes: features can be numerical of categorical
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Define how apple looks
1. Color: Radish/Red
2. Type: Fruit
3. Shape: Round
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
Train the machine learning system
1. Color: Radish/Red
2. Type : Fruit
3. Shape Learning: update the
algorithmā€™s parameters
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
Test the machine learning system
Unseen data
Features
1. Color: Green
2. Type : Fruit
3. Shape: Half-bitten
Red apple/Apple logo/Green apple?
Green apple
Accuracy: 80%
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
Applying supervised learning
Input Output Application
email spam? (yes/no) spam filtering
audio text transcript speech recognition
ads, user info click? (yes/no) online advertising
Indonesian Japanese machine translation
plate number pics plate number computer vision
9
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10
End of File
10
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
Unsupervised Learning and Reinforcement Learning
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
Data without label
What if, we have no labeled data?
Or, we have very large data that it is almost impossible to label it.
Can we do something with the data?
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Data without label
Yes, we do! We can find some similarities,
or at least we can provide better representation to the data
[Source: scikit-learn.org]
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Clustering
Automatic grouping based on similar features among data
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Dimensionality reduction
Better representation based on dominant features
[Source: https://towardsdatascience.com/a-one-stop-shop-for-principal-component-analysis-5582fb7e0a9c]
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Association rules
Uncovering relationship between frequently bought items
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
In March 2016, Lee Sedol, the Korean Go 18-
times world champion, played and lost a five-
game match against DeepMindā€™s AlphaGoā€”a
deep reinforcement learning based Google
DeepMindā€™s project.
[Source: Aurelien Geron, 2021]
7
Reinforcement learning
Learning based on optimal policy
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
Initial Performance After 15 minutes of training After 30 minutes of training
[Source: https://deepsense.ai/what-is-reinforcement-learning-the-complete-guide/]
8
Reinforcement learning in action
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
End of File
9
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
AI Applications in Medical Diagnosis and Healthcare Systems
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
Roles of AI in healthcare systems
[Source: DataFlair, 2021]
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
AI applications in healthcare systems
ā€¢ Machine learning in medical eye tracking
ā€¢ AI for covid-19 detection
ā€¢ Self-early screening app for oral cancer
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Machine learning in medical eye tracking
San Diego, US
Industrial partner:
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Reference:
S. Wibirama, I. Ardiyanto, T. Satriya, T.B. Adji, N. A. Setiawan, M. T. Setiawan, ā€œAn
Improved Pupil Localization Technique for Real-Time Video-Oculography Extreme
Eyelid Occlusionā€, International Journal of Innovative Computing, Information and
Control, Vol. 15, No. 4, 2019, pp. 1547-1563.
Common problem in this
research: how to handle
noises caused by eyelid
occlusion?
Machine learning in medical eye tracking
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Pupil Detection with Automatic Thresholding
Reference:
S. Wibirama, I. Ardiyanto, T. Satriya,
T.B. Adji, N. A. Setiawan, M. T.
Setiawan, ā€œAn Improved Pupil
Localization Technique for Real-Time
Video-Oculography Extreme Eyelid
Occlusionā€, International Journal of
Innovative Computing, Information and
Control, Vol. 15, No. 4, 2019, pp. 1547-
1563.
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
AI for Covid-19 detection
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
AI for Covid-19 detection
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
Self-early screening app for oral cancer
9
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10
oral cancer,
malignancy
oral squamous
cell carcinoma
oral lesion
Text books
Scientific journal
Dataset: 1154 pictures
517 Cancer
259 Normal
258 Non-cancer lesion
Self-early screening app for oral cancer
Dataset acquisition
10
3/31/22
6
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 11
Cancer images
Non-cancer images
Google Colaboratory
Images dataset Screening parameters
Self-early screening app for oral cancer
Prediction process
11
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 12
Screening
photo
Results of
prediction
Probability of
cancer
occurrence
Recommended action:
Cancer case:
Medical observation
with dentist/medical
doctor
Non-cancer case:
Presenting information
on avoiding oral cancer
Self-early screening app for oral cancer
Prediction result
12
3/31/22
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 13
End of File
13
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
AI Applications in Traffic Monitoring and Security
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
AI applications in traffic monitoring and security
ā€¢ Vehicle number plate recognition
ā€¢ Real-time car counting
ā€¢ Twitter-based geolocation for traffic monitoring
ā€¢ Self-driving car
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Vehicle number plate recognition
DIP DIP
DIP
Machine learning
Reference:
D.Sihombing, H.A. Nugroho, S. Wibirama, ā€œPerspective rectification in vehicle number plate recognition using 2D-2D transformation of planar
homographyā€, in 2015 International Conference on Science in Information Technology, pp. 237-240, 2015.
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Real-time car counting
4
Reference:
Hudalizaman, I. Ardiyanto, S. Wibirama, ā€œImage Enhancement on You Only Look Once (YOLO) Method to Detect Public
Transportation of CCTV Imageā€, presented in The 6th International Conference Science and Technology, 2020.
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
How does YOLO (You Only Look Once) work?
ā€¢ Step 1: The image is divided into grid cells. Each grid
cell forecasts B bounding boxes and provides their
confidence scores. The cells predict the class
probabilities to establish the class of each object.
ā€¢ Step 2: We can notice at least three classes of objects:
a car, a dog, and a bicycle. Note that for one object,
there will be more than one bounding boxes because an
object may overlap on several grid cells.
ā€¢ Step 3: Intersection Over Union (IOU) ensures that the
predicted bounding boxes are equal to the real boxes of
the objects.
ā€¢ Step 4: If IOU is greater than 0.5, we can say that the
prediction is good enough.
ā€¢ Step 5: Remove unnecessary bounding boxes that do
not meet the threshold.
ā€¢ Step 6: The final detection will consist of unique
bounding boxes that fit the objects perfectly.
5
IoU = Area of yellow box / Area of green box
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Twitter-based geolocation for traffic monitoring
6
Reference:
D.A. Kurniawan, S. Wibirama, N.A. Setiawan, ā€œReal-
time traffic classification with Twitter data miningā€, in
2016 8th International Conference on Information
Technology and Electrical Engineering, pp. 1-5, 2016.
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
Twitter-based geolocation for traffic monitoring
7
Reference:
D.A. Kurniawan, S. Wibirama, N.A. Setiawan, ā€œReal-
time traffic classification with Twitter data miningā€, in
2016 8th International Conference on Information
Technology and Electrical Engineering, pp. 1-5, 2016.
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
Twitter-based geolocation for traffic monitoring
8
Reference:
D.A. Kurniawan, S. Wibirama, N.A. Setiawan, ā€œReal-
time traffic classification with Twitter data miningā€, in
2016 8th International Conference on Information
Technology and Electrical Engineering, pp. 1-5, 2016.
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
Self-driving car
9
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10
How does self-driving car work?
High-level view of the data collection system. Input
Actual output by
human driver
Computed
output
Input Computed output
Training the neural network.
The trained network is used to generate steering
commands from a single front-facing center camera.
10
3/31/22
6
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 11
End of File
11
3/31/22
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1
Sunu Wibirama
sunu@ugm.ac.id
Department of Electrical and Information Engineering
Faculty of Engineering
Universitas Gadjah Mada
INDONESIA
AI Applications in Human-Computer Interaction
Kecerdasan Buatan | Artificial Intelligence
Version: January 2022
1
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2
Touchless technology: from laboratory to necessity
Public display has been an inseparable part of smart
societies around the world (i.e. in the airport, toilet,
and other public facilities)
However, implementing an informative public display
during pandemic posses a challenging interaction
circumstances.
To avoid Covid-19, there is a strong need to develop
an intelligent touchless technology to minimize
customer interactions with high contact surfaces.
Our proposal: spontaneous gaze-based interaction
powered with artificial intelligence
Source of photo:
https://www.enr.com/articles/49734-airports-ponder-touchless-technology-installations-in-bathrooms
2
3/31/22
2
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3
Gaze-based interactive application
A brief illustration
Application content
User (passerby)
Userā€™s object of interest
(dynamic button)
Eye Tracker
(Suatmi Murnani & Sunu Wibirama, 2020)
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4
Three types of eye movement
1
1. Fixation
*eyes remain still for
more than 200-300 ms
2
2. Saccade
*rapid eye movement from
an object to another object
3
3. Smooth pursuit
*slower eye movement while pursuing an object
(Suatmi Murnani & Sunu Wibirama, 2020)
4
3/31/22
3
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5
Eye tracking calibration: fixation-based
ā€¢ Goal: improving spatial accuracy during gaze
interaction
ā€¢ User is asked to fixate their gaze on calibration
targets (animated white or red circle).
ā€¢ Mapping from eye position to calibration target:
second order polynomial regression
Gaze calibration target
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6
Ƙ Alternative method:
Uncalibrated gaze-based
interaction
(Smooth pursuit-based
gaze interaction)
Spatial accuracy
issue
*limitation of calibration:
-time consuming
-tiring / fatigue
- impractical for interaction in public space
Can not meet
the challenge in
spontaneous
interaction
Challenges of spontaneous gaze-based interaction
Eye tracking calibration
(Suatmi Murnani & Sunu Wibirama, 2020)
6
3/31/22
4
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7
Eye tracking data processing
Hidden Markov
Models
Exponential
Moving
Average (EMA)
Pearson
Product-
Moment
Correlation
(PPMC)
(Suatmi Murnani & Sunu Wibirama, 2020)
7
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8
Probabilistic events detection using Hidden Markov Models
ā€¢ Objectives: eye movement classification to improve accuracy of spontaneous object selection
ā€¢ Hidden states: Fixation (Fix), Saccades (Sac), Post-Saccadic Oscillation (PSO), and Smooth Pursuit (SP)
ā€¢ Observable states: segment velocity and inter-segment angle from gaze position signal
Our choice on NSLR and HMM was based on:
J. Pekkanen and O. Lappi, ā€œA new and general approach to signal denoising and eye movement classification based on
segmented linear regression,ā€ Scientific reports, vol. 7, no. 1, p. 17726, 2017.
(Suatmi Murnani, 2019)
8
3/31/22
5
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9
Pearson Product-Moment Correlation (PPMC)
ā€¢ Pearson Product-Moment Correlation measures the
similarity of eye movements (e.g. smooth pursuit) and
object trajectories based on their spatial pattern
correlation.
ā€¢ PPMC for objects that moved along X-axis direction
was calculated from their X coordinates.
ā€¢ This approach was also applied for objects that
moved along Y-axis direction.
ā€¢ We computed PPMC scores for all buttons and
chose the largest PPMC score. This score resembled
the button that was gazed by the user.
Max(C1, C2, C3) = the triggered button
with Cn denotes PPMC score and n is
the dynamic button on screen
C1
C2
C3
9
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10
coviDisplayPRO: gaze-controlled smart public display
10
3/31/22
6
sunu@ugm.ac.id
Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 11
End of File
11

More Related Content

What's hot

Piranti Keluaran (Output)
Piranti Keluaran (Output)Piranti Keluaran (Output)
Piranti Keluaran (Output)Andhi Pratama
Ā 
Seminar proposal penelitian
Seminar proposal penelitianSeminar proposal penelitian
Seminar proposal penelitianQueen Anaqi
Ā 
Algoritma powerpoint
Algoritma powerpointAlgoritma powerpoint
Algoritma powerpointIrwin andriyanto
Ā 
Psikologi warna & Typografi.pptx
Psikologi warna & Typografi.pptxPsikologi warna & Typografi.pptx
Psikologi warna & Typografi.pptxRadenzFachrieAchakKh
Ā 
Sistem multimedia-teknik-informatika
Sistem multimedia-teknik-informatikaSistem multimedia-teknik-informatika
Sistem multimedia-teknik-informatikaRakhmi Khalida, M.M.S.I
Ā 
FREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN SUATU KEJADIAN
FREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN  SUATU KEJADIANFREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN  SUATU KEJADIAN
FREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN SUATU KEJADIANHappy-Hevy Hestu Pratiwi
Ā 
Interaksi Manusia Dan Komputer 4
Interaksi Manusia Dan Komputer 4Interaksi Manusia Dan Komputer 4
Interaksi Manusia Dan Komputer 4Hide Maru
Ā 
Dampak sosial informatika
Dampak sosial informatikaDampak sosial informatika
Dampak sosial informatikaLORDALI4
Ā 
ppt_IMK-design-interface
ppt_IMK-design-interfaceppt_IMK-design-interface
ppt_IMK-design-interfaceyusuf09
Ā 
16.modul melakukan deployment model (final) v1 1
16.modul melakukan deployment model (final) v1 116.modul melakukan deployment model (final) v1 1
16.modul melakukan deployment model (final) v1 1ArdianDwiPraba
Ā 
Tugas Dampak Positif Dan Negatif IMK
Tugas Dampak Positif Dan Negatif IMKTugas Dampak Positif Dan Negatif IMK
Tugas Dampak Positif Dan Negatif IMKHendra Deni Afriliya
Ā 
Tabel padanan bilangan Desimal, Biner, Oktal dan Heksadesimal
Tabel padanan bilangan Desimal, Biner, Oktal dan HeksadesimalTabel padanan bilangan Desimal, Biner, Oktal dan Heksadesimal
Tabel padanan bilangan Desimal, Biner, Oktal dan HeksadesimalMustahal SSi
Ā 
INTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTERINTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTERAndhi Pratama
Ā 
MultiProgramming and Time Sharing
MultiProgramming and Time SharingMultiProgramming and Time Sharing
MultiProgramming and Time SharingTri Sugihartono
Ā 
INTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTERINTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTERsolikin6
Ā 
Interaksi manusia dan komputer
Interaksi manusia dan komputerInteraksi manusia dan komputer
Interaksi manusia dan komputerMiftahul Khair N
Ā 

What's hot (20)

Piranti Keluaran (Output)
Piranti Keluaran (Output)Piranti Keluaran (Output)
Piranti Keluaran (Output)
Ā 
Manusia dan teknologi
Manusia dan teknologiManusia dan teknologi
Manusia dan teknologi
Ā 
Konsep dasar UI/UX
Konsep dasar UI/UXKonsep dasar UI/UX
Konsep dasar UI/UX
Ā 
Seminar proposal penelitian
Seminar proposal penelitianSeminar proposal penelitian
Seminar proposal penelitian
Ā 
Algoritma powerpoint
Algoritma powerpointAlgoritma powerpoint
Algoritma powerpoint
Ā 
Psikologi warna & Typografi.pptx
Psikologi warna & Typografi.pptxPsikologi warna & Typografi.pptx
Psikologi warna & Typografi.pptx
Ā 
Sistem multimedia-teknik-informatika
Sistem multimedia-teknik-informatikaSistem multimedia-teknik-informatika
Sistem multimedia-teknik-informatika
Ā 
FREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN SUATU KEJADIAN
FREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN  SUATU KEJADIANFREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN  SUATU KEJADIAN
FREKUENSI HARAPAN SUATU KEJADIAN, PELUANG KOMPLEMEN SUATU KEJADIAN
Ā 
Imk 1 pendahuluan
Imk 1   pendahuluanImk 1   pendahuluan
Imk 1 pendahuluan
Ā 
Contoh proposal pengajuan pkl
Contoh proposal pengajuan pklContoh proposal pengajuan pkl
Contoh proposal pengajuan pkl
Ā 
Interaksi Manusia Dan Komputer 4
Interaksi Manusia Dan Komputer 4Interaksi Manusia Dan Komputer 4
Interaksi Manusia Dan Komputer 4
Ā 
Dampak sosial informatika
Dampak sosial informatikaDampak sosial informatika
Dampak sosial informatika
Ā 
ppt_IMK-design-interface
ppt_IMK-design-interfaceppt_IMK-design-interface
ppt_IMK-design-interface
Ā 
16.modul melakukan deployment model (final) v1 1
16.modul melakukan deployment model (final) v1 116.modul melakukan deployment model (final) v1 1
16.modul melakukan deployment model (final) v1 1
Ā 
Tugas Dampak Positif Dan Negatif IMK
Tugas Dampak Positif Dan Negatif IMKTugas Dampak Positif Dan Negatif IMK
Tugas Dampak Positif Dan Negatif IMK
Ā 
Tabel padanan bilangan Desimal, Biner, Oktal dan Heksadesimal
Tabel padanan bilangan Desimal, Biner, Oktal dan HeksadesimalTabel padanan bilangan Desimal, Biner, Oktal dan Heksadesimal
Tabel padanan bilangan Desimal, Biner, Oktal dan Heksadesimal
Ā 
INTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTERINTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTER
Ā 
MultiProgramming and Time Sharing
MultiProgramming and Time SharingMultiProgramming and Time Sharing
MultiProgramming and Time Sharing
Ā 
INTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTERINTERAKSI MANUSIA DAN KOMPUTER
INTERAKSI MANUSIA DAN KOMPUTER
Ā 
Interaksi manusia dan komputer
Interaksi manusia dan komputerInteraksi manusia dan komputer
Interaksi manusia dan komputer
Ā 

Similar to Modul Topik 1 - Kecerdasan Buatan

Modul Topik 6 - Kecerdasan Buatan.pdf
Modul Topik 6 - Kecerdasan Buatan.pdfModul Topik 6 - Kecerdasan Buatan.pdf
Modul Topik 6 - Kecerdasan Buatan.pdfSunu Wibirama
Ā 
Modul Topik 8 - Kecerdasan Buatan
Modul Topik 8 - Kecerdasan BuatanModul Topik 8 - Kecerdasan Buatan
Modul Topik 8 - Kecerdasan BuatanSunu Wibirama
Ā 
Modul Topik 2 - Kecerdasan Buatan.pdf
Modul Topik 2 - Kecerdasan Buatan.pdfModul Topik 2 - Kecerdasan Buatan.pdf
Modul Topik 2 - Kecerdasan Buatan.pdfSunu Wibirama
Ā 
Modul Topik 4 - Kecerdasan Buatan.pdf
Modul Topik 4 - Kecerdasan Buatan.pdfModul Topik 4 - Kecerdasan Buatan.pdf
Modul Topik 4 - Kecerdasan Buatan.pdfSunu Wibirama
Ā 
K-12 Computing Education for the AI Era: From Data Literacy to Data Agency
K-12 Computing Education for the AI Era: From Data Literacy to Data AgencyK-12 Computing Education for the AI Era: From Data Literacy to Data Agency
K-12 Computing Education for the AI Era: From Data Literacy to Data AgencyHenriikka Vartiainen
Ā 
Understanding Emerging Technology and Its Impact on Online & Blended Learning
Understanding Emerging Technology and Its Impact on Online & Blended LearningUnderstanding Emerging Technology and Its Impact on Online & Blended Learning
Understanding Emerging Technology and Its Impact on Online & Blended LearningStephen Murgatroyd, PhD FBPsS FRSA
Ā 
Modul Topik 3 - Kecerdasan Buatan
Modul Topik 3 - Kecerdasan BuatanModul Topik 3 - Kecerdasan Buatan
Modul Topik 3 - Kecerdasan BuatanSunu Wibirama
Ā 
Modul Topik 7 - Kecerdasan Buatan
Modul Topik 7 - Kecerdasan BuatanModul Topik 7 - Kecerdasan Buatan
Modul Topik 7 - Kecerdasan BuatanSunu Wibirama
Ā 
Advanced Software Engineering Program with IIT Madras
Advanced Software Engineering Program with IIT MadrasAdvanced Software Engineering Program with IIT Madras
Advanced Software Engineering Program with IIT MadrasMamathaSharma4
Ā 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learningshivani saluja
Ā 
Presenting GDSC Intro Session 23 (4).pptx
Presenting GDSC Intro Session 23 (4).pptxPresenting GDSC Intro Session 23 (4).pptx
Presenting GDSC Intro Session 23 (4).pptxKumarRajeev18
Ā 
DIYguru CATIA Course
DIYguru CATIA CourseDIYguru CATIA Course
DIYguru CATIA CourseSrishti Sikaria
Ā 
Android Based Quiz Application
Android Based Quiz ApplicationAndroid Based Quiz Application
Android Based Quiz ApplicationIRJET Journal
Ā 
Spohrer IESS 20230217 v9.pptx
Spohrer IESS 20230217 v9.pptxSpohrer IESS 20230217 v9.pptx
Spohrer IESS 20230217 v9.pptxISSIP
Ā 
City i-Tick: The android based mobile application for studentsā€™ attendance at...
City i-Tick: The android based mobile application for studentsā€™ attendance at...City i-Tick: The android based mobile application for studentsā€™ attendance at...
City i-Tick: The android based mobile application for studentsā€™ attendance at...journalBEEI
Ā 
Google Summer of Code (GSoC) 2020 for mentors
Google Summer of Code (GSoC) 2020 for mentorsGoogle Summer of Code (GSoC) 2020 for mentors
Google Summer of Code (GSoC) 2020 for mentorsPradeeban Kathiravelu, Ph.D.
Ā 
IRJET- Android Application for Training and Placement Cell using Machine ...
IRJET-  	  Android Application for Training and Placement Cell using Machine ...IRJET-  	  Android Application for Training and Placement Cell using Machine ...
IRJET- Android Application for Training and Placement Cell using Machine ...IRJET Journal
Ā 
Android Based E-Learning Application Class-E
Android Based E-Learning Application Class-EAndroid Based E-Learning Application Class-E
Android Based E-Learning Application Class-EIRJET Journal
Ā 

Similar to Modul Topik 1 - Kecerdasan Buatan (20)

Modul Topik 6 - Kecerdasan Buatan.pdf
Modul Topik 6 - Kecerdasan Buatan.pdfModul Topik 6 - Kecerdasan Buatan.pdf
Modul Topik 6 - Kecerdasan Buatan.pdf
Ā 
Modul Topik 8 - Kecerdasan Buatan
Modul Topik 8 - Kecerdasan BuatanModul Topik 8 - Kecerdasan Buatan
Modul Topik 8 - Kecerdasan Buatan
Ā 
Modul Topik 2 - Kecerdasan Buatan.pdf
Modul Topik 2 - Kecerdasan Buatan.pdfModul Topik 2 - Kecerdasan Buatan.pdf
Modul Topik 2 - Kecerdasan Buatan.pdf
Ā 
Modul Topik 4 - Kecerdasan Buatan.pdf
Modul Topik 4 - Kecerdasan Buatan.pdfModul Topik 4 - Kecerdasan Buatan.pdf
Modul Topik 4 - Kecerdasan Buatan.pdf
Ā 
GDSC Info Session KMIT
GDSC Info Session KMITGDSC Info Session KMIT
GDSC Info Session KMIT
Ā 
K-12 Computing Education for the AI Era: From Data Literacy to Data Agency
K-12 Computing Education for the AI Era: From Data Literacy to Data AgencyK-12 Computing Education for the AI Era: From Data Literacy to Data Agency
K-12 Computing Education for the AI Era: From Data Literacy to Data Agency
Ā 
Understanding Emerging Technology and Its Impact on Online & Blended Learning
Understanding Emerging Technology and Its Impact on Online & Blended LearningUnderstanding Emerging Technology and Its Impact on Online & Blended Learning
Understanding Emerging Technology and Its Impact on Online & Blended Learning
Ā 
Modul Topik 3 - Kecerdasan Buatan
Modul Topik 3 - Kecerdasan BuatanModul Topik 3 - Kecerdasan Buatan
Modul Topik 3 - Kecerdasan Buatan
Ā 
Modul Topik 7 - Kecerdasan Buatan
Modul Topik 7 - Kecerdasan BuatanModul Topik 7 - Kecerdasan Buatan
Modul Topik 7 - Kecerdasan Buatan
Ā 
Advanced Software Engineering Program with IIT Madras
Advanced Software Engineering Program with IIT MadrasAdvanced Software Engineering Program with IIT Madras
Advanced Software Engineering Program with IIT Madras
Ā 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
Ā 
Presenting GDSC Intro Session 23 (4).pptx
Presenting GDSC Intro Session 23 (4).pptxPresenting GDSC Intro Session 23 (4).pptx
Presenting GDSC Intro Session 23 (4).pptx
Ā 
DIYguru CATIA Course
DIYguru CATIA CourseDIYguru CATIA Course
DIYguru CATIA Course
Ā 
1.pdf
1.pdf1.pdf
1.pdf
Ā 
Android Based Quiz Application
Android Based Quiz ApplicationAndroid Based Quiz Application
Android Based Quiz Application
Ā 
Spohrer IESS 20230217 v9.pptx
Spohrer IESS 20230217 v9.pptxSpohrer IESS 20230217 v9.pptx
Spohrer IESS 20230217 v9.pptx
Ā 
City i-Tick: The android based mobile application for studentsā€™ attendance at...
City i-Tick: The android based mobile application for studentsā€™ attendance at...City i-Tick: The android based mobile application for studentsā€™ attendance at...
City i-Tick: The android based mobile application for studentsā€™ attendance at...
Ā 
Google Summer of Code (GSoC) 2020 for mentors
Google Summer of Code (GSoC) 2020 for mentorsGoogle Summer of Code (GSoC) 2020 for mentors
Google Summer of Code (GSoC) 2020 for mentors
Ā 
IRJET- Android Application for Training and Placement Cell using Machine ...
IRJET-  	  Android Application for Training and Placement Cell using Machine ...IRJET-  	  Android Application for Training and Placement Cell using Machine ...
IRJET- Android Application for Training and Placement Cell using Machine ...
Ā 
Android Based E-Learning Application Class-E
Android Based E-Learning Application Class-EAndroid Based E-Learning Application Class-E
Android Based E-Learning Application Class-E
Ā 

Recently uploaded

Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxUnboundStockton
Ā 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxRaymartEstabillo3
Ā 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
Ā 
ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)Dr. Mazin Mohamed alkathiri
Ā 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
Ā 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...jaredbarbolino94
Ā 
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļøcall girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø9953056974 Low Rate Call Girls In Saket, Delhi NCR
Ā 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfSumit Tiwari
Ā 
MICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxMICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxabhijeetpadhi001
Ā 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfMr Bounab Samir
Ā 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
Ā 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
Ā 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
Ā 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
Ā 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
Ā 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
Ā 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
Ā 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
Ā 

Recently uploaded (20)

Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docx
Ā 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
Ā 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
Ā 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
Ā 
ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)
Ā 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini  Delhi NCR9953330565 Low Rate Call Girls In Rohini  Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR
Ā 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
Ā 
Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...Historical philosophical, theoretical, and legal foundations of special and i...
Historical philosophical, theoretical, and legal foundations of special and i...
Ā 
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļøcall girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
call girls in Kamla Market (DELHI) šŸ” >ą¼’9953330565šŸ” genuine Escort Service šŸ”āœ”ļøāœ”ļø
Ā 
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdfEnzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Enzyme, Pharmaceutical Aids, Miscellaneous Last Part of Chapter no 5th.pdf
Ā 
MICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptxMICROBIOLOGY biochemical test detailed.pptx
MICROBIOLOGY biochemical test detailed.pptx
Ā 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Ā 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
Ā 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
Ā 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
Ā 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
Ā 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
Ā 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
Ā 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Ā 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
Ā 

Modul Topik 1 - Kecerdasan Buatan

  • 1. Topik 1 Definisi, Topik, dan Terminologi Kecerdasan Buatan Dr. Sunu Wibirama Modul Kuliah Kecerdasan Buatan Kode mata kuliah: UGMx 001001132012 March 31, 2022
  • 2. March 31, 2022 1 Capaian Pembelajaran Mata Kuliah Topik ini akan memenuhi CPMK 1, yakni mampu mendefinisikan pengertian sistem cer- das, berbagai macam terminologi di bidang kecerdasan buatan, dan berbagai macam aplikasi sistem berbasis kecerdasan buatan. Adapun indikator tercapainya CPMK tersebut adalah mampu membedakan konsep narrow AI dan general AI, mengerti konsep umum machine learning (supervised, unsupervised, reinforcement learning), mengerti contoh penerapan AI dan peluang AI di dunia kerja. 2 Cakupan Materi Cakupan materi dalam topik ini sebagai berikut: a) What is AI: mengenal konsep dasar kecerdasan buatan dan aplikasinya dalam kehidu- pan sehari-hari. b) AI and The Future of Jobs: mengenal dampak dari penerapan kecerdasan buatan terhadap dunia kerja dan peluang digantikannya sumber daya manusia dengan mesin. c) Learning AI: materi ini berisi seputar berbagai macam cara untuk mempelajari kecer- dasan buatan, mulai dari pendekatan secara konseptual (conceptual approach), secara algoritmis (algorithmic approach), secara matematis (mathematical approach), sampai dengan melaui praktik nyata untuk memecahkan permasalahan tertentu (real case study). d) Machine Intelligence Continuum: materi ini berisi tentang pembagian kecerdasan mesin menjadi beberapa tingkatan. Kecerdasan mesin dibagi berdasarkan kemam- puan mesin untuk menyelesaikan tuga dalam domain pengetahuan yang sempit, luas, dan bagaimana mesin mampu beradaptasi dengan domain pengetahuan yang baru. e) Expert Systems and Machine Learning: materi ini berisi penjelasan tentang teknologi kecerdasan buatan paling awal, yang dikenal dengan expert systems. Kelemahan expert systems pada akhirnya mendorong para peneliti untuk menemukan teknik lain yang dapat digunakan untuk melatih mesin melakukan suatu tugas secara otomatis tanpa harus diprogram secara eksplisit. Metode inilah yang disebut dengan machine learning. f) Supervised Learning, Unsupervised Learning and Reinforcement Learning: materi ini membahas tipe-tipe machine learning yang sering dijumpai dalam pemecahan problem- problem praktis. Tipe-tipe machine learning ini dijelaskan dengan ilustrasi yang in- tuitif untuk memudahkan pemahaman. g) Various AI Applications: materi ini menjelaskan tentang berbagai implementasi ke- cerdasan buatan di bidang kesehatan (healthcare), pengawasan lalu-lintas (traffic mon- itoring), keamanan (security), dan interaksi manusia-komputer (human-computer in- teraction). 1
  • 3. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA What is Artificial Intelligence? Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 AI and your daily activities 2
  • 4. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Artificial intelligence (AI) ā€¢ Intelligence: the ability to acquire and apply knowledge ā€¢ Artificial intelligence is created to simulates human intelligence processes by machines, especially computer systems. ā€¢ These processes include learning, decision-making, and self-correction. Particular applications of AI include expert systems (e.g., Google Maps), speech recognition (e.g.,: Apple Siri) and machine vision (e.g., Facebookā€™s face recognition). 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 [Source: Frost and Sullivan, ā€œArtificial Intelligence-R&D and Applications Road Mapā€, 2016] 4
  • 5. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Artificial Intelligence and Future Jobs Kecerdasan Buatan | Artificial Intelligence Version: January 2022 5 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Businesses affected by AI AI value creation by 2030: $13 trillion [Source: McKinsey and Co, ā€œNotes from the AI frontier: Applications and value of deep learningā€, 2018] 6
  • 6. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 How AI improves business [Source: Marco K., Medium, 2019] [Source: World Economic Forum, Future of Jobs Report, 2020] 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 [Source: Harvard Business Review, 2017] 8
  • 7. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 End of File 9
  • 8. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Learning AI: How to Get Started Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 Approaches on learning AI Conceptual approach Illustrations and visualizations are helpful Pros: ā€¢ Intuitive understanding ā€¢ The easiest way to learn AI ā€¢ Helping you explaining AI to non-specialist Cons: ā€¢ Shallow understanding, not enough if you aim for career as ML researcher/engineer/data scientist ā€¢ No practical experience (coding, algorithm design, etc.) Algorithmic approach Learn from pseudocode or source code Pros: ā€¢ Understanding both concept and process in AI techniques ā€¢ Fastest way to get your hands wet with programming exercise ā€¢ Entry point for most AI professional career Cons: ā€¢ Rarely uncovering whatā€™s under the hood (math), which is important if you want to be ML researcher/academician Mathematical approach Demystifying AI using mathematics Pros: ā€¢ Providing strong theoretical background of AI techniques ā€¢ Necessary if you aim for career in academia / RnD division in tech industry. Cons: ā€¢ You have to be strong in at least three parts of mathematics: probability and statistics, linear algebra, and calculus Case study Real case problem solving Pros: ā€¢ Developing strong practical skills ā€¢ You may need to blend other three approaches to be successful in solving problem ā€¢ Widening experience, useful in professional career Cons: ā€¢ Real world dataset with noises/errors may be not so easy to obtain ā€¢ You need strong background in programming, conceptual understanding, and math 2
  • 9. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Learning AI: How to Get Started (Part 2) Kecerdasan Buatan | Artificial Intelligence Version: January 2022 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Conceptual approach [Source: Annalyn Ng, Decision Trees Tutorial, Algobeans.Com, 2015] 4
  • 10. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Algorithmic approach 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Mathematical approach 6
  • 11. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 Case study 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 More recommended resources (1) 8
  • 12. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 https://www.kdnuggets.com/ More recommended resources (2) 9 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10 https://www.coursera.org/learn/machine-learning More recommended resources (3) 10
  • 13. 3/31/22 6 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama https://machinelearningmastery.com/start-here/ More recommended resources (4) 11 11 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 12 Online datasets https://archive.ics.uci.edu/ml/index.php 12
  • 14. 3/31/22 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 13 Live coding courses http://datacamp.com 13 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 14 End of File 14
  • 15. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Machine Intelligence Continuum (Part 1) Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 Narrow vs. General AI 2
  • 16. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Machine Intelligence Continuum 3 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Level 1: Systems that act ā€¢ Lowest level of the continuum: rule-based automatons. ā€¢ Hand engineered, following if-then rules. ā€¢ Cruise control in your car: ā€¢ The system monitors your automobileā€™s speed and uses a motor to vary throttle position to maintain a constant speed ā€¢ Remember: this is not a ā€œself-driving carā€, you cannot take your hands off the wheel. 4 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 4
  • 17. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Level 2: Systems that predict ā€¢ The system analyzes the data and produces probabilistic predictions based on the data. ā€¢ Prediction does not necessarily need to be a future event, but rather a mapping of known information to unknown information ā€¢ If your data is flawed, or you choose a sample set to analyze that does not represent your target population as a whole, you will get erroneous results (case study: The US 2016 election polls). 5 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Level 3: Systems that learn ā€¢ The system performs particular tasks without being explicitly programmed. ā€¢ These systems are mostly powered by two notorious AI branches: machine learning and deep learning. ā€¢ The systems are used in many enterprise applications to improve the process of turning data into predictions: ā€¢ Predictive marketing ā€¢ Netflixā€™s movies recommendation 6 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 6
  • 18. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 End of File 7
  • 19. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Machine Intelligence Continuum (Part 2) Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 Machine Intelligence Continuum 2 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 2
  • 20. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Level 4: Systems that create ā€¢ Recent breakthroughs in neural network models have inspired a resurgence of computational creativity, with computers now capable of producing original writing, imagery, music, and industrial designs. ā€¢ A profound example is ā€œautomated image-based story tellerā€ using deep neural networks. ā€¢ Berlin-based engineer Samim trained a neural network on 14 million lines of passages from romance novels and asked the model to generate stories about images. 3 [Source: Samim, ā€œGenerating Stories about Imagesā€, Medium.Com, 2015] 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Level 5: Systems that relate ā€¢ Since digital assistants like Appleā€™s Siri and Amazon Echoā€™s Alexa infiltrate our personal lives, machines will also need to be emotionally intelligent to succeed in our society. ā€¢ Sentiment analysis, also known as opinion mining or emotion AI, extracts and quantifies emotional states from our text, voice, facial expressions, and body language. ā€¢ This AI systems are commonly used in user experience research and AI-powered interview software. ā€¢ Affectivaā€”a leading emotion AI companyā€”helps advertisers improve the effectiveness of brand content by assessing and adapting to consumer reactions. 4 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 4
  • 21. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Level 6: Systems that master ā€¢ A human toddler only needs to see a single tiger to develop a mental construct of the animal and recognize other tigers. ā€¢ If humans needed to see thousands of tigers before learning to run away, our species would have died out long ago. ā€¢ By contrast a deep learning algorithm needs to process thousands of tiger images to recognizing them in images and video. Even, the algorithm does not reliably recognize other abstractions and representations of tigers, such as cartoons or costumes. ā€¢ A ā€œSystem That Mastersā€ is an intelligent agent capable of constructing abstract concepts and strategic plans from sparse data. By creating modular conceptual representations of the world around us, humans are able to transfer knowledge from one domain to another. 5 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Level 7: Systems that evolve ā€¢ This final category refers to systems that exhibit superhuman intelligence and capabilities. ā€¢ ā€œSystems That Evolveā€ are entities capable of dynamically changing their own architecture and design to adapt to environmental needs. ā€¢ Computers are currently constrained by both hardware and software, while humans and other biological organisms are constrained by wetware. ā€¢ Some futurists hypothesize that we may be able to achieve superhuman intelligence by augmenting biological brains with synthesized technologies, but currently this research is more science fiction than science. 6 [Source: M. Yao, ā€œThe machine intelligence continuumā€, TopBots.Com, 2017] 6
  • 22. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 [Source: Michael Copeland, 2016] 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 End of File 8
  • 23. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Expert Systems and Machine Learning Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama [Source: Michael Copeland, 2016] 2 2
  • 24. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Early AI: Expert Systems Suppose you want to recognize a digit of 7 You can tell computer three rules on how to write a ā€œ7ā€ [Source: Andrew Glassner, 2021] 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Early AI: Expert Systems Suddenly, your computer sees this number. Do you think the computer can recognize this number? I donā€™t think so. You have to ā€œteachā€ the computer to recognize an object automatically without being explicitly programmed Ć  machine learning [Source: Andrew Glassner, 2021] 4
  • 25. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Machine Learning ā€œA computer program is said to learn from experience (E) with some class of tasks (T) and a performance measure (P) if its performance at tasks in T as measured by P improves with Eā€ (Tom Mitchell, 1997) [Source: Andrew Glassner, 2021] 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Some important terminologies ā€¢ Training/Evolution set Set of data to discover potentially predictive relationships. ā€¢ Instances A sample is an item to process (e.g. classify). It can be a document, a picture, a sound, a video, a row in database or CSV file, or whatever you can describe with a fixed set of quantitative traits. ā€¢ Features / attributes The number of features or distinct traits that can be used to describe each item in a quantitative manner. ā€¢ Feature vector is an n-dimensional vector of numerical features that represent some object. ā€¢ Feature extraction Preparation of feature vector, transforms the data in the high-dimensional space to a space of fewer dimensions. 6
  • 26. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama (class / label) (features) (instance) 7 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama (class / label) (features) (instance) 8 ? 8
  • 27. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 End of File 9
  • 28. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Supervised Learning Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 How students learn 2
  • 29. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Can we treat machine with same process? 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama Apple What do you mean by Simple example 4
  • 30. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Define how apple looks Features: 1. Color: Radish/Red 2. Type: Fruit 3. Shape: Round Features: 1. Color: Sky Blue 2. Type: Logo 3. Shape: Half-bitten Features: 1. Color: Yellow 2. Type: Fruit 3. Shape: Round Label : red apple Label : apple logo Label : green apple Notes: features can be numerical of categorical 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Define how apple looks 1. Color: Radish/Red 2. Type: Fruit 3. Shape: Round 6
  • 31. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 Train the machine learning system 1. Color: Radish/Red 2. Type : Fruit 3. Shape Learning: update the algorithmā€™s parameters 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 Test the machine learning system Unseen data Features 1. Color: Green 2. Type : Fruit 3. Shape: Half-bitten Red apple/Apple logo/Green apple? Green apple Accuracy: 80% 8
  • 32. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 Applying supervised learning Input Output Application email spam? (yes/no) spam filtering audio text transcript speech recognition ads, user info click? (yes/no) online advertising Indonesian Japanese machine translation plate number pics plate number computer vision 9 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10 End of File 10
  • 33. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA Unsupervised Learning and Reinforcement Learning Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 Data without label What if, we have no labeled data? Or, we have very large data that it is almost impossible to label it. Can we do something with the data? 2
  • 34. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Data without label Yes, we do! We can find some similarities, or at least we can provide better representation to the data [Source: scikit-learn.org] 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Clustering Automatic grouping based on similar features among data 4
  • 35. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Dimensionality reduction Better representation based on dominant features [Source: https://towardsdatascience.com/a-one-stop-shop-for-principal-component-analysis-5582fb7e0a9c] 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Association rules Uncovering relationship between frequently bought items 6
  • 36. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 In March 2016, Lee Sedol, the Korean Go 18- times world champion, played and lost a five- game match against DeepMindā€™s AlphaGoā€”a deep reinforcement learning based Google DeepMindā€™s project. [Source: Aurelien Geron, 2021] 7 Reinforcement learning Learning based on optimal policy 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 Initial Performance After 15 minutes of training After 30 minutes of training [Source: https://deepsense.ai/what-is-reinforcement-learning-the-complete-guide/] 8 Reinforcement learning in action 8
  • 37. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 End of File 9
  • 38. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA AI Applications in Medical Diagnosis and Healthcare Systems Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 Roles of AI in healthcare systems [Source: DataFlair, 2021] 2
  • 39. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 AI applications in healthcare systems ā€¢ Machine learning in medical eye tracking ā€¢ AI for covid-19 detection ā€¢ Self-early screening app for oral cancer 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Machine learning in medical eye tracking San Diego, US Industrial partner: 4
  • 40. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Reference: S. Wibirama, I. Ardiyanto, T. Satriya, T.B. Adji, N. A. Setiawan, M. T. Setiawan, ā€œAn Improved Pupil Localization Technique for Real-Time Video-Oculography Extreme Eyelid Occlusionā€, International Journal of Innovative Computing, Information and Control, Vol. 15, No. 4, 2019, pp. 1547-1563. Common problem in this research: how to handle noises caused by eyelid occlusion? Machine learning in medical eye tracking 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Pupil Detection with Automatic Thresholding Reference: S. Wibirama, I. Ardiyanto, T. Satriya, T.B. Adji, N. A. Setiawan, M. T. Setiawan, ā€œAn Improved Pupil Localization Technique for Real-Time Video-Oculography Extreme Eyelid Occlusionā€, International Journal of Innovative Computing, Information and Control, Vol. 15, No. 4, 2019, pp. 1547- 1563. 6
  • 41. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 AI for Covid-19 detection 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 AI for Covid-19 detection 8
  • 42. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 Self-early screening app for oral cancer 9 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10 oral cancer, malignancy oral squamous cell carcinoma oral lesion Text books Scientific journal Dataset: 1154 pictures 517 Cancer 259 Normal 258 Non-cancer lesion Self-early screening app for oral cancer Dataset acquisition 10
  • 43. 3/31/22 6 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 11 Cancer images Non-cancer images Google Colaboratory Images dataset Screening parameters Self-early screening app for oral cancer Prediction process 11 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 12 Screening photo Results of prediction Probability of cancer occurrence Recommended action: Cancer case: Medical observation with dentist/medical doctor Non-cancer case: Presenting information on avoiding oral cancer Self-early screening app for oral cancer Prediction result 12
  • 44. 3/31/22 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 13 End of File 13
  • 45. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA AI Applications in Traffic Monitoring and Security Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 AI applications in traffic monitoring and security ā€¢ Vehicle number plate recognition ā€¢ Real-time car counting ā€¢ Twitter-based geolocation for traffic monitoring ā€¢ Self-driving car 2
  • 46. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Vehicle number plate recognition DIP DIP DIP Machine learning Reference: D.Sihombing, H.A. Nugroho, S. Wibirama, ā€œPerspective rectification in vehicle number plate recognition using 2D-2D transformation of planar homographyā€, in 2015 International Conference on Science in Information Technology, pp. 237-240, 2015. 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Real-time car counting 4 Reference: Hudalizaman, I. Ardiyanto, S. Wibirama, ā€œImage Enhancement on You Only Look Once (YOLO) Method to Detect Public Transportation of CCTV Imageā€, presented in The 6th International Conference Science and Technology, 2020. 4
  • 47. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 How does YOLO (You Only Look Once) work? ā€¢ Step 1: The image is divided into grid cells. Each grid cell forecasts B bounding boxes and provides their confidence scores. The cells predict the class probabilities to establish the class of each object. ā€¢ Step 2: We can notice at least three classes of objects: a car, a dog, and a bicycle. Note that for one object, there will be more than one bounding boxes because an object may overlap on several grid cells. ā€¢ Step 3: Intersection Over Union (IOU) ensures that the predicted bounding boxes are equal to the real boxes of the objects. ā€¢ Step 4: If IOU is greater than 0.5, we can say that the prediction is good enough. ā€¢ Step 5: Remove unnecessary bounding boxes that do not meet the threshold. ā€¢ Step 6: The final detection will consist of unique bounding boxes that fit the objects perfectly. 5 IoU = Area of yellow box / Area of green box 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Twitter-based geolocation for traffic monitoring 6 Reference: D.A. Kurniawan, S. Wibirama, N.A. Setiawan, ā€œReal- time traffic classification with Twitter data miningā€, in 2016 8th International Conference on Information Technology and Electrical Engineering, pp. 1-5, 2016. 6
  • 48. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 Twitter-based geolocation for traffic monitoring 7 Reference: D.A. Kurniawan, S. Wibirama, N.A. Setiawan, ā€œReal- time traffic classification with Twitter data miningā€, in 2016 8th International Conference on Information Technology and Electrical Engineering, pp. 1-5, 2016. 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 Twitter-based geolocation for traffic monitoring 8 Reference: D.A. Kurniawan, S. Wibirama, N.A. Setiawan, ā€œReal- time traffic classification with Twitter data miningā€, in 2016 8th International Conference on Information Technology and Electrical Engineering, pp. 1-5, 2016. 8
  • 49. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 Self-driving car 9 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10 How does self-driving car work? High-level view of the data collection system. Input Actual output by human driver Computed output Input Computed output Training the neural network. The trained network is used to generate steering commands from a single front-facing center camera. 10
  • 50. 3/31/22 6 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 11 End of File 11
  • 51. 3/31/22 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 1 Sunu Wibirama sunu@ugm.ac.id Department of Electrical and Information Engineering Faculty of Engineering Universitas Gadjah Mada INDONESIA AI Applications in Human-Computer Interaction Kecerdasan Buatan | Artificial Intelligence Version: January 2022 1 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 2 Touchless technology: from laboratory to necessity Public display has been an inseparable part of smart societies around the world (i.e. in the airport, toilet, and other public facilities) However, implementing an informative public display during pandemic posses a challenging interaction circumstances. To avoid Covid-19, there is a strong need to develop an intelligent touchless technology to minimize customer interactions with high contact surfaces. Our proposal: spontaneous gaze-based interaction powered with artificial intelligence Source of photo: https://www.enr.com/articles/49734-airports-ponder-touchless-technology-installations-in-bathrooms 2
  • 52. 3/31/22 2 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 3 Gaze-based interactive application A brief illustration Application content User (passerby) Userā€™s object of interest (dynamic button) Eye Tracker (Suatmi Murnani & Sunu Wibirama, 2020) 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 4 Three types of eye movement 1 1. Fixation *eyes remain still for more than 200-300 ms 2 2. Saccade *rapid eye movement from an object to another object 3 3. Smooth pursuit *slower eye movement while pursuing an object (Suatmi Murnani & Sunu Wibirama, 2020) 4
  • 53. 3/31/22 3 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 5 Eye tracking calibration: fixation-based ā€¢ Goal: improving spatial accuracy during gaze interaction ā€¢ User is asked to fixate their gaze on calibration targets (animated white or red circle). ā€¢ Mapping from eye position to calibration target: second order polynomial regression Gaze calibration target 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 6 Ƙ Alternative method: Uncalibrated gaze-based interaction (Smooth pursuit-based gaze interaction) Spatial accuracy issue *limitation of calibration: -time consuming -tiring / fatigue - impractical for interaction in public space Can not meet the challenge in spontaneous interaction Challenges of spontaneous gaze-based interaction Eye tracking calibration (Suatmi Murnani & Sunu Wibirama, 2020) 6
  • 54. 3/31/22 4 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 7 Eye tracking data processing Hidden Markov Models Exponential Moving Average (EMA) Pearson Product- Moment Correlation (PPMC) (Suatmi Murnani & Sunu Wibirama, 2020) 7 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 8 Probabilistic events detection using Hidden Markov Models ā€¢ Objectives: eye movement classification to improve accuracy of spontaneous object selection ā€¢ Hidden states: Fixation (Fix), Saccades (Sac), Post-Saccadic Oscillation (PSO), and Smooth Pursuit (SP) ā€¢ Observable states: segment velocity and inter-segment angle from gaze position signal Our choice on NSLR and HMM was based on: J. Pekkanen and O. Lappi, ā€œA new and general approach to signal denoising and eye movement classification based on segmented linear regression,ā€ Scientific reports, vol. 7, no. 1, p. 17726, 2017. (Suatmi Murnani, 2019) 8
  • 55. 3/31/22 5 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 9 Pearson Product-Moment Correlation (PPMC) ā€¢ Pearson Product-Moment Correlation measures the similarity of eye movements (e.g. smooth pursuit) and object trajectories based on their spatial pattern correlation. ā€¢ PPMC for objects that moved along X-axis direction was calculated from their X coordinates. ā€¢ This approach was also applied for objects that moved along Y-axis direction. ā€¢ We computed PPMC scores for all buttons and chose the largest PPMC score. This score resembled the button that was gazed by the user. Max(C1, C2, C3) = the triggered button with Cn denotes PPMC score and n is the dynamic button on screen C1 C2 C3 9 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 10 coviDisplayPRO: gaze-controlled smart public display 10
  • 56. 3/31/22 6 sunu@ugm.ac.id Copyright Ā© 2022 Sunu Wibirama | Do not distribute without permission @sunu_wibirama 11 End of File 11