The document discusses machine learning and how computers can be programmed to learn from examples without being explicitly programmed. It provides examples of machine learning applications like predicting house prices, text classification, and face detection. Additionally, it describes different types of learning problems including supervised learning, unsupervised learning, and classification problems.
Semi-Automatic Generation of Quizzes and Learning Artifacts from Linked DataGuillermo Álvaro Rey
Slides for "Semi-Automatic Generation of Quizzes and Learning Artifacts from Linked Data" position paper presented at Linked Learning workshop, WWW2012 conference.
Paper available at: http://ceur-ws.org/Vol-840/11-paper-21.pdf
Analyse et prospective : Campagne Obama - Draft DARRAGI Gilles
Il s'agit d'appréhender les grandes lignes de la campagne d'Obama et d'envisager une approche nouvelle des campagnes politiques.
Les nouveaux processsus et enjeux.
Semi-Automatic Generation of Quizzes and Learning Artifacts from Linked DataGuillermo Álvaro Rey
Slides for "Semi-Automatic Generation of Quizzes and Learning Artifacts from Linked Data" position paper presented at Linked Learning workshop, WWW2012 conference.
Paper available at: http://ceur-ws.org/Vol-840/11-paper-21.pdf
Analyse et prospective : Campagne Obama - Draft DARRAGI Gilles
Il s'agit d'appréhender les grandes lignes de la campagne d'Obama et d'envisager une approche nouvelle des campagnes politiques.
Les nouveaux processsus et enjeux.
Stratégie de communication politique pour la candidature de Mr François Fillon à la primaire ouverte Les Républicains 2016.
ECS Paris Master 1 de communication Publique & Politique
Barack Obama : la bataille s' est également jouée sur les réseaux sociaux !Kantar
Comment Barack Obama a également gagné la bataille sur les médias sociaux - l'annonce de sa victoire sur Twitter a généré plus de 535 000 RT. Analyse de Leendert de Voogd, TNS Opinion
Recommandation stratégique pour la candidature à la primaire socialiste de Dominique Strauss-Kahn.
Travail de groupe: ECS Paris (Master 1 de communication publique & politique)
Deep Learning: Towards General Artificial IntelligenceRukshan Batuwita
For the past several years Deep Learning methods have revolutionized the areas in Pattern Recognition, namely, Computer Vision, Speech Recognition, Natural Language Processing etc. These techniques have been mainly developed by academics, closely working with tech giants such as Google, Microsoft and Facebook where the research outcomes have been successfully integrated into commercial products such as Google image and voice search, Google Translate, Microsoft Cortana, Facebook M and many more interesting applications that are yet to come. More recently, Google DeepMind Technologies has been working on Artificial General Intelligence using Deep Reinforcement Learning methods, where their AlphaGo system beat the world champion of the complex Chinese game 'Go' in March 2016. This talk will present a thorough introduction to major Deep Learning techniques, recent breakthroughs and some exciting applications.
Stratégie de communication politique pour la candidature de Mr François Fillon à la primaire ouverte Les Républicains 2016.
ECS Paris Master 1 de communication Publique & Politique
Barack Obama : la bataille s' est également jouée sur les réseaux sociaux !Kantar
Comment Barack Obama a également gagné la bataille sur les médias sociaux - l'annonce de sa victoire sur Twitter a généré plus de 535 000 RT. Analyse de Leendert de Voogd, TNS Opinion
Recommandation stratégique pour la candidature à la primaire socialiste de Dominique Strauss-Kahn.
Travail de groupe: ECS Paris (Master 1 de communication publique & politique)
Deep Learning: Towards General Artificial IntelligenceRukshan Batuwita
For the past several years Deep Learning methods have revolutionized the areas in Pattern Recognition, namely, Computer Vision, Speech Recognition, Natural Language Processing etc. These techniques have been mainly developed by academics, closely working with tech giants such as Google, Microsoft and Facebook where the research outcomes have been successfully integrated into commercial products such as Google image and voice search, Google Translate, Microsoft Cortana, Facebook M and many more interesting applications that are yet to come. More recently, Google DeepMind Technologies has been working on Artificial General Intelligence using Deep Reinforcement Learning methods, where their AlphaGo system beat the world champion of the complex Chinese game 'Go' in March 2016. This talk will present a thorough introduction to major Deep Learning techniques, recent breakthroughs and some exciting applications.
Deep Learning @ ZHAW Datalab (with Mark Cieliebak & Yves Pauchard)Thilo Stadelmann
A high-level introduction to the current buzz around "Deep Learning" (That it is famous, successfull, and a continuation of neural network research; what is new since the last century, what is the basic idea, what is our outlook into ints future).
Followed by our stake in it and two use cases (face recognition, text analytics).
An introduction to machine learning. I gave a talk on this, the video can be found here:
http://www.techgig.com/expert-speak/Introduction-to-Machine-Learning-616
Similar to Machine Learning: Learning with data (20)
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
2. Outline
• Introduction
• Examples
• What does it mean to learn?
• Supervised and Unsupervised Learning
• Types of Learning
• Classification Problem
• Text Mining Example
• Conclusions (and further reading)
2
4. What is Machine Learning?
• A branch of artificial
intelligence (AI)
• Arthur Samuel (1959)
Field of study that gives
computers the ability to
learn without being explicitly
programmed
From: Andrew NG – Standford Machine Learning Classes
http://www.youtube.com/watch?v=UzxYlbK2c7E
4 09-11-2011
5. What is Machine Learning?
• Tom Mitchell (1998) Well-posed Learning
Problem:
A computer program is said to learn from
experience E with respect to some class of
tasks T and performance measure P, if its
performance at tasks in T, as measured by P,
improves with experience E.
• Mark Dredze
Teaching a computer about the world
5 09-11-2011
6. What is Machine Learning?
• Goal:
Design and development of algorithms that allow
computers to evolve behaviors based on
empirical data, such as from sensor data or
databases
• How to apply machine Learning?
• Observe the world
• Develop models that match observations
• Teach computer to learn these models
• Computer applies learned model to the world
6 09-11-2011
7. Example 1:
Prediction of House Price
From: Andrew NG – Standford Machine Learning Classes
http://www.youtube.com/watch?v=UzxYlbK2c7E
7 09-11-2011
8. Example 2:
Learning to automatically classify text documents
From: http://www.xcellerateit.com/
8 09-11-2011
9. Example 3:
Face Detection and Tracking
http://www.micc.unifi.it/projects/optimal-
face-detection-and-tracking/
9 09-11-2011
10. Example 4:
Social Network Mining
Users’
Profile
Friendship
Group &
Network
U3
U1 U5
Hidden Information ?
U2 U4
From: Exploit of Online Social Networks with Community-Based
Graph Semi-Supervised Learning, Mingzhen Mo and Irwin King Group
ICONIP 2010, Sydney, Australia Network
10 09-11-2011
13. What does it mean to learn?
• Learn patterns in data
z Decision ẋ
System
z : observed signal
ẋ Estimated output
13 09-11-2011
14. Unsupervised Learning
• Look for patterns in data
• No training Data (no examples of output)
• Pro:
• No labeling of examples for output
• Con:
• Cannot demonstrate specific types of output
• Applications:
• Data mining
• Finds interesting patterns in data
From: Mark Dredze
Machine Learning - Finding Patterns in the World
14 09-11-2011
15. Supervised Learning
• Learn patterns to simulate given output
• Pro:
• Can learn complex patterns
• Good performance
• Con:
• Requires many examples of output for examples
• Applications:
• Classification
• Sorts data into predefined groups
From: Mark Dredze
Machine Learning - Finding Patterns in the World
15 09-11-2011
16. Types of Learning: Output
• Classification
• Binary, multi‐class, multi‐label, hierarchical, etc.
• Classify email as spam
• Loss: accuracy
• Ranking
• Order examples by preference
• Rank results of web search
• Loss: Swapped pairs
• Regression
• Real‐valued output
• Predict the price of tomorrow’s stock price
• Loss: Squared loss
• Structured prediction
• Sequences, trees, segmentation
• Find faces in an image
• Loss: Precision/Recall of faces
From: Mark Dredze
16 09-11-2011 Machine Learning - Finding Patterns in the World
17. Classification Problem
• Classical Architecture
z Feature y ẋ
Classification
Extraction
z : observed signal
y : feature vector (pattern) y S
ẋ Estimated output (class) ẋ {1,2,…,c}
17 09-11-2011
18. Classification Problem
• Example with 1 feature
• Problem: classify people in non-obese or obese by
observation of its weight (only 1 feature)
• Is it possible to classify without without making any
mistakes?
18
18
19. Classification Problem
• Example with 2 features
z Feature y = {weight, ẋ = non-obese
Classification
Extraction Height} or obese
z : observed signal
y : feature vector (pattern) y S
ẋ Estimated output (class) ẋ {1: non-obese, 2: obese}
19 09-11-2011
20. Classification Problem
• Example with 2 feature
• Problem: classify people in non-obese or obese by
observation of its weight and height
• Now the decision appears more simple!
20
20
21. Classification Problem
• Example with 2 feature
• Problem: classify people in non-obese or obese by
observation of its weight and height
• Regiões de decisão: R1 : non-obese; R2 : obese
21
21
22. Classification Problem
• Decision Regions
• Goal of the classifier: define a partition of the feature space with
c disjoint regions, called decision regions: : R1, R2, …, Rc
22
22
24. Text Mining Process
Adapted from: Introduction to Text Mining,
Yair Even-Zohar, University of Illinois
24 09-11-2011
25. Text Mining Process
• Text preprocessing
• Syntactic/Semantic text
analysis
• Features Generation
• Bag of words
• Features Selection
• Simple counting
• Statistics
• Text/Data Mining
• Classification- Supervised
learning
• Clustering- Unsupervised
learning
• Analyzing results
25 09-11-2011
26. Syntactic / Semantic text analysis
• Part Of Speech (pos) tagging
• Find the corresponding pos for each word
e.g., John (noun) gave (verb) the (det) ball (noun)
• Word sense disambiguation
• Context based or proximity based
• Parsing
• Generates a parse tree (graph) for each sentence
• Each sentence is a stand alone graph
26 09-11-2011
27. Feature Generation: Bag of words
• Text document is represented by the words it
contains (and their occurrences)
• e.g., “Lord of the rings” {“the”, “Lord”, “rings”, “of”}
• Highly efficient
• Makes learning far simpler and easier
• Order of words is not that important for certain applications
• Stemming: identifies a word by its root
• e.g., flying, flew fly
• Reduce dimensionality
• Stop words: The most common words are unlikely
to help text mining
• e.g., “the”, “a”, “an”, “you” …
27 09-11-2011
28. Example
Hi,
Here is your weekly update (that unfortunately hasn't gone
out in about a month). Not much action here right now.
1) Due to the unwavering insistence of a member of the
group, the ncsa.d2k.modules.core.datatype package is month).
hi, weekly update (that unfortunately gone out
now completely independent of now. d2k application.
much action here right the 1) due unwavering insistence
2) Transformations are now handled differently in Tables. package
member group, ncsa.d2k.modules.core.datatype
Previously, transformations were done using a
now completely independent d2k application. 2)
TransformationModule. That handled could thentables. previously,
transformations now module differently be added
to a list that an ExampleTable kept. transformationmodule. module
transformations done using Now, there is an
interfaceadded list exampletable kept. sub-interface called
called Transformation and a now, interface called
ReversibleTransformation. unfortunate go out month much action here
hi week update
transformation sub-interface called
right now 1 due unwaver insistence member group ncsa
reversibletransformation.
d2k modules core datatype package now complete
independence d2k application 2 transformation now handle
different table previous transformation do use
transformationmodule module add list exampletable keep
now interface call transformation sub-interface call
reversibletransformation
28 09-11-2011
29. Feature Generation: Weighting
• Term Frequency
Bag of Words
Lorem 1
term ti, document dj
dolor 1
Praesent 1
• Inverse Document Frequency
Lorem ipsum dolor sit
amet, consectetuer
adipiscing elit. Praesent iaculis 1
et quam sit amet diam
porttitor iaculis.
Vestibulum ante ipsum Vestibulum 1
primis in faucibus orci
luctus et ultrices posuere
ipsum 2
cubilia Curae;
consectetuer 2
• TF-IDF
29 09-11-2011
31. Feature Selection
• Reduce dimensionality
• Learners have difficulty addressing tasks with high
dimensionality
• Irrelevant features
• Not all features help!
• e.g., the existence of a noun in a news
article is unlikely to help classify it as
“politics” or “sport”
• Stop Words Removal
31 09-11-2011
32. Example
hi core
week datatype
update package
unfortunate complete
go independence
out application
month 2 hi do
much transformationweek core
action handle update datatype
here different unfortunate package
right table go complete
now previous out independence
1 use month hi application datatype
due much
transformationmodule transformation
week package
unwaver add action handle
update complete
insistence list here different
unfortunate independence
member exampletable right table
month application
group keep now previous
ncsa interface due action
use transformation
d2k call insistence right
add handle
modules sub-interface member duelist different
do group
reversibletransformation keep
insistence table
ncsa interface
member previous
d2k call
group add
modules sub-interface
ncsa list
d2k interface
modules call
core sub-interface
32 09-11-2011
34. Text Mining: Classification definition
• Given: a collection of labeled records
(training set)
• Each record contains a set of features (attributes), and
the true class (label)
• Find: a model for the class as a function
of the values of the features
• Goal: previously unseen records should be
assigned a class as accurately as possible
• A test set is used to determine the accuracy of the
model. Usually, the given data set is divided into training
and test sets, with training set used to build the model
and test set used to validate it
34 09-11-2011
35. Text Mining: Clustering definition
• Given: a set of documents and a similarity
measure among documents
• Find: clusters such that:
• Documents in one cluster are more similar to one another
• Documents in separate clusters are less similar to one another
• Goal:
• Finding a correct set of documents
35 09-11-2011
36. Supervised vs. Unsupervised Learning
• Supervised learning (classification)
• Supervision: The training data (observations,
measurements, etc.) are accompanied by labels
indicating the class of the observations
• New data is classified based on the training set
• Unsupervised learning (clustering)
• The class labels of training data is unknown
• Given a set of measurements, observations, etc. with the
aim of establishing the existence of classes or clusters in
the data
36 09-11-2011
38. Readings
• Survey Books in Machine Learning
• The Elements of Statistical Learning
• Hastie, Tibshirani, Friedman
• Pattern Recognition and Machine Learning
• Bishop
• Machine Learning
• Mitchell
• Questions?
38 09-11-2011
39. ACKNOWLEDGEMENTS
• ISEL – DEETC
• Final year and MSc supervised students (Tony Tam, ...)
• Students of Digital Signal Processing
• Artur Ferreira
• Instituto Telecomunicações (IT)
David Coutinho, Hugo Silva, Ana Fred, Mário Figueiredo
• Fundação para a Ciência e Tecnologia (FCT)
39 09-11-2011
40. www.it.pt
Thank you for the attention!
André Ribeiro Lourenço
Mail to: alourenco@deetc.isel.ipl.pt
arlourenco@gmail.com
40