SlideShare a Scribd company logo
1 of 39
Quality Assurance of
Digital Education
Lessons from the Maltese
Experience
Design Thinking
3
Does Digital Education need Quality
Assurance & Accreditation?
Purpose of Quality Assurance
4
accountability enhancement
provide information to
assure … the quality of the
higher education
institution’s activities
provide advice and
recommendations on how
(HEI) might improve what it
is doing The ESGs exist to
create a common
basis of trust
between institutions
and systems.Source: European Standards and Guidelines for
Quality Assurance in Higher Education (2015)
Trust is about
Perception
Key Concepts
5
I don’t trust what
I don’t
understand
Trust is a
Prerequisite
for recognition and
portability
Key Concepts
6
Students should be able
to build up qualifications
made up of different
credits from many
universitiesMinister Bartolo
7
digital education ?
education which occurs primarily
in a
digital space
can we trust
digital is different
and thus
not fully
understood or trusted
Key Concepts
8
What is different about digital
technology?
9
anonymous distributed amorphous
borderless cheap scalable
Concerns
Concern:
– Assessment cannot be
secured
Solution:
– Specify methods of
assessment security
– Specify methods of ensuring
student identity
10
anonymous
amorphous
Concerns
Concern:
- persons / organizations ‘escape’
QA through unbundling
Solution:
- check the profiles of all staff
involved: design, delivery, support
- No distinction between
subcontractors and provider
institutions
11
distributed
borderless
Concerns
Concern:
- no effective sanction against
abusers
Solution:
- ultimate beneficial owner
disclosed
- legal representative resident in
Malta
- student records must be physically
stored in Malta
12
distributed
borderless
Concerns
Concern:
- diploma mill qualifications will
multiply
Solution:
• only accredited institutions may
offer qualifications pegged to the
qualifications framework
• legal sanction for those who peg it
badly
13
cheap
scalable
14
Do we need new forms of
accreditation for digital learning?
Subject to
Accreditation
Subject to
Quality Assurance
A Binary Choice?
15
Formal
Education
Occurs in
organized
and
structured
environment
Explicitly
designated
as learning
Typically
Leads to
Certification
Non-Formal
Education
Occurs in
planned
activities
Not
Explicitly
designated
as learning
Typically
does Not
Lead to
Certification
CEDEFOP
Definitions
A Simplified Typology of e-Learning
16
Traditional
E-Learning
Replicates a
Formal
University
Education
Formal
Education
Typically
Leads to
Certification
MOOCs,
Flexible &
Open
Education
‘Open’
therefore
unstructured
Non-Formal
Education
Typically
does Not
Lead to
Certification
Observation
In such a scenario
existing quality & accreditation
instruments
suffice with small changes
17
Subject to
Accreditation
18
Formal Education
Occurs in organized
and structured
environment
Typically
Leads to
Certification
Non-Formal
Education
Occurs in
planned
activities
Not
Explicitly
designated
as learning
Typically
does Not
Lead to
Certification
RecognitionofNon-Formal
&InformalLearning
Recognition of Non-
Formal Learning is a
potential avenue
for MOOC Certification
19
Observation
Recognition of Non-Formal Learning
does not scale to millions of students
20
Subject to
Accreditation
21
Formal Education
Occurs in organized
and structured
environment
Typically
Leads to
Certification
Non-Formal
Education
Occurs in
planned
activities
Not
Explicitly
designated
as learning
Typically
does Not
Lead to
Certification
RecognitionofNon-Formal
&InformalLearning
Are MOOCs Really
Non-Formal?
Explicitly
designated
as learning
Subject to
Accreditation
Subject to
Quality Assurance
A Third Way
22
Formal
Education
Occurs in
organized and
structured
environment
Explicitly
designated as
learning
Typically Leads
to Certification
Semi-Formal
Education
Occurs in
planned
activities
Explicitly
designated as
learning
Typically Leads
to Certification
Non-Formal
Education
Occurs in
planned
activities
Not Explicitly
designated as
learning
Typically does
Not Lead to
Certification
This ‘third way’ is already
mainstream
23
This ‘third way’ is already
mainstream
24
What is a Course?
25
occurs in
organized and
structured
environment
occurs in
planned
activities
under the
direction
(supervision &
control) of an
instructor
under the
(supervision &
control) of the
learner
Teaching
(course)
Self-Directed
Learning
formal
semi-formal
What kind of Certification?
26
Typically Leads
to Certification
Accredited
Non-
Accredited
Recognition and Assessment
is impossible without a currency
Key Concepts
27
Currency is issued
by authorised and
respected institutions
Key Concepts
28
The base currency of learning in
Europe is ECTS
Key Concepts
29
31
European Qualifications
Framework
adapts
defines Malta Qualifications
Framework
Recipe for different
qualifications
# of
ECTS
learning
outcomes
level
Degrees
Diplomas
Specialisations
Certificates
Best Indicator of a Quality
Qualification
is a Quality Institution
Key Concepts
32
Overview of the Maltese System
True student choice requires
trusted qualifications
Key Concepts
34
Overview of the Maltese System
SEMI-FORMAL
PATHWAY
Quality teaching involves determing
fitness for purpose
Key Concepts
36
Overview of the Maltese System
Scenarios Enabled by
Accreditation
38
Scenarios enabled by Accreditation
39
40
Looking Forward to the debate
Anthony F. Camilleri – anthony@knowledgeinnnovation.eu
http://www.slideshare.net/anthonycamilleri

More Related Content

What's hot

Microcredentials in the future european policy landscape
Microcredentials in the future european policy landscapeMicrocredentials in the future european policy landscape
Microcredentials in the future european policy landscapeAnthony Fisher Camilleri
 
The State of Digital Education: What I learned
The State of Digital Education: What I learnedThe State of Digital Education: What I learned
The State of Digital Education: What I learnedAnthony Fisher Camilleri
 
Common microcredential framework
Common microcredential frameworkCommon microcredential framework
Common microcredential frameworkEADTU
 
Validation and Blockchain: Challenges and Opportunities
Validation and Blockchain: Challenges and OpportunitiesValidation and Blockchain: Challenges and Opportunities
Validation and Blockchain: Challenges and OpportunitiesAnthony Fisher Camilleri
 
Implementing QA in Complex Organisations: Applications of Theory to Education...
Implementing QA in Complex Organisations: Applications of Theory to Education...Implementing QA in Complex Organisations: Applications of Theory to Education...
Implementing QA in Complex Organisations: Applications of Theory to Education...Anthony Fisher Camilleri
 
How the Blockchain can shape the future of education
How the Blockchain can shape the future of educationHow the Blockchain can shape the future of education
How the Blockchain can shape the future of educationAlexander Mikroyannidis
 
Micro-credentialing Workshop: A view from the Australian higher education sector
Micro-credentialing Workshop: A view from the Australian higher education sectorMicro-credentialing Workshop: A view from the Australian higher education sector
Micro-credentialing Workshop: A view from the Australian higher education sectorCharles Darwin University
 
Blockchain technology for the lifelong learner
Blockchain technology for the lifelong learnerBlockchain technology for the lifelong learner
Blockchain technology for the lifelong learnerAlexander Mikroyannidis
 
Facilitating lifelong learning through the use of blockchain technology
Facilitating lifelong learning through the use of blockchain technologyFacilitating lifelong learning through the use of blockchain technology
Facilitating lifelong learning through the use of blockchain technologyAlexander Mikroyannidis
 
Open Credentials for Open Education
Open Credentials for Open EducationOpen Credentials for Open Education
Open Credentials for Open EducationIldiko Mazar
 
Making quality assurance more European – where are we and where do we want to...
Making quality assurance more European – where are we and where do we want to...Making quality assurance more European – where are we and where do we want to...
Making quality assurance more European – where are we and where do we want to...Colin Tück
 
Credentialing open non-formal learning in Higher Education: the MicroHE appro...
Credentialing open non-formal learning in Higher Education: the MicroHE appro...Credentialing open non-formal learning in Higher Education: the MicroHE appro...
Credentialing open non-formal learning in Higher Education: the MicroHE appro...EDEN Digital Learning Europe
 
Strengthening the impact of QA: a student perspective
Strengthening the impact of QA: a student perspectiveStrengthening the impact of QA: a student perspective
Strengthening the impact of QA: a student perspectiveAnthony Fisher Camilleri
 
Open Education Passports and Micro Credentials for refugees and migrants
Open Education Passports and Micro Credentials for refugees and migrantsOpen Education Passports and Micro Credentials for refugees and migrants
Open Education Passports and Micro Credentials for refugees and migrantsIldiko Mazar
 
The OEPass Learning Passport as a way to facilitate recognition of open crede...
The OEPass Learning Passport as a way to facilitate recognition of open crede...The OEPass Learning Passport as a way to facilitate recognition of open crede...
The OEPass Learning Passport as a way to facilitate recognition of open crede...Ildiko Mazar
 
Collaboration around HVET & PHE in Europe: Initial Findings from Research
Collaboration around HVET & PHE in Europe: Initial Findings from ResearchCollaboration around HVET & PHE in Europe: Initial Findings from Research
Collaboration around HVET & PHE in Europe: Initial Findings from ResearchAnthony Fisher Camilleri
 
Challenges Facing Professional Higher Education in Central and South-Eastern ...
Challenges Facing Professional Higher Education in Central and South-Eastern ...Challenges Facing Professional Higher Education in Central and South-Eastern ...
Challenges Facing Professional Higher Education in Central and South-Eastern ...Anthony Fisher Camilleri
 

What's hot (20)

Microcredentials in the future european policy landscape
Microcredentials in the future european policy landscapeMicrocredentials in the future european policy landscape
Microcredentials in the future european policy landscape
 
The State of Digital Education: What I learned
The State of Digital Education: What I learnedThe State of Digital Education: What I learned
The State of Digital Education: What I learned
 
Common microcredential framework
Common microcredential frameworkCommon microcredential framework
Common microcredential framework
 
Micro-credentials in Higher Education
Micro-credentials in Higher EducationMicro-credentials in Higher Education
Micro-credentials in Higher Education
 
Learning Passport as Credit Supplement to be used
Learning Passport as Credit Supplement to be usedLearning Passport as Credit Supplement to be used
Learning Passport as Credit Supplement to be used
 
Validation and Blockchain: Challenges and Opportunities
Validation and Blockchain: Challenges and OpportunitiesValidation and Blockchain: Challenges and Opportunities
Validation and Blockchain: Challenges and Opportunities
 
Implementing QA in Complex Organisations: Applications of Theory to Education...
Implementing QA in Complex Organisations: Applications of Theory to Education...Implementing QA in Complex Organisations: Applications of Theory to Education...
Implementing QA in Complex Organisations: Applications of Theory to Education...
 
How the Blockchain can shape the future of education
How the Blockchain can shape the future of educationHow the Blockchain can shape the future of education
How the Blockchain can shape the future of education
 
Micro-credentialing Workshop: A view from the Australian higher education sector
Micro-credentialing Workshop: A view from the Australian higher education sectorMicro-credentialing Workshop: A view from the Australian higher education sector
Micro-credentialing Workshop: A view from the Australian higher education sector
 
Blockchain technology for the lifelong learner
Blockchain technology for the lifelong learnerBlockchain technology for the lifelong learner
Blockchain technology for the lifelong learner
 
Facilitating lifelong learning through the use of blockchain technology
Facilitating lifelong learning through the use of blockchain technologyFacilitating lifelong learning through the use of blockchain technology
Facilitating lifelong learning through the use of blockchain technology
 
Open Credentials for Open Education
Open Credentials for Open EducationOpen Credentials for Open Education
Open Credentials for Open Education
 
Making quality assurance more European – where are we and where do we want to...
Making quality assurance more European – where are we and where do we want to...Making quality assurance more European – where are we and where do we want to...
Making quality assurance more European – where are we and where do we want to...
 
Why the focus on Micro - Credentials?
Why the focus on Micro - Credentials?Why the focus on Micro - Credentials?
Why the focus on Micro - Credentials?
 
Credentialing open non-formal learning in Higher Education: the MicroHE appro...
Credentialing open non-formal learning in Higher Education: the MicroHE appro...Credentialing open non-formal learning in Higher Education: the MicroHE appro...
Credentialing open non-formal learning in Higher Education: the MicroHE appro...
 
Strengthening the impact of QA: a student perspective
Strengthening the impact of QA: a student perspectiveStrengthening the impact of QA: a student perspective
Strengthening the impact of QA: a student perspective
 
Open Education Passports and Micro Credentials for refugees and migrants
Open Education Passports and Micro Credentials for refugees and migrantsOpen Education Passports and Micro Credentials for refugees and migrants
Open Education Passports and Micro Credentials for refugees and migrants
 
The OEPass Learning Passport as a way to facilitate recognition of open crede...
The OEPass Learning Passport as a way to facilitate recognition of open crede...The OEPass Learning Passport as a way to facilitate recognition of open crede...
The OEPass Learning Passport as a way to facilitate recognition of open crede...
 
Collaboration around HVET & PHE in Europe: Initial Findings from Research
Collaboration around HVET & PHE in Europe: Initial Findings from ResearchCollaboration around HVET & PHE in Europe: Initial Findings from Research
Collaboration around HVET & PHE in Europe: Initial Findings from Research
 
Challenges Facing Professional Higher Education in Central and South-Eastern ...
Challenges Facing Professional Higher Education in Central and South-Eastern ...Challenges Facing Professional Higher Education in Central and South-Eastern ...
Challenges Facing Professional Higher Education in Central and South-Eastern ...
 

Viewers also liked

Idi2017 - Cloud DB: strengths and weaknesses
Idi2017 - Cloud DB: strengths and weaknessesIdi2017 - Cloud DB: strengths and weaknesses
Idi2017 - Cloud DB: strengths and weaknessesLinuxaria.com
 
Financial Management- Comparison Two MNCS in FMCG Sector
Financial Management- Comparison Two MNCS in FMCG SectorFinancial Management- Comparison Two MNCS in FMCG Sector
Financial Management- Comparison Two MNCS in FMCG Sectorsdusane1
 
"Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ...
"Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ..."Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ...
"Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ...ExternalEvents
 
L IGP Agneau de Sisteron
L IGP Agneau de SisteronL IGP Agneau de Sisteron
L IGP Agneau de SisteronExternalEvents
 
Shots and angles analysis
Shots and angles analysisShots and angles analysis
Shots and angles analysisOlivia Quinn
 
Print edition-surinenglish-591-20170310
Print edition-surinenglish-591-20170310Print edition-surinenglish-591-20170310
Print edition-surinenglish-591-20170310colegioelatabalmalaga
 
Evaluación del estado de nutrición
Evaluación del estado de nutriciónEvaluación del estado de nutrición
Evaluación del estado de nutriciónFatimaBriseidaCG
 
Visual content marketing for small business your how-to ultimate guide
Visual content marketing for small business  your how-to ultimate guideVisual content marketing for small business  your how-to ultimate guide
Visual content marketing for small business your how-to ultimate guideSocialMediaOnlineClasses.com
 
Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17
Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17
Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17StartUps.be
 
Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17
Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17
Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17StartUps.be
 
JAWS DAYS 2017 lunch session
JAWS DAYS 2017 lunch sessionJAWS DAYS 2017 lunch session
JAWS DAYS 2017 lunch session陽平 山口
 
владислав володин семинар Prom.ua - хмельницкий 2017 февраль
владислав володин   семинар Prom.ua - хмельницкий 2017 февральвладислав володин   семинар Prom.ua - хмельницкий 2017 февраль
владислав володин семинар Prom.ua - хмельницкий 2017 февральVlad Volodin
 

Viewers also liked (17)

Idi2017 - Cloud DB: strengths and weaknesses
Idi2017 - Cloud DB: strengths and weaknessesIdi2017 - Cloud DB: strengths and weaknesses
Idi2017 - Cloud DB: strengths and weaknesses
 
Arquitectura del Quattrocento.
Arquitectura del Quattrocento.Arquitectura del Quattrocento.
Arquitectura del Quattrocento.
 
Financial Management- Comparison Two MNCS in FMCG Sector
Financial Management- Comparison Two MNCS in FMCG SectorFinancial Management- Comparison Two MNCS in FMCG Sector
Financial Management- Comparison Two MNCS in FMCG Sector
 
"Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ...
"Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ..."Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ...
"Projeto Piloto - Brasil Primeiro Seminário Regional – Projeto FAO Guayaquil ...
 
L IGP Agneau de Sisteron
L IGP Agneau de SisteronL IGP Agneau de Sisteron
L IGP Agneau de Sisteron
 
Shots and angles analysis
Shots and angles analysisShots and angles analysis
Shots and angles analysis
 
Evaluacion del estado nutricio
Evaluacion del estado nutricioEvaluacion del estado nutricio
Evaluacion del estado nutricio
 
Print edition-surinenglish-591-20170310
Print edition-surinenglish-591-20170310Print edition-surinenglish-591-20170310
Print edition-surinenglish-591-20170310
 
Evaluación del estado de nutrición
Evaluación del estado de nutriciónEvaluación del estado de nutrición
Evaluación del estado de nutrición
 
Visual content marketing for small business your how-to ultimate guide
Visual content marketing for small business  your how-to ultimate guideVisual content marketing for small business  your how-to ultimate guide
Visual content marketing for small business your how-to ultimate guide
 
Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17
Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17
Harold Grondel: Intrapreneurship - Corporate innovation - TSD 17
 
Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17
Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17
Philippe Mouchard: Intrapreneurship - Corporate innovation - TSD 17
 
JAWS DAYS 2017 lunch session
JAWS DAYS 2017 lunch sessionJAWS DAYS 2017 lunch session
JAWS DAYS 2017 lunch session
 
Ikhtiologi riska
Ikhtiologi riskaIkhtiologi riska
Ikhtiologi riska
 
Documento di Buona Causa
Documento di Buona CausaDocumento di Buona Causa
Documento di Buona Causa
 
владислав володин семинар Prom.ua - хмельницкий 2017 февраль
владислав володин   семинар Prom.ua - хмельницкий 2017 февральвладислав володин   семинар Prom.ua - хмельницкий 2017 февраль
владислав володин семинар Prom.ua - хмельницкий 2017 февраль
 
Así es hoy el cv perfecto
Así es hoy el cv perfectoAsí es hoy el cv perfecto
Así es hoy el cv perfecto
 

Similar to Quality Assurance of Digital Education: Lessons from the Maltese Experience

Digital Badging at the Open University
Digital Badging at the Open UniversityDigital Badging at the Open University
Digital Badging at the Open UniversityDr Patrina Law
 
The College Career Office Employers Love
The College Career Office Employers LoveThe College Career Office Employers Love
The College Career Office Employers LoveCollegis Education
 
Digital badging at the OU
Digital badging at the OUDigital badging at the OU
Digital badging at the OUDr Patrina Law
 
OpenCred Study – Recognition of open learning in Europe: some issues for inst...
OpenCred Study – Recognition of open learning in Europe: some issues for inst...OpenCred Study – Recognition of open learning in Europe: some issues for inst...
OpenCred Study – Recognition of open learning in Europe: some issues for inst...witthaus
 
Ontario Open Badges Forum - Don's Deck
Ontario Open Badges Forum - Don's DeckOntario Open Badges Forum - Don's Deck
Ontario Open Badges Forum - Don's DeckDon Presant
 
Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...
Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...
Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...SURF Events
 
Micro credentialing and open badges
Micro credentialing and open badgesMicro credentialing and open badges
Micro credentialing and open badgesRobert Schuwer
 
Badge your way to digital literacy
Badge your way to digital literacyBadge your way to digital literacy
Badge your way to digital literacyStudyvibe
 
GAC Borderless Learning
GAC Borderless LearningGAC Borderless Learning
GAC Borderless LearningWaleed Jameel
 
The application of open digital badging at the OU UK and its future in he
The application of open digital badging at the OU UK and its future in heThe application of open digital badging at the OU UK and its future in he
The application of open digital badging at the OU UK and its future in heDr Patrina Law
 
Micro-certification Pilot Presentations, Feb 2020 (consolidated)
Micro-certification Pilot Presentations, Feb 2020 (consolidated)Micro-certification Pilot Presentations, Feb 2020 (consolidated)
Micro-certification Pilot Presentations, Feb 2020 (consolidated)Lena Patterson
 
Embracing Multigenerational Teams in Audit
Embracing Multigenerational Teams in AuditEmbracing Multigenerational Teams in Audit
Embracing Multigenerational Teams in AuditJim Kaplan CIA CFE
 
Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...
Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...
Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...EDEN Digital Learning Europe
 
L&D Level 5 Brochure 2016
L&D Level 5 Brochure 2016L&D Level 5 Brochure 2016
L&D Level 5 Brochure 2016Sumaya Hashim
 
The function of microcredentials for the Open University
The function of microcredentials for the Open UniversityThe function of microcredentials for the Open University
The function of microcredentials for the Open UniversityRobert Farrow
 
CCCS and CSU Digital Badge presentation at Aurora Badge Summit June 2016
CCCS and CSU Digital Badge presentation at Aurora Badge Summit  June 2016CCCS and CSU Digital Badge presentation at Aurora Badge Summit  June 2016
CCCS and CSU Digital Badge presentation at Aurora Badge Summit June 2016cccscoetc
 
E-Portfolios and Assesment: Introduction to iWebfolio
E-Portfolios and Assesment: Introduction to iWebfolioE-Portfolios and Assesment: Introduction to iWebfolio
E-Portfolios and Assesment: Introduction to iWebfolioLisa Scheese
 

Similar to Quality Assurance of Digital Education: Lessons from the Maltese Experience (20)

Digital Badging at the Open University
Digital Badging at the Open UniversityDigital Badging at the Open University
Digital Badging at the Open University
 
The College Career Office Employers Love
The College Career Office Employers LoveThe College Career Office Employers Love
The College Career Office Employers Love
 
Digital badging at the OU
Digital badging at the OUDigital badging at the OU
Digital badging at the OU
 
OpenCred Study – Recognition of open learning in Europe: some issues for inst...
OpenCred Study – Recognition of open learning in Europe: some issues for inst...OpenCred Study – Recognition of open learning in Europe: some issues for inst...
OpenCred Study – Recognition of open learning in Europe: some issues for inst...
 
Ontario Open Badges Forum - Don's Deck
Ontario Open Badges Forum - Don's DeckOntario Open Badges Forum - Don's Deck
Ontario Open Badges Forum - Don's Deck
 
Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...
Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...
Bruggen, geen barrières: flexibel onderwijs ondersteunen met open badges - Ri...
 
Micro credentialing and open badges
Micro credentialing and open badgesMicro credentialing and open badges
Micro credentialing and open badges
 
Badge your way to digital literacy
Badge your way to digital literacyBadge your way to digital literacy
Badge your way to digital literacy
 
GAC Borderless Learning
GAC Borderless LearningGAC Borderless Learning
GAC Borderless Learning
 
The application of open digital badging at the OU UK and its future in he
The application of open digital badging at the OU UK and its future in heThe application of open digital badging at the OU UK and its future in he
The application of open digital badging at the OU UK and its future in he
 
Micro-certification Pilot Presentations, Feb 2020 (consolidated)
Micro-certification Pilot Presentations, Feb 2020 (consolidated)Micro-certification Pilot Presentations, Feb 2020 (consolidated)
Micro-certification Pilot Presentations, Feb 2020 (consolidated)
 
Embracing Multigenerational Teams in Audit
Embracing Multigenerational Teams in AuditEmbracing Multigenerational Teams in Audit
Embracing Multigenerational Teams in Audit
 
Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...
Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...
Open Credentials for Open Education - Moving the Needle Forward - Ildiko Maza...
 
L&D Level 5 Brochure 2016
L&D Level 5 Brochure 2016L&D Level 5 Brochure 2016
L&D Level 5 Brochure 2016
 
Level 5 Diploma in IT – E-commerce Delivered Online by LSBR,UK
Level 5 Diploma in IT – E-commerce Delivered Online by LSBR,UKLevel 5 Diploma in IT – E-commerce Delivered Online by LSBR,UK
Level 5 Diploma in IT – E-commerce Delivered Online by LSBR,UK
 
The function of microcredentials for the Open University
The function of microcredentials for the Open UniversityThe function of microcredentials for the Open University
The function of microcredentials for the Open University
 
CCCS and CSU Digital Badge presentation at Aurora Badge Summit June 2016
CCCS and CSU Digital Badge presentation at Aurora Badge Summit  June 2016CCCS and CSU Digital Badge presentation at Aurora Badge Summit  June 2016
CCCS and CSU Digital Badge presentation at Aurora Badge Summit June 2016
 
Level 5 Diploma in Information Technology Delivered Online by LSBR,UK
Level 5 Diploma in Information Technology Delivered Online by LSBR,UKLevel 5 Diploma in Information Technology Delivered Online by LSBR,UK
Level 5 Diploma in Information Technology Delivered Online by LSBR,UK
 
E-Portfolios and Assesment: Introduction to iWebfolio
E-Portfolios and Assesment: Introduction to iWebfolioE-Portfolios and Assesment: Introduction to iWebfolio
E-Portfolios and Assesment: Introduction to iWebfolio
 
Prospectus new 2015
Prospectus new 2015Prospectus new 2015
Prospectus new 2015
 

More from Anthony Fisher Camilleri

Beyond the hype, a blockchain approach to educational management
Beyond the hype, a blockchain approach to educational managementBeyond the hype, a blockchain approach to educational management
Beyond the hype, a blockchain approach to educational managementAnthony Fisher Camilleri
 
Standardising Management Systems for Educational Organizations – implications...
Standardising Management Systems for Educational Organizations – implications...Standardising Management Systems for Educational Organizations – implications...
Standardising Management Systems for Educational Organizations – implications...Anthony Fisher Camilleri
 
Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...
Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...
Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...Anthony Fisher Camilleri
 
Developing a System for the Accreditation of Digital Learning in Malta
Developing a System for the Accreditation of Digital Learning in MaltaDeveloping a System for the Accreditation of Digital Learning in Malta
Developing a System for the Accreditation of Digital Learning in MaltaAnthony Fisher Camilleri
 
International Context of QA in VET, HVET and PHE
International Context of QA in VET, HVET and PHEInternational Context of QA in VET, HVET and PHE
International Context of QA in VET, HVET and PHEAnthony Fisher Camilleri
 
Challenges in Peer Assessment of Student Centred Learning
Challenges in Peer Assessment of Student Centred LearningChallenges in Peer Assessment of Student Centred Learning
Challenges in Peer Assessment of Student Centred LearningAnthony Fisher Camilleri
 
Working on the Relationship: Quality Assurance as a Tool for Improving Labour...
Working on the Relationship: Quality Assurance as a Tool for Improving Labour...Working on the Relationship: Quality Assurance as a Tool for Improving Labour...
Working on the Relationship: Quality Assurance as a Tool for Improving Labour...Anthony Fisher Camilleri
 
ECBCheck: strengthening e-learning capacity globally
ECBCheck: strengthening e-learning capacity globallyECBCheck: strengthening e-learning capacity globally
ECBCheck: strengthening e-learning capacity globallyAnthony Fisher Camilleri
 
PHE - The Role of Stakeholders - a Slovenian perspective
PHE - The Role of Stakeholders - a Slovenian perspectivePHE - The Role of Stakeholders - a Slovenian perspective
PHE - The Role of Stakeholders - a Slovenian perspectiveAnthony Fisher Camilleri
 
Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)
Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)
Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)Anthony Fisher Camilleri
 
Quality Assurance and Innovative Education: A Provocative Vision for the Futu...
Quality Assurance and Innovative Education: A Provocative Vision for the Futu...Quality Assurance and Innovative Education: A Provocative Vision for the Futu...
Quality Assurance and Innovative Education: A Provocative Vision for the Futu...Anthony Fisher Camilleri
 
Quality Assurance of e-Learning: Methodologies and Issues to Consider
Quality Assurance of e-Learning: Methodologies and Issues to ConsiderQuality Assurance of e-Learning: Methodologies and Issues to Consider
Quality Assurance of e-Learning: Methodologies and Issues to ConsiderAnthony Fisher Camilleri
 

More from Anthony Fisher Camilleri (15)

Beyond the hype, a blockchain approach to educational management
Beyond the hype, a blockchain approach to educational managementBeyond the hype, a blockchain approach to educational management
Beyond the hype, a blockchain approach to educational management
 
Blockchain in Education
Blockchain in EducationBlockchain in Education
Blockchain in Education
 
Standardising Management Systems for Educational Organizations – implications...
Standardising Management Systems for Educational Organizations – implications...Standardising Management Systems for Educational Organizations – implications...
Standardising Management Systems for Educational Organizations – implications...
 
An introduction to ISO 21001
An introduction to ISO 21001An introduction to ISO 21001
An introduction to ISO 21001
 
Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...
Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...
Blockchain for Education: A Study on Digital Accreditation of Personal and Ac...
 
Developing a System for the Accreditation of Digital Learning in Malta
Developing a System for the Accreditation of Digital Learning in MaltaDeveloping a System for the Accreditation of Digital Learning in Malta
Developing a System for the Accreditation of Digital Learning in Malta
 
International Context of QA in VET, HVET and PHE
International Context of QA in VET, HVET and PHEInternational Context of QA in VET, HVET and PHE
International Context of QA in VET, HVET and PHE
 
Challenges in Peer Assessment of Student Centred Learning
Challenges in Peer Assessment of Student Centred LearningChallenges in Peer Assessment of Student Centred Learning
Challenges in Peer Assessment of Student Centred Learning
 
Working on the Relationship: Quality Assurance as a Tool for Improving Labour...
Working on the Relationship: Quality Assurance as a Tool for Improving Labour...Working on the Relationship: Quality Assurance as a Tool for Improving Labour...
Working on the Relationship: Quality Assurance as a Tool for Improving Labour...
 
Preparing Engaged Citizens
Preparing Engaged CitizensPreparing Engaged Citizens
Preparing Engaged Citizens
 
ECBCheck: strengthening e-learning capacity globally
ECBCheck: strengthening e-learning capacity globallyECBCheck: strengthening e-learning capacity globally
ECBCheck: strengthening e-learning capacity globally
 
PHE - The Role of Stakeholders - a Slovenian perspective
PHE - The Role of Stakeholders - a Slovenian perspectivePHE - The Role of Stakeholders - a Slovenian perspective
PHE - The Role of Stakeholders - a Slovenian perspective
 
Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)
Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)
Conclusions of the PHExcel (Professional Higher Education Excellence Seminar)
 
Quality Assurance and Innovative Education: A Provocative Vision for the Futu...
Quality Assurance and Innovative Education: A Provocative Vision for the Futu...Quality Assurance and Innovative Education: A Provocative Vision for the Futu...
Quality Assurance and Innovative Education: A Provocative Vision for the Futu...
 
Quality Assurance of e-Learning: Methodologies and Issues to Consider
Quality Assurance of e-Learning: Methodologies and Issues to ConsiderQuality Assurance of e-Learning: Methodologies and Issues to Consider
Quality Assurance of e-Learning: Methodologies and Issues to Consider
 

Recently uploaded

Quarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up FridayQuarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up FridayMakMakNepo
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Atmosphere science 7 quarter 4 .........
Atmosphere science 7 quarter 4 .........Atmosphere science 7 quarter 4 .........
Atmosphere science 7 quarter 4 .........LeaCamillePacle
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
ROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint PresentationROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint PresentationAadityaSharma884161
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfUjwalaBharambe
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxAnupkumar Sharma
 
Planning a health career 4th Quarter.pptx
Planning a health career 4th Quarter.pptxPlanning a health career 4th Quarter.pptx
Planning a health career 4th Quarter.pptxLigayaBacuel1
 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxRaymartEstabillo3
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Mark Reed
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 

Recently uploaded (20)

Quarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up FridayQuarter 4 Peace-education.pptx Catch Up Friday
Quarter 4 Peace-education.pptx Catch Up Friday
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 
Atmosphere science 7 quarter 4 .........
Atmosphere science 7 quarter 4 .........Atmosphere science 7 quarter 4 .........
Atmosphere science 7 quarter 4 .........
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
ROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint PresentationROOT CAUSE ANALYSIS PowerPoint Presentation
ROOT CAUSE ANALYSIS PowerPoint Presentation
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
 
Planning a health career 4th Quarter.pptx
Planning a health career 4th Quarter.pptxPlanning a health career 4th Quarter.pptx
Planning a health career 4th Quarter.pptx
 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 

Quality Assurance of Digital Education: Lessons from the Maltese Experience

  • 1. Quality Assurance of Digital Education Lessons from the Maltese Experience
  • 3. 3 Does Digital Education need Quality Assurance & Accreditation?
  • 4. Purpose of Quality Assurance 4 accountability enhancement provide information to assure … the quality of the higher education institution’s activities provide advice and recommendations on how (HEI) might improve what it is doing The ESGs exist to create a common basis of trust between institutions and systems.Source: European Standards and Guidelines for Quality Assurance in Higher Education (2015)
  • 5. Trust is about Perception Key Concepts 5 I don’t trust what I don’t understand
  • 6. Trust is a Prerequisite for recognition and portability Key Concepts 6 Students should be able to build up qualifications made up of different credits from many universitiesMinister Bartolo
  • 7. 7 digital education ? education which occurs primarily in a digital space can we trust
  • 8. digital is different and thus not fully understood or trusted Key Concepts 8
  • 9. What is different about digital technology? 9 anonymous distributed amorphous borderless cheap scalable
  • 10. Concerns Concern: – Assessment cannot be secured Solution: – Specify methods of assessment security – Specify methods of ensuring student identity 10 anonymous amorphous
  • 11. Concerns Concern: - persons / organizations ‘escape’ QA through unbundling Solution: - check the profiles of all staff involved: design, delivery, support - No distinction between subcontractors and provider institutions 11 distributed borderless
  • 12. Concerns Concern: - no effective sanction against abusers Solution: - ultimate beneficial owner disclosed - legal representative resident in Malta - student records must be physically stored in Malta 12 distributed borderless
  • 13. Concerns Concern: - diploma mill qualifications will multiply Solution: • only accredited institutions may offer qualifications pegged to the qualifications framework • legal sanction for those who peg it badly 13 cheap scalable
  • 14. 14 Do we need new forms of accreditation for digital learning?
  • 15. Subject to Accreditation Subject to Quality Assurance A Binary Choice? 15 Formal Education Occurs in organized and structured environment Explicitly designated as learning Typically Leads to Certification Non-Formal Education Occurs in planned activities Not Explicitly designated as learning Typically does Not Lead to Certification CEDEFOP Definitions
  • 16. A Simplified Typology of e-Learning 16 Traditional E-Learning Replicates a Formal University Education Formal Education Typically Leads to Certification MOOCs, Flexible & Open Education ‘Open’ therefore unstructured Non-Formal Education Typically does Not Lead to Certification
  • 17. Observation In such a scenario existing quality & accreditation instruments suffice with small changes 17
  • 18. Subject to Accreditation 18 Formal Education Occurs in organized and structured environment Typically Leads to Certification Non-Formal Education Occurs in planned activities Not Explicitly designated as learning Typically does Not Lead to Certification RecognitionofNon-Formal &InformalLearning Recognition of Non- Formal Learning is a potential avenue for MOOC Certification
  • 19. 19
  • 20. Observation Recognition of Non-Formal Learning does not scale to millions of students 20
  • 21. Subject to Accreditation 21 Formal Education Occurs in organized and structured environment Typically Leads to Certification Non-Formal Education Occurs in planned activities Not Explicitly designated as learning Typically does Not Lead to Certification RecognitionofNon-Formal &InformalLearning Are MOOCs Really Non-Formal? Explicitly designated as learning
  • 22. Subject to Accreditation Subject to Quality Assurance A Third Way 22 Formal Education Occurs in organized and structured environment Explicitly designated as learning Typically Leads to Certification Semi-Formal Education Occurs in planned activities Explicitly designated as learning Typically Leads to Certification Non-Formal Education Occurs in planned activities Not Explicitly designated as learning Typically does Not Lead to Certification
  • 23. This ‘third way’ is already mainstream 23
  • 24. This ‘third way’ is already mainstream 24
  • 25. What is a Course? 25 occurs in organized and structured environment occurs in planned activities under the direction (supervision & control) of an instructor under the (supervision & control) of the learner Teaching (course) Self-Directed Learning formal semi-formal
  • 26. What kind of Certification? 26 Typically Leads to Certification Accredited Non- Accredited
  • 27. Recognition and Assessment is impossible without a currency Key Concepts 27
  • 28. Currency is issued by authorised and respected institutions Key Concepts 28
  • 29. The base currency of learning in Europe is ECTS Key Concepts 29
  • 30. 31 European Qualifications Framework adapts defines Malta Qualifications Framework Recipe for different qualifications # of ECTS learning outcomes level Degrees Diplomas Specialisations Certificates
  • 31. Best Indicator of a Quality Qualification is a Quality Institution Key Concepts 32
  • 32. Overview of the Maltese System
  • 33. True student choice requires trusted qualifications Key Concepts 34
  • 34. Overview of the Maltese System SEMI-FORMAL PATHWAY
  • 35. Quality teaching involves determing fitness for purpose Key Concepts 36
  • 36. Overview of the Maltese System
  • 38. Scenarios enabled by Accreditation 39
  • 39. 40 Looking Forward to the debate Anthony F. Camilleri – anthony@knowledgeinnnovation.eu http://www.slideshare.net/anthonycamilleri