eMadrid seminar on «IEEE standards over education and learning technologies»

1. IEEE P2834 Joint Standardization
Project on Secured and Trusted
Learning Systems
Hamadou Saliah-Hassane, ing. PhD. SMIEE
Chair of IEEE Education Society Standards Committee
TELUQ University, Canada
hamadou.saliah-hassane@teluq.ca

2. TELUQ University
Founded in 1972, TÉLUQ is the only french-language university in
North America offering all its courses via distance education. Every
year, nearly 20,000 undergraduate and graduate students obtain
their university education from TÉLUQ.
https://www.teluq.ca/site/en/

3. Outline
• Development and maintenance processes of an IEEE
Education Society sponsored standard
• IEEE Std 1876 – 2019 on Networked Smart Learning
Objects for Online Laboratories
• IEEE - P2834 Secured and Trusted Learning
Systems
0

4. Development and maintenance
processes of an IEEE Education
Society sponsored standard

5. What Standards Do?
• Standards solve marketplace problems
• Standards are successful when they
facilitate expansion, remove friction,
lower costs, ensure safety, add stability,
or otherwise positively impact their target
market or supply chain.
• The key measure of success is adoption in
a relevant market.
Interoperability
Quality
Supply Chain
Relevance

6. What Standards Do?
Interoperability Quality Supply Chain Relevance

7. What Standards Do?
Interoperability Quality Supply Chain Relevance
Wireless Local Area Network (WLAN)
IEEE 802.11™

8. IEEE Standard Development Process Flow
Study Group /
Industry?
Connection
Initiative?
Project
Authorization
Request
PAR

9. IEEE Standard Development Life Cycle
P1876™ is Sponsored
by IEEE Education
Society since 2011
Individual vs Entity

10. The IEEE Education Society
(EdSoc) is a society of
the Institute of Electrical and
Electronics Engineers (IEEE)
that is focused on the theory
and practice
of education and educational
technology needed to deliver
effectively domain
knowledge in the fields of
interest of IEEE.

11. 7000+
Individual
Members
200+ Corporate
Members
IEEE Conformity
Assessment
Program
Standards
The IEEE Standards
Associations offers a
variety of industry
consensus products
•Standards
Development
•Industry Connections
•Registration Authority
•Conformity Assessment
•Open Source (new)
IEEE
Registration
Authority
IEEE Standards Associations (SA)

12. IEEE Learning
Technology Standards Committee
(LTSC)
The IEEE Learning Technology
Standards Committee (LTSC) is
chartered by the IEEE Computer
Society Standards Activity
Board to develop internationally
accredited technical standards,
recommended practices, and
guides for learning technology.

13. The IEEE
Learning
Technology
Standards
Committee
Program
The Industry
Connections
Industry
Consortium on
Learning
Engineering
(ICICLE)
IEEE ICICLE
IC Industry
Consortium
on Learning
Engineering
Current LTSC Activities

14. § Early Phase (1997 – 2002)
§ Content Portability: Develop eLearning
once, deliver in any Learning Management
System
§ Definition of eLearning: Architecture,
vocabulary, and notion of a learning object
§ Learner Information: Demographic
information, credentials. Also basic
reusable competency definitions
§ Content Portability standards were
successful
§ Active world-wide participation from LMS
vendors, educators, industry, and
researchers
§ Adopted via the Shareable Content Object
Reference Model (SCORM)
§ Arguably launched a multi-billion dollar
market
The IEEE
Learning
Technology
Standards
Committee

15. § Next Phase (2003 – 2015)
§ Maintenance of early work
§ Translation into XML
§ Conceptual models
§ Generally inactive – no
significant new market problems
to solve!
§ Current Phase (2016 –
present)
§ Explosion in interest
§ New technologies
§ Artificial Intelligence
§ Big Data
§ Virtual Reality
§ New Web Architectures and
Business Models
§ New standards activities (next
slide)
The IEEE
Learning
Technology
Standards
Committee

16. § New Standards Activities
§ Student Data Governance
§ AR Learning Experience Model
§ Mobile Learning Platforms
§ Reusable Competency Definitions
§ xAPI
§ Federated Machine Learning*
§ Adaptive Instructional Systems
§ Adaptive Instruction Systems
§ Clarifying market definitions
§ Exploring interoperability (e.g. learner
models)
§ Participation from industry, educators,
researchers
The IEEE
Learning
Technology
Standards
Committee

17. § IEEE Standardization Process
§ Anyone can directly participate
§ Follows due process and provides right to
appeal
§ Decisions are consensus driven
§ Balance among stakeholders is required
§ Process is open and transparent
§ Steps in the process
§ Project authorization
§ Working Group develops draft standard
§ Standard is balloted – anyone in the IEEE
Standards Association can provide
comments and vote
§ Standard is approved and published
§ Adoption depends on vendors and their
customers
The IEEE
Learning
Technology
Standards
Committee

18. IEEE Industry Consortium on Learning
Engineering (ICICLE) initiative
“ICICLE is an open
forum and community-
driven platform for
defining and
supporting the
profession of Learning
Engineering.”

19. Special Interest Groups (SIGs)
IEEE ICICLE
IC Industry Consortium
on Learning
Engineering
Started January 2018
500 Individual Members
70+ Organization
Members
IEEE Industry Consortium on Learning
Engineering (ICICLE) initiative

20. How to Participate
• Join ICICLE
– Subscribe at https://www.ieeeicicle.org/
• IEEE LTSC
– General information:
http://site.ieee.org/sagroups-ltsc/home/
– Adaptive Instructional Systems:
http://site.ieee.org/sagroups-2247-1/

21. IEEE Std 1876 – 2019
on Networked Smart Learning
Objects for Online Laboratories

22. § Sharing Resources
– Lab Equipment (affordance)
– Managers /Teachers / Lab Tutors / Facilitators
– Students /Learners
– Contents and Learning Scenarios
§ Collaborative Learning / Teaching / Flippled Classrooms/
Pedagogical Sound
– Delivery Environments (Moodle, WebCT, Sakaï etc)
– Communication Tools: Knowledge Modelers, White Boards,
Email, Chat etc.
§ Federation – Brokerage of Online Labs
– Networking – Security – Management – Pedagocical needs
– Cyber physical Systems – Online or Networked Embedded
Systems – Complex Systems – Interoperability – Compliance
(manufacturers)
Why a Standard for Online
Laboratories for Education?

23. IEEE-SA P1876 Working Group
Chair: Hamadou Saliah-Hassane
Vice Chair: Luis Felipe Zapata-Rivera
Editorial board: John Shokley,
Hamadou Saliah-Hassane, Denis Gillet,
Miguel Rodriguez Artacho, Janusz
Zalewski
hsaliah@ieee.org
https://ieee-sa.centraldesktop.com/1876public/
http://site.ieee.org/sagroups-edusc/
https://standards.ieee.org/standard/1876-2019.html
Networked Smart Learning Objects for Online
Laboratories

24. IEEE SA P1876 Working Group Member
PROFILES (Groups & Consortiums)
•PROLEARN: European Project in the framework of FP7
– Interoperability for searching Learning Object Repositories:
The ProLearn Query Language – Metadata for Learning
Object
•GOLC: Global Online Laboratory Consortium (2009 -) -"The
mission of the consortium is the creation of sharable, online
experimental environments which increase the educational and
scientific value of learning which may not be accessible,
scalable or efficient through traditional methods.“
– http://www.online-engineering.org/GOLC_about.php - The
International Association of Online Engineering (IAOE) –
Development of Online Engineering
•LiLa: Library of Labs; an initiative of eight
universities and three enterprises, for the mutual exchange of
and access to Online Labs
Networked Smart Learning Objects for Online
Laboratories

25. IEEE SA P1876 Working Group Member
PROFILES (Groups & Consortiums)
•LORNET: Pan Canadian Project Founded by NSERC
– Interoperability of Learning Object – LO Repositories – TELOS –
Instructional Design Software - Online Labs integration for
Distance Education and Research
•Go-Lab: Global Online Laboratory Consortium (2009 -) - “The
Go-Lab project aims to encourage young people to engage in
science topics, acquire scientific inquiry skills, and experience
the culture of doing science by undertaking active guided
experimentation”; http://www.go-lab-project.eu/
•RexLab: Remote Experimental Lab – (1997 -) the Remote at
the Federal University of Santa Catarina in Brazil (UFSC)
http://rexlab.ufsc.br/en/
Networked Smart Learning Objects for Online
Laboratories

26. IEEE SA P1876 Working Group Member
PROFILES (Services, Software & Hardware)
Individual members of the group use products and services
they developed or mutally developed by their partners in our
choosen approach of Research & Development of the P1876™
Draft.
iLab – Shared Architecture (ISA) - First developed at MIT
VISIR –Virtual Instrument Systems in Reality - First
developed at Blekinge Institute of Technology http://openlabs.bth.se/
WebLab Deusto – Labsland - http://weblab.deusto.es/website/
GRAASP – Developed at École Polytechnique Fédérale de Lausanne -
http://graasp.eu/
Insdustrial Partners: ARM: https://www.arm.com/research-
education/university ; NI: ni.com;
MathWorks™… & Cloud Software Providers
Networked Smart Learning Objects for Online
Laboratories

27. IEEE Std 1876 – 2019 Abstract
« Methods for storing,
retrieving, and accessing online
laboratories as smart and
interactive learning objects
are defined in this standard. For
this purpose, the first level of the
standard offers any online
laboratory (lab) as a service
(Lab as a Service or LaaS). The
standard also defines methods for
integrating online laboratories as
smart learning objects in learning
environments and learning object
repositories. »

28. IEEE Std 1876 – 2019 Architecture

29. IEEE Std 1876 – 2019 Student Involvement
WG Member: Dr. Luis Felipe Zapata-Rivera (2019)
Dissertation Title: “Models and implementations of online Laboratories; A definition of a standard architecture to integrate distributed
remote experiments”
Supervisor(s) : Dr. Maria Larrondo Petrie
WG Member: Dr. Raul Cordeiro (2018)
Dissertation Title: “Evolution Model for Remote and Virtual Laboratories”
Supervisor(s) : Dr. José Manuel Fonseca and Dr. Gustavo Ribeiro Alves
WG Member: Dr. Wissam Halimi (2018)
Dissertation Title: “Topics in Educational Cyber-Physical Labs: Configurations, Data Collection and Analysis”
Supervisor(s): Dr. Denis Gillet and Dr. Christophe Salzmann
WG Member: Dr. Mohamed Mhamdi (2017)
Dissertation Title: “Contribution to the Specification of an Advanced support Environment for 3D Automation Remote Laboratory”
Supervisor(s): Dr. Hamadou Saliah-Hassane and Dr. Rafik Braham
WG Member: Dr. Luis de la Torre (2013)
Dissertation Title: “New Generation Virtual and Remote Laboratories”
Supervisor(s) : Dr. José Sánchez Moreno and Dr. Sebastián Dormido Bencomo
WG Member: Dr. Pablo Orduña (2013)
Dissertation Title: “Transitive and Scalable Federation Model for Remote Laboratories”
Supervisor(s) : Dr. Javier García-Zubia
WG Member: Dr. Mohamed Tawfik (2011)
Dissertation Title: “Laboratory as a Service (LaaS): a Paradigm for Developing and Implementing Modular Remote Laboratories”
Supervisor(s) : Dr. Manuel Castro and Dr. Elio San Cristobal
WG Member: Dr. Felix Garcia-Loro (2018)
Dissertation Title: “Evaluation and Learning in Remote Laboratories: A Proposal for an Automatic System for
Formative Assessment Applied to VISIR Remote Laboratory”
Supervisor(s) : Dr. Manuel Castro and Dr. Sergio Martin

30. IEEE - P2834 Secured and Trusted
Learning Systems

31. IEEE - P2834 Secured and Trusted
Learning Systems
0

32. IEEE - P2834 Secured and Trusted
Learning Systems (Keywords)
0
Digital Forensics, Forensic Readiness, Security, Artificial Intelligence,
Machine learning, Deep learning, IoT, Virtual Reality (VR), Augmented
Reality (AR), Online Software/Hardware Testing, Reliability, Mobility,
Federation of Online Laboratories, Cyberphysical laboratories, Federated
Database Security, Policy Based Management, Role Based Access
Control, Infrastructure-as-a-service, Federated Cloud Security, e-
learning, Learning Management Systems, Data governance and Privacy

33. IEEE - P2834 Secured and Trusted
Learning Systems (Sponsors)
This initiative is jointly sponsored by:
•IEEE Education Society (EdSoc),
•IEEE LTSC
•IEEE Industrial Electronics Society
(IES).
0

34. IEEE - P2834 Secured and Trusted
Learning Systems
• The proposed project will produce an individual based standard and
a guide that will ensure the security of human, virtual/software and
hardware interacting in online learning environments.
• This standard and the related guide will also ensure respect for the
privacy of the human actors involved in the learning and teaching
process.
On 5-Sep-2019 the IEEE-SA Standards Board approved P2834
until 31-Dec-2023.
0

35. IEEE - P2834 Secured and Trusted
Learning Systems (Proposal)
This development will provide a
specific standard and a guide
that would allow training
institutions to design, implement
and adequately manage safe e-
learning environments that are
ready for digital forensics
analysis to be integrate into a
federation of educational
institutions.
0

36. IEEE - P2834 Secured and Trusted
Learning Systems (Context)
The new realities and facts in terms of security for educational institutions
adopting distance or bimodal education as a strategy for delivering their courses:
1. The strengthening as well as the new requirements of national and international
organizations for the respect of the personal data governance as well as that of privacy to
which e-learning environments must conform;
2. The emerging needs of federation of educational institutions;
3. Several initiatives, academic or industrial alliances, standardization or normalization
organizations still deal with the security of information systems in silos or sometimes
relegate the task to other entities;
4. with the proliferation of social media tools and applications and the emergence of
sometimes open and low-cost electronic devices, teachers and students are competing
creatively for building up ad hoc digital learning environments parallel or grafted to
institutional ones. This sometimes compromises and jeopardize all the security and
academic management measures put in place.
0

37. • Lack of flexibility to comply with privacy and security
requirements of academic and government institutions
• Most of the security threats that have been identified
on Cyber-physical System and IoT implementations
are also applicable to Online laboratory systems
SECURITY CHALLENGES ON
ONLINE LABORATORY SYSTEMS

38. Physical environment of the system (lab facility)
Hardware (lab stations, controllers)
Software (web platforms, data bases, LRSs.. etc)
communication equipment and facilities (networking
device: routers, switches, servers)
VULNERABILITIES OF ONLINE
LABORATORY SYSTEMS

39. IEEE Std 1876 – 2019 Architecture

40. Security Challenges Lab Interaction and
xAPI Statement Generation
User personal Information
should to be protected
User Academic information
visible for other systems
Malicious Code Insertion
possibility
xAPI Integration to a remote lab system, Zapata-Rivera,
Larrondo-Petrie, 2017

41. Hamadou Saliah-Hassane,
IEEE Education Society Standards
Committee Chair
TELUQ University, Canada
Email: hamadou.saliah-hassane@teluq.ca
Contributors:
Avron Barr, Chair of IEEE LTSC, US
Robby Robson, IEEE Standards Association
Standards Board, US
Luis Felipe Rivera Zapata & Maria Larrondo
Petrie – Florida Atlantic University, US

42. References
IEEE Education Society (EdSoc) (Online): http://ieee-edusociety.org/
ICICLE (Online): https://www.ieeeicicle.org/
IEEE LTSC General information (Online):
http://site.ieee.org/sagroups-ltsc/home/
IEEE LTSC Adaptive Instructional Systems (Online):
http://site.ieee.org/sagroups-2247-1/
IEEE 1876-2019 - IEEE Standard for Networked Smart Learning
Objects for Online Laboratories, Standard document available at
(Online): https://standards.ieee.org/standard/1876-2019.html
IEEE Std 1876 – Networked Smart Learning Objects for Online
Laboratories, Official Website (Online):
https://site.ieee.org/sagroups-edusc/
IEEE Std 1876 – Networked Smart Learning Objects for Online
Laboratorie, IEEE Central Desktop (Online): https://ieee-
sa.centraldesktop.com/1876public/

43. References
VISIR –Virtual Instrument Systems in Reality - First developed at Blekinge
Institute of Technology (Online): http://openlabs.bth.se/
WebLab Deusto – Labsland (Online): http://weblab.deusto.es/website/
GRAASP – Developed at École Polytechnique Fédérale de Lausanne
(Online): http://graasp.eu/
Go-Lab: (Online): http://www.go-lab-project.eu/
GOLC: Global Online Laboratory Consortium (Online): http://www.online-
engineering.org/GOLC_about.php
The International Association of Online Engineering (IAOE) (Online):
http://online-engineering.org/
LiLa: Library of Labs (Online): https://www.lila-project.org
RexLab: Remote Experimental Lab (Online): https://rexlab.ufsc.br
Smart Adaptive Remote Laboratories (Online): http://sarl.fau.edu/sarl
ARM (Online): https://www.arm.com/research-education/university
NI (Online): http://www.ni.com
MathWorks (Online): http://www.mathworks.com