These are my slides for the presentation of the work I've presented in the International Conference for Internet Technology and Secured Transactions (ICITST) 2017.
A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors Model - ICITST 2017
1. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
A Collaborative System for Corporate Performance
Evaluation using Gamification and the Learning Vectors
Model
Michelle G. Cacais1, Gilvandenys L. Sales1
1Postgraduate Program in Computer Science
Federal Institute of Education, Science and Technology of Ceará (IFCE) – Brazil
December 7 2017
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 1 / 28
2. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Summary
1 Introduction
2 Learning Vectors Model (LV)
3 Related work
4 PIPA : design and development
System appearance
Learning Vectors applied to PIPA
5 Preliminary results
Methodology
Results
6 Conclusion
7 References
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 2 / 28
3. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Introduction
Human Capital consists of the skills and competencies that favor the performance
The adoption of a collaborative system could improve the performance of the
teams
The Learning Vectors Model (LV) is an evaluation methodology and
gamification is the motivator factor
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 3 / 28
4. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Learning Vectors Model (LV)
The Learning Vectors Model is a qualitative-quantitative methodology of non-linear
evaluation
Allows constant monitoring
The LV Model uses vectors and numerical equations in a two-dimensional way
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 4 / 28
5. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Learning Vectors Model (LV)
FIGURE – Graphic representation of the vectors of LV Model (SALES, 2010, p. 88)
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 5 / 28
6. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
LV Equations
Equation 1 shows how the value of LVX is obtained
LVX = 10 × cos[(−12α + I)] (1)
The vertical component LVY is determined by the Equation 2.
LVY = 10 × sen[(−12 + I)] (2)
Equation 3 shows the calculation of the β Factor.
β =
Positivity
Negativity
(3)
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 6 / 28
7. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
LV Icons
FIGURE – Description of LV Icons
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 7 / 28
8. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Related work
Work based on gamification
Steffens et al 1 : proposes a framework applied to the context of software
engineering to verify the issues and how to apply game elements to overcome this
ones
Stanculescu et al 2 : brings an experiment performed in a multinational company
to verify how gamification could influence the performance of the employees
1. Steffens, Flvio, et al. ”Using Gamification as a Collaboration Motivatorfor Software Development Teams : A
Preliminary Framework.” (2015).
2. tanculescu, Laurentiu Catalin, et al. ”Work and play : An experimentin enterprise gamification.” Proceedings of
the 19th ACM Conferenceon Computer-Supported Cooperative Work Social Computing. ACM,2016
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 8 / 28
9. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Related work
Work based on systems for corporate evaluation
Ng et al 3 : the authors explain how they developed a Key Performance Indicators
(KPI) system for Maintenance, Repair and Operation (MRO)
Falcinelli et al 4 : evaluates the devices for e-learning aimed at compulsory
training
3. Ng, K. K. H., M. H. M. Tang, and C. K. M. Lee. ”Design and developmentof a performance evaluation system for
the aircraft maintenance industry.”Industrial Engineering and Engineering Management (IEEM), 2015
IEEEInternational Conference on. IEEE, 2015.
4. Falcinelli, Floriana, et al. ”Evaluation of an e-learning device for workerscompulsory training : an example of
collaboration between university andcompany.” Research on Education and Media 8.2 (2016) : 26-32.
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 9 / 28
10. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Related work
Work based on the LV Model
Sales et al 5 : addresses possible impacts that changes in the management of
learning could lead to the distance education
Gonçalves et al 6 : presents an application of the Instruction by Peers associated
with the LV Model, to the Forum "Questions and Answers"
5. Sales, G. L. Learning Vectors (LV) : um modelo de avaliao da aprendiza-gem em EaD online aplicando mtricas
no-lineares. Diss. Tese Doutorado.Departamento de Engenharia de Teleinformtica. Universidade Federal doCear.
2010. 239f, 2010.
6. Gonçalves, Alexandra Joca, Joana Laysa Lima Cunha, and Gilvandenys Leite Sales. "Concepção do Fórum PR
LV : avaliação formativa da aprendizagem." RENOTE 14.1.
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 10 / 28
11. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Related work - comparison
TABLE – Summary of related work and contribution
Reference Gamification Valuation LV Model
Steffens et al
√
Stanculescu et al
√ √
Ng et al
√
Falcinelli et al
√
Sales et al
√
Gonçaalves et al
√
Our proposal
√ √ √
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 11 / 28
12. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
PIPA : design and development
PIPA
Process Planning and Institutional Evaluation (PIPA), is a gamified system that uses
the Learning Vector Model for corporate performance evaluation and follow-up of tasks.
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 12 / 28
13. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Technical aspects
FIGURE – PHP
http ://www.php.net/
FIGURE – RGraph
https ://www.rgraph.net/
FIGURE – MySQL
https ://www.mysql.com/
FIGURE – HTML,
CSS and
Javascript
FIGURE – Bootstrap
https ://getboots-
trap.com/
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 13 / 28
14. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
System appearance
System appearance
FIGURE – Login page
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 14 / 28
15. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
System appearance
System appearance
FIGURE – User’s first page
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 15 / 28
16. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
System appearance
System appearance
FIGURE – Page of general projects
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 16 / 28
17. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
System appearance
System appearance
FIGURE – Page of projects of the user
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 17 / 28
18. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Learning Vectors applied to PIPA
Learning Vectors applied to PIPA
The scores will be given by the same equations of the LV Model
The values for LVX are used for the point system
P = P + (10 × cos[(−12α + I))] (4)
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 18 / 28
19. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Learning Vectors applied to PIPA
Learning Vectors applied to PIPA
Scores are obtained by calculating LVX
Total points are the sum of all scores obtained
The ranking depends on the scores of the week
The β Factor is indicative of whether or not to level up
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 19 / 28
20. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Preliminary results
We choose a microenterprise with 7 employees
a receptionist
an accountant
two proprietary partners
three representatives working externally
The enterprise is located in Fortaleza, Brazil
The test period was a little more than a month in the first quarter of 2017
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 20 / 28
21. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Methodology
Methodology
We scheduled a day for installation of the program and explanation of how to use it
Another meeting was scheduled for the evaluation of the software
Two forms were applied :
Questionnaire of the evaluators
Self-assessment questionnaire
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 21 / 28
22. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Results
Results
Questionnaire of the evaluators
1. Did the
employees
obtain
improvement in
income through
PIPA?
2. The level of
difficulty of
evaluating
employees by
PIPA was :
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 22 / 28
23. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Results
Results
Questionnaire of the evaluators
3. Did the
monitoring of the
activity of the
employees by
PIPA helped the
company?
4. Did you use to
evaluate
employees
beforehand by
any other
method?
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 23 / 28
24. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Results
Results
Self-assessment questionnaire
1. In a general
way, how do you
evaluate your
experience with
PIPA software?
2. In your
opinion, do your
performance
improved with
PIPA?
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 24 / 28
25. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Results
Results
Self-assessment questionnaire
3. Do you think
your interaction
with others
improved using
PIPA?
4. Was the
evaluation by
PIPA a positive,
negative or
neutral factor?
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 25 / 28
26. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
Conclusion
A formative assessment can help with the follow-up of tasks
It is presumed that our system can improve the performance of the employees
The LV Model and gamification can be used together to help follow-up of tasks
and evaluation
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 26 / 28
27. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
References
Carrion, Wellington. "Design para web designers : princípios do design para web." Rio
de Janeiro (2008).
Bourque, Pierre, and Richard E. Fairley. Guide to the software engineering body of
knowledge (SWEBOK (R)) : Version 3.0. IEEE Computer Society Press, 2014.
Gonçalves, Alexandra Joca, Joana Laysa Lima Cunha, and Gilvandenys Leite Sales.
"Concepção do Fórum PR LV : avaliação formativa da aprendizagem." RENOTE 14.1.
Falcinelli, Floriana, et al. "Evaluation of an e-learning device for workers’ compulsory
training : an example of collaboration between university and company." Research on
Education and Media 8.2 (2016) : 26-32.
Ng, K. K. H., M. H. M. Tang, and C. K. M. Lee. "Design and development of a
performance evaluation system for the aircraft maintenance industry." Industrial
Engineering and Engineering Management (IEEM), 2015 IEEE International
Conference on. IEEE, 2015.
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 27 / 28
28. Introduction Learning Vectors Model (LV) Related work PIPA : design and development Preliminary results Conclusion References
References
Ruzzarin, Ricardo, Augusto Prates do Amaral, and Marcelo Simiono. Sistema
integrado de gestão de pessoas com base em competências. Editora AGE Ltda, 2006.
Sales, G. L. Learning Vectors (LV) : um modelo de avaliação da aprendizagem em EaD
online aplicando métricas não-lineares. Diss. Tese Doutorado. Departamento de
Engenharia de Teleinformática. Universidade Federal do Ceará. 2010. 239f, 2010.
Sales, Gilvandenys Leite, Eliana Alves Moreira Leite, and Cassandra Ribeiro Joye.
"Gerenciamento da Aprendizagem, Evasão em Ead Online e Possiveis Soluções : Um
Estudo de Caso no IFCE." RENOTE 10.3 (2012).
Stanculescu, Laurentiu Catalin, et al. "Work and play : An experiment in enterprise
gamification." Proceedings of the 19th ACM Conference on Computer-Supported
Cooperative Work & Social Computing. ACM, 2016.
Steffens, Flávio, et al. "Using Gamification as a Collaboration Motivator for Software
Development Teams : A Preliminary Framework." (2015).
Tanaka, Samara, et al. "Gamification, Inc. : como reinventar empresas a partir de
jogos." (2013).
Michelle G. Cacais, Gilvandenys L. Sales IFCE A Collaborative System for Corporate Performance Evaluation using Gamification and the Learning Vectors MoDecember 7 2017 28 / 28