This document D2.3.1 is the first report out of three deliverables (D2.3.2, D2.3.3) of Task 2.4 - Evaluation of challenge submissions. Task 2.4 is about the actual assessment of the participating projects within the LinkedUp Veni, Vidi and Vici competition on the basis of the LinkedUp Evaluation Framework (D2.2.1).
We especially report about the outcomes of the various competitions and analyse the practical experiences of the experts with the LinkedUp Evaluation Framework.
In the current document D2.3.1 we report about the Linked Data tools and ideas that have been submitted to the first data competition - Veni. In total, we received 23 submissions, 8 of them have been shortlisted and invite to a poster presentation at the Open Knowledge Conference (OKCon), 3 of them have been awarded at OKCon according to the Linkedup evaluation process, and one submission received an audience award.
This deliverable provides an overview of the Veni submissions, explains the evaluation procedure that result in a short list of the best submissions, justifies the decision for the winners, and also reports the experiences with the evaluation framework that has been created in the previous WP2 deliverables [7][8]
http://portal.ou.nl/documents/363049/b40fb118-6e65-4875-86e9-8def1266c552
http://creativecommons.org/licenses/by-nc-sa/3.0/
Drachsler, H., Stoyanov, S., Pieper, F., Guy, M. (2013). D2.3.1 Evaluation results of the LinkedUp Veni competition. LinkedUp project. Heerlen, The Netherlands.
EDLD808 Program Evaluation Final Project Final Paper - Online EducationPaul Gruhn
This the complete research for program evaluation project I performed on the CSC230 Database for Web Applications course, which I teach online, to Community College Students.
EDLD808 Program Evaluation Final Project Final Paper - Online EducationPaul Gruhn
This the complete research for program evaluation project I performed on the CSC230 Database for Web Applications course, which I teach online, to Community College Students.
The main purposes of the current deliverable D2.1 is to provide the foundations of an Evaluation Framework that can be applied to compare Open Web Data applications and rank them according to their achievements. D2.1 contains the information gained from Task 2.1 - Evaluation criteria and method review and Task 2.2 - Validation of the evaluation criteria and methods of WP2 (DoW. p. 8). According to those tasks, we conducted an expert survey with the Group Concept Mapping method to identify relevant indicators and criteria for the Evaluation Framework. In a second step, we conducted a focused literature review to extend the outcomes of the expert survey with latest indicators reported in the literature. We finally, present the initial concept of the Evaluation Framework and its criteria and indicators.
This deliverable provides the theoretical foundations for the Evaluation Framework that is further developed into a scoring sheet for the judges of LinkedUp challenge in deliverable D2.2.1. The Evaluation Framework will be further developed and amended according to the experiences collected in the three LinkedUp data competitions during the LinkedUp challenge
http://portal.ou.nl/documents/363049/ae41bc18-130b-45d2-94a6-e4b4e42726fe
http://creativecommons.org/licenses/by-nc-sa/3.0/
Drachsler, H., Greller, W., Stoyanov, S., Fetahu, B., Daga, E., Parodi, E., Mosca, M., Adamou, A., Herder, E. (2013). D2.1 Evaluation Criteria and Methods. LinkedUp project. Heerlen, The Netherlands.
The main purpose of the current deliverable D2.2.1 is to hold the current version of the Evaluation Framework and to operationalise it for the LinkedUp challenge judges into a concrete evaluation instrument. This deliverable is not intended as a very elaborated report rather than a summary of the current version of the Evaluation Framework based on the extensive studies in deliverable D2.1 – Evaluation Methods and Metrics. D2.2.1will be reconsidered in the final report of WP2 to demonstrate the development of the Evaluation Framework during the life cycle of the LinkedUp project. For this purpose it is supportive to have the first version of the Evaluation Framework as a tangible outcome and an own entity as conducted in this deliverable.
http://portal.ou.nl/documents/363049/27b00ab7-2c2e-4fda-90a1-6db41e6493ac
http://creativecommons.org/licenses/by-nc-sa/3.0/
Drachsler, H., Greller, W., Stoyanov, S. (2013). D2.2.1 Evaluation Frameowork. LinkedUp project. Heerlen, The Netherlands.
The main purposes of the current deliverable D2.1 is to provide the foundations of an Evaluation Framework that can be applied to compare Open Web Data applications and rank them according to their achievements. D2.1 contains the information gained from Task 2.1 - Evaluation criteria and method review and Task 2.2 - Validation of the evaluation criteria and methods of WP2 (DoW. p. 8). According to those tasks, we conducted an expert survey with the Group Concept Mapping method to identify relevant indicators and criteria for the Evaluation Framework. In a second step, we conducted a focused literature review to extend the outcomes of the expert survey with latest indicators reported in the literature. We finally, present the initial concept of the Evaluation Framework and its criteria and indicators.
This deliverable provides the theoretical foundations for the Evaluation Framework that is further developed into a scoring sheet for the judges of LinkedUp challenge in deliverable D2.2.1. The Evaluation Framework will be further developed and amended according to the experiences collected in the three LinkedUp data competitions during the LinkedUp challenge
http://portal.ou.nl/documents/363049/ae41bc18-130b-45d2-94a6-e4b4e42726fe
http://creativecommons.org/licenses/by-nc-sa/3.0/
Drachsler, H., Greller, W., Stoyanov, S., Fetahu, B., Daga, E., Parodi, E., Mosca, M., Adamou, A., Herder, E. (2013). D2.1 Evaluation Criteria and Methods. LinkedUp project. Heerlen, The Netherlands.
The main purpose of the current deliverable D2.2.1 is to hold the current version of the Evaluation Framework and to operationalise it for the LinkedUp challenge judges into a concrete evaluation instrument. This deliverable is not intended as a very elaborated report rather than a summary of the current version of the Evaluation Framework based on the extensive studies in deliverable D2.1 – Evaluation Methods and Metrics. D2.2.1will be reconsidered in the final report of WP2 to demonstrate the development of the Evaluation Framework during the life cycle of the LinkedUp project. For this purpose it is supportive to have the first version of the Evaluation Framework as a tangible outcome and an own entity as conducted in this deliverable.
http://portal.ou.nl/documents/363049/27b00ab7-2c2e-4fda-90a1-6db41e6493ac
http://creativecommons.org/licenses/by-nc-sa/3.0/
Drachsler, H., Greller, W., Stoyanov, S. (2013). D2.2.1 Evaluation Frameowork. LinkedUp project. Heerlen, The Netherlands.
LinkedTV Deliverable 2.7 - Final Linked Media Layer and EvaluationLinkedTV
This deliverable presents the evaluation of content annotation and content enrichment systems that are part of the final tool set developed within the LinkedTV consortium. The evaluations were performed on both the Linked News and Linked Culture trial content, as well as on other content annotated for this purpose. The evaluation spans three languages: German (Linked News), Dutch (Linked
Culture) and English. Selected algorithms and tools were also subject to benchmarking in two international contests: MediaEval 2014 and TAC’14. Additionally, the Microposts 2015 NEEL Challenge is being organized with the support of LinkedTV.
LinkedTV Deliverable 3.8 - Design guideline document for concept-based presen...LinkedTV
This document presents guidelines on how to setup enriched video experiences.
We provide user-centric guidelines on the named entities that should be detected and selected to effectively enrich video news broadcasts. This is presented in the form of a user study.
We selected 5 news videos and manually extracted the
candidate entities from various sources, such as the transcript, visual content and related articles. An expert was asked to also provide interesting entities for the videos. The resulting 99 candidate entities were presented to 50 participants via an online survey. The participants rated the level of interestingness of the entities and the usefulness of
information from Wikipedia about these entities. Analysis of
the results shows that users prefer entities of the type
organization and person and have little interest for entities of the type location. They also indicate that subtitles are not
enough as a source of interesting entities and that the amount of interesting entities can be improved by the combined use of subtitles with entities extracted from related articles or entities suggested by an expert. The expert suggestions showed to be more accurate than any other source of entities. Wikipedia seems to be a suitable source of additional information about the entities in the news, but should be complemented with additional sources.
We provide engineering guidelines on how to present,
aggregate and process content for TV program companion
applications. We describe the content processing pipeline that was developed in WP3 to feed the content for the LinkedNews and Linked Culture demonstrators. This shows how content from the Web can be re-purposed to enrich videos by extracting the core display content and presenting it in a uniform way to the user.
LoCloud - D4.3: Regional Training Workshopslocloud
Three workshops were held in Bordeaux, Poznań and Graz during the autumn of 2014. The topics covered during the workshops included: the MORE repository, the MINT ingestion tool, the LoCloud Collections (formerly Lightweight Digital Library service), the Historical Place Names service, the Vocabulary service, the Geolocation Enrichment Tools and the Enrichment Service. Finally, an introduction to the LoCloud support mechanism was provided covering the support portal, the help-desk and the questions-and-answers sub-systems.
This report provides overview of the agenda of training workshops, and summarizes their outcomes including some general recommendations for the project regarding the challenges seen as the most important by workshops participants.
A Usability Evaluation carried out on my second year Brunel Group project.
A.R.C. (Augmented Reality Communicator), is an augmented reality social networking application , designed and built for my second year group project at Brunel University.
ARIADNE: Final innovation agenda and action planariadnenetwork
D2.4 - The introduction to the Final Innovation Agenda and Action Plan briefly addresses the goals of ARIADNE, the objectives of the agenda and action plan, and the stakeholders and beneficiaries of the proposed activities. Also ARIADNE’s roles in the activities are addressed. These can be summarised as helping others to make a difference with regard to progress and innovation in archaeological research based on better access to and (re-)usability of research data. Furthermore, the focus areas in the 5-year innovation horizon and 10-year perspective are introduced.
Authors;
Guntram Geser (SRFG)
Franco Niccolucci (PIN)
Supporting Collaboration and Harnessing of OER Within the Policy Framework of...Saide OER Africa
Supporting Collaboration and Harnessing of OER Within the Policy Framework of KNUST: Report Prepared by OER Africa on Behalf of the Kwame Nkrumah University of Science and Technology (KNUST). As part of a broader process of stimulating collaboration amongst distance education providers taking place under the auspices of the African Council on Distance Education’s Technical Committee on Collaboration, OER Africa and the Kwame Nkrumah University of Science and Technology (KNUST) signed a Memorandum of Understanding that has established a framework for a joint programme of action. Accordingly, OER Africa is providing support to KNUST in review of its current policies to assess the extent to which they facilitate collaboration and alternative, open licences for its educational materials.
Health OER Inter-Institutional Project Formative Evaluation of Health OER Des...Saide OER Africa
The review was to be based on a study of relevant documents, interviews with academic staff involved in institutional policy making and OER production, interviews with students who had experienced OERs (in cases where this was possible). The evaluation approach was not intended to be judgemental, but rather to explore experiences (on progress, achievements and blockages) thus far. Respondents were to be invited to look back in a way that provided experiences as a basis for identifying issues relevant to further project development. Broad approval of the Evaluation Brief was received together with valuable guidance in respect of the conduct of the review, particularly in relation to institution-specific circumstances.
User behavior model & recommendation on basis of social networks Shah Alam Sabuj
At present social networks play an important role to express people's sentiment and interest in a particular field. Extracting a user's public social network data (what the user shares with friends and relatives and how the user reacts over others' thought) means extracting the user's behavior. Defining some determined hypothesis if we make machine understand human sentiment and interest, it is possible to recommend a user about his/her personal interest on basis of the user's sentiment analyzed by machine. Our main approach is to suggest a user regarding the user's specific interest that is anticipated by analyzing the user's public data. This can be extended to further business analysis to suggest products or services of different companies depending on the consumer's personal choice. This automation will also help to choose the correct candidate for any questionnaire. This system will also help anyone to know about himself or herself, how one's behavior may influence others. It is possible to identify different types of people such as- dependable people, leadership skilled, people of supportive mentality, people of negative mentality etc.
LinkedTV Deliverable 6.5 - Final evaluation of the LinkedTV ScenariosLinkedTV
The deliverable presents the results of evaluating the final
scenario demonstrators LinkedNews and LinkedCulture in the LinkedTV project. We tested specifically user satisfaction with the enriched TV experience we enabled for cultural heritage and news TV programs. We also supported the evaluation of other aspects of the LinkedTV technologies in the trials, specifically the personalization and content curation.
Software Project Management: Project PlanningMinhas Kamal
Software Project Management: ResearchColab- Project Planning (Document-4)
Presented in 4th year of Bachelor of Science in Software Engineering (BSSE) course at Institute of Information Technology, University of Dhaka (IIT, DU).
In this webinar, Prof Hendrik Drachsler will reflect on the process of applying learning analytics solutions within higher education settings, its implications, and the critical lessons learned in the Trusted Learning Research Program. The talk will focus on the experience of edutec.science research collective consisting of researchers from the Netherlands and Germany that contribute to the Trusted Learning Analytics (TLA) research program. The TLA program aims to provide actionable and supportive feedback to students and stands in the tradition of human-centered learning analytics concepts. Thus, the TLA program aims to contribute to unfolding the full potential of each learner. It, therefore, applies sensor technology to support psychomotor as well as web technology to support meta-cognitive and collaborative learning skills with high-informative feedback methods. Prof. Drachsler applies validated measurement instruments from the field of psychometric and investigates to what extent Learning Analytics interventions can reproduce the findings of these instruments. During this webinar, Prof Drachsler will discuss the lessons learned from implementing TLA systems. He will touch on TLA prerequisites like ethics, privacy, and data protection, as well as high informative feedback for psychomotor, collaborative, and meta-cognitive competencies and the ongoing research towards a repository, methods, tools and skills that facilitate the uptake of TLA in Germany and the Netherlands.
Smart Speaker as Studying Assistant by Joao ParganaHendrik Drachsler
The thesis by Joao Pargana followed two main goals, first, a smart speaker application was created to support learners in informal learning processes through a question/answer application. Second, the impact of the application was tested amongst various users by analyzing how adoption and
transition to newer learning procedures can occur.
Dieser Entwurf eines Verhaltenskodex richtet sich an Hochschulen, die mittels Learning Analytics die Qualität des Lernens und Lehrens verbessern wollen. Der Kodex kann als Vorlage zur Erstellung von organisationsspezifischen Verhaltenskodizes dienen. Er sollte an Hochschulen, die Learning Analytics einführen wollen, durch Konsultationen mit allen Interessengruppen überprüft und an die Ziele sowie die bestehende Praxis innerhalb der jeweiligen Hochschulen angepasst werden. Der Kodex wurde auf Grundlage einer Analyse bestehender europäischer Kodizes und der in Deutschland geltenden Rechtsgrundlage vom Innovationsforum Trusted Learning Analytics des hessenweiten Projektes "Digital gestütztes Lehren und Lernen in Hessen" entwickelt.
Abstract (English):
This code of conduct can be used as a template for creating organization-specific codes of conduct in Germany. The Code was developed on the basis of an analysis of existing European codes of conduct and the legal basis for the usage of data in higher education in Germany.
Rödling, S. (2019). Entwicklung einer Applikation zum assoziativen Medien Ler...Hendrik Drachsler
Ziel der vorliegenden Bachelorarbeit ist es, den Einfluss von zusätzlicher am Handgelenk wahr-genommener Vibration in Verbindung mit der visuellen Darstellung eines Lerninhaltes auf denLernerfolg zu messen. Der Lernerfolg wird hierbei durch die Lerngeschwindigkeit sowie denUmfang der Wissenskonsolidierung über die Testreihe definiert. Zu diesem Zweck wurde eine Experimentalstudie zumAssoziativen Lernendurchgeführt. Für die Studie verwendeten 33Probanden eine App, die für die vorliegende Arbeit entwickelt wurde. Im Mittel aller Studiener-gebnisse wurden sowohl für die Lerngeschwindigkeit als auch für die Wissenskonsolidierungbessere Werte erzielt, wenn die Probanden die Möglichkeit hatten, den Lerninhalt sowohl visu-ell als auch haptisch zu erfahren. Die festgestellten Unterschiede des Lernerfolges erreichtenjedoch keine statistische Signifikanz. Die Abweichungen der Ergebnisse nach der Umsetzungder vorgeschlagenen Änderungen am Studiendesign sind abzuwarten. Die Bachelorarbeit ist vor allem für den Bildungsbereich interessant.
The present bachelor thesis aims to measure the influence of vibration perceived at the wrist in connection with the visual representation of learning content on the learning success. The learning success is defined by the learning speed and the extent of knowledge consolidation over the test series. For this purpose, an experimental study on Associative Learning was conducted. For the study, 33 test persons used an app, which was developed for the present work. On average of all study results better values were achieved for both learning speed and knowledge consolidation, if the test persons could experience the learning content both visually and haptically. However, the differences in learning outcomes did not reach statistical significance. The results of the deviations after the implementation of the proposed changes to the study design must be awaited. The Bachelor’s thesis is particularly interesting for the education sector.
E.Leute: Learning the impact of Learning Analytics with an authentic datasetHendrik Drachsler
Nowadays, data sets of the interactions of users and their corresponding demographic data are becoming more and more valuable for companies and academic institutions like universities
when optimizing their key performance indicators. Whether it is to develop a model to predict the optimal learning path for a student or to sell customers additional products, data sets to
train these models are in high demand. Despite the importance and need for big data sets it still has not become apparent to every decision-maker how crucial data sets like these are for the
future success of their operations.
The objective of this thesis is to demonstrate the use of a data set, gathered from the virtual learning environment of a distance learning university, by answering a selection of questions in
Learning Analytics. Therefore, a real-world data set was analyzed and the selected questions were answered by using state-of-the-art machine learning algorithms.
Romano, G. (2019) Dancing Trainer: A System For Humans To Learn Dancing Using...Hendrik Drachsler
Masters thesis by Romano, G., (2019). Dancing is the ability to feel the music and express it in rhythmic movements with the body. But learning how to dance can be challenging because it requires proper coordination and understanding of rhythm and beat. Dancing courses, online courses or learning with free content are ways to learn dancing. However, solutions with human-computer interaction are rare or
missing. The Dancing Trainer (DT) is proposed as a generic solution to fill this gap. For the beginning, only Salsa is implemented, but more dancing styles can be added. The DT uses the Kinect to interact multimodally with the user. Moreover, this work shows that dancing steps can be defined as gestures with the Kinect v2 to build a dancing corpus. An experiment with
25 participants is conducted to determine the user experience, strengths and weaknesses of the DT. The outcome shows that the users liked the system and that basic dancing steps were
learned.
In May 2018, the new General Data Protection Regulation (GDPR) will enter into force in the European Union. This new regulation is considered as the most modern data protection law for Big Data societies of tomorrow. The GDPR will bring major changes to data ownership and the way data can be accessed, processed, stored, and analysed in the European Union. From May 2018 onwards, data subjects gain fundamental rights such as ‘the right to access data’ or ‘the right to be forgotten’. This will force Big Data system designers to follow a privacy-by-design approach for their infrastructures and fundamentally change the way data can be treated in the European Union.
The presentation provides an overview of the Trusted Learning Analytics Programme as it has been recently initiated at the University of Frankfurt and the DIPF research institute in Germany. Educational data is under special focus of the GDPR, as it is considered as highly sensitive like data from a nuclear plant. It shows opportunities and challenges for using educational data for learning analytics purposes under the light of the GDPR 2018.
Fighting level 3: From the LA framework to LA practice on the micro-levelHendrik Drachsler
This presentation explores shortcomings of learning analytics for the wide adoption in educational organisations. It is NOT about ethics and privacy rather than focuses on shortcomings of learning analytics for teachers and students in the classroom (micro-level). We investigated if and to what extend learning analytics dashboards are addressing educational concepts. Map opportunities and challenges for the use of Learning Analytics dashboards for the design of courses, and present an evaluation instrument for the effects of Learning Analytics called EFLA. EFLA can be used to measure the effects of LA tools at the teacher and student side. It is a robust but light (8 items) measurement to quickly investigate the level of adoption of learning analytics in a course (micro-level). The presentation concludes that Learning Analytics is still to much a computer science dicipline that does not fulfill the often claimed position of the middle space between educational and computer science research.
Presentation given at PELARS Policy event, Brussles, 09.11.2016. A follow up op the first LACE Policy event in April 2015. Special focus is on the exploitation and sustainability activities for LACE in the SIG LACE SoLAR.
Dutch Cooking with xAPI Recipes, The Good, the Bad, and the ConsistentHendrik Drachsler
This paper presents the experiences of several Dutch projects in their application of the xAPI standard and different design patterns including the deployment of Learning Record Stores. In this paper we share insights and argue for the formation of an international Special Interest Group on interoperability issues to contribute to the Open Analytics Framework as envisioned by SoLAR and enacted by the Apereo Learning Analytics Initiative. Therefore, we provide an overview of the advantages and disadvantages of implementing the current xAPI standard by presenting projects that applied xAPI in very different ways followed by the lessons learned.
Recommendations for Open Online Education: An Algorithmic StudyHendrik Drachsler
Recommending courses to students in online platforms is studied widely. Almost all studies target closed platforms, that belong to a University or some other educational provider. This makes the course recommenders situation specific. Over the last years, a demand has developed for recommender system that suit open online platforms. Those platforms have some common characteristics, such as the lack of rich user profiles with content metadata. Instead they log user interactions within the platform that can be used for analysis and personalization. In this paper, we investigate how user interactions and activities tracked within open online learning platforms can be used to provide recommendations. We present a study in which we investigate the application of several state-of-the-art recommender algorithms, including a graph-based recommender approach. We use data from the OpenU open online learning platform that is in use by the Open University of the Netherlands. The results show that user-based and memory-based methods perform better than model-based and factorization methods. Particularly, the graph-based recommender system proves to outperform the classical approaches on prediction accuracy of recommendations in terms of recall. We conclude that, if the algorithms are chosen wisely, recommenders can contribute to a better experience of learners in open online courses.
Soude Fazeli, Enayat Rajabi, Leonardo Lezcano, Hendrik Drachsler, Peter Sloep
Privacy and Analytics – it’s a DELICATE Issue. A Checklist for Trusted Learni...Hendrik Drachsler
The widespread adoption of Learning Analytics (LA) and Educational Data Mining (EDM) has somewhat stagnated recently, and in some prominent cases even been reversed following concerns by governments, stakeholders and civil rights groups about privacy and ethics applied to the handling of personal data. In this ongoing discussion, fears and realities are often indistin-guishably mixed up, leading to an atmosphere of uncertainty among potential beneficiaries of Learning Analytics, as well as hesitations among institutional managers who aim to innovate their institution’s learning support by implementing data and analytics with a view on improving student success. In this presentation, we try to get to the heart of the matter, by analysing the most common views and the propositions made by the LA community to solve them. We conclude the paper with an eight-point checklist named DELICATE that can be applied by researchers, policy makers and institutional managers to facilitate a trusted implementation of Learning Analytics.
DELICATE checklist - to establish trusted Learning AnalyticsHendrik Drachsler
The DELICATE checklist contains eight action points that should be considered by managers and decision makers planning the implementation of Learning Analytics / Educational Data Mining solutions either for their own institution or with an external provider.
The eight points are:
1. Determination: Decide on the purpose of learning analytics for your institution. What aspects of learning or learner services are you trying to improve?
2. Explain: Define the scope of data collection and usage. Who has a need to have access to the data or the results? Who manages the datasets? On what criteria?
3. Legitimate: Explain how you operate within the legal frameworks, refer to the essential legislation. Is the data collection excessive, random, or fit for purpose?
4. Involve: Talk to stakeholders and give assurances about the data distribution and use. Give as much control as possible to data subjects (permission architecture), and provide access to their data for the individuals.
5. Consent: Seek consent through clear consent questions. Provide an opt-out option.
6. Anonymise: De-identify individuals as much as possible, aggregate data into meta-models.
7. Technical aspects: Monitor who has access to data, especially in areas with high staff turn-over. Establish data storage to high security standards.
8. External partners: Make sure externals provide highest data security standards. Ensure data is only used for intended purposes and not passed on to third parties.
We hope that the DELICATE checklist will be a helpful instrument for any educational institution to demystify the ethics and privacy discussions around Learning Analytics. As we have tried to show in this article, there are ways to design and provide privacy conform Learning Analytics that can benefit all stakeholders and keep control with the users themselves and within the established trusted relationship between them and the institution.
Updated Flyer of the LACE project with latest tangible outcomes and collaboration possibilities.
LACE connects players in the fields of Learning Analytics (LA) and Educational Data Mining (EDM) in order to support the development of a European community and share emerging best practices.
Objectives
-------------
• Promote knowledge creation and exchange
• Increase the evidence base about Learning Analytics
• Contribute to the definition of future directions
• Build consensus on pressing topics like data interoperability, data sharing, ethics and privacy, and Learning Analytics supported instructional design
Activities
• Organise events to connect organisations that are conducting LA/EDM research
• Create and curate a knowledge base to capture evidence for the effectiveness of Learning Analytics
• Produce reviews to inform the LACE community about latest developments in the field
Presentation given at Serious Request 2015, #SR15, Heerlen.
Within the Open University we started a 12 hours marathon college, to collect money for the charity action of radiostation 3FM. The collected money will go to the red cross and support young people in conflict areas.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
2. Page 2 of 58
LinkedUp Support Action – 317620
LinkedUp Consortium
This document is part of the LinkedUp Support Action funded by the ICT Programme of the Commission of
the European Communities by the grant number 317620. The following partners are involved in the project:
Leibniz Universität Hannover (LUH)
Forschungszentrum L3S
Appelstrasse 9a
30169 Hannover
Germany
Contact person: Stefan Dietze
E-mail address: dietze@L3S.de
The Open University
Walton Hall, MK7 6AA
Milton Keynes
United Kingdom
Contact person: Mathieu d'Aquin
E-mail address: m.daquin@open.ac.uk
Open Knowledge Foundation Limited LBG
Cowley Road St John,
Innovation Centre
CB4 0WS, Cambridge
United Kingdom
Contact person: Sander van der Waal
E-mail address: sander.vanderwaal@okfn.org
ELSEVIER BV
Radarweg 29,
1043NX AMSTERDAM
The Netherlands
Contact person: Michael Lauruhn
E-mail address: M.Lauruhn@elsevier.com
Open Universiteit Nederland
Valkenburgerweg 177,
6419 AT Heerlen
The Netherlands
Contact person: Hendrik Drachsler
E-mail address: Hendrik.Drachsler@ou.nl
Lattanzio Learning S.p.A.
Via Domenico Cimarosa, 4
20144 Milano
Italy
Contact person: Elisabetta Parodi
E-mail address: parodi@lattanziogroup.eu
Work package participants
The following partners have taken an active part in the work leading to the elaboration of this document, even
if they might not have directly contributed to the writing of this document or its parts:
• OUNL, Hendrik Drachsler, Slavi Stoyanov
• LUH, Fritz Pieper, Eelco Herder, Stefan Dietze
• OUUK, Mathieu d'Aquin
• OKF, Marieke Guy
Executive Summary
This document D2.3.1 is the first report out of three deliverables (D2.3.2, D2.3.3) of Task 2.4 - Evaluation of
challenge submissions. Task 2.4 is about the actual assessment of the participating projects within the
LinkedUp Veni, Vidi and Vici competition on the basis of the LinkedUp Evaluation Framework (D2.2.1).
We especially report about the outcomes of the various competitions and analyse the practical experiences of
the experts with the LinkedUp Evaluation Framework.
In the current document D2.3.1 we report about the Linked Data tools and ideas that have been submitted to
the first data competition - Veni. In total, we received 23 submissions, 8 of them have been shortlisted and
invite to a poster presentation at the Open Knowledge Conference (OKCon), 3 of them have been awarded at
OKCon according to the Linkedup evaluation process, and one submission received an audience award.
This deliverable provides an overview of the Veni submissions, explains the evaluation procedure that result
in a short list of the best submissions, justifies the decision for the winners, and also reports the experiences
with the evaluation framework that has been created in the previous WP2 deliverables [7][8].
4. Page 4 of 58
LinkedUp Support Action – 317620
5. Course Finder ............................................................................................................................................. 30
6. DataConf: Enriching conference publications with a mobile mashup application .................................... 30
7. Enrichment of Young Digital Planet's biology lessons .............................................................................. 31
8. DrHoo ......................................................................................................................................................... 31
9. FavSync - Collect bookmarks together ...................................................................................................... 31
10. Globe-Town: open data for sustainable development education ............................................................. 31
11. Knownodes - A collaborative project to explore, create and define links between online resources and
ideas ................................................................................................................................................................ 32
12. Learner Journey Navigation System ........................................................................................................ 32
13. MELOD: Mobile Environment for learning with Linked Open Data ...................................................... 33
14. LinkedIn MOOCs counselor .................................................................................................................... 33
15. MOOCrank: recommendation of MOOCs based on learning outcomes ................................................. 33
16. Neuro-Cloud Free Textbook Project ........................................................................................................ 33
17. One Million Museum Moments ............................................................................................................... 34
18. REthink, REassure, RElook, REsee, REmember, REdiscover. This is simple. This is ReCredible ........ 34
19. Social VLE With Rich Structure Learning Data Using Semantic CMS .................................................. 34
20. Suggest me content for further reading and learning ............................................................................... 35
21. We-Share: a social annotation application that publishes and retrieves information about educational
ICT tools from the Web of Data ..................................................................................................................... 35
22. Wikipedia data linker ............................................................................................................................... 35
23. yourHistory: Personalising Historic Events ............................................................................................. 36
Appendix
B
–
Veni
Evaluation
Form
......................................................................
37
Appendix
C
–
Interview
text
..................................................................................
43
1. Interview with Leonardo Lezcano (computer scientist / Spain): ............................................................... 43
2. Interview with Peter Kraker (computer scientist / Austria): ...................................................................... 46
3. Interview with Olga Santos (TEL expert / Spain): ..................................................................................... 49
4. Interview with Marco Kalz (educational scientist / Germany): ................................................................. 53
5. Interview with Krassen Stefanov (computer scientist / Bulgaria): ............................................................ 57
6. Page 6 of 58
LinkedUp Support Action – 317620
Table 1: Overview of all submissions of the Veni competition.
ID
Authors
Title
Abstract
1
Madi Solomon,
Marlowe Johnson
and Ira Kleinberg
Open Linked Education
Data
The Open LInked Education Data database is a curated
"Subject" vocabulary offered as a community service to
the education sector.
2
Martijn Kleppe,
Max Kemman,
Henri Beunders,
Laura Hollink,
Damir Juric, Johan
Oomen and Jaap
Blom
PoliMedia - Improving
the Analyses of Radio &
Newspaper coverage of
Political Debates
PoliMedia aims to stimulate and facilitate large-scale,
cross-media analysis of the coverage of political events
focussing on the meetings of the Dutch parliament, and
providing automatically generated links between the
transcripts of those meetings, newspaper articles,
including their original lay-out on the page, and radio
bulletins.
3
Ricardo Alonso
Maturana, María
Ortega, María
Elena
Alvarado,Susana
López-Sola and
María José Ibáñez
Mismuseos.net: Art
After Technology.
Putting cultural data to
work in a Linked Data
platform
Mismuseos.net shows a case of consumption and use of
Linked Data from museums and their valorisation in
education, through innovative end-user applications, like
facet-based searches, semantic context creation and
navigation through graphs, which drastically improve
user experience.
5
Devon Walshe and
Lizzie Brotherston
Course Finder
The coursefinder app is a searchable map of UK
courses from Elementary level to University.
6
Florian Bacle,
Benoît Durant de
La Pastellière,
Fiona Le Peutrec
and Lionel Médini
DataConf: Enriching
conference publications
with a mobile mashup
application
DataConf is a mobile Web application that allows
browsing of conference publications, their authors,
authors organizations, and even authors other
publications or publications related to the same
keywords.
7
Jana Parvanova
and Ilian Uzunov
Enrichment of Young
Digital Planet's biology
lessons
The demo uses allows exploration of biology lessons
owned by Young Digital Planet and is a multimedia
application with additional links and images.
8
Lazaros Ioannidis,
Panagiotis
Bamidis,
Charalampos
Bratsas and Eleni
Dafli
Dr Hoo
The Dr Hoo game begins with a central concept, say a
drug, that needs to be 'guessed' by the player. They
guess the answer using hints which might be concepts
(like a disease targeted by the drug) or a simple property
of the original concept (like a brand name).
9
Vladi Trop,
Raphael Glassberg
and Peter
Kollarovits
FavSync - Collect
bookmarks together
FavSync allows users to easily share and sync groups of
bookmarks with other users.
10
Jack Townsend
Globe-Town: open data
for sustainable
development education
11
Dor Garbash
Knownodes - A
collaborative project to
explore, create and
Globe-Town.org opens up the successes and the
challenges of sustainable development around the world
and what they mean for you, through a fun and
informative web application built from open data.
Knownodes is a collaborative website that enables
anyone to relate, define and explore connections
between web-resources and ideas.
8. Page 8 of 58
LinkedUp Support Action – 317620
2.1. The Scoring Sheet for the Veni competition
One main outcomes of the LinkedUp project is the development of a comprehensive Evaluation Framework
(EF) for data competitions. We therefore conducted in deliverable D2.1– Evaluation Criteria and Metrics [7] a
Group Concept Mapping study with experts to work out specific evaluation criteria Open Web Data
competitions in the Educational Domain. The Evaluation Frameworks acts as a comprehensive collection of
possible evaluation criteria and their indicators that can be selected and customised for specific tasks in a data
competition. In D2.1 we identified five relevant evaluation criteria of the LinkedUp EF: 1. Educational
Innovation, 2. Usability, 3. Performance, 4. Data, 5. Legal and Privacy [7]. In a complementary literature
review on suitable evaluation metrics and methods, the preliminary version of the LinkedUp EF was further
adjusted and substantiated. The literature review provided more detailed evaluation indicators and also
summarised potential evaluation methods.
Afterwards, in deliverable D2.2.1 [8] we operationalise the Evaluation Framework into a concrete evaluation
instrument based on a Google form. The EF will be further developed and improved throughout the duration
of the project, especially after each round of a data competition in the LinkedUp Challenge. This report is one
of these evaluation milestones that will provide specific improvements to the LinkedUp EF.
In the Veni competition the LinkedUp judges rated the submitted tools with the concrete evaluation items in
the Google form as reported in D2.2.1. They received the following instructions for their evaluation:
DETAILED REVIEW PLAN:
Please follow the following steps during your reviews.
1. Scan the submissions assigned to you – see the list at the end of this email. In each paper, there is a link to
the demo site, either in the main text or in the references. Watch the demo or do a live test of the tools.
2. Start the review: Please go to the Google evaluation form (http://bit.ly/data_competition) and enter the ID,
TITLE of the submission from the Easychair system.
3. Please rate your assigned submission(s) according to the 6 criteria. In case you experience difficulties with
some indicators or want to make a short note, use the open text field of a criterion.
4. When a review (Google evaluation form) has been submitted, please go to Easychair and ‘submit’ your
review there with a short quote “Review done”.
Afterwards the reviews provided their reviews according to the 6 evaluation criteria and various sub-scales on
a 0-5 scale. For details about the evaluation from please look at Appendix B.
2.2. Evaluation results
After all reviews were collected, we started a thorough analysis of the evaluation results. First of all we
visualized the evaluation results for each criteria in a single bar chart to get a rough overview of the
assessment results of the LinkedUp judges.
10. Page 10 of 58
LinkedUp Support Action – 317620
Figure 2: Line chart presentation of the ratings of the submissions over all evaluation criteria.
2.2.1. A shortlist of 10 submissions
Next to the line chart overview in Figure 2, we calculated the average score of each submission with regard to
(a) all evaluation criteria and (b) all evaluation criteria without the usability score (SUS). The SUS score has a
higher score (between 25 -100) than the other evaluation criteria. In order to make sure that the average score
for the submissions is not affected by the high SUS value we calculated this additional value for the
submissions.
We used figure 1 and 2 to identify the ten best submissions for further analysis and identify candidates for the
award ceremony at the OKCon Conference. Figure 4 shows both average scores next to each other. Although
we calculated the average scores with and without the SUS score, both figures lead to the same results. A
zoom view into the top 10 submissions (see Figure 3), showed that submission 11 and 14 are behind their
competitors. Note the list of submissions below is not sorted according to the average score.
•
•
•
•
•
•
•
Submission ID 21 - We-Share
Submission ID 2 - PoliMedia
Submission ID 23 - yourHistory
Submission ID 10 - Globe-Town
Submission ID 6 - DataConf
Submission ID 3 - Mismuseos.net
Submission ID 12 - Learner Journey Navigation System