We present a prototype recommendation system for mobile applications that exploits a rather general description of the user’s context. One of the main features of the proposed so- lution is the proactive and completely automated procedure of querying the apps marketplace, able to retrieve a set of apps and to rank them on the basis of the current situation of the user. We also present a first experimental evaluation that confirms the effectiveness of the general design and im- plementation choices and sheds some light on the peculiar features and critical issues of recommendation systems for mobile applications.
Programs Coming Together Using ExamSoft to assess interprofessional education...ExamSoft
Presented by: Carla D. Hernandez, Assessment Coordinator, and Anthony C. Marziliano, Associate Director of Assessment, and Marc E. Gillespie, Ph.D., Professor, Associate Dean for Graduate Education and Research, St. John's University College of Pharmacy & Health Sciences
Professional health science programs must now explicitly identify interprofessional education (IPE) activities that provide unique opportunities for student-to-student engagement. Offering IPE activities is essential to advance education in these fields. We actively identify IPE possibilities and a methodology to assess them using ExamSoft’s categorization system. Our faculty are content experts and are in the best position to categorize test-items with national exam blueprints, the essential hierarchical ontologies that drive programs. Blueprints contain goals, outcomes, knowledge domains, professional skills and attributes often required for proficiency in specific health care professions. Mapping between different program blueprints allows the College to identify parts of the curriculum that are shared between programs and are ideal targets for IPE efforts. We provide worked examples where we observed overlapping terms that serve as an impetus for faculty and administrators to capitalize, creating IPE opportunities. By the very nature of this activity, overlapping terms are associated with test items that can be used to establish a pre-IPE activity baseline, as well as, assess the IPE activity itself. Synergistic assessment of shared goals and outcomes (using ExamSoft categories) helps us prepare our students to be outstanding health care professionals in the 21st century.
There's more to learning evaluation than surveys and smile sheets. In this recent webinar, Andrew Downes laid down practical, straightforward advice on how to take your learning evaluation further and measure whether your learning programs are having the impact they were designed to achieve.
Here's the slides!
Performance Management to Program Evaluation: Creating a Complementary Connec...nicholes21
The document summarizes a presentation on performance management and program evaluation given at the 2013 American Evaluation Association Conference. It begins with an agenda and overview of key concepts. It then discusses distinguishing performance management from program evaluation and how they complement each other. The remainder of the document uses a case study of a nonprofit called New Roads for New Visions (NRNV) to illustrate how to conduct a needs assessment, create a logic model, build a performance management system, and design a program evaluation plan to link performance management to evaluation.
Improving collaborative filtering using lexicon-based sentiment analysisIJECEIAES
Since data is available increasingly on the Internet, efforts are needed to develop and improve recommender systems to produce a list of possible favorite items. In this paper, we expand our work to enhance the accuracy of Arabic collaborative filtering by applying sentiment analysis to user reviews, we also addressed major problems of the current work by applying effective techniques to handle the scalability and sparsity problems. The proposed approach consists of two phases: the sentiment analysis and the recommendation phase. The sentiment analysis phase estimates sentiment scores using a special lexicon for the Arabic dataset. The item-based and singular value decomposition-based collaborative filtering are used in the second phase. Overall, our proposed approach improves the experiments’ results by reducing average of mean absolute and root mean squared errors using a large Arabic dataset consisting of 63,000 book reviews.
This document summarizes a presentation on open virtual mobility (OVM) and self-regulated learning (SRL). It outlines the objectives of the OpenVM Erasmus+ project to enhance uptake of OVM through skills development. A quality assurance framework is designed based on international standards and incorporates design-based research cycles. The project aims to develop OVM tools aligned with the SRL cycle of forethought, performance, and self-reflection. An internal review found some tools were well-aligned as planned while others required improvement to better support SRL. Overall, the presentation emphasizes that learning design is important to fully foster SRL through open virtual mobility.
The document discusses Mohammed Taha Ahmed Al daghan's four week internship at ASPEXX Health Solutions Pvt Ltd. It covered topics in artificial intelligence, machine learning, data science, and mobile app building. Projects included a personalized product recommendation tool using collaborative filtering, age prediction using OpenCV, and building mobile apps with Flutter and Ionic frameworks. The internship provided hands-on experience with real-world datasets and guidance from mentors.
Information Retrieval and User-centric Recommender System EvaluationAlan Said
Poster describing the ERCIM-funded project on IR- and user-centric recommender system evaluation currently being undertaken in the Information Access group at CWI.
Presented at UMAP 2013.
The first question of Getting to Outcomes is to assess the underlying needs and resources in the community. Conducting a thorough needs and resources assessment is important to understand where problems exist, which groups are most affected, prevalent risk factors, and existing community assets. The needs assessment process involves gathering both qualitative and quantitative data from various sources to define the problem and identify solutions. Combining multiple perspectives provides a comprehensive picture of the issues and resources in the community.
Programs Coming Together Using ExamSoft to assess interprofessional education...ExamSoft
Presented by: Carla D. Hernandez, Assessment Coordinator, and Anthony C. Marziliano, Associate Director of Assessment, and Marc E. Gillespie, Ph.D., Professor, Associate Dean for Graduate Education and Research, St. John's University College of Pharmacy & Health Sciences
Professional health science programs must now explicitly identify interprofessional education (IPE) activities that provide unique opportunities for student-to-student engagement. Offering IPE activities is essential to advance education in these fields. We actively identify IPE possibilities and a methodology to assess them using ExamSoft’s categorization system. Our faculty are content experts and are in the best position to categorize test-items with national exam blueprints, the essential hierarchical ontologies that drive programs. Blueprints contain goals, outcomes, knowledge domains, professional skills and attributes often required for proficiency in specific health care professions. Mapping between different program blueprints allows the College to identify parts of the curriculum that are shared between programs and are ideal targets for IPE efforts. We provide worked examples where we observed overlapping terms that serve as an impetus for faculty and administrators to capitalize, creating IPE opportunities. By the very nature of this activity, overlapping terms are associated with test items that can be used to establish a pre-IPE activity baseline, as well as, assess the IPE activity itself. Synergistic assessment of shared goals and outcomes (using ExamSoft categories) helps us prepare our students to be outstanding health care professionals in the 21st century.
There's more to learning evaluation than surveys and smile sheets. In this recent webinar, Andrew Downes laid down practical, straightforward advice on how to take your learning evaluation further and measure whether your learning programs are having the impact they were designed to achieve.
Here's the slides!
Performance Management to Program Evaluation: Creating a Complementary Connec...nicholes21
The document summarizes a presentation on performance management and program evaluation given at the 2013 American Evaluation Association Conference. It begins with an agenda and overview of key concepts. It then discusses distinguishing performance management from program evaluation and how they complement each other. The remainder of the document uses a case study of a nonprofit called New Roads for New Visions (NRNV) to illustrate how to conduct a needs assessment, create a logic model, build a performance management system, and design a program evaluation plan to link performance management to evaluation.
Improving collaborative filtering using lexicon-based sentiment analysisIJECEIAES
Since data is available increasingly on the Internet, efforts are needed to develop and improve recommender systems to produce a list of possible favorite items. In this paper, we expand our work to enhance the accuracy of Arabic collaborative filtering by applying sentiment analysis to user reviews, we also addressed major problems of the current work by applying effective techniques to handle the scalability and sparsity problems. The proposed approach consists of two phases: the sentiment analysis and the recommendation phase. The sentiment analysis phase estimates sentiment scores using a special lexicon for the Arabic dataset. The item-based and singular value decomposition-based collaborative filtering are used in the second phase. Overall, our proposed approach improves the experiments’ results by reducing average of mean absolute and root mean squared errors using a large Arabic dataset consisting of 63,000 book reviews.
This document summarizes a presentation on open virtual mobility (OVM) and self-regulated learning (SRL). It outlines the objectives of the OpenVM Erasmus+ project to enhance uptake of OVM through skills development. A quality assurance framework is designed based on international standards and incorporates design-based research cycles. The project aims to develop OVM tools aligned with the SRL cycle of forethought, performance, and self-reflection. An internal review found some tools were well-aligned as planned while others required improvement to better support SRL. Overall, the presentation emphasizes that learning design is important to fully foster SRL through open virtual mobility.
The document discusses Mohammed Taha Ahmed Al daghan's four week internship at ASPEXX Health Solutions Pvt Ltd. It covered topics in artificial intelligence, machine learning, data science, and mobile app building. Projects included a personalized product recommendation tool using collaborative filtering, age prediction using OpenCV, and building mobile apps with Flutter and Ionic frameworks. The internship provided hands-on experience with real-world datasets and guidance from mentors.
Information Retrieval and User-centric Recommender System EvaluationAlan Said
Poster describing the ERCIM-funded project on IR- and user-centric recommender system evaluation currently being undertaken in the Information Access group at CWI.
Presented at UMAP 2013.
The first question of Getting to Outcomes is to assess the underlying needs and resources in the community. Conducting a thorough needs and resources assessment is important to understand where problems exist, which groups are most affected, prevalent risk factors, and existing community assets. The needs assessment process involves gathering both qualitative and quantitative data from various sources to define the problem and identify solutions. Combining multiple perspectives provides a comprehensive picture of the issues and resources in the community.
SYST15892 Interactive User Interface Design Phase IV Usa.pdfacsmadurai
SYST15892 - Interactive User Interface Design
Phase IV Usability Testing
Grade weight: 15%
Requirements
Based on your initial Storyboard / Wireframes develop an interactive
prototype with invisionapp to carry out a series of tasks to be tested with
live users. The tasks should include TWO common tasks and at least ONE
advanced task. Registering / logging in to the website / service are
considered common tasks.
You will need to conduct the usability testing on a minimum of FIVE
individuals and use the "Think Aloud" method to capture their thoughts,
actions and interaction with the prototype. During the test one group
member should be a note taker to record what the user is doing and saying
during the testing.
Note: DO NOT explain, prompt or help the user during the testing. This will
taint your results and not give you real feedback on the interface /
interaction.
Prepare a small survey with a 5-point Likert scale and open-ended
questions. Compile all the results into a report as part of your submission.
SYST15892 - Interactive User Interface Design
Phase IV Usability Testing
Deliverables (Each section will have the same grade)
1. PROTOTYPE: invisionapp prototype based on your wireframes.
2. PREPARATION:
a. A copy of your "script" including introduction to make the user
feel at home (biscuits...).
b. The goal or goals that you tell the user, and the tasks that you
expect the user to accomplish but keep secret.
3. RESULTS:
a. The results of the testing including Likert Scale results,
observations about user actions and expectations, verbal
feedback from the user, and answers to open-ended questions.
4. CONCLUSION:
a. Areas of the wireframes that need improvement or changes.
b. Feedback on the interface from the users (Positive and
Negative).
c. A statement on what the group thought went well and tasks/
actions from the user feedback that surprised the group, tasks
that took longer than expected, errors or confusion from the
user.
d. What you learned about your application and steps to improve.
e. What you learned about Usability Testing.
Submission
Submit the followings to the Dropbox on SLATE in the Final Project
Part 4 folder (e-mail submissions will NOT be accepted):
The zip file of the prototype downloaded from invisionapp.
A document containing deliverables 2 to 4 (see above).
Only one submission per group.
Please refer to the Late Submission Policy.
Only the last submission is accepted and marked, all other
submissions are ignored.
Any attempt at cheating on the assignment will result in a grade of zero
Introduction: The name of our application would be Bright Future. It is about guiding people to take
steps to achieve the dream job they want in the future. It would guide us from the basic level to the
higher levels. The aim of our app is to provide information to people about the eligibilities and
requirements of a specific job. Requirements: Concept: The concept of our program is to help
people know their career paths. The app prompts t.
This document summarizes the design and evaluation of two demonstrators for personalized online advertisements. The first demonstrator focuses on offline adaptation of ads based on movie context, user profile, social media posts, and preferences. An evaluation with 200 participants found that transparency and user control improved perceived quality, intention, understanding, and attitude toward ads. The second demonstrator aims to perform online adaptation by recognizing objects in videos and retrieving personalized ads to be integrated in real-time. It outlines the required technical capabilities and plans to leverage external APIs and partner technologies from the PARIS project.
Hybrid Solution of the Cold-Start Problem in Context-Aware Recommender SystemsMatthias Braunhofer
This document summarizes Matthias Braunhofer's doctoral research on addressing the cold-start problem in context-aware recommender systems. It presents basic context-aware rating prediction models like CAMF-CC and SPF, and proposes novel variants that incorporate additional contextual information like item categories or user demographics. It also describes two approaches to building hybrid context-aware recommender systems - heuristic switching and adaptive weighting. An evaluation compares the performance of these models on three datasets in addressing new user, new item, and new context cold-start situations, finding that hybrid models generally outperform basic models.
How to Increase the Quality of Learning Resourcesolavskun
The document summarizes the iQTool project which aims to develop an open-source software tool integrated with learning management systems to assess the quality of eLearning training programs and materials. The tool will allow institutions to measure teaching quality and support quality assurance. The project involves research on existing LMS platforms and quality management systems, software development, creation of educational content on quality assurance and using the tool, and testing the tool through pilot trainings. Various work packages divide tasks among the participating partners from different European countries.
Malik Almaliki, Funmilade Faniyi, Rami Bahsoon, Keith Phalp, Raian Ali. Requirements-driven Social Adaptation: Expert Survey. The 20th International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ 2014), Essen, Germany. April 2014.
Self-adaptation empowers software systems with the capability to meet stakeholders’ requirements in a dynamic environment. Such systems autonomously monitor changes and events which drive adaptation decisions at runtime. Social Adaptation is a recent kind of requirements-driven adaptation which enables users to give a runtime feedback on the success and quality of a system’s configurations in reaching their requirements. The system analyses users’ feedback, infers their collective judgement and then uses it to shape its adaptation decisions. However, there is still a lack of engineering mechanisms to guarantee a correct conduction of Social Adaptation. These slides report on a two-phase Expert Survey to identify core benefits, domain areas and challenges for Social Adaptation.We provide practitioners and researchers in adaptive
systems engineering with insights on this emerging role of users, or the crowd.
Testing in the Wild: Practices for Testing Beyond the LabTechWell
The stakes in the mobile app marketplace are very high, with thousands of apps vying for the limited space on users’ mobile devices. Organizations must ensure that their apps work as intended from day one and to do that must implement a successful mobile testing strategy leveraging in-the-wild testing. Matt Johnston describes how to create and implement a tailored in-the-wild testing strategy to boost app success and improve user experience. Matt provides strategies, tips, and real-world examples and advice on topics ranging from fragmentation issues, to the different problems inherent in web and mobile apps, to deciding what devices you must test vs. those you should test. After hearing real-world examples of how testing in the wild affects app quality, leave with an understanding of and actionable information about how to launch apps that perform as intended in the hands of end-users—from day one.
Description, lessons learned and future developments of the Dynamic COMPAS project. A quality and project management software for NGO based on the Quality COMPAS assurance method.
This course covers systems integration processes, including documenting integration requirements, designing integration solutions using patterns, and implementing solutions using service-oriented architecture. Students will complete projects involving evaluating open-source ERP systems and implementing business processes. The course aims to explain challenges, concepts, and strategies for integration projects and teach relevant architectures, methodologies, and technologies.
StudentFlowPatterns.com - Analyzing flow patterns of students through a courseJan Stoop
One of the biggest problems faced by educational institutions today is how to effectively manage the flow of students through a study course and how to do so at a much lower cost per graduate. Without proper analysis and appropriate strategies, the cost of education will keep on rising, placing the world even further away from the quality education it needs.
StudentFlowPatterns is a software programme giving users the opportunity to understand the fundamentals governing the flow of students through a study course, without dealing with the micro-dynamics of the flow process. It provides opportunities for decision makers to analyse flow patterns in a scientific way and to formulate and compare strategies for improving the throughput and cost efficiency of study courses.
The document proposes various research studies for Labaiik in 2021 to help achieve its business objectives. It outlines qualitative and quantitative studies including focus group discussions to understand user experiences and attitudes, usability testing to identify UX issues, and a brand tracking study using monthly online surveys to monitor key performance indicators. The results will provide insights into customer satisfaction, perceptions of Labaiik versus competitors, and feedback for improvements. Data will be analyzed using Qualtrics survey tools and dashboards to help optimize the app and user experience. Suggestions are also made for new app features.
Nada Sherief, Nan Jiang, Mahmood Hosseini, Keith Phalp, Raian Ali. Crowdsourcing Software Evaluation. The 18th International Conference on Evaluation and Assessment in Software Engineering (EASE 2014). London, UK. 13-14 May 2014.
This document discusses how to perform a gap analysis for containers practices. It outlines the steps to identify the topic, determine relevant practices, survey stakeholders to collect current practice levels and importance scores, perform a gap assessment to identify differences between current and best practices, validate the results in a workshop, and conduct a gap analysis to prioritize areas for improvement. An example is provided where containers is the topic, practices are identified from nine categories, stakeholders are surveyed, and gap scores are calculated and analyzed to determine which practice areas and individual practices should be the focus of an improvement strategy.
This document provides the introduction and methodology for a project that will evaluate NetBeans and Eclipse IDEs to determine which is best suited for novice Java programmers developing small applications. The author will conduct an Evidence Based Software Engineering (EBSE) exercise involving a systematic literature review, feature analysis, survey study, and practical research. Over 40-80 relevant articles will be critically analyzed to address the EBSE question. In addition, surveys of 20-30 professionals and students will provide opinions, and the author will develop small Java applications in each IDE to compare functionality based on the literature review and survey results. Finally, a recommendation will be made on the most suitable IDE for novice programmers based on integrating all findings and the author's practical experience.
This document discusses an organization's learning ecosystem, which includes the combination of technologies and resources available to help individuals learn. It describes components like an LMS, content authoring tools, learning analytics, and an LRS for collecting data on learning activities from various systems. The document also provides examples of how an organization used an LRS and analytics platform to examine the impact of compliance training investments on outcomes like employee retention and behaviors. Aggregating interaction-level data allowed the organization to identify changes, improve content, and demonstrate the impact of its learning programs.
Developing an evaluation strategy to gain insights into the ROER4D multi-nati...SarahG_SS
Presentation at the OE Global Conference held in Banff, Canada in April 2015. This presentation introduces the development of the evaluation strategy, using Utilization Focused Evaluation (UFE), for the ROER4D Project (http://roer4d.org/).
You can access the abstract here: http://conference.oeconsortium.org/2015/presentation/developing-an-evaluation-strategy-to-gain-insights-into-a-multi-national-project-roer4d/
DEVELOPMENT OF WEB APPLICATION FOR PACKAGING DESIGNijma
The majority of One Tambon One Product (OTOP) entrepreneurs desired a new packaging design that attracts the attention of consumers. The aims of this research were to 1) determine the packaging demands of entrepreneurs, 2) develop a conceptual framework for web applications, and 3) create web applications. Finally, 4) to ascertain entrepreneurs' satisfaction with the use of web applications in packaging design. The demographic and sample were recruited from the central region's population, entrepreneurs, and customers. Purposive sampling was used to choose 400 entrepreneurs and customers in Saraburi province. The main result was that requirement of entrepreneursabout package must be easy to portable. And Web Application must be also easy to use. By opinion of experts the result of web application development was overall high level and satisfaction of web application that help entrepreneurs to design package was high level. So the benefit of research is that entrepreneurs had web application to design the package and lower cost.
Implementation Of A Pre Study Phase EssayAshley Thomas
The document discusses the key ideas from Fred Brooks' book "The Mythical Man-Month", which explores software development project management. It explains that a "man-month" represents the effort of one person over a four-week period, which is typically estimated at 160 hours. Brooks' central thesis is that adding more people to a late software project makes it later, contradicting the assumption that more people means more work gets done in less time. The document analyzes Brooks' law and its implications for software development scheduling and resource estimation.
Running Head ADDIE Worksheet- HRMN 4061ADDIE Worksheet- HRMN 4daniatrappit
The document provides details about designing an online training program on cybersecurity threats for employees. It includes an analysis of learning needs, learners, and content. The design section outlines learning outcomes, instructional methods using computers, and assessments involving software installation and testing. The document also discusses the delivery method, timeline, and resources needed for the virtual and physical training sessions.
"Choosing proper type of scaling", Olena SyrotaFwdays
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
More Related Content
Similar to A Context-Aware Retrieval System for Mobile Applications
SYST15892 Interactive User Interface Design Phase IV Usa.pdfacsmadurai
SYST15892 - Interactive User Interface Design
Phase IV Usability Testing
Grade weight: 15%
Requirements
Based on your initial Storyboard / Wireframes develop an interactive
prototype with invisionapp to carry out a series of tasks to be tested with
live users. The tasks should include TWO common tasks and at least ONE
advanced task. Registering / logging in to the website / service are
considered common tasks.
You will need to conduct the usability testing on a minimum of FIVE
individuals and use the "Think Aloud" method to capture their thoughts,
actions and interaction with the prototype. During the test one group
member should be a note taker to record what the user is doing and saying
during the testing.
Note: DO NOT explain, prompt or help the user during the testing. This will
taint your results and not give you real feedback on the interface /
interaction.
Prepare a small survey with a 5-point Likert scale and open-ended
questions. Compile all the results into a report as part of your submission.
SYST15892 - Interactive User Interface Design
Phase IV Usability Testing
Deliverables (Each section will have the same grade)
1. PROTOTYPE: invisionapp prototype based on your wireframes.
2. PREPARATION:
a. A copy of your "script" including introduction to make the user
feel at home (biscuits...).
b. The goal or goals that you tell the user, and the tasks that you
expect the user to accomplish but keep secret.
3. RESULTS:
a. The results of the testing including Likert Scale results,
observations about user actions and expectations, verbal
feedback from the user, and answers to open-ended questions.
4. CONCLUSION:
a. Areas of the wireframes that need improvement or changes.
b. Feedback on the interface from the users (Positive and
Negative).
c. A statement on what the group thought went well and tasks/
actions from the user feedback that surprised the group, tasks
that took longer than expected, errors or confusion from the
user.
d. What you learned about your application and steps to improve.
e. What you learned about Usability Testing.
Submission
Submit the followings to the Dropbox on SLATE in the Final Project
Part 4 folder (e-mail submissions will NOT be accepted):
The zip file of the prototype downloaded from invisionapp.
A document containing deliverables 2 to 4 (see above).
Only one submission per group.
Please refer to the Late Submission Policy.
Only the last submission is accepted and marked, all other
submissions are ignored.
Any attempt at cheating on the assignment will result in a grade of zero
Introduction: The name of our application would be Bright Future. It is about guiding people to take
steps to achieve the dream job they want in the future. It would guide us from the basic level to the
higher levels. The aim of our app is to provide information to people about the eligibilities and
requirements of a specific job. Requirements: Concept: The concept of our program is to help
people know their career paths. The app prompts t.
This document summarizes the design and evaluation of two demonstrators for personalized online advertisements. The first demonstrator focuses on offline adaptation of ads based on movie context, user profile, social media posts, and preferences. An evaluation with 200 participants found that transparency and user control improved perceived quality, intention, understanding, and attitude toward ads. The second demonstrator aims to perform online adaptation by recognizing objects in videos and retrieving personalized ads to be integrated in real-time. It outlines the required technical capabilities and plans to leverage external APIs and partner technologies from the PARIS project.
Hybrid Solution of the Cold-Start Problem in Context-Aware Recommender SystemsMatthias Braunhofer
This document summarizes Matthias Braunhofer's doctoral research on addressing the cold-start problem in context-aware recommender systems. It presents basic context-aware rating prediction models like CAMF-CC and SPF, and proposes novel variants that incorporate additional contextual information like item categories or user demographics. It also describes two approaches to building hybrid context-aware recommender systems - heuristic switching and adaptive weighting. An evaluation compares the performance of these models on three datasets in addressing new user, new item, and new context cold-start situations, finding that hybrid models generally outperform basic models.
How to Increase the Quality of Learning Resourcesolavskun
The document summarizes the iQTool project which aims to develop an open-source software tool integrated with learning management systems to assess the quality of eLearning training programs and materials. The tool will allow institutions to measure teaching quality and support quality assurance. The project involves research on existing LMS platforms and quality management systems, software development, creation of educational content on quality assurance and using the tool, and testing the tool through pilot trainings. Various work packages divide tasks among the participating partners from different European countries.
Malik Almaliki, Funmilade Faniyi, Rami Bahsoon, Keith Phalp, Raian Ali. Requirements-driven Social Adaptation: Expert Survey. The 20th International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ 2014), Essen, Germany. April 2014.
Self-adaptation empowers software systems with the capability to meet stakeholders’ requirements in a dynamic environment. Such systems autonomously monitor changes and events which drive adaptation decisions at runtime. Social Adaptation is a recent kind of requirements-driven adaptation which enables users to give a runtime feedback on the success and quality of a system’s configurations in reaching their requirements. The system analyses users’ feedback, infers their collective judgement and then uses it to shape its adaptation decisions. However, there is still a lack of engineering mechanisms to guarantee a correct conduction of Social Adaptation. These slides report on a two-phase Expert Survey to identify core benefits, domain areas and challenges for Social Adaptation.We provide practitioners and researchers in adaptive
systems engineering with insights on this emerging role of users, or the crowd.
Testing in the Wild: Practices for Testing Beyond the LabTechWell
The stakes in the mobile app marketplace are very high, with thousands of apps vying for the limited space on users’ mobile devices. Organizations must ensure that their apps work as intended from day one and to do that must implement a successful mobile testing strategy leveraging in-the-wild testing. Matt Johnston describes how to create and implement a tailored in-the-wild testing strategy to boost app success and improve user experience. Matt provides strategies, tips, and real-world examples and advice on topics ranging from fragmentation issues, to the different problems inherent in web and mobile apps, to deciding what devices you must test vs. those you should test. After hearing real-world examples of how testing in the wild affects app quality, leave with an understanding of and actionable information about how to launch apps that perform as intended in the hands of end-users—from day one.
Description, lessons learned and future developments of the Dynamic COMPAS project. A quality and project management software for NGO based on the Quality COMPAS assurance method.
This course covers systems integration processes, including documenting integration requirements, designing integration solutions using patterns, and implementing solutions using service-oriented architecture. Students will complete projects involving evaluating open-source ERP systems and implementing business processes. The course aims to explain challenges, concepts, and strategies for integration projects and teach relevant architectures, methodologies, and technologies.
StudentFlowPatterns.com - Analyzing flow patterns of students through a courseJan Stoop
One of the biggest problems faced by educational institutions today is how to effectively manage the flow of students through a study course and how to do so at a much lower cost per graduate. Without proper analysis and appropriate strategies, the cost of education will keep on rising, placing the world even further away from the quality education it needs.
StudentFlowPatterns is a software programme giving users the opportunity to understand the fundamentals governing the flow of students through a study course, without dealing with the micro-dynamics of the flow process. It provides opportunities for decision makers to analyse flow patterns in a scientific way and to formulate and compare strategies for improving the throughput and cost efficiency of study courses.
The document proposes various research studies for Labaiik in 2021 to help achieve its business objectives. It outlines qualitative and quantitative studies including focus group discussions to understand user experiences and attitudes, usability testing to identify UX issues, and a brand tracking study using monthly online surveys to monitor key performance indicators. The results will provide insights into customer satisfaction, perceptions of Labaiik versus competitors, and feedback for improvements. Data will be analyzed using Qualtrics survey tools and dashboards to help optimize the app and user experience. Suggestions are also made for new app features.
Nada Sherief, Nan Jiang, Mahmood Hosseini, Keith Phalp, Raian Ali. Crowdsourcing Software Evaluation. The 18th International Conference on Evaluation and Assessment in Software Engineering (EASE 2014). London, UK. 13-14 May 2014.
This document discusses how to perform a gap analysis for containers practices. It outlines the steps to identify the topic, determine relevant practices, survey stakeholders to collect current practice levels and importance scores, perform a gap assessment to identify differences between current and best practices, validate the results in a workshop, and conduct a gap analysis to prioritize areas for improvement. An example is provided where containers is the topic, practices are identified from nine categories, stakeholders are surveyed, and gap scores are calculated and analyzed to determine which practice areas and individual practices should be the focus of an improvement strategy.
This document provides the introduction and methodology for a project that will evaluate NetBeans and Eclipse IDEs to determine which is best suited for novice Java programmers developing small applications. The author will conduct an Evidence Based Software Engineering (EBSE) exercise involving a systematic literature review, feature analysis, survey study, and practical research. Over 40-80 relevant articles will be critically analyzed to address the EBSE question. In addition, surveys of 20-30 professionals and students will provide opinions, and the author will develop small Java applications in each IDE to compare functionality based on the literature review and survey results. Finally, a recommendation will be made on the most suitable IDE for novice programmers based on integrating all findings and the author's practical experience.
This document discusses an organization's learning ecosystem, which includes the combination of technologies and resources available to help individuals learn. It describes components like an LMS, content authoring tools, learning analytics, and an LRS for collecting data on learning activities from various systems. The document also provides examples of how an organization used an LRS and analytics platform to examine the impact of compliance training investments on outcomes like employee retention and behaviors. Aggregating interaction-level data allowed the organization to identify changes, improve content, and demonstrate the impact of its learning programs.
Developing an evaluation strategy to gain insights into the ROER4D multi-nati...SarahG_SS
Presentation at the OE Global Conference held in Banff, Canada in April 2015. This presentation introduces the development of the evaluation strategy, using Utilization Focused Evaluation (UFE), for the ROER4D Project (http://roer4d.org/).
You can access the abstract here: http://conference.oeconsortium.org/2015/presentation/developing-an-evaluation-strategy-to-gain-insights-into-a-multi-national-project-roer4d/
DEVELOPMENT OF WEB APPLICATION FOR PACKAGING DESIGNijma
The majority of One Tambon One Product (OTOP) entrepreneurs desired a new packaging design that attracts the attention of consumers. The aims of this research were to 1) determine the packaging demands of entrepreneurs, 2) develop a conceptual framework for web applications, and 3) create web applications. Finally, 4) to ascertain entrepreneurs' satisfaction with the use of web applications in packaging design. The demographic and sample were recruited from the central region's population, entrepreneurs, and customers. Purposive sampling was used to choose 400 entrepreneurs and customers in Saraburi province. The main result was that requirement of entrepreneursabout package must be easy to portable. And Web Application must be also easy to use. By opinion of experts the result of web application development was overall high level and satisfaction of web application that help entrepreneurs to design package was high level. So the benefit of research is that entrepreneurs had web application to design the package and lower cost.
Implementation Of A Pre Study Phase EssayAshley Thomas
The document discusses the key ideas from Fred Brooks' book "The Mythical Man-Month", which explores software development project management. It explains that a "man-month" represents the effort of one person over a four-week period, which is typically estimated at 160 hours. Brooks' central thesis is that adding more people to a late software project makes it later, contradicting the assumption that more people means more work gets done in less time. The document analyzes Brooks' law and its implications for software development scheduling and resource estimation.
Running Head ADDIE Worksheet- HRMN 4061ADDIE Worksheet- HRMN 4daniatrappit
The document provides details about designing an online training program on cybersecurity threats for employees. It includes an analysis of learning needs, learners, and content. The design section outlines learning outcomes, instructional methods using computers, and assessments involving software installation and testing. The document also discusses the delivery method, timeline, and resources needed for the virtual and physical training sessions.
Similar to A Context-Aware Retrieval System for Mobile Applications (20)
"Choosing proper type of scaling", Olena SyrotaFwdays
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
Your One-Stop Shop for Python Success: Top 10 US Python Development Providersakankshawande
Simplify your search for a reliable Python development partner! This list presents the top 10 trusted US providers offering comprehensive Python development services, ensuring your project's success from conception to completion.
Skybuffer SAM4U tool for SAP license adoptionTatiana Kojar
Manage and optimize your license adoption and consumption with SAM4U, an SAP free customer software asset management tool.
SAM4U, an SAP complimentary software asset management tool for customers, delivers a detailed and well-structured overview of license inventory and usage with a user-friendly interface. We offer a hosted, cost-effective, and performance-optimized SAM4U setup in the Skybuffer Cloud environment. You retain ownership of the system and data, while we manage the ABAP 7.58 infrastructure, ensuring fixed Total Cost of Ownership (TCO) and exceptional services through the SAP Fiori interface.
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...Jason Yip
The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Digital Marketing Trends in 2024 | Guide for Staying AheadWask
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...Alex Pruden
Folding is a recent technique for building efficient recursive SNARKs. Several elegant folding protocols have been proposed, such as Nova, Supernova, Hypernova, Protostar, and others. However, all of them rely on an additively homomorphic commitment scheme based on discrete log, and are therefore not post-quantum secure. In this work we present LatticeFold, the first lattice-based folding protocol based on the Module SIS problem. This folding protocol naturally leads to an efficient recursive lattice-based SNARK and an efficient PCD scheme. LatticeFold supports folding low-degree relations, such as R1CS, as well as high-degree relations, such as CCS. The key challenge is to construct a secure folding protocol that works with the Ajtai commitment scheme. The difficulty, is ensuring that extracted witnesses are low norm through many rounds of folding. We present a novel technique using the sumcheck protocol to ensure that extracted witnesses are always low norm no matter how many rounds of folding are used. Our evaluation of the final proof system suggests that it is as performant as Hypernova, while providing post-quantum security.
Paper Link: https://eprint.iacr.org/2024/257
Main news related to the CCS TSI 2023 (2023/1695)Jakub Marek
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
Driving Business Innovation: Latest Generative AI Advancements & Success StorySafe Software
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Generating privacy-protected synthetic data using Secludy and MilvusZilliz
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?
Dandelion Hashtable: beyond billion requests per second on a commodity serverAntonios Katsarakis
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
HCL Notes and Domino License Cost Reduction in the World of DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyScyllaDB
Freshworks creates AI-boosted business software that helps employees work more efficiently and effectively. Managing data across multiple RDBMS and NoSQL databases was already a challenge at their current scale. To prepare for 10X growth, they knew it was time to rethink their database strategy. Learn how they architected a solution that would simplify scaling while keeping costs under control.
Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API?
Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose?
Which one is cheapest? Which one is fastest? Which one will scale to meet our needs?
Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsDianaGray10
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
Introduction of Cybersecurity with OSS at Code Europe 2024Hiroshi SHIBATA
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3Data Hops
Free A4 downloadable and printable Cyber Security, Social Engineering Safety and security Training Posters . Promote security awareness in the home or workplace. Lock them Out From training providers datahops.com
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
A Context-Aware Retrieval System for Mobile Applications
1. A Context-Aware
Retrieval System for
Mobile Applications
Stefano Mizzaro, Marco Pavan, Ivan Scagnetto, Ivano Zanello
!
Dept. of Mathematics and Computer Science - University of Udine
via delle Scienze, 206
Udine, Italy
{mizzaro, marco.pavan, ivan.scagnetto}@uniud.it, ivano.zanello@gmail.com
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
2. Agenda
• Introduction: mobile systems and context-awareness
• Our approach, and connections with the Context-Aware
Browser (CAB)
• The proposed system: AppCAB (i.e. Apps for CAB)
• Experimental evaluation
• Results and future works
• Questions
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
3. Mobile systems and Context-awareness
• Mobile devices have exceeded computer sales for the
first time in 2012
• Many people have moved several activities from their
computer to their smartphone or tablet
• Smaller screens and (virtual) keyboards lead users to
make more effort to seek and get what they need
• Users are sometimes forced to use the device in
particular situations or in stressful moments
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
4. Mobile systems and Context-awareness
• With huge mobile marketplaces, users are overwhelmed by
the large amount of applications combined with a usage
situation that often implies distraction and time pressure!
• By analyzing the situation in which they are, it is possible to
exploit the information extracted from user’s context to
find the right applications to recommend in that specific
moment
• The context plays the role of “filter” and helps to improve the
information retrieval process
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
5. Our approach
• Contextual information extraction
We used contexts generated by the Context-Aware Browser (CAB)
• Mobile applications’ metadata extraction
We developed a crawler for Apple AppStore in order to get Title,
Description, Category and Average rating for each application
• Recommender system design
It needs to be as precise as possible, since users have to interact with
ergonomically limited devices; It is useless to have a long list of suggestions
on a screen of a few inches
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
6. Our approach
• Experimental evaluation
Test collection based evaluation that follows principles of TREC and
in particular contextual suggestion track
Documents = apps metadata (from Apple Appstore)
Information needs description (“topics”) = context descriptors (12
contexts generated by the CAB system)
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
7. BaseLine System (BLS)
• We developed BLS using basic information retrieval
techniques in order to
have a term of comparison for our proposals and measure future
improvements
test how effective are common IR techniques in the field of
recommender system for mobile applications
• BLS = indexer + query processor
To build the index of all words found in each app metadata
And to retrieve the right set of apps starting from a context description
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
8. BLS - indexer
• TF.IDF of each word extracted from all apps’ Title
and Description
During this process we also keep track of which category is
associated to the app for each occurrence of the word, into an array
of counters
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
C1,1 C2,1
word a1
array of category counters
…
C1,2 C2,2
word a2 …
Cn,1
Cn,2
word an
…
9. BLS - indexer
• Category for each context
By summing up all the arrays of counters of all the words in the user
context we select the category with the highest score
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
C1,1 C2,1
word cx1
array of category counters
…
C1,2 C2,2
word cx2 …
Cn,1
Cn,2
word cxn
…
context
{ C1,n C2,n … Cn,n
+
+
+ +
+ +
= = =
C1,n C2,n … Cn,nCi,n
context category
=
category with the highest score
* *
10. BLS - query processor
• List of apps ordered by their relevance value for
each context term
For each context word it seeks into the index the applications
containing it
• Set of lists obtained by repeating the process for
each context term
• Total list with distinct entries
If an app is present more than once, we sum all its relevance values
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
11. BLS - final steps
• We keep just the first 1000 applications from the total list
The final purpose of the system is to suggest a small set of the most relevant applications to
users
• We apply 2 bonuses as score modifier (boosts)
App average rating boost: we increase or decrease the relevance score based on the user
evaluation of the app as follows
!
!
Category boost: if the retrieved app is associated to the same category of the context, then the
relevance score is boosted up with double value
• Final list with a set of 10 applications
As final task we reorder the apps list, with the new scores, and cut it off in order to have just 10
applications to recommend to users
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
Evaluation 1 2 3 4 5
Score modifier -50% -25% +0% +25% +50%
12. AppCAB
• AppCAB is our proposal presented in 2 versions: “base” and “pro”
To show some differences by applying different bonus scores
• AppCAB = indexer + query processor
The indexing process for both version uses the Lucene search engine library
As for BLS, during this process we keep track of categories, but for context category computation we
keep the entire list instead of just the first one
• We apply 3 bonuses as score modifier, at indexing time
A score reduction to apps present into “Game” category: 70% of original score
App average rating boost: we increase or decrease the relevance score based on the user evaluation of
the app as follows
!
!
App popularity boost: (min(0.5, numberOfReviews/100000))*100
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
Evaluation 1 1.5 2 2.5 3 3.5 4 4.5 5
Score modifier -50% -37% -25% -12% +0% +12% +25% +37% +50%
13. AppCAB
• AppCAB “base” after the indexing process does not apply any boosts at query
time
To test how it works with just boosts included at indexing time
Without taking into account the application category
• AppCAB “pro” = “base” + 2 bonuses as score modifier at query time
Category boost: if the retrieved app is associated one of the first three categories of the context, then the
relevance score is boosted up as follows
!
!
Title boost: if a query term is present in the app title we add +10% to the original score
• Final list with a set of 10 applications
We remove duplicate applications (many apps have free/lite and pro version)
We reorder the apps list, with the new scores, and cut it off in order to have just 10 applications to recommend
to users
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
Category rank 1 2 3
Score modifier +25% +12.5
%
+8%
14. Experimental evaluation
• Benchmark TREC-like
Collection of “documents” = apps metadata (nearly the whole set of apps related to
the Italian marketplace of Apple AppStore)
Statements of information needs (“topics”) = 12 textual context descriptors
generated by the CAB system
A set of relevance judgments = made by 16 people using a Likert scale on a single
item;
The values were numbers between 0 and 5 with the following meaning:
- 5 = highest value
- 1 = lowest value
- 0 = they were not able to evaluate the app due to external factors, such as
related webpage not reachable
We run all three algorithms for 12 contexts in order to get three sets of 10
applications for each context
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
15. Experimental evaluation
• Sample of relevance assessors: 16 people distributed as follows:
• Metric: Normalized Discounted Cumulative Gain (NDCG)
Since we need a limited set of recommendations (10 applications), and since we
collected relevance judgments on five levels scale, we measure the quality of the
system by using NDCG@5 and NDCG@10, in order to consider 5 and 10 retrieved
apps
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
• men
• women
• over 40
• 31-40
• 21-30
• under 20
• development
• advanced
• intermediate
• basic
• iOS
• android
• windows
• other
sex age familiarity with mobile devices mobile platform owned
16. Results - retrieval effectiveness
• 0-values: during the test some assessors chose to
assign a 0-value as app evaluation due to the non-
availability of the related web page
A 0-value is not the lowest relevance value but a score reporting the
impossibility to assess the application, due to external factors
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
17. Results - NDCG@5
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
NDCG@5 score with 0-values
NDCG@5 score without 0-values
Amount of 0-values:
• 14.5% for BLS
• 16.9% for AppCAB “base”
• 11.7% for AppCAB “pro”
Score over all contexts:
• 0.63 fro AppCAB “pro”
• 0.60 for AppCAB “base”
• 0.49 for BLS
Score over all contexts:
• 0.65 fro AppCAB “pro”
• 0.62 for AppCAB “base”
• 0.52 for BLS
18. Results - NDCG@5
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
NDCG@5 score with 0-values
NDCG@5 score without 0-values
• AppCAB solutions have higher effectiveness
in most of cases
• In particular the “pro” version has further improved
the results
19. Results - NDCG@5
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
NDCG@5 score with 0-values
NDCG@5 score without 0-values
• The exception of contexts 8 and 9 shows some
cases where the AppCAB systems failed
• The non-reachability of the related webpage for
some applications does not strongly affect the
score, even for contexts 8 and 9, therefore it is not
the reason of failure in those cases
• The low performance is due to the heterogeneous
set of keywords, suggesting distinct and unrelated
topics
20. Results - NDCG@10
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
Amount of 0-values:
• 14.5% for BLS
• 16.9% for AppCAB “base”
• 11.7% for AppCAB “pro”
Score over all contexts:
• 0.69 fro AppCAB “pro”
• 0.61 for AppCAB “base”
• 0.54 for BLS
Score over all contexts:
• 0.71 fro AppCAB “pro”
• 0.64 for AppCAB “base”
• 0.56 for BLS
NDCG@10 score with 0-values
NDCG@10 score without 0-values
21. Results - NDCG@10
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
NDCG@10 score without 0-values
NDCG@10 score with 0-values
• AppCAB effectiveness is increased
• The differences between the systems
remain with the same proportion
• AppCAB “pro” confirms the best performance
22. Results - NDCG@10
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
NDCG@10 score without 0-values
NDCG@10 score with 0-values
• We still have some exceptions such as contexts
6, 8 and 9
• and in particular the context 1 where 0-values
considerably affect the results
• Despite the exception in certain contexts, the overall
score describes how AppCAB improves retrieval
effectiveness by providing a better set of applications
to relevance assessors
• In particular the “pro” version has further improved
the results in general
23. Results - Rating distribution
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
• AppCAB system got many 1-ratings less than
the BLS solution
• also for the other rating values, although less
pronounced, there is an improvement
• The higher mean and median values emphasise
AppCAB “pro” effectiveness
24. Results - statistical significance
• Statistical tests to determine whether there are any significant
differences between the means of relevance judgements
Shapiro-Wilk normality test: the results show that none of them has normal
distribution
Levene test, in order to verify the homogeneity of variances: the results confirm that
we could not accept the hypothesis of homogeneity of variances
Friedman test, in order to verify if datasets have significant differences:
the resulting parameter value indicates a statistically significant difference
between means!
Post-hoc test, in order to know which specific groups differed:
the results show that AppCAB “pro” solution has significant difference compared
to both others, and instead how the AppCAB “base” did not give a noticeable
improvement compared to BLS
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
25. Conclusions and future works
• AppCAB “pro” has been evaluated better than the others in 42% of
cases, measured with NDCG@5, and in 50% of cases with
NDCG@10
• Also from the technical point of view there have been improvements
By using Lucene library the indexing process has been optimized both in terms of building
and read operations
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
NDCG@5 NDCG@10
• AppCAB “pro”
• AppCAB “base”
• BLS
• AppCAB “pro”
• AppCAB “base”
• BLS
26. Conclusions and future works
• Future work:!
a first obvious, and needed, improvement would be to rely on state-of-the-art IR models that
are more effective than TF.IDF, like BM25
AppCAB “pro” can be tested with English contexts and apps to refine it and make it more
versatile
- the index built is ready to work with the English language, in order to provide
applications for international marketplaces
query building process might be improved by means of query enrichment techniques (i.e.
by adding a new set of words) in order to filter apps in a more accurate way
improving the retrieval process over time, by taking into account user choices
- by creating a history of what users install and run, in order to apply new boosts
- to exploit user participation in social networks, in order to get feedback about shared
preferences and habits
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine
27. Thank you for your attention
• Questions…
4th Workshop on Context-awareness in Retrieval and Recommendation
in conjunction with ECIR 2014, Amsterdam
2014 Marco PavanUniversità degli studi di Udine