Master global, project- based learning in 5 simple stepsKyle Wagner
This session will teach novice to advanced educators the simple, 5-step project- design process for creating rigorous, engaging and real- world PBL experiences for students.
An In-Progress Use Case: Customizing & Deploying DITA to Produce Innovative E...Edwina Lui
Kaplan Publishing, the trade publishing group within Kaplan Test Prep, has traditionally produced a range of printed study materials to assist students in preparing for a broad spectrum of standardized tests. Like many companies, Kaplan’s customer base is technologically diverse and highly adaptive, exhibiting increasing demand for innovative digital test prep products that provide a more personalized study experience, adhere to a high standard for quality, and accurately reflect evolving educational standards tested by the test makers. To support the goal of providing our students with excellent study materials that fit their changing needs, Kaplan Publishing began to move towards an XML-based content and product development workflow, and decided in 2010 to adopt DITA as an XML standard--a decision based, in part, on the inclusion of the Learning & Training Specialization in DITA 1.2.
Comparativa de lo que considera el Tribunal Supremo respecto a las hipotecas multidivisas (STS 323/2015) y el Tribunal de Justicia de la UE respecto a los préstamos en divisas de Hungría (STJE de 03/12/2015)
"Natural Language Access to Data: Where Reasoning Makes Sense"diannepatricia
Richard Waldinger from SRI International presented this for the Cognitive Systems Institute Speaker Series on April 7, 2016. To hear a replay go to http://cognitive-science.info/community/weekly-update/
Master global, project- based learning in 5 simple stepsKyle Wagner
This session will teach novice to advanced educators the simple, 5-step project- design process for creating rigorous, engaging and real- world PBL experiences for students.
An In-Progress Use Case: Customizing & Deploying DITA to Produce Innovative E...Edwina Lui
Kaplan Publishing, the trade publishing group within Kaplan Test Prep, has traditionally produced a range of printed study materials to assist students in preparing for a broad spectrum of standardized tests. Like many companies, Kaplan’s customer base is technologically diverse and highly adaptive, exhibiting increasing demand for innovative digital test prep products that provide a more personalized study experience, adhere to a high standard for quality, and accurately reflect evolving educational standards tested by the test makers. To support the goal of providing our students with excellent study materials that fit their changing needs, Kaplan Publishing began to move towards an XML-based content and product development workflow, and decided in 2010 to adopt DITA as an XML standard--a decision based, in part, on the inclusion of the Learning & Training Specialization in DITA 1.2.
Comparativa de lo que considera el Tribunal Supremo respecto a las hipotecas multidivisas (STS 323/2015) y el Tribunal de Justicia de la UE respecto a los préstamos en divisas de Hungría (STJE de 03/12/2015)
"Natural Language Access to Data: Where Reasoning Makes Sense"diannepatricia
Richard Waldinger from SRI International presented this for the Cognitive Systems Institute Speaker Series on April 7, 2016. To hear a replay go to http://cognitive-science.info/community/weekly-update/
Cognitive systems institute group update speaker series june 25 2015diannepatricia
Jim Spohrer's presentation on Cognitive Systems Institute Group Speaker Series June 25, 2015. Calls are Thursdays at 10:30am ET. Contact fodell@us.ibm.com to attend.
Tom Finin: “From Strings to Things: Populating Knowledge Bases from Text”diannepatricia
Tim Finin, Professor of Computer Science and Electrical Engineering at the University of Maryland, Baltimore County (UMBC) gave a wonderful presentation entitled “From Strings to Things: Populating Knowledge Bases from Text,” as part of our Cognitive Systems Institute Speaker Series.
Ken Forbus presented “Software Social Organisms: Implications for measuring ...diannepatricia
Kenneth D. Forbus, Walter P. Murphy Professor of Computer Science and Professor of Education at Northwestern University, gave a wonderful presentation “Software Social Organisms: Implications for measuring AI progress” as part of our Cognitive Systems Institute Speaker Series.
"Toward Generating Domain-specific / Personalized Problem Lists from Electron...diannepatricia
Ching-huei Tsou, senior software engineer in the Watson Algorithms group from IBM Watson Research, presented this at the Cognitive Systems Institute Speaker Series on April 14, 2016.
Martin Takac - “Solving Large-Scale Machine Learning Problems in a Distribute...diannepatricia
Martin Takac, Assistant Professor, Lehigh University, gave a great presentation today on “Solving Large-Scale Machine Learning Problems in a Distributed Way” as part of our Cognitive Systems Institute Speaker Series.
“A Universal Translator as a Cognitive System, beginning as a Guidebook with ...diannepatricia
Scott MacLeod, founder and president of World University and School gave this presentation at the Cognitive Systems Institute Speaker Series on May 5, 2016.
Cognitive Computing by Professor Gordon Pipadiannepatricia
Professor Dr. Gordon Pipa, University of Osnabrueck, Germany is making this presentation for the Cognitive Systems Institute Speaker Series on May 26, 2016.
Multimodal behavior signal analysis and interpretation for young kids with ASDdiannepatricia
Dr. Ming Li from Sun Yat-sen University CMU Joint Institute of Engineering presented “Multimodal behavior signal analysis and interpretation for young kids with ASD.” as part of the Cognitive Systems Institute Speaker Series.
“Towards Building a Cognitive System to Fight for National College Admission ...diannepatricia
Yansong Feng from Peking University presented “Towards Building a Cognitive System to Fight for National College Admission Challenge” as part of the Cognitive Systems Institute Speaker Series.
“Towards Multi-Step Expert Advice for Cognitive Computing” - Dr. Achim Rettin...diannepatricia
Dr. Achim Rettinger from Karlsruhe Institute of Technology presented this today as part of the Cognitive Systems Institute Speaker Series on October 13, 2016
In this webinar, IPSASB Technical Director John Stanford and IPSASB Principal Paul Mason provide an introduction to IPSAS 40, Public Sector Combinations, including the project history, key definitions, approach to classification of combinations, and key changes since the Combinations Exposure Draft.
“From Eliza to Siri and beyond: Promise and challenges of intelligent, langua...diannepatricia
“From Eliza to Siri and beyond: Promise and challenges of intelligent, language-controlled assistants/chatbots.“ - Alexander Braun, founder of Creative Construction Heroes presented as part of the Cognitive Systems Institute Speaker Series on Nov. 3, 2016.
This is an instructional plan I designed and implemented for a course in my Master's program. I instructed three people in the job market on how to have a successful interview (*successful meaning either being invited for a second interview or getting the job).
Cognitive systems institute group update speaker series june 25 2015diannepatricia
Jim Spohrer's presentation on Cognitive Systems Institute Group Speaker Series June 25, 2015. Calls are Thursdays at 10:30am ET. Contact fodell@us.ibm.com to attend.
Tom Finin: “From Strings to Things: Populating Knowledge Bases from Text”diannepatricia
Tim Finin, Professor of Computer Science and Electrical Engineering at the University of Maryland, Baltimore County (UMBC) gave a wonderful presentation entitled “From Strings to Things: Populating Knowledge Bases from Text,” as part of our Cognitive Systems Institute Speaker Series.
Ken Forbus presented “Software Social Organisms: Implications for measuring ...diannepatricia
Kenneth D. Forbus, Walter P. Murphy Professor of Computer Science and Professor of Education at Northwestern University, gave a wonderful presentation “Software Social Organisms: Implications for measuring AI progress” as part of our Cognitive Systems Institute Speaker Series.
"Toward Generating Domain-specific / Personalized Problem Lists from Electron...diannepatricia
Ching-huei Tsou, senior software engineer in the Watson Algorithms group from IBM Watson Research, presented this at the Cognitive Systems Institute Speaker Series on April 14, 2016.
Martin Takac - “Solving Large-Scale Machine Learning Problems in a Distribute...diannepatricia
Martin Takac, Assistant Professor, Lehigh University, gave a great presentation today on “Solving Large-Scale Machine Learning Problems in a Distributed Way” as part of our Cognitive Systems Institute Speaker Series.
“A Universal Translator as a Cognitive System, beginning as a Guidebook with ...diannepatricia
Scott MacLeod, founder and president of World University and School gave this presentation at the Cognitive Systems Institute Speaker Series on May 5, 2016.
Cognitive Computing by Professor Gordon Pipadiannepatricia
Professor Dr. Gordon Pipa, University of Osnabrueck, Germany is making this presentation for the Cognitive Systems Institute Speaker Series on May 26, 2016.
Multimodal behavior signal analysis and interpretation for young kids with ASDdiannepatricia
Dr. Ming Li from Sun Yat-sen University CMU Joint Institute of Engineering presented “Multimodal behavior signal analysis and interpretation for young kids with ASD.” as part of the Cognitive Systems Institute Speaker Series.
“Towards Building a Cognitive System to Fight for National College Admission ...diannepatricia
Yansong Feng from Peking University presented “Towards Building a Cognitive System to Fight for National College Admission Challenge” as part of the Cognitive Systems Institute Speaker Series.
“Towards Multi-Step Expert Advice for Cognitive Computing” - Dr. Achim Rettin...diannepatricia
Dr. Achim Rettinger from Karlsruhe Institute of Technology presented this today as part of the Cognitive Systems Institute Speaker Series on October 13, 2016
In this webinar, IPSASB Technical Director John Stanford and IPSASB Principal Paul Mason provide an introduction to IPSAS 40, Public Sector Combinations, including the project history, key definitions, approach to classification of combinations, and key changes since the Combinations Exposure Draft.
“From Eliza to Siri and beyond: Promise and challenges of intelligent, langua...diannepatricia
“From Eliza to Siri and beyond: Promise and challenges of intelligent, language-controlled assistants/chatbots.“ - Alexander Braun, founder of Creative Construction Heroes presented as part of the Cognitive Systems Institute Speaker Series on Nov. 3, 2016.
This is an instructional plan I designed and implemented for a course in my Master's program. I instructed three people in the job market on how to have a successful interview (*successful meaning either being invited for a second interview or getting the job).
Rossiter, Biggs and Petrulis (2008), Innovative problem-based learning approa...cilass.slideshare
Presentation by Dr Diane Rossiter, Dr Catherine Biggs and Dr Robert Petrulis (University of Sheffield, Department of Chemical and Process Engineering and CILASS) at the Engineering Education Conference 2008, Loughborough, entitled: 'Innovative problem-based learning approach using off and online resources in 1st year Chemical Engineering'
Rossiter and Biggs (2008) - Development of Online Quizzes to Support Problem-...cilass.slideshare
Presentation given by Dr Diane Rossiter and Dr Catherine Biggs of the Department of Department of Chemical and Process Engineering at the University of Sheffield at the 2008 International Blended Learning Conference (University of Hertfordshire), entitled: "Development of online quizzes to support problem-based learning in chemical engineering"
An augmented reality approach to curriculum designdebbieholley1
Presentation on a two year action research project, demonstrating the benefits of co-creation using AR for computing and gaming students undertaking PDP activities
An evidence-based model to enhance programme-wide assessment using technology: TESTA to FASTECH . Presented by Tansy Jessop and Yaz El-Hakim (University of Winchester) and Paul Hyland (Bath Spa University). Facilitated by Mark Russell (University of Hertfordshire).
Jisc conference 2011
Questions that should be asked for online delivery classes are: Is the instructor using online exemplary practices? Is the instructor qualified to teach online? Methods that could be used on a voluntary basis to answer these questions will be discussed.
Teaching cognitive computing with ibm watsondiannepatricia
Ralph Badinelli, Lenz Chair in the Department of Business Information Technology, Pamplin College of Business of Virginia Tech. presented "Teaching Cognitive Computing with IBM Watson" as part of the Cognitive Systems Institute Speaker Series.
Cognitive systems institute talk 8 june 2017 - v.1.0diannepatricia
José Hernández-Orallo, Full Professor, Department of Information Systems and Computation at the Universitat Politecnica de València, presentation “Evaluating Cognitive Systems: Task-oriented or Ability-oriented?” as part of the Cognitive Systems Institute Speaker Series.
Building Compassionate Conversational Systemsdiannepatricia
Rama Akkiraju, Distinguished Engineer and Master Inventor at IBM, presention "Building Compassionate Conversational Systems" as part of the Cognitive Systems Institute Speaker Series.
“Artificial Intelligence, Cognitive Computing and Innovating in Practice”diannepatricia
Cristina Mele, Full Professor of Management at the University of Napoli “Federico II”, presentation as part of Cognitive Systems Institute Speaker Series
Eric Manser and Will Scott from IBM Research, presentation on "Cognitive Insights Drive Self-driving Accessibility" as part of the Cognitive Systems Institute Speaker Series
Roberto Sicconi and Malgorzata (Maggie) Stys, founders of TeleLingo, presented "AI in the Car" as part of the Cognitive Systems Institute Speaker Series.
“Semantic PDF Processing & Document Representation”diannepatricia
Sridhar Iyengar, IBM Distinguished Engineer at the IBM T. J. Watson Research Center, presention “Semantic PDF Processing & Document Representation” as part of the Cognitive Systems Institute Group Speaker Series.
Joining Industry and Students for Cognitive Solutions at Karlsruhe Services R...diannepatricia
Gerhard Satzger, Director of the Karlsruhe Service Research Institute and two former students and IBMers, Sebastian Hirschl and Kathrin Fitzer, presention"Joining Industry and Students for Cognitive Solutions at Karlsruhe Services Research Center" as part of the Cognitive Systems Institute Speaker Series.
170330 cognitive systems institute speaker series mark sherman - watson pr...diannepatricia
Dr. Mark Sherman, Director of the Cyber Security Foundations group at CERT within CMU’s Software Engineering Institute. , presention “Experiences Developing an IBM Watson Cognitive Processing Application to Support Q&A of Application Security Diagnostics” as part of the Cognitive Systems Institute Speaker Series.
“Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption”diannepatricia
Chuck Howell, Chief Engineer for Intelligence Programs and Integration at the MITRE Corporation, presentation “Fairness Cases as an Accelerant and Enabler for Cognitive Assistance Adoption” as part of the Cognitive Systems Institute Speaker Series.
From complex Systems to Networks: Discovering and Modeling the Correct Network"diannepatricia
From complex Systems to Networks: Discovering and Modeling the Correct Network" by Nitesh Chawla as part of the Cognitive Systems Institute Speaker Series
Nitesh Chawla is the Frank M. Freimann Professor of Computer Science and Engineering, and director of the research center on network and data sciences (iCeNSA) at the University of Notre Dame.
Developing Cognitive Systems to Support Team Cognitiondiannepatricia
Steve Fiore from the University of Central Florida presented “Developing Cognitive Systems to Support Team Cognition” as part of the Cognitive Systems Institute Speaker Series
Kevin Sullivan from the University of Virginia presented: "Cyber-Social Learning Systems: Take-Aways from First Community Computing Consortium Workshop on Cyber-Social Learning Systems" as part of the Cognitive Systems Institute Speaker Series.
“IT Technology Trends in 2017… and Beyond”diannepatricia
William Chamberlin, IBM Distinguished Market Intelligence Professional, presented “IT Technology Trends in 2017… and Beyond” as part of the Cognitive Systems Institute Speaker Series on January 26, 2017.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
6. Related Work
Course Evaluation
● Braga, M. et al. 2014
● Cohen, Peter A. 1981
● Greenwald, A. G. and Gillmore, M.G. 1997
● Marsh, H.W., and Roche, L.A. 1997
● Stark, P. B. and Freishtat, R. 2014
6
Perceived Learning & Education
● Eom, S. B., Wen, H. J., & Ashill, N. 2006
● Richardson, J. C. and Swan, K. 2003
● Swan, K. 2001
7. Demographics Questions
For MOOCs: Country, Gender, Age, Years of
training, Reason for taking the course.
For IEOR 170: Major, Year, Number of other
related courses taken, Interest in the subject,
Reason for taking the course.
7
8. Quantitative Analysis Topics (QAT)
1. How would you rate the course so far in terms of
technical difficulty?
2. How would you rate the course so far in terms of
usefulness to your career?
3. How would you rate your enthusiasm so far for this
course?
4. How would you rate your performance so far in this
course?
5. How would you rate the effectiveness of course
assignments so far to help you develop your skills? 8
9. NLP Limitation in M-CAFE
Selecting a set of insightful,
novel, and relevant ideas
is hard.
Suggestions are often short
and subject-specific.
9
10. Related Work
Collaborative Filtering
● Goldberg, K. et al. 2001
● Konstan, J.A. et al. 1997
● Pearson, K. 1901
● Sarwar, B. et al. 2001
● Yang, X. et al.2014
10
Natural Language Processing
(NLP)
● Adamopoulos, P. 2013
● Pang, B and Lee, L. 2008
● Reich, J. et al. 2014
15. 15
Participation
IEOR 170: 16 weeks in
Jan - May, 2015
● Student Count: 96
● QAT Rating Count:
424
● Idea Count: 270
● CF Rating Count:
2483
16. Quantitative Analysis Topics
Graph visualization of QAT rating changes
over time.
Figure 2: course difficulty rating over
the first 10 weeks for IEOR 170. 16
19. Wilson Score:
We took the mean grade g and then
calculated the 95% confidence interval of g
using standard error: g +/- 1.96*SE(g). We
then rank the ideas by the lower bound g -
1.96*SE(g).
19
Given a set of rating to each idea, how
should we rank them.
20. Since each participant rates k<<N ideas, how
to choose which ideas to present.
Uncertainty Sampling!
For each idea i,
Probability of exposure:
P(i) ∝ SE(i)
where SE(i) is the standard
error of idea i
20
21. CF performance assessment
No universal rule on how good an idea is.
Assess from specific perspectives:
Do CF selected ideas have a broad topic coverage?
Is CF selecting ideas with better quality in general?
Does CF idea ranking agree with Instructor ranking?
21
22. CF performance assessment
1. Chat forums.
2. Basics.
3. Javascript.
4. Additional time.
5. Additional exercises.
6. Security.
7. Update technology.
Figure 3: The number of comments for each topic in the top 20
comments for CS 169.2x. 22
23. Quality scoring metric:
1 - Not readable.
2 - Readable but unrelated to the course.
3 - Present one idea about the course but it is not a
suggestion.
4 - Present a suggestion with some reasoning.
5 - Present a suggestion with reasoning and propose a
solution.
CF performance assessment
23
24. A suggestion with a quality score of 5:
Design patterns are hard to grasp without getting your hands dirty in a messy
problem. I think using a quiz for that week instead of a challenging homework
assignment was a mistake. I understand the concepts as abstract entities but would
still have a hard time figuring out when and how to use them. I felt the same way
about the Javascript week as well. A homework assignment doing JS and AJAX on
the rotten potatoes example would have been ideal.
A suggestion with a quality score of 1 is:
Devise + Omniauth !!! 24
CF performance assessment
27. Conclusion
Developed a novel platform to generate timely
feedback on course issue.
Motivated student participation in courses.
Highlighted valuable ideas using peer-to-peer
collaborative filtering.
27
28. Future Work
Explore how sorting and presenting ideas based on factors
such as time or novelty will affect participation.
Add topic tagging to organize suggested ideas.
28