Ascilite webinar series: http://www.ascilite.org.au/index.php?p=news_detail&item=240
A slightly different version of the Macquarie University keynote at http://www.slideshare.net/sbs/our-learning-analytics-are-our-pedagogy
I swapped out more general critiques of big data, for more detail on Dispositional and Discourse Learning Analytics
Keynote Address, Expanding Horizons 2012, Macquarie University
http://staff.mq.edu.au/teaching/workshops_programs/expanding_horizons
"Learning Analytics": unprecedented data sets and live data streams about learners, with computational power to help make sense of it all, and new breeds of staff who can talk predictive models, pedagogy and ethics. This means rather different things to different people: unprecedented opportunity to study, benchmark and improve educational practice, at scales from countries and institutions, to departments, individual teachers and learners. "Benchmarking" may trigger dystopic visions of dumbed down proxies for 'real teaching and learning', but an emu response is no good. For educational institutions, our calling is to raise the quality of debate, shape external and internal policy, and engage with the companies and open communities developing the future infrastructure. How we deploy these new tools rests critically on assessment regimes, what can be logged and measured with integrity, and what we think it means to deliver education that equips citizens for a complex, uncertain world.
A Global Network for Deep Learning: the Case of Uruguay@cristobalcobo
The aim of this paper is to describe an innovative large-scale action research in the field of education. This paper illustrates a unique sample of a global network of schools working together as a "living lab" to test, implement and improve innovative pedagogical practices in seven different countries (clusters). This experience can be regarded as a disruptive experiment from the methodological (i.e. network of schools), pedagogical (i.e. learning by creating) and accountability perspective (i.e. novel ways of assessing learning outcomes). This global network allocates special relevance to the cultural and contextual specificities of each member. This paper focuses on the Uruguayan case, the only non-developed partner country, which is working in incorporating up to 2,800 schools in this global network by the end of 2019. After providing a background and key figures of the current education system in Uruguay, the authors describe the outcomes of this experience so far (2013- 2016) and highlight some of the expected achievements and instruments to assess the second phase of this experience (2016-2019), with special emphasis in the design of new metrics and the adoption of new assessment tools. After stating the conclusions, the paper points out the limitations and further questions to be explored along the implementation of this global experiment in education.
By Cobo, Brovetto, Gago
Social Media in Learning, Teaching, and Scholarship: 6 Tales of PracticeGeorge Veletsianos
Keynote at the 2013 Teaching & Learning to the Power of Technology Conference at Saskatchewan, Canada.
Abstract: The last ten years have seen dramatic changes in the ways millions of individuals connect, communicate, and network via technology and through social media. Social media have also penetrated the higher education sector, and it has been posited that they have influenced not only the ways students connect with each other, but also the ways scholarship is organized, delivered, enacted, and experienced. In this keynote, I will share six research-based stories describing the integration and use of social media in higher education. These stories paint an intricate picture of the use of social media in education and juxtapose three perspectives: (a) social media use guided by techno-enthusiasm and techno-determinism, (b) social media as tools to question and circumvent traditional elements of scholarly practice, and (c) social media as transformative technology.
Digital Scholarship powered by reflection and reflective practice through the...Judy O'Connell
Current online information environments and the associated social and pedagogical transactions within them create an important information ecosystem that can and should influence and shape the professional engagement and digital scholarship within our learning communities in the higher education sector. Thanks to advances in technology, the powerful tools at our disposal to help students understand and learn in unique ways are enabling new ways of producing, searching and sharing information and knowledge. By leveraging technology, we have the opportunity to open new doors to scholarly inquiry for ourselves and our students. While practical recommendations for a wide variety of ways of working with current online technologies are easily marketed and readily adopted, there is insufficient connection to digital scholarship practices in the creation of meaning and knowledge through more traditional approaches to the ‘portfolio’. In this context, a review of the portfolio integration into degree programs under review in the School of Information Studies led to an update of the portfolio approach in the professional experience subject to an extended and embedded e-portfolio integrated throughout the subject and program experience. This was done to support a strong connection between digital scholarship, community engagement, personal reflection and professional reflexive practices. In 2013 the School of Information Studies established CSU Thinkspace, a branded Wordpress solution from Campus Press, to better serve the multiple needs and learning strategies identified for the Master of Education programs. The aim was to use a product that replicates the authentic industry standard tools used in schools today, and to model the actual ways in which these same teachers can also work in digital environments with their own students or in their own professional interactions. This paper will review how the ePortfolio now provides reflective knowledge construction, self-directed learning, and facilitate habits of lifelong learning within their professional capabilities.
Referred published as part of the EPortolios Forum, Sydney, 2016.
Online Learning Design for Diversity and Inclusion Shalin Hai-Jew
Social inclusion and respect for diversity are some of the most important democratic values that inform learning design. The educational research literature offers methods for how to design teaching and learning for people in all (many of?) their complex dimensions:
demographics;
cultures [including worldviews, beliefs, values, practices, and others];
languages;
learning preferences;
differing perceptions and information processing, and others,
… so that all are included and supported and welcomed. Widely known approaches include accessibility mitigations, universal design practices, multi-cultural adaptations, and others. This presentation provides a light overview of suggested practices and how these are applied to practical instructional designs of online learning with modern technological enablements.
Keynote Address, Expanding Horizons 2012, Macquarie University
http://staff.mq.edu.au/teaching/workshops_programs/expanding_horizons
"Learning Analytics": unprecedented data sets and live data streams about learners, with computational power to help make sense of it all, and new breeds of staff who can talk predictive models, pedagogy and ethics. This means rather different things to different people: unprecedented opportunity to study, benchmark and improve educational practice, at scales from countries and institutions, to departments, individual teachers and learners. "Benchmarking" may trigger dystopic visions of dumbed down proxies for 'real teaching and learning', but an emu response is no good. For educational institutions, our calling is to raise the quality of debate, shape external and internal policy, and engage with the companies and open communities developing the future infrastructure. How we deploy these new tools rests critically on assessment regimes, what can be logged and measured with integrity, and what we think it means to deliver education that equips citizens for a complex, uncertain world.
A Global Network for Deep Learning: the Case of Uruguay@cristobalcobo
The aim of this paper is to describe an innovative large-scale action research in the field of education. This paper illustrates a unique sample of a global network of schools working together as a "living lab" to test, implement and improve innovative pedagogical practices in seven different countries (clusters). This experience can be regarded as a disruptive experiment from the methodological (i.e. network of schools), pedagogical (i.e. learning by creating) and accountability perspective (i.e. novel ways of assessing learning outcomes). This global network allocates special relevance to the cultural and contextual specificities of each member. This paper focuses on the Uruguayan case, the only non-developed partner country, which is working in incorporating up to 2,800 schools in this global network by the end of 2019. After providing a background and key figures of the current education system in Uruguay, the authors describe the outcomes of this experience so far (2013- 2016) and highlight some of the expected achievements and instruments to assess the second phase of this experience (2016-2019), with special emphasis in the design of new metrics and the adoption of new assessment tools. After stating the conclusions, the paper points out the limitations and further questions to be explored along the implementation of this global experiment in education.
By Cobo, Brovetto, Gago
Social Media in Learning, Teaching, and Scholarship: 6 Tales of PracticeGeorge Veletsianos
Keynote at the 2013 Teaching & Learning to the Power of Technology Conference at Saskatchewan, Canada.
Abstract: The last ten years have seen dramatic changes in the ways millions of individuals connect, communicate, and network via technology and through social media. Social media have also penetrated the higher education sector, and it has been posited that they have influenced not only the ways students connect with each other, but also the ways scholarship is organized, delivered, enacted, and experienced. In this keynote, I will share six research-based stories describing the integration and use of social media in higher education. These stories paint an intricate picture of the use of social media in education and juxtapose three perspectives: (a) social media use guided by techno-enthusiasm and techno-determinism, (b) social media as tools to question and circumvent traditional elements of scholarly practice, and (c) social media as transformative technology.
Digital Scholarship powered by reflection and reflective practice through the...Judy O'Connell
Current online information environments and the associated social and pedagogical transactions within them create an important information ecosystem that can and should influence and shape the professional engagement and digital scholarship within our learning communities in the higher education sector. Thanks to advances in technology, the powerful tools at our disposal to help students understand and learn in unique ways are enabling new ways of producing, searching and sharing information and knowledge. By leveraging technology, we have the opportunity to open new doors to scholarly inquiry for ourselves and our students. While practical recommendations for a wide variety of ways of working with current online technologies are easily marketed and readily adopted, there is insufficient connection to digital scholarship practices in the creation of meaning and knowledge through more traditional approaches to the ‘portfolio’. In this context, a review of the portfolio integration into degree programs under review in the School of Information Studies led to an update of the portfolio approach in the professional experience subject to an extended and embedded e-portfolio integrated throughout the subject and program experience. This was done to support a strong connection between digital scholarship, community engagement, personal reflection and professional reflexive practices. In 2013 the School of Information Studies established CSU Thinkspace, a branded Wordpress solution from Campus Press, to better serve the multiple needs and learning strategies identified for the Master of Education programs. The aim was to use a product that replicates the authentic industry standard tools used in schools today, and to model the actual ways in which these same teachers can also work in digital environments with their own students or in their own professional interactions. This paper will review how the ePortfolio now provides reflective knowledge construction, self-directed learning, and facilitate habits of lifelong learning within their professional capabilities.
Referred published as part of the EPortolios Forum, Sydney, 2016.
Online Learning Design for Diversity and Inclusion Shalin Hai-Jew
Social inclusion and respect for diversity are some of the most important democratic values that inform learning design. The educational research literature offers methods for how to design teaching and learning for people in all (many of?) their complex dimensions:
demographics;
cultures [including worldviews, beliefs, values, practices, and others];
languages;
learning preferences;
differing perceptions and information processing, and others,
… so that all are included and supported and welcomed. Widely known approaches include accessibility mitigations, universal design practices, multi-cultural adaptations, and others. This presentation provides a light overview of suggested practices and how these are applied to practical instructional designs of online learning with modern technological enablements.
Digital Learning Environments: A multidisciplinary focus on 21st century lear...Judy O'Connell
As a result of an extensive curriculum review a new multi-disciplinary degree programme in education and information studies was developed to uniquely facilitate educators’ capacity to be responsive to the demands
of a digitally connected world. Charles Sturt University’s Master of Education (Knowledge Networks and Digital Innovation) aims to develop agile leaders in new cultures of digital formal and informal learning. By examining key features and influences of global connectedness,
information organisation, communication and participatory cultures of learning, students are provided with the opportunity to reflect on their professional practice in a networked learning community, and to improve learning and teaching in digital environments.
10_05_2019 Seminario eMadrid sobre «Tecnologías de la educación dentro y fuer...eMadrid network
Presentación de Davinia Hernández-Leo, profesora de la Universitat Pompeu Fabra (UPF), Barcelona: «Apoyo al profesorado con analíticas de comunidad, diseño y aprendizaje»
Supporting teachers with community, design and learning analytics, Davinia He...davinia.hl
Apoyo al profesorado con analíticas de comunidad, diseño y aprendizaje
Supporting teachers with community, design and learning analytics
Seminario eMadrid, UAM 05/2019
http://www.emadridnet.org/index.php/es/eventos2/1100-seminario-emadrid-sobre-tecnologias-dentro-y-fuera-del-aula
http://www.emadridnet.org/index.php/es/28-eventos-y-seminarios/1102-apoyo-al-profesorado-con-analiticas-de-comunidad-diseno-y-aprendizaje
Abstract
I will present an overview of the educational technologies research conducted by the TIDE research group of the Information and Communication Technologies Department at Universitat Pompeu Fabra in Barcelona (http://www.upf.edu/web/tide @TIDE_UPF). The overview will be articulated around the perspective of supporting teachers and teacher communities (e.g., a school) in the design of the best possible (technology-enhanced) learning activities considering their students and their contexts. Main contributions that will be presented include a community platform for integrated learning design (ILDE), including multiple authoring tools (e.g. PyramidApp for collaborative learning, edCrumble for blended learning) and the use of data analytics at different levels (learning, design, community) to support community awareness and teacher reflection when designing for learning. The presentation will include results of several research projects (METIS, CoT, MdM-EDS, RESET, SmartLET, Illuminated).
En esta ponencia presentaré un resumen de la investigación en tecnologías educativas llevada a cabo por el grupo TIDE del Departamento de Tecnologías de la Información y las Comunicaciones en la Universidad Pompeu Fabra en Barcelona (http://www.upf.edu/web/tide @TIDE_UPF). El resumen se presenta desde la perspectiva del apoyo al profesorado y a comunidades de profesores (como, por ejemplo, una escuela) en el diseño de buenas actividades de aprendizaje considerando los estudiantes y sus contextos. Las contribuciones principales incluyen una plataforma de comunidad para el diseño integrado de actividades de aprendizaje (ILDE), incluidas herramientas de autoría (como PyramidApp para aprendizaje colaborativo apoyado por ordenador, edCrumble para aprendizaje híbrido) y el uso de analíticas de datos a diferentes niveles (aprendizaje, diseño, comunidad) ara facilitar la conciencia de comunidad y la reflexión por los profesores cuando diseñan para generar aprendizajes. La presentación incluirá resultados de varios proyectos de investigación (METIS, CoT, MdM-EDS, RESET, SmartLET, Illuminated).
http://www.upf.edu/web/tide
The Modern Digital Learning Landscape: 5 Tips To Engage Gen Z and Millennial ...Aggregage
If 2020 hasn’t radically changed your approach to your learning program, it’s time to get in the digital learning game or risk being left behind. But if you’re searching for current, new ways to engage people online and keep your business thriving, look to your youngest learners. In the next 5 years, Millennials will comprise 75% of the workforce, and Gen Z is right behind them. To future-proof your learning program, make sure your content is designed with these young professional learners in mind.
The Future of Learning: Embracing Social Learning for SuccessSaba Software
Today, the world is grounded in a vast and dynamic world of information and technology. Organizations
have access to content like never before, compounded by the Web 2.0 movement. This ability to
communicate swiftly evolved into collaboration that has become an intense driver of the “knowledge
economy.”
During the last two years we have seen how knowledge management and leadership development
via learning are being incorporated more frequently as strategies to increase organizational agility.1
Additionally, learning organizations that act as strategic enablers for the business are more focused on
connecting people to people and content through knowledge management and social technology.
Saba Software partnered with Human Capital Media (HCM) Advisory Group to better understand how
business is taking advantage of social learning. In the 2013 survey, HCM examined how organizations are
approaching social learning, which methods have proven to be successful and where challenges are experienced.
Educator-NICs: Envisaging the Future of ICT–enabled Networked Improvement Communities
Learning Emergence Workshop • University of Bristol • 20th May 2014
E-Learning in the university: When will it really happen?eLearning Papers
eLearning has enormous potential in education, and there is an urgent need to take stock of the possibilities that it offers. Despite this urgency, research on eLearning is still in a nascent stage and there is a degree of conceptual confusion in the field that is difficult to tolerate.
Authors: Ann-Louise Davidson, David Waddington,
Literature in digital environments: Changes and emerging trends in Australian...Judy O'Connell
Igniting a passion for reading and research is core business for school libraries, inevitably placing the library at the centre of the 21st century reading and learning experience. It is in this context that digital literature creates some challenging questions for teachers and librarians in schools, while the emergence of digital technology and/or device options also offers a great many opportunities. Collection development in school libraries encompasses an understanding of the need to contextualise these e-literature needs within the learning and teaching experiences in the school. The Australian Library and Information Association’s 2013 statement Future of collections 50:50 predicted that library print and ebook collections in libraries would establish a 50:50 equilibrium by 2020 and that this balance would be maintained for the foreseeable future. This statement from the Australian professional body raised the need to know more about e-collections in school libraries. For teacher librarians in Australian schools, the nature of online collections, and the integration of ebooks into the evolving reading culture is influenced by the range and diversity of texts, interfaces, devices, and experiences available to complement existing print and media collections or services. Management and budget constraints also influence e-collections. By undertaking a review of the literature, a discussion of the education context, and a critical analysis of the trends evidenced by national survey data, this paper presents an overview of the changes and emerging trends in digital literature and ebook collections in school library services in Australia today.
ICO Fall School 2012, Santuari de Santa Maria del Collell, Gironahttps://sites.google.com/site/icofallschool2012
A week long PhD training school for educational and ed-tech researchers
Digital Learning Environments: A multidisciplinary focus on 21st century lear...Judy O'Connell
As a result of an extensive curriculum review a new multi-disciplinary degree programme in education and information studies was developed to uniquely facilitate educators’ capacity to be responsive to the demands
of a digitally connected world. Charles Sturt University’s Master of Education (Knowledge Networks and Digital Innovation) aims to develop agile leaders in new cultures of digital formal and informal learning. By examining key features and influences of global connectedness,
information organisation, communication and participatory cultures of learning, students are provided with the opportunity to reflect on their professional practice in a networked learning community, and to improve learning and teaching in digital environments.
10_05_2019 Seminario eMadrid sobre «Tecnologías de la educación dentro y fuer...eMadrid network
Presentación de Davinia Hernández-Leo, profesora de la Universitat Pompeu Fabra (UPF), Barcelona: «Apoyo al profesorado con analíticas de comunidad, diseño y aprendizaje»
Supporting teachers with community, design and learning analytics, Davinia He...davinia.hl
Apoyo al profesorado con analíticas de comunidad, diseño y aprendizaje
Supporting teachers with community, design and learning analytics
Seminario eMadrid, UAM 05/2019
http://www.emadridnet.org/index.php/es/eventos2/1100-seminario-emadrid-sobre-tecnologias-dentro-y-fuera-del-aula
http://www.emadridnet.org/index.php/es/28-eventos-y-seminarios/1102-apoyo-al-profesorado-con-analiticas-de-comunidad-diseno-y-aprendizaje
Abstract
I will present an overview of the educational technologies research conducted by the TIDE research group of the Information and Communication Technologies Department at Universitat Pompeu Fabra in Barcelona (http://www.upf.edu/web/tide @TIDE_UPF). The overview will be articulated around the perspective of supporting teachers and teacher communities (e.g., a school) in the design of the best possible (technology-enhanced) learning activities considering their students and their contexts. Main contributions that will be presented include a community platform for integrated learning design (ILDE), including multiple authoring tools (e.g. PyramidApp for collaborative learning, edCrumble for blended learning) and the use of data analytics at different levels (learning, design, community) to support community awareness and teacher reflection when designing for learning. The presentation will include results of several research projects (METIS, CoT, MdM-EDS, RESET, SmartLET, Illuminated).
En esta ponencia presentaré un resumen de la investigación en tecnologías educativas llevada a cabo por el grupo TIDE del Departamento de Tecnologías de la Información y las Comunicaciones en la Universidad Pompeu Fabra en Barcelona (http://www.upf.edu/web/tide @TIDE_UPF). El resumen se presenta desde la perspectiva del apoyo al profesorado y a comunidades de profesores (como, por ejemplo, una escuela) en el diseño de buenas actividades de aprendizaje considerando los estudiantes y sus contextos. Las contribuciones principales incluyen una plataforma de comunidad para el diseño integrado de actividades de aprendizaje (ILDE), incluidas herramientas de autoría (como PyramidApp para aprendizaje colaborativo apoyado por ordenador, edCrumble para aprendizaje híbrido) y el uso de analíticas de datos a diferentes niveles (aprendizaje, diseño, comunidad) ara facilitar la conciencia de comunidad y la reflexión por los profesores cuando diseñan para generar aprendizajes. La presentación incluirá resultados de varios proyectos de investigación (METIS, CoT, MdM-EDS, RESET, SmartLET, Illuminated).
http://www.upf.edu/web/tide
The Modern Digital Learning Landscape: 5 Tips To Engage Gen Z and Millennial ...Aggregage
If 2020 hasn’t radically changed your approach to your learning program, it’s time to get in the digital learning game or risk being left behind. But if you’re searching for current, new ways to engage people online and keep your business thriving, look to your youngest learners. In the next 5 years, Millennials will comprise 75% of the workforce, and Gen Z is right behind them. To future-proof your learning program, make sure your content is designed with these young professional learners in mind.
The Future of Learning: Embracing Social Learning for SuccessSaba Software
Today, the world is grounded in a vast and dynamic world of information and technology. Organizations
have access to content like never before, compounded by the Web 2.0 movement. This ability to
communicate swiftly evolved into collaboration that has become an intense driver of the “knowledge
economy.”
During the last two years we have seen how knowledge management and leadership development
via learning are being incorporated more frequently as strategies to increase organizational agility.1
Additionally, learning organizations that act as strategic enablers for the business are more focused on
connecting people to people and content through knowledge management and social technology.
Saba Software partnered with Human Capital Media (HCM) Advisory Group to better understand how
business is taking advantage of social learning. In the 2013 survey, HCM examined how organizations are
approaching social learning, which methods have proven to be successful and where challenges are experienced.
Educator-NICs: Envisaging the Future of ICT–enabled Networked Improvement Communities
Learning Emergence Workshop • University of Bristol • 20th May 2014
E-Learning in the university: When will it really happen?eLearning Papers
eLearning has enormous potential in education, and there is an urgent need to take stock of the possibilities that it offers. Despite this urgency, research on eLearning is still in a nascent stage and there is a degree of conceptual confusion in the field that is difficult to tolerate.
Authors: Ann-Louise Davidson, David Waddington,
Literature in digital environments: Changes and emerging trends in Australian...Judy O'Connell
Igniting a passion for reading and research is core business for school libraries, inevitably placing the library at the centre of the 21st century reading and learning experience. It is in this context that digital literature creates some challenging questions for teachers and librarians in schools, while the emergence of digital technology and/or device options also offers a great many opportunities. Collection development in school libraries encompasses an understanding of the need to contextualise these e-literature needs within the learning and teaching experiences in the school. The Australian Library and Information Association’s 2013 statement Future of collections 50:50 predicted that library print and ebook collections in libraries would establish a 50:50 equilibrium by 2020 and that this balance would be maintained for the foreseeable future. This statement from the Australian professional body raised the need to know more about e-collections in school libraries. For teacher librarians in Australian schools, the nature of online collections, and the integration of ebooks into the evolving reading culture is influenced by the range and diversity of texts, interfaces, devices, and experiences available to complement existing print and media collections or services. Management and budget constraints also influence e-collections. By undertaking a review of the literature, a discussion of the education context, and a critical analysis of the trends evidenced by national survey data, this paper presents an overview of the changes and emerging trends in digital literature and ebook collections in school library services in Australia today.
ICO Fall School 2012, Santuari de Santa Maria del Collell, Gironahttps://sites.google.com/site/icofallschool2012
A week long PhD training school for educational and ed-tech researchers
Invited talk, INSIGHT Centre for Data Analytics, Univ. Galway, 2 Oct 2013, http://www.insight-centre.org
Abstract:
Data and analytics are transforming how organisations work in all sectors. While there are clearly ethical issues around big data and privacy, there may also be an argument that educational institutions have a moral obligation to use all the information they have to maximize the learner's progress. So, assuming education can't (arguably shouldn't) resist this revolution, the question is how to harness this new capability intelligently. Learning Analytics is an exploding research field and startup market: do leaders know what to ask when the vendors roll up with dazzling dashboards? In this talk I'll provide an overview of developments, and consider some of the key questions we should be asking. Like any modelling technology and accounting system, analytics are not neutral, and do not passively describe sociotechnical reality: they begin to shape it. Moreover, they start with the things that are easiest to count, which doesn't necessarily equate to the things we value in learning. Given the crisis in education at many levels, what realities do we want analytics to perpetuate, or bring into being?
Bio:
Simon Buckingham Shum is Professor of Learning Informatics at the UK Open University's Knowledge Media Institute. He researches, teaches and consults on Learning Analytics, Collective Intelligence and Argument Visualization. His background is B.Sc. Psychology, M.Sc. Ergonomics and Ph.D. Human-Computer Interaction. He co-edited Visualizing Argumentation (Springer 2003), the standard reference in the field, followed by Knowledge Cartography (2008). In the field of Learning Analytics, he served as Program Co-Chair of the 2nd International Learning Analytics LAK12 conference, chaired the LAK13 Discourse-Centric Learning Analytics workshop, and the LASI13 Dispositional Learning Analytics workshop. He is a co-founder of the Society for Learning Analytics Research, Compendium Institute, LearningEmergence.net, and was Co-Founder and General Editor of the Journal of Interactive Media in Education. He serves on the Advisory Groups for a variety of learning analytics initiatives in education and enterprise, and is a Visiting Fellow at University of Bristol Graduate School of Education. Contact him via http://simon.buckinghamshum.net
Webinar: Learning Informatics Lab, University of Minnesota
Replay the talk: https://youtu.be/dcJZeDIMr2I
Learning Informatics
AI • Analytics • Accountability • Agency
Simon Buckingham Shum
Professor of Learning Informatics
Director, Connected Intelligence Centre
University of Technology Sydney
Abstract:
“Health Informatics”. “Urban Informatics”. “Social Informatics”. Informatics offers systemic ways of analyzing and designing the interaction of natural and artificial information processing systems. In the context of education, I will describe some Learning Informatics lenses and practices which we have developed for co-designing analytics and AI with educators and students. We have a particular focus on closing the feedback loop to equip learners with competencies to navigate a complex, uncertain future, such as critical thinking, professional reflection and teamwork. En route, we will touch on how we build educators’ trust in novel tools, our design philosophy of “embracing imperfection” in machine intelligence, and the ways that these infrastructures embody values. Speaking from the perspective of leading an institutional innovation centre in learning analytics, I hope that our experiences spark productive reflection around as the UMN Learning Informatics Lab builds its program.
Biography:
Simon Buckingham Shum is Professor of Learning Informatics at the University of Technology Sydney, where he serves as inaugural director of the Connected Intelligence Centre. CIC is a transdisciplinary innovation centre, using analytics to provide new insights for university teams, with particular expertise in educational data science. Simon’s career-long fascination with software’s ability to make thinking visible has seen him active in communities including Computer-Supported Cooperative Work, Hypertext, Design Rationale, Scholarly Publishing, Semantic Web, Computational Argumentation, Educational Technology and Learning Analytics. The challenge of visualizing contested knowledge has produced several books: Visualizing Argumentation, Knowledge Cartography, and Constructing Knowledge Art. He has been active over the last decade in shaping the field of Learning Analytics, co-founding the Society for Learning Analytics Research, and catalyzing several strands: Social Learning Analytics, Discourse Analytics, Dispositional Analytics and Writing Analytics. http://Simon.BuckinghamShum.net
Technical Challenges for Realizing Learning AnalyticsRalf Klamma
Technical Challenges for Realizing Learning Analytics
Learntec 2015, January 28, 2015, Karlsruhe, Germany,
Ralf Klamma
Advanced Community Informations Systems (ACIS) Group
RWTH Aachen University
Confronting Reality with Big Data & Learning Analytics
We are experiencing an explosion in the quantity of data available online from archives and live streams. Learning Analytics is concerned with how educational research, and learning platform design, can make more effective use of such data (Long & Siemens, 2011). Improving outcomes through the analysis of data is of interest to researchers, administrators, systems architects, social media developers, educators and learners. Analytics are being held up by some as a way to confront, and tackle, the tough new realities of less money, less attention, and higher accountability for quality of learning.
Researchers and vendors are building reporting capabilities into tools that provide unprecedented levels of data on learners. This symposium will show what is possible, and what's coming soon. What objections could possibly be raised to such progress?
However, information infrastructure embodies and shapes worldviews: classification schemes are not only systematic ways to capture and preserve, but also to forget, by virtue of what remains invisible (Bowker & Star, 1999). Learning analytics and recommendation engines are designed with a particular conception of ‘success’, driving the patterns deemed to be evidence of progress, the interventions that are deemed appropriate, the data captured and the rules that fire in software.
This symposium will air some of the critical arguments around the limits of decontextualised data and automated analytics, which often appear reductionist in nature, failing to illuminate higher order learning. There are complex ethical issues around data fusion, and it is not clear to what extent learners are empowered, in contrast to being merely the objects of tracking technology. Educators may also find themselves at the receiving end of a new battery of institutional ‘performance indicators’ that do not reflect what they consider to be authentic learning and teaching.
This Symposium will provide the opportunity to hear a series of brief presentations introducing contrasting perspectives, before the debate is opened to all. Speakers from a cross-section of The Open University will describe how we are connecting datasets, analysing student data and prototyping next generation analytics. Complementing this, JISC will present a national capability perspective, with an update on the JISC CETIS ‘landscape analysis’ of the field, which will clarify potential benefits, issues to consider, and help institutions to assess their current capability and possible next steps.
Participants will catch up with developments in this fast moving field, through exposure to the possibilities of analytics, as well as issues to be alert to.
Webinar for LearningAnalytics.net Open Course, Feb. 2011, (Athabasca U)
Simon Buckingham Shum
Knowledge Media Institute
Open University UK
http://simon.buckinghamshum.net
http://open.edu
Keynote Address, International Conference of the Learning Sciences, London Festival of Learning
Transitioning Education’s Knowledge Infrastructure:
Shaping Design or Shouting from the Touchline?
Abstract: Bit by bit, a data-intensive substrate for education is being designed, plumbed in and switched on, powered by digital data from an expanding sensor array, data science and artificial intelligence. The configurations of educational institutions, technologies, scientific practices, ethics policies and companies can be usefully framed as the emergence of a new “knowledge infrastructure” (Paul Edwards).
The idea that we may be transitioning into significantly new ways of knowing – about learning and learners – is both exciting and daunting, because new knowledge infrastructures redefine roles and redistribute power, raising many important questions. For instance, assuming that we want to shape this infrastructure, how do we engage with the teams designing the platforms our schools and universities may be using next year? Who owns the data and algorithms, and in what senses can an analytics/AI-powered learning system be ‘accountable’? How do we empower all stakeholders to engage in the design process? Since digital infrastructure fades quickly into the background, how can researchers, educators and learners engage with it mindfully? If we want to work in “Pasteur’s Quadrant” (Donald Stokes), we must go beyond learning analytics that answer research questions, to deliver valued services to frontline educational users: but how are universities accelerating the analytics innovation to infrastructure transition?
Wrestling with these questions, the learning analytics community has evolved since its first international conference in 2011, at the intersection of learning and data science, and an explicit concern with those human factors, at many scales, that make or break the design and adoption of new educational tools. We are forging open source platforms, links with commercial providers, and collaborations with the diverse disciplines that feed into educational data science. In the context of ICLS, our dialogue with the learning sciences must continue to deepen to ensure that together we influence this knowledge infrastructure to advance the interests of all stakeholders, including learners, educators, researchers and leaders.
Speaking from the perspective of leading an institutional analytics innovation centre, I hope that our experiences designing code, competencies and culture for learning analytics sheds helpful light on these questions.
Presents an overview of the learning analytics field touching on the status of the technology, the challenges it faces, the arrival of predictive analytics to education and the best approach towards a successful implementation.
The Generative AI System Shock, and some thoughts on Collective Intelligence ...Simon Buckingham Shum
Keynote Address: Team-based Learning Collaborative Asia Pacific Community (TBLC-APC) Symposium (“Impact of emerging technologies on learning strategies”) 8-9 February 2024, Sydney https://tbl.sydney.edu.au
Slides from my contribution to the panel convened by Jeremy Roschelle at the International Society for the Learning Sciences: Engaging Learning Scientists in Policy Challenges: AI and the Future of Learning
Deliberative Democracy as a strategy for co-designing university ethics aro...Simon Buckingham Shum
Buckingham Shum, S. (2021). Deliberative Democracy as a strategy for co-designing university ethics around analytics and AI in education. AARE2021: Australian Association for Research in Education, 28 Nov. – 2 Dec. 2021
Deliberative Democracy as a Strategy for Co-designing University Ethics Around Analytics and AI in Education
Simon Buckingham Shum
Connected Intelligence Centre, University of Technology Sydney
Universities can see an increasing range of student and staff activity as it becomes digitally visible in their platform ecosystems. The fields of Learning Analytics and AI in Education have demonstrated the significant benefits that ethically responsible, pedagogically informed analysis of student activity data can bring, but such services are only possible because they are undeniably a form of “surveillance”, raising legitimate questions about how the use of such tools should be governed.
Our prior work has drawn on the rich concepts and methods developed in human-centred system design, and participatory/co-design, to design, deploy and validate practical tools that give a voice to non-technical stakeholders (e.g. educators; students) in shaping such systems. We are now expanding the depth and breadth of engagement that we seek, looking to the Deliberative Democracy movement for inspiration. This is a response to the crisis in confidence in how typical democratic systems engage citizens in decision making. A hallmark is the convening of a Deliberative Mini-Public (DMP) which may work at different scales (organisation; community; region; nation) and can take diverse forms (e.g. Citizens’ Juries; Citizens’ Assemblies; Consensus Conferences; Planning Cells; Deliberative Polls). DMP’s combination of stratified random sampling to ensure authentic representation, neutrally facilitated workshops, balanced expert briefings, and real support from organisational leaders, has been shown to cultivate high quality dialogue in sometimes highly conflicted settings, leading to a strong sense of ownership of the DMP's final outputs (e.g. policy recommendations).
This symposium contribution will describe how the DMP model is informing university-wide consultation on the ethical principles that should govern the use of analytics and AI around teaching and learning data.
March 2021 • 24/7 Instant Feedback on Writing: Integrating AcaWriter into yo...Simon Buckingham Shum
Slides accompanying the monthly UTS educator briefing https://cic.uts.edu.au/events/24-7-instant-feedback-on-writing-integrating-acawriter-into-your-teaching-18-march/
What difference could instant feedback on draft writing make to your students? Over the last 5 years the Connected Intelligence Centre has been developing and piloting an automated feedback tool for academic writing (AcaWriter), working closely with academics across several faculties. The research portal documents how educators and students engage with this kind of AI, and what we’ve learnt about integrating it into teaching and assessment.
In May, AcaWriter was launched to all students along with an information portal. Now we want to start upskilling academics, tutors and learning technologists, in a monthly session to give you the chance to learn about AcaWriter, and specifically, good practices for integrating it into your subject. CIC can support you, and we hope you may be interested in co-designing publishable research.
AcaWriter handles several different ‘genres’ of writing, including reflective writing (e.g. a Reflective Essay; Reflective Blogs/Journals on internships/work-placements) and analytical writing (e.g. Argumentative Essays; Research Abstracts & Introductions). This briefing will demo AcaWriter, and show it can be embedded in student activities. We hope this sparks ideas for your own teaching, which we can discuss in more detail.
ICQE20: Quantitative Ethnography Visualizations as Tools for ThinkingSimon Buckingham Shum
Slides for this keynote talk to the 2nd International Conference on Quantitative Ethnography
http://simon.buckinghamshum.net/2021/02/icqe2020-keynote-qe-viz-as-tools-for-thinking/
24/7 Instant Feedback on Writing: Integrating AcaWriter into your TeachingSimon Buckingham Shum
https://cic.uts.edu.au/events/24-7-instant-feedback-on-writing-integrating-acawriter-into-your-teaching-2-dec/
What difference could instant feedback on draft writing make to your students? Over the last 5 years the Connected Intelligence Centre has been developing and piloting an automated feedback tool for academic writing (AcaWriter), working closely with academics across several faculties. The research portal documents how educators and students engage with this kind of AI, and what we’ve learnt about integrating it into teaching and assessment.
In May, AcaWriter was launched to all students along with an information portal. Now we want to start upskilling academics, tutors and learning technologists, in a monthly session to give you the chance to learn about AcaWriter, and specifically, good practices for integrating it into your subject. CIC can support you, and we hope you may be interested in co-designing publishable research.
AcaWriter handles several different ‘genres’ of writing, including reflective writing (e.g. a Reflective Essay; Reflective Blogs/Journals on internships/work-placements) and analytical writing (e.g. Argumentative Essays; Research Abstracts & Introductions).
This briefing will demo AcaWriter, and show it can be embedded in student activities. We hope this sparks ideas for your own teaching, which we can discuss in more detail.
An introduction to argumentation for UTS:CIC PhD students (with some Learning Analytics examples, but potentially of wider interest to students/researchers)
Despite AI’s potential for beneficial use, it creates important risks for Australians. AI, big data, and AI-informed decision making can cause exclusion, discrimination, skill loss, and economic impact; and can affect privacy, security of critical infrastructure and social well-being. What types of technology raise particular human rights concerns? Which human rights are particularly implicated?
Abstract: The emerging configuration of educational institutions, technologies, scientific practices, ethics policies and companies can be usefully framed as the emergence of a new “knowledge infrastructure” (Paul Edwards). The idea that we may be transitioning into significantly new ways of knowing – about learning and learners, teaching and teachers – is both exciting and daunting, because new knowledge infrastructures redefine roles and redistribute power, raising many important questions. What should we see when open the black box powering analytics? How do we empower all stakeholders to engage in the design process? Since digital infrastructure fades quickly into the background, how can researchers, educators and learners engage with it mindfully? This isn’t just interesting to ponder academically: your school or university will be buying products that are being designed now. Or perhaps educational institutions should take control, building and sharing their own open source tools? How are universities accelerating the transition from analytics innovation to infrastructure? Speaking from the perspective of leading an institutional innovation centre in learning analytics, I hope that our experiences designing code, competencies and culture for learning analytics sheds helpful light on these questions.
Towards Collaboration Translucence: Giving Meaning to Multimodal Group DataSimon Buckingham Shum
Vanessa Echeverria, Roberto Martinez-Maldonado, and Simon Buck- ingham Shum.. 2019. Towards Collaboration Translucence: Giving Meaning to Multimodal Group Data. In Proceedings of ACM CHI conference (CHI’19). ACM, New York, NY, USA, Paper 39, 16 pages. https://doi.org/10.1145/3290605.3300269
Collocated, face-to-face teamwork remains a pervasive mode of working, which is hard to replicate online. Team members’ embodied, multimodal interaction with each other and artefacts has been studied by researchers, but due to its complexity, has remained opaque to automated analysis. However, the ready availability of sensors makes it increasingly affordable to instrument work spaces to study teamwork and groupwork. The possibility of visualising key aspects of a collaboration has huge potential for both academic and professional learning, but a frontline challenge is the enrichment of quantitative data streams with the qualitative insights needed to make sense of them. In response, we introduce the concept of collaboration translucence, an approach to make visible selected features of group activity. This is grounded both theoretically (in the physical, epistemic, social and affective dimensions of group activity), and contextually (using domain-specific concepts). We illustrate the approach from the automated analysis of healthcare simulations to train nurses, generating four visual proxies that fuse multimodal data into higher order patterns.
Panel held at LAK13: 3rd International Conference on Learning Analytics & Knowledge
http://simon.buckinghamshum.net/2013/03/lak13-edu-data-scientists-scarce-breed
Educational Data Scientists: A Scarce Breed
The Educational Data Scientist is currently a poorly understood, rarely sighted breed. Reports vary: some are known to be largely nocturnal, solitary creatures, while others have been reported to display highly social behaviour in broad daylight. What are their primary habits? How do they see the world? What ecological niches do they occupy now, and will predicted seismic shifts transform the landscape in their favour? What survival skills do they need when running into other breeds? Will their numbers grow, and how might they evolve? In this panel, the conference will hear and debate not only broad perspectives on the terrain, but will have been exposed to some real life specimens, and caught glimpses of the future ecosystem.
Kirsty Kitto, Simon Buckingham Shum, and Andrew Gibson. (2018). Embracing Imperfection in Learning Analytics. In Proceedings of LAK18: International Conference on Learning Analytics and Knowledge, March 5–9, 2018, Sydney, NSW, Australia, pp.451-460. (ACM, New York, NY, USA). https://doi.org/10.1145/3170358.3170413
Open Access: http://simon.buckinghamshum.net/2018/01/embracing-imperfection-in-learning-analytics
Abstract: Learning Analytics (LA) sits at the confluence of many contributing disciplines, which brings the risk of hidden assumptions inherited from those fields. Here, we consider a hidden assumption derived from computer science, namely, that improving computational accuracy in classification is always a worthy goal. We demonstrate that this assumption is unlikely to hold in some important educational contexts, and argue that embracing computational “imperfection” can improve outcomes for those scenarios. Specifically, we show that learner-facing approaches aimed at “learning how to learn” require more holistic validation strategies. We consider what information must be provided in order to reasonably evaluate algorithmic tools in LA, to facilitate transparency and realistic performance comparisons.
Opening to the inaugural workshop on Learning Analytics in Schools held at LAK18: International Conference on Learning Analytics & Knowledge, Sydney. http://lak18.solaresearch.org
Introduction to AI for Nonprofits with Tapp NetworkTechSoup
Dive into the world of AI! Experts Jon Hill and Tareq Monaur will guide you through AI's role in enhancing nonprofit websites and basic marketing strategies, making it easy to understand and apply.
2024.06.01 Introducing a competency framework for languag learning materials ...Sandy Millin
http://sandymillin.wordpress.com/iateflwebinar2024
Published classroom materials form the basis of syllabuses, drive teacher professional development, and have a potentially huge influence on learners, teachers and education systems. All teachers also create their own materials, whether a few sentences on a blackboard, a highly-structured fully-realised online course, or anything in between. Despite this, the knowledge and skills needed to create effective language learning materials are rarely part of teacher training, and are mostly learnt by trial and error.
Knowledge and skills frameworks, generally called competency frameworks, for ELT teachers, trainers and managers have existed for a few years now. However, until I created one for my MA dissertation, there wasn’t one drawing together what we need to know and do to be able to effectively produce language learning materials.
This webinar will introduce you to my framework, highlighting the key competencies I identified from my research. It will also show how anybody involved in language teaching (any language, not just English!), teacher training, managing schools or developing language learning materials can benefit from using the framework.
The French Revolution, which began in 1789, was a period of radical social and political upheaval in France. It marked the decline of absolute monarchies, the rise of secular and democratic republics, and the eventual rise of Napoleon Bonaparte. This revolutionary period is crucial in understanding the transition from feudalism to modernity in Europe.
For more information, visit-www.vavaclasses.com
The Roman Empire A Historical Colossus.pdfkaushalkr1407
The Roman Empire, a vast and enduring power, stands as one of history's most remarkable civilizations, leaving an indelible imprint on the world. It emerged from the Roman Republic, transitioning into an imperial powerhouse under the leadership of Augustus Caesar in 27 BCE. This transformation marked the beginning of an era defined by unprecedented territorial expansion, architectural marvels, and profound cultural influence.
The empire's roots lie in the city of Rome, founded, according to legend, by Romulus in 753 BCE. Over centuries, Rome evolved from a small settlement to a formidable republic, characterized by a complex political system with elected officials and checks on power. However, internal strife, class conflicts, and military ambitions paved the way for the end of the Republic. Julius Caesar’s dictatorship and subsequent assassination in 44 BCE created a power vacuum, leading to a civil war. Octavian, later Augustus, emerged victorious, heralding the Roman Empire’s birth.
Under Augustus, the empire experienced the Pax Romana, a 200-year period of relative peace and stability. Augustus reformed the military, established efficient administrative systems, and initiated grand construction projects. The empire's borders expanded, encompassing territories from Britain to Egypt and from Spain to the Euphrates. Roman legions, renowned for their discipline and engineering prowess, secured and maintained these vast territories, building roads, fortifications, and cities that facilitated control and integration.
The Roman Empire’s society was hierarchical, with a rigid class system. At the top were the patricians, wealthy elites who held significant political power. Below them were the plebeians, free citizens with limited political influence, and the vast numbers of slaves who formed the backbone of the economy. The family unit was central, governed by the paterfamilias, the male head who held absolute authority.
Culturally, the Romans were eclectic, absorbing and adapting elements from the civilizations they encountered, particularly the Greeks. Roman art, literature, and philosophy reflected this synthesis, creating a rich cultural tapestry. Latin, the Roman language, became the lingua franca of the Western world, influencing numerous modern languages.
Roman architecture and engineering achievements were monumental. They perfected the arch, vault, and dome, constructing enduring structures like the Colosseum, Pantheon, and aqueducts. These engineering marvels not only showcased Roman ingenuity but also served practical purposes, from public entertainment to water supply.
Embracing GenAI - A Strategic ImperativePeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Acetabularia Information For Class 9 .docxvaibhavrinwa19
Acetabularia acetabulum is a single-celled green alga that in its vegetative state is morphologically differentiated into a basal rhizoid and an axially elongated stalk, which bears whorls of branching hairs. The single diploid nucleus resides in the rhizoid.
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdfTechSoup
In this webinar you will learn how your organization can access TechSoup's wide variety of product discount and donation programs. From hardware to software, we'll give you a tour of the tools available to help your nonprofit with productivity, collaboration, financial management, donor tracking, security, and more.
1. Ascilite Webinar, Oct 2012
Our Learning Analytics
are Our Pedagogy
Simon Buckingham Shum @
http://twitter.com/sbskmi
Knowledge Media Institute, The Open University UK
http://simon.buckinghamshum.net
1
2. learning objective:
walk out with
better questions
+ lightning overview of learning analytics
+ glimpses of how analytics might nurture
learning for the new terrain we face
2
3. Musicality ≠ Musical Reproduction
In those early days the children were taught from the start to develop
their own voice, whether literally singing, or through the
instrument they played. They were not taught music,
but musicality. Central to this tuition were the partimenti, many
pages of detailed music notes which pose many questions,
but leave the pupil to find the solutions. The
music is not a literal transcript, which the musician reads and reproduces.
set of rules and then
The partimenti establish, at the start, a
pose a set of conflicts for the musician to
resolve, in their own way.
3
http://bit.ly/onmusicality
5. Possibly 90% of the digital data we have
today was generated in the last 2 years
Volume outstrips old infrastructure
Variety Internet of things, e-business transactions, environmental
sensors, social media, audio, video, mobile…
Velocity The speed of data access and analysis is exploding
A quantitative shift on this scale is in fact a qualitative shift, requiring
new ways of thinking about
societal phenomena
5
6. edX: “this is big data, giving us the chance
to ask big questions about learning”
Will the tomorrow’s
educational researcher be
as helpless without an
analytics infrastructure, as
a geneticist without
genome databases, or a
physicist without CERN? 6
7. Lifelogging: explosion of data capture
and sharing about personal activities
http://www.mirror-project.eu
http://quantifiedself.com/guide 7
12. ‘Learning Analytics’ and
‘Academic Analytics’
Long, P. and Siemens, G. (2011), Penetrating the fog: analytics in learning and education. Educause Review Online,
46, 5, pp.31-40. http://www.educause.edu/ero/article/penetrating-fog-analytics-learning-and-education 12
15. Macro/Meso/Micro Learning Analytics
Macro:
region/state/national/international
Meso:
institution-wide
Micro:
individual user actions
(and hence cohort)
Will institutions be dazzled by the
dashboards, or know what
questions to ask at each level?
21. Business Intelligence companies see an
education market opening up
These are pedagogically agnostic:
they seek to optimize operational
efficiency whatever the sector
These may make pedagogical
assumptions: how will learning
design and assessment regimes
shape the analytics they offer?
http://www.sas.com/industry/education/highered 21
22. Business Intelligence companies see an
education market opening up
…but do they know anything about
the roles that language plays in
learning and knowledge
construction? 22
25. Analytics in your VLE:
Blackboard: feedback to students
http://www.blackboard.com/Platforms/Analytics/Overview.aspx
25
26. Purdue University Signals: real time traffic-
lights for students based on predictive model
Premise: academic success is defined as a function of
aptitude (as measured by standardized test scores and
similar information) and effort (as measured by participation
within the online learning environment).
Using factor analysis and logistic regression, a model was
tested to predict student success based on:
• ACT or SAT score
• Overall grade-point average
Predicted 66%-80% • CMS usage composite
of struggling • CMS assessment composite
students who • CMS assignment composite
needed help • CMS calendar composite
Campbell et al (2007). Academic Analytics: A New Tool for a New Era, EDUCAUSE
Review, vol. 42, no. 4 (July/August 2007): 40–57. http://bit.ly/lmxG2x 26
27. Desire2Learn visual analytics & predictive models
which can be interrogated on different dimensions
http://www.desire2learn.com/products/analytics
27
28. Desire2Learn visual analytics & predictive models
which can be interrogated on different dimensions
http://www.desire2learn.com/products/analytics
28
30. Khan Academy: more data to teachers,
finer-grained feedback to students
http://www.thegatesnotes.com/Topics/Education/Sal-Khan-Analytics-Khan-Academy 30
34. Hard distinctions between Learning +
Academic analytics may dissolve
…as they get joined up, each level enriches the others
Macro:
region/state/national/international
Meso:
institution-wide
Micro:
individual user actions
(and hence cohort)
Aggregation of user traces
enriches meso + macro analytics
with finer-grained process data
35. Hard distinctions between Learning +
Academic analytics may dissolve
…as they get joined up, each level enriches the others
Macro:
region/state/national/international
Meso:
institution-wide
Micro:
individual user actions
(and hence cohort)
Aggregation of user traces Breadth + depth from macro
enriches meso + macro analytics + meso levels add power to
with finer-grained process data micro analytics
37. but how do we do
analytics for
this kind of learning?...
37
38. Learning analytics for this?
“We are preparing students for jobs
that do not exist yet, that will use
technologies that have not been
invented yet, in order to solve
problems that are not even
problems yet.”
“Shift Happens”
http://shifthappens.wikispaces.com
38
39. Learning analytics for this?
“While employers continue to demand high academic
standards, they also now want more. They want
people who can adapt, see connections,
innovate, communicate and work with
others. This is true in many areas of work. The new
knowledge-based economies in particular will
increasingly depend on these abilities. Many
businesses are paying for courses to promote creative
abilities, to teach the skills
and attitudes that
are now essential for economic
success…”
All our Futures: Creativity, culture & education, May 1999 39
40. Learning analytics for this?
Think about the analytics
products and initiatives
reviewed above – where
would you locate them
on these dimensions?
Creativity, Culture and
Education (2009)
Changing Young Lives
2012. Newcastle: CCE.
http://www.creativitycultureeducation.org/
changing-young-lives-2012 40
41. Learning analytics for this?
The Knowledge-Agency Window
co-generation
Expert-led enquiry Student-led enquiry
Knowledge
and use
Teaching as
Authenticity
learning design
Agency
Identity
Repetition,
Pre-scribed
Knowledge
Abstraction
Acquisition
Expert-led teaching Student-led revision
Teacher agency Student agency
Ruth Deakin Crick, Univ. Bristol, Centre for Systems Learning & Leadership
“Pedagogy of Hope”: http://learningemergence.net/2012/09/21/pedagogy-of-hope
42. analytics grounded in the
principles of good
assessment
for learning?
(not summative assessment for
grading pupils, teachers,
institutions or nations)
42
43. Assessment for Learning Few learning analytics are
http://assessment-reform-group.org currently able to take o
board the richness of this
original conception of
assessment for learning
43
50. Musicality ≠ Musical Reproduction
In those early days the children were taught from the start to develop
their own voice, whether literally singing, or through the
instrument they played. They were not taught music,
but musicality. Central to this tuition were the partimenti, many
pages of detailed music notes which pose many questions,
but leave the pupil to find the solutions. The
music is not a literal transcript, which the musician reads and reproduces.
set of rules and then
The partimenti establish, at the start, a
pose a set of conflicts for the musician to
resolve, in their own way.
50
http://bit.ly/onmusicality
51. Dispositions are important
“Knowledge of methods alone
will not suffice: there must be
the desire, the will, to employ
them. This desire is an affair
of personal disposition.”
John Dewey, 1933
Dewey, J. How We Think: A Restatement of the Relation of Reflective Thinking to the
Educative Process. Heath and Co, Boston, 1933
51
52. Dispositions are important
“The test of successful education
is not the amount of knowledge
that pupils take away from school,
but their appetite to know and
their capacity to learn.”
Sir Richard Livingstone, 1941
52
53. Dispositions are important
Slide from Guy Claxton: http://www.scribd.com/doc/26685380/Guy-Claxton-Learning-to-Learn
Perkins, D.N., Jay, E., & Tishman, S. (1993). Beyond abilities: A dispositional theory of thinking. Merrill- 53
Palmer Quarterly: Journal of Developmental Psychology, 39(1): 1-21.
54. Dispositions are beginning to register
within the learning analytics community
Brown, M., Learning Analytics: Moving from Concept to Practice. EDUCAUSE Learning Initiative
Briefing, 2012. http://www.educause.edu/library/resources/learning-analytics-moving-concept-practice 54
55. In your experience, what are the qualities
shown by the most effective learners?
Think about the most effective learners you’ve met/
mentored/taught
Not necessarily the highest grade scorers, but the ones
who showed a sustained appetite for learning
What qualities/dispositions/attitudes did they bring?
Type a few key words
into the textchat…
55
56. A ‘visual learning analytic’
7-dimensional spider diagram of how the learner sees themself
Basis for a mentored-
discussion on how the
learner sees him/herself,
and strategies for
strengthening the profile
56
Bristol and Open University are now embedding ELLI in learning software.
57. ELLI: Effective Lifelong Learning Inventory
Web questionnaire 72 items (children and adult versions: used
in schools, universities and workplace)
57
58. Validated as loading onto
7 dimensions of “Learning Power”
Being Stuck & Static Changing & Learning
Data Accumulation Meaning Making
Passivity Critical Curiosity
Being Rule Bound Creativity
Isolation & Dependence Learning Relationships
Being Robotic Strategic Awareness
Fragility & Dependence Resilience
Univ. Bristol and Vital Partnerships provides practitioner resources
and tools to support their application in schools and the workplace 58
59. Learning to Learn: 7 Dimensions of Learning Power
Factor analysis of the literature plus expert interviews: identified seven
dimensions of effective learning power , since validated empirically with
learners at many levels. (Deakin Crick, Broadfoot and Claxton, 2004)
60. Learning to Learn: 7 Dimensions of Learning Power
Factor analysis of the literature plus expert interviews: identified seven
dimensions of effective learning power , since validated empirically with
learners at many levels. (Deakin Crick, Broadfoot and Claxton, 2004)
60
61. Learning Warehouse 2.0 analytics platform
User experience:
Research-validated assessment tools
Researcher interface
Learning Communities
Analytics:
Real time ELLI Analytics reports
Bespoke research reports
Datasets:
>40,000 ELLI profiles
(data from other hosted apps)
61
62. Adding imagery to ELLI dimensions to
connect with learner identity
62
63. Working with Gappuwiyak School, N. Territory AUS
(Ruth Deakin Crick, University of Bristol) http://bit.ly/srUSHE
Changing & Learning: Strategic Awareness:
The Drongo - Guwak Emu - Wurrpan
Meaning Making:
The Pigeon - Nabalawal
Critical Curiosity:
Sea Eagle - Djert
Resilience:
Brolga - Gudurrku
Learning Relationships: Creativity:
The Cockatoo - Ngerrk Bower Bird - Djurwirr 63
65. EnquiryBlogger:
Tuning Wordpress as an ELLI-based learning journal
Standard Wordpress editor
Categories from ELLI
Plugin visualizes
blog categories,
mirroring the ELLI
spider
65
66. Primary School EnquiryBloggers
Bushfield School, Wolverton, UK
EnquiryBlogger: blogging for Learning Power & Authentic Enquiry
http://learningemergence.net/2012/06/20/enquiryblogger-for-learning-power-authentic-enquiry
68. Could a platform generate an
ELLI profile from user traces?
Different social
network patterns
Questioning and
in different
challenging may
contexts may
load onto Critical
load onto
Curiosity
Learning
Relationships
Repeated
Sharing relevant attempts to pass
resources from an online test
other contexts may load onto
may load onto Resilience
Meaning Making
Shaofu Huang: Prototyping Learning Power Modelling in SocialLearn
http://www.open.ac.uk/blogs/SocialLearnResearch/2012/06/20/social-learning-analytics-symposium
69. SocialLearn provides new possibilities of
looking at learners learning
ELLI works from what Now we can observe what
learners say they do they actually do…
Shaofu Huang: Prototyping Learning Power Modelling in SocialLearn
69
http://www.open.ac.uk/blogs/SocialLearnResearch/2012/06/20/social-learning-analytics-symposium
70. ELLI feedbacks inform development of
learning
Educator or
leader s
interventions
Mentored
discussions
Shaofu Huang: Prototyping Learning Power Modelling in SocialLearn
70
http://www.open.ac.uk/blogs/SocialLearnResearch/2012/06/20/social-learning-analytics-symposium
71. How about SocialLearn learning disposition
analytics?
How do these
feedbacks help
people learn?
What and where What kind of feedback
should we look at? should we provide?
Will we still have What is the most appropriate
seven dimensions? way to do it?
Shaofu Huang: Prototyping Learning Power Modelling in SocialLearn
71
http://www.open.ac.uk/blogs/SocialLearnResearch/2012/06/20/social-learning-analytics-symposium
74. Socio-cultural discourse analysis
(Mercer et al, OU)
• Disputational talk, characterised by disagreement and
individualised decision making.
• Cumulative talk, in which speakers build positively but
uncritically on what the others have said.
• Exploratory talk, in which partners engage critically but
constructively with each other's ideas.
Mercer, N. (2004). Sociocultural discourse analysis: analysing classroom talk as a social
mode of thinking. Journal of Applied Linguistics, 1(2), 137-168.
74
75. Socio-cultural discourse analysis
(Mercer et al, OU)
• Exploratory talk, in which partners engage critically but
constructively with each other's ideas.
• Statements and suggestions are offered for joint consideration.
• These may be challenged and counter-challenged, but challenges are
justified and alternative hypotheses are offered.
• Partners all actively participate and opinions are sought and considered
before decisions are jointly made.
• Compared with the other two types, in Exploratory talk knowledge is made
more publicly accountable and reasoning is more visible in the talk.
Mercer, N. (2004). Sociocultural discourse analysis: analysing classroom talk as a social
mode of thinking. Journal of Applied Linguistics, 1(2), 137-168.
75
76. Analytics for identifying Exploratory talk
Elluminate sessions can
be very long – lasting for
hours or even covering
days of a conference
It would be useful if we could
identify where quality learning
conversations seem to be taking
place, so we can recommend
those sessions, and not have to
sit through online chat about
virtual biscuits
Ferguson, R. and Buckingham Shum, S. Learning analytics to identify exploratory dialogue within synchronous text chat. 76
1st International Conference on Learning Analytics & Knowledge (Banff, Canada, 27 Mar-1 Apr, 2011)
77. Defining indicators of Exploratory Talk
Category Indicator
Challenge But if, have to respond, my view
Critique However, I’m not sure, maybe
Discussion of Have you read, more links
resources
Evaluation Good example, good point
Explanation Means that, our goals
Explicit reasoning Next step, relates to, that’s why
Justification I mean, we learned, we observed
Reflections of Agree, here is another, makes the
perspectives of others point, take your point, your view
77
78. Extract classified as Exploratory Talk
Time Contribution
2:42 PM I hate talking. :-P My question was whether "gadgets" were just
basically widgets and we could embed them in various web sites,
like Netvibes, Google Desktop, etc.
2:42 PM Thanks, that's great! I am sure I understood everything, but looks
inspiring!
2:43 PM Yes why OU tools not generic tools?
2:43 PM Issues of interoperability
2:43 PM The "new" SocialLearn site looks a lot like a corkboard where you
can add various widgets, similar to those existing web start pages.
2:43 PM What if we end up with as many apps/gadgets as we have social
networks and then we need a recommender for the apps!
2:43 PM My question was on the definition of the crowd in the wisdom of
crowds we acsess in the service model?
2:43 PM there are various different flavours of widget e.g. Google gadgets,
W3C widgets etc. SocialLearn has gone for Google gadgets 78
79. Discourse analytics on webinar
textchat
Given a 2.5 hour webinar, where in the live
textchat were the most effective learning
conversations?
Not at the start and end of a webinar
Sheffield, UK not as sunny but if we zoom in on a peak… See you!
as yesterday - still warm
bye for now!
Greetings from Hong Kong
bye, and thank you
Morning from Wiltshire,
80
sunny here! Bye all for now
60
40
20
0
9:28
9:32
10:13
11:48
12:00
12:05
12:04
9:36
9:40
9:41
9:46
9:50
9:53
9:56
10:00
10:05
10:07
10:07
10:09
10:17
10:23
10:27
10:31
10:35
10:40
10:45
10:52
10:55
11:04
11:08
11:11
11:17
11:20
11:24
11:26
11:28
11:31
11:32
11:35
11:36
11:38
11:39
11:41
11:44
11:46
11:52
11:54
12:03
-20
-40
Average Exploratory
-60
Wei & He extensions to: Ferguson, R. and Buckingham Shum, S. (2011). Learning Analytics to Identify Exploratory Dialogue within Synchronous
Text Chat. Proc. 1st Int. Conf. Learning Analytics & Knowledge. Feb. 27-Mar 1, 2011, Banff. ACM Press. Eprint: http://oro.open.ac.uk/28955
80. Discourse analytics on webinar
textchat
Given a 2.5 hour
webinar, where in the
live textchat were the
most effective learning
conversations?
Classified as
“exploratory
talk”
(more
substantive
100 for learning)
50
0
9:28
“non-
9:40
9:50
10:00
10:07
10:17
10:31
10:45
11:04
11:17
11:26
11:32
11:38
11:44
11:52
12:03
-50 exploratory”
Averag
-100
Wei & He extensions to: Ferguson, R. and Buckingham Shum, S. (2011). Learning Analytics to Identify Exploratory Dialogue within Synchronous
Text Chat. Proc. 1st Int. Conf. Learning Analytics & Knowledge. Feb. 27-Mar 1, 2011, Banff. ACM Press. Eprint: http://oro.open.ac.uk/28955
81. Discourse analysis (Xerox Incremental Parser)
Detection of salient sentences in scholarly reports,
based on the rhetorical signals authors use:
BACKGROUND KNOWLEDGE: NOVELTY: OPEN QUESTION:
Recent studies indicate … ... new insights provide direct evidence ... … little is known …
… the previously proposed … ... we suggest a new ... approach ... … role … has been elusive
Current data is insufficient …
… is universally accepted ... ... results define a novel role ...
CONRASTING IDEAS: SIGNIFICANCE: SUMMARIZING:
… unorthodox view resolves … studies ... have provided important The goal of this study ...
paradoxes … advances Here, we show ...
In contrast with previous Knowledge ... is crucial for ... Altogether, our results ... indicate
hypotheses ... understanding
... inconsistent with past findings ... valuable information ... from studies
GENERALIZING: SURPRISE:
... emerging as a promising approach We have recently observed ...
surprisingly
Our understanding ... has grown
exponentially ... We have identified ... unusual
... growing recognition of the The recent discovery ... suggests Ágnes Sándor & OLnet Project:
http://olnet.org/node/512
intriguing roles
importance ...
De Liddo, A., Sándor, Á. and Buckingham Shum, S., Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine
Annotation Study. Computer Supported Cooperative Work, 21, 4-5, (2012), 417-448. http://oro.open.ac.uk/31052
82. Human and machine analysis of a text for key
contributions
Document 1 19 sentences annotated 22 sentences annotated
11 sentences same as human annotation
Document 2 71 sentences annotated 59 sentences annotated
42 sentences same as human annotation
http://technologies.kmi.open.ac.uk/cohere/2012/01/09/cohere-plus-automated-rhetorical-annotation
De Liddo, A., Sándor, Á. and Buckingham Shum, S., Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine
Annotation Study. Computer Supported Cooperative Work, 21, 4-5, (2012), 417-448. http://oro.open.ac.uk/31052
83. KMi’s Cohere:
a web deliberation platform enabling semantic social
network and discourse network analytics
Rebecca is playing
the role of broker,
connecting 2 peers’
contributions in
meaningful ways
De Liddo, A., Buckingham Shum, S., Quinto, I., Bachler, M. and Cannavacciuolo, L. Discourse-centric learning analytics. 1st
International Conference on Learning Analytics & Knowledge (Banff, 27 Mar-1 Apr, 2011) http://oro.open.ac.uk/25829
84. Discourse Network Analytics =
Concept Network + Social Network Analytics
De Liddo, A., Buckingham Shum, S., Quinto, I., Bachler, M. and Cannavacciuolo, L. Discourse-centric learning analytics. 1st
International Conference on Learning Analytics & Knowledge (Banff, 27 Mar-1 Apr, 2011) http://oro.open.ac.uk/25829
86. “The basic question is not
what can we measure?
The basic question is
what does a good education look like?”
(Gardner Campbell)
http://chronicle.com/blogs/techtherapy/2012/05/02/episode-95-learning-analytics-could-lead-to-wal-martification-of-college
http://lak12.wikispaces.com/Recordings 86
87. Our analytics promote
values, pedagogy and
assessment regimes.
Are we clear which master
our analytics serve? Are we
happy to be judged by them?
87
88. LAnoirblanc.tumblr.com
reactions to Learning Analytics in image and story
Choose an image and email it to the site with your story…
Instructions: h"p://www.educause.edu/sites/default/files/library/presenta7ons/ELI124/GS13/LAnoirblanc.pdf