Inted 2010 ugc final


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • The CONCEDE multi-layered quality framework is described below. 1. A first level of quality assurance is based on users’ comments, reviews and ratings in relation to a learning experience taking place within one HE institution. This is a bottom up process, since users decide on whatever grounds they prefer whether a UGC is relevant to their needs. This can be done by letting users rate or comment on the UGC or describe how they have used it. The argument for such an approach would be that quality is not an inherent part of an UGC but contextual. It is only the specific learning situation that determines whether a UGC is useful or not, and therefore the user should be the judge. Moreover, in this way UGC is viewed through various “lenses”, such as professional societies, universities, school boards, publishers, colleagues and peers, and various “criteria”: most popular content, most linked, highest user ratings, and learning assessment rating (OECD, 2007, Giving knowledge for free: the emergence of open educational resources). Users reviews will be linked to their e-portfolios (linked in; social network…), so that peers will be able to contextualise their judgement and reviews. In this way it will be possible to link narrative elements of content creators to UGC: the assumption is that UGC must not be anonymous. A 2.0 environment will be prompted for hosting this process. 2. A second layer of quality assurance is based on institutional quality procedures undertaken by universities. Institutions most probably use internal quality checks and procedures before integrating UGC into learning provisions. Teachers are the main actors of this level. This could be considered a top down process. The third layer is dialogue and negotiations among the representatives of these two levels of quality assurance (i.e. teachers and learners) in order to reach a consensus which determine a synthesis of both layers described above. Dialogue and exchange of practices will take place both in presence and through the ad hoc learning environment
  • Inted 2010 ugc final

    1. 1. QUALITY ASSURANCE OF USER GENERATED CONTENT IN HIGHER EDUCATION Claudio Delrio University of Emilia Romagna (ITALY) Thomas Kretschmer Institute for Innovation in Learning (ILI/FIM) Friedrich-Alexander University of Erlangen-Nuremberg (GERMANY)
    2. 3. Explosion of User Generated Content Time person of the year 2008
    3. 4. Changing faces of e-Learning From Distribution… … to Collaboration and Reflection Transmissive Learning Expansive Learning Learning Management Systems Materials online Presentation Information E-Portfolios Weblogs Communication Collaboration WiKis Communities
    4. 5. The scope <ul><li>The “explosion” of user generated content (UGC) takes place at such a magnitude and extent which go beyond definitory boundaries. However, some common traits can be identified (Adaptation from OECD study on the Participative Web: User Generated Content , 2008 ): </li></ul><ul><ul><li>Publication and sharing: be it on a publicly accessible website, a collaborative project work, or on a page on a social networking site accessible to a selected group of people </li></ul></ul><ul><ul><li>Creative effort: often also has a collaborative element to it, as is the case with websites which users can edit collaboratively. Yet the minimum amount of creative effort is hard to define and depends on the context. </li></ul></ul><ul><ul><li>Creation outside professional contexts: but possibility of feedback into organisational settings . It often does not have an institutional or a commercial market context. Motivating factors include: connecting with peers, achieving a certain level of fame, notoriety, or prestige, and the desire to express oneself. </li></ul></ul><ul><ul><li>Or: </li></ul></ul><ul><ul><li>“ UGC is content produced by the end user” (Wikipedia) </li></ul></ul>
    5. 6. Example 1
    6. 7. Example 2
    7. 8. Universities and UGC (1) <ul><li>There are several inhibiting factors both to the introduction of UGC into higher education and the related development of quality frameworks. Some of them are: </li></ul><ul><ul><li>Lack of time, skills and reward system for teachers and still a significant share of learners </li></ul></ul><ul><ul><li>Reluctance of many teachers to use or create UGC, since they challenge the concept of “authority” </li></ul></ul><ul><ul><li>Ensuring quality of UGC is sometimes perceived as an additional burden instead of a key asset for learning experiences’ enrichment and knowledge management </li></ul></ul><ul><ul><li>Measuring quality of collaborative UGC is not easy due to the difficulty of seizing individual contributions </li></ul></ul><ul><ul><li>The use of UGC for learning is often considered a supplement to traditional pedagogic strategies instead of vehicle of pedagogic and organisational innovation. </li></ul></ul><ul><ul><li>insufficient involvement of stakeholders, policy makers and users in the dialogue on quality into higher education </li></ul></ul>
    8. 9. Universities and UGC (2) <ul><li>Enhancing quality of UGC and ultimately fostering its acceptance into teaching and learning practice is fundamental for universities in their modernisation agenda. </li></ul><ul><li>European Qualifications Framework : </li></ul><ul><ul><li>Emphasis on the recognition of informal and non-formal learning </li></ul></ul><ul><ul><li>Emancipation of qualifications and competences obtained in non-formal settings </li></ul></ul><ul><li>Students will demand it!! </li></ul>
    9. 10. What is the object of quality assessment in the production of UGC and learning 2.0 approaches ? (QMPP, 2009) <ul><li>Activity, behaviour, communication </li></ul><ul><ul><li>Social interaction and networks; process of communication; activity, behaviour, communication </li></ul></ul><ul><li>Process of learning </li></ul><ul><ul><li>Process more important than outcomes; control of activities </li></ul></ul><ul><li>Structure of learning objects </li></ul><ul><ul><li>User satisfaction; standardization; tagging </li></ul></ul>
    10. 11. What are methods and instruments to assess/develop quality in the production of UGC and learning 2.0 approaches? (QMPP, 2009) <ul><li>Self assessment </li></ul><ul><ul><li>Empowerment of learners; supporting system; tools & guidelines </li></ul></ul><ul><li>Peer reviews, external assessment and collaborative dialogue </li></ul><ul><ul><li>Polls, surveys; wisdom of the crowds </li></ul></ul><ul><li>Challenges and problems </li></ul><ul><ul><li>Absence of standards; „garbage-in-garbage-out“-problem </li></ul></ul>
    11. 12. Peers‘ / learners‘ side Peer creation Peer validation Editing Updating Enriching Benchmarking Peer reviews Peer reflections Peer learning Enabling processes Enabling tools Enabling policies Enabling policies
    12. 13. Methods of quality development for eLearning 2.0 (Ehlers 2009) Teachers Evaluations aimed at target group Peers, learning communities Social recommendation Teachers Assessment of e-portfolios Learners with the help of/ feedback by teachers Self-evaluation Quality assessment by Methods of quality development
    13. 14. The CONCEDE quality framework ( Quality Procedures of LEARNERS (discussed through peer reviews, comments and rating) INSTITUTIONAL Quality Procedures (primarily represented by teachers) Dialogue & Negotiation
    14. 15. Partners <ul><li>Institut für Lern-Innovation (ILI) - Friedrich-Alexander-Universität Erlangen-Nürnberg (DE) </li></ul><ul><li>European Federation for Quality in eLearning - EFQUEL (BE) </li></ul><ul><li>HCI Productions Oy (SU) </li></ul><ul><li>Budapest University of Technology and Economics – BME (HU) </li></ul><ul><li>Universitat Oberta de Catalunya - UOC (ES) </li></ul><ul><li>University of Plymouth (UK) </li></ul><ul><li>Portuguese Catholic University (PT) </li></ul><ul><li>MENON Network EEIG (BE) </li></ul>
    15. 16. Thank you for your attention!! <ul><ul><li>[email_address] </li></ul></ul><ul><ul><li> </li></ul></ul><ul><ul><li> </li></ul></ul><ul><ul><li>Skype: kre.fim </li></ul></ul><ul><ul><li>SecondLife: Hildegard Morpork </li></ul></ul><ul><ul><li>Follow-up at the: </li></ul></ul><ul><ul><li>EFQUEL Innovation Forum </li></ul></ul><ul><ul><li>Sept. 8-10, Lisbon (Portugal) </li></ul></ul>