• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
RepliCHI 2012 SIG @ CHI2012
 

RepliCHI 2012 SIG @ CHI2012

on

  • 728 views

slides from the RepliCHI SIG @ #chi2012 talking about Replication at #chi2013 onwards

slides from the RepliCHI SIG @ #chi2012 talking about Replication at #chi2013 onwards

Statistics

Views

Total Views
728
Views on SlideShare
709
Embed Views
19

Actions

Likes
0
Downloads
1
Comments
0

1 Embed 19

http://us-w1.rockmelt.com 19

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    RepliCHI 2012 SIG @ CHI2012 RepliCHI 2012 SIG @ CHI2012 Presentation Transcript

    • CHI2011 Panel CHI2012 SIG CHI2013 ? CHI2014 RepliCHI ? How to tackle replication of HCI research. Thinking forward. CHI2015 ?Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel Why discuss replication? CHI2012 SIG • Replication is a corner-stone of good science CHI2013 We’re not all ? scientists tho! CHI2014 ? CHI2015 ? • We should facilitate it - but we do not (do we?)Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel Why discuss replication? CHI2012 SIG • We live in a global community - but run studies locally CHI2013 ? CHI2014 ? CHI2015 ? • Does all research apply cross-culturally?Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel Why discuss replication? CHI2012 SIG • Technology moves fast - duh. CHI2013 ? CHI2014 ? CHI2015 ? • Do all findings still apply?Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel But its a problem CHI2012 SIG • Data, software, and people might be CHI2013 proprietary ? • Minor differences in study CHI2014 methods or tools might ? create an effect • Methods and tools are hard to reproduce exactly CHI2015 ? • There may be no benefit / outcomeDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel But its a problem CHI2012 SIG CHI2013 • Can you imaging publishing a paper thats not novel work? ? • Can you imagine getting a review saying: incremental CHI2014 • Novelty and significance are key review criteria ? • TOCHI “publishes only original and significant research CHI2015 papers.” ?Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel It’s a bit scary too CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ? • Can create conflict, and doubtDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel We should talk about it CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ? • So we did - we are - and hopefully we willDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel The 2011 panel CHI2012 SIG CHI2013 ? CHI2014 ? - Most Importantly - • We had an excellent audience and lots of questions CHI2015 • but not enough discussion ?Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel Today CHI2012 SIG • We want to talk to you more • And we’ve got some important people to listen CHI2013 ? • CHI2012 Program co-chair CHI2014 • CHI2013 Conference Chair ? • TOCHI Information Director CHI2015 • CHI2014 Conference co-chair ? • SIGCHI VP PublicationsDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel The future? CHI2012 SIG • A route to publication - extended abstract CHI2013 ? • A venue to talk about replication - openly CHI2014 • Motivation / Reason / Reward for replicating research ? • A mature community that checks / validates itself CHI2015 • A place where people look to for updates ? RepliCHIDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ? RepliCHIDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel CHI2012 RepliCHI SIG • Invites Extended Abstracts CHI2013 ? • About the attempt (more so than the research) • Submitted around time of alt.chi CHI2014 ? • Presented discussed in a whole day event (like DocCon) • Some portion presenting in the main proceedings CHI2015 ?Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel CHI2012 RepliCHI SIG • Invites Extended Abstracts CHI2013 ? • About the attempt (more so than the research) • Submitted around time of alt.chi CHI2014 ? • Presented discussed in a whole day event (like DocCon) • Some portion presenting in the main proceedings CHI2015 ? Now: we break/improve the ideaDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel Questions? CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ?Dr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12
    • CHI2011 Panel Today then CHI2012 SIG CHI2013 • ~10 mins - an intro ? • ~10 mins - the questions CHI2014 ? • ~30 mins - in working groups • ~20 mins - feedback/discussion CHI2015 ? • ~10 mins - wrap upDr Max L. Wilson drmaxlwilson@gmail.comTuesday, 29 May 12