Machine translation vs. common language: Effects on idea exchange in cross-lingual groups (CSCW 2013)
Machine Translation vs. Common Language: !Effects on Idea Exchange in Cross-Lingual Groups Hao$Chuan)Wang )Na#onalTsingHuaUniversity,Taiwan Susan)R.)Fussell )CornellUniversity,NY,USA Dan)Cosley ) )CornellUniversity,NY,USA ) ACMCSCW2013.SanAntonio,TX,USA ! !
Experimental DesignRandomly)assign)cross$lingual)groups)to)media?on)condi?on) MT-mediated English-mediated American-Chinese Dyad American-Chinese Dyad Brainstorm)two)trials)(15)min)each))) in)counterbalanced)order) “Benefits and costs “Benefits and costs for having an extra for having an extra thumb” eye” Measure) Produc?vity)and)Comprehensibility) ! Wang, Fussell, Cosley ! 8)
Measurement: ProductivityProduc-vity) • Manually)translated)Chinese)contribu?ons)to)English)for) consistency)of)coding • Count)numberoforiginalideasby)manually)coding) brainstorming)conversa?ons) Idea? Original?( How about sleeping, with one eye contac5ng with A pillow? idea 1‐some originality New opportuni5es for business: glasses for the 3 B eyed person. idea 1‐some originality I think sleeping on your side would become the B norm. idea 0‐duplicate A Are we s5ll talking about the advan? no_idea B New hats would need to be made. idea 1‐some originality B sure. no_idea A ok no_idea B haircuts would certainly be modiﬁed. idea 1‐some originality ! Wang, Fussell, Cosley ! 9)
Results: Productivity 14 English MT 12 In)English)groups,)Americans) (na?ve)speaker))produced) 10 more)ideas)than)Chinese)Idea Productivity 8 (non$na?ve)speaker).) 6 4 2 0 American Chinese ! Wang, Fussell, Cosley ! 10)