Rmpiとsnowで並列処理

Rmpi snow 2011 2 27 (@mokjpn)2011 2 27 1

snow2011 2 27 2

“R” Wiki RjpWiki2011 2 27 3

.....2011 2 27 4

....2011 2 27 5

Mac, 8 .... 12 .... R CPU 100%2011 2 27 6

, , 50 ( 5 ) , , , ID, ,2011 2 27 7

2 0.3 ( ) 1 ±90 ( )2011 2 27 8

(5 ) ...50 5 (5 ) 12011 2 27 9

(R , ...) Simple Network of Workstations: snow parLapply2011 2 27 10

snow ”SOCK”, “MPI”, “PVM” , Mac Leopard OpenMPI (/usr/bin/mpirun ) MPI R Rmpi2011 2 27 11

50 sample 5 2 ) system.time (Mac Pro, 2.66GHz Quad-Core Xeon), 4 35.815 6.944 42.481 4 5.226 21.670 26.806 8 5.169 28.009 34.398 2 7.339 23.668 30.8542011 2 27 12

snow > # Rmpi snow > library(Rmpi) > library(snow) > cl <- makeCluster(4, “MPI”) > #( : )..... > stopCluster(cl)2011 2 27 13

all2list <- function(cl, all=fakeall, columns=c("OrderAcceptDate.D","Sex", "Age", "XFT4000", "XQM9800")) { clusterExport(cl,c("all","columns")) id <- paste("P",unique(all$PatientID),sep="") idlist <- as.list(unique(all$PatientID)) names(idlist) <- id parLapply(cl, idlist, function(x) { ctable <- all[which(all$PatientID == x), columns] return(ctable.sorted <- ctable[order(ctable$OrderAcceptDate.D),]) } ) } ※ clusterExport export (RjpWiki “R ” )2011 2 27 14

OrderAcceptDate.D XFT4000 XQM9800 Admission Age Sex PatientID 1 2008-11-11 NA 1.13 55 F 5664297 2 2009-09-11 0.95 0.27 61 M 2989233 3 2010-05-28 0.82 0.92 70 F 3204964 4 2007-08-27 0.21 1.01 38 F 7503779 5 2010-02-18 7.26 0.88 73 M 3090135 6 2010-02-04 0.50 3.30 63 M 7271333 $P2989233 OrderAcceptDate.D Sex Age XFT4000 Admission XQM9800 2009-01-20 M 60 1.09 0.07 2009-02-13 M 60 1.06 0.63 2009-03-03 M 60 0.91 0.27 2009-09-11 M 61 0.95 0.27 2010-05-28 M 61 0.92 0.82 2010-06-25 M 62 1.17 0.33 2010-06-29 M 62 1.10 6.94 ※ID,2011 2 27 15

parLapply lapply function(x) unlist vector rbind parLapply lapply # parLapply : result, : d d <- data.frame() for(n in names(result)) { if(!is.null(a <- result[[n]] )) { d <<- rbind(d,data.frame(name=n, Sex=a$Sex,Age=a$Age, XFT4000=a$XFT4000)) } }2011 2 27 16

Mac R , Rmpi snow parLapply lapply list unlist , $ [[ ]]2011 2 27 17

Rmpi , snow ,R 50 R B5 , ISBN 978-4-489-02097-1 42011 2 27 18

http://d.hatena.ne.jp	538
http://webcache.googleusercontent.com	2
http://translate.googleusercontent.com	1

Rmpiとsnowで並列処理

by mokjpn on Feb 27, 2011

Accessibility

Tags

Upload Details

Usage Rights

3 Embeds 541

Statistics