Script de pypsark , leer una fuente de archivo plana.

1. from pyspark import SparkContext,
SparkConf
conf = SparkConf().setAppName("hdfs_test")
sc = SparkContext(conf=conf)
text_file = sc.textFile("hdfs://hanameservice/testzep/prueba2.txt")
counts = text_file.flatMap(lambda line: line.split(" ")).map(lambda word: (word,
1)).reduceByKey(lambda a, b: a + b)
counts.saveAsTextFile("hdfs://hanameservice/testzep/count.txt")
sc.stop()