How to run python Spark Streaming

Jump to bottom Edit New page

Ken Takagiwa edited this page Jul 17, 2014 · 5 revisions

reduce is not implement yet.

git clone https://github.com/giwa/spark.git

cd spark

sbt/sbt assembly

textStream

./bin/pyspark examples/src/main/python/streaming/wordcount.py path/to/direcotry

socketTextStream

./bin/pyspark examples/src/main/python/streaming/network_wordcount.py localhost 9999