Skip to content

Latest commit

 

History

History
28 lines (21 loc) · 1.06 KB

README.md

File metadata and controls

28 lines (21 loc) · 1.06 KB
Raw

Cloud Computing 2021 Experiment

This folder contains Cloud Computing 2021 Experiment submission files. Please check Report.pdf for details.

File Structure

  • image-buildscript: For building custom mirror
  • HuaweiCloud-openAPI: For Creating Virtual Machines
  • WordCount: WordCount source file and results
  • GraphX: Connected Component sources
  • PageRank: Page Rank sources
  • Report.pdf: The report PDF file

Run GraphX Connected Components

  • Copy the entire dir GraphX on to VM
  • run under GraphX : sbt package
  • upload two txt files onto HDFS data/graphx folder
  • run spark-submit --class "org.apache.spark.examples.graphx.ConnectedComponentsExample" target/scala-2.12/graphx-connected-component_2.12-1.0.jar
  • See the results in STDOUT.

Run PageRank

  • Copy the entire dir PageRank on to VM
  • run under PageRank : sbt package
  • upload three txt files onto HDFS data folder
  • run spark-submit --class "PageRankWiki" target/scala-2.12/graphx-pagerank-wiki-users_2.12-1.0.jar
  • See the results in STDOUT.