Installation

Add this line to your application's Gemfile:

gem 'ruby-spark'

And then execute:

$ bundle

Or install it yourself as:

$ gem install ruby-spark

If you are installing gem from filesystem run also rake build.

Install Apache Spark

To install latest supported Spark. Project is build by SBT.

$ ruby-spark build

Options

--hadoop-version	Version of hadoop which will assembled with the Spark
--spark-core-version	Version of Spark core
--spark-version	Version of Spark
--scala-version	Version of Scala
--target	Directory where Spark will be stored. This directory is not saved. For shell use option --target Or on ruby: Spark.load_lib(TARGET)
--only-ext	Build only extension for RubySpark

Default versions is saved on build.rb.