Installation fails under Rails 4

[aaroncraigongithub]

On a clean installation of Rails 4, I cannot successfully complete the rake installation task.

Here is the complete console output:

vagrant@ubuntu-server-12042-x64-vbox4210:/vagrant/sites/treat-rails$ bundle exec rails c
Loading development environment (Rails 4.1.0)
irb(main):001:0> require 'treat'
=> false
irb(main):003:0> Treat::Core::Installer.install 'english'

Treat Installer, v. 2.0.7


1. Installing core dependencies.

Installing nokogiri...
Fetching: mini_portile-0.5.3.gem (100%)
Fetching: nokogiri-1.6.1.gem (100%)
Building native extensions.  This could take a while...
Warning: couldn't install gem 'nokogiri' (ERROR: Failed to build gem native extension.

    /usr/local/rbenv/versions/2.1.1/bin/ruby extconf.rb
*** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of necessary
libraries and/or headers.  Check the mkmf.log file for more details.  You may
need configuration options.

Provided configuration options:
    --with-opt-dir
    --without-opt-dir
    --with-opt-include
    --without-opt-include=${opt-dir}/include
    --with-opt-lib
    --without-opt-lib=${opt-dir}/lib
    --with-make-prog
    --without-make-prog
    --srcdir=.
    --curdir
    --ruby=/usr/local/rbenv/versions/2.1.1/bin/ruby
extconf.rb:92:in `require': cannot load such file -- mini_portile (LoadError)
    from extconf.rb:92:in `<main>'

extconf failed, exit code 1

Gem files will remain installed in /vagrant/sites/treat-rails/vendor/bundle/ruby/2.1.0/gems/nokogiri-1.6.1 for inspection.
Results logged to /vagrant/sites/treat-rails/vendor/bundle/ruby/2.1.0/extensions/x86_64-linux/2.1.0-static/nokogiri-1.6.1/gem_make.out
).
Installing ferret...
Fetching: ferret-0.11.8.5.gem (100%)
Building native extensions.  This could take a while...
Installing bson_ext...
Fetching: bson-1.10.0.gem (100%)
Fetching: bson_ext-1.10.0.gem (100%)
Building native extensions.  This could take a while...
Installing mongo...
Fetching: mongo-1.10.0.gem (100%)
Installing lda-ruby...
Fetching: shoulda-context-1.2.1.gem (100%)
Fetching: shoulda-matchers-2.6.0.gem (100%)
Fetching: shoulda-3.5.0.gem (100%)
Fetching: lda-ruby-0.3.8.gem (100%)
Building native extensions.  This could take a while...
Installing stanford-core-nlp...
Fetching: rjb-1.4.9.gem (100%)
Building native extensions.  This could take a while...
Fetching: bind-it-0.2.7.gem (100%)
Fetching: stanford-core-nlp-0.5.1.gem (100%)
Installing linguistics...
Fetching: loggability-0.10.1.gem (100%)
Fetching: linguistics-2.0.3.gem (100%)
This library also presents tie-ins for the 'linkparser' and
'wordnet' libraries, which you can enable by installing the
gems of the same name.
Installing ruby-readability...
Fetching: guess_html_encoding-0.0.9.gem (100%)
Fetching: nokogiri-1.6.2.rc2.gem (100%)
Building native extensions.  This could take a while...
Warning: couldn't install gem 'ruby-readability' (ERROR: Failed to build gem native extension.

    /usr/local/rbenv/versions/2.1.1/bin/ruby extconf.rb
Building nokogiri using packaged libraries.
*** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of necessary
libraries and/or headers.  Check the mkmf.log file for more details.  You may
need configuration options.

Provided configuration options:
    --with-opt-dir
    --without-opt-dir
    --with-opt-include
    --without-opt-include=${opt-dir}/include
    --with-opt-lib
    --without-opt-lib=${opt-dir}/lib
    --with-make-prog
    --without-make-prog
    --srcdir=.
    --curdir
    --ruby=/usr/local/rbenv/versions/2.1.1/bin/ruby
    --help
    --clean
    --use-system-libraries
extconf.rb:292:in `require': cannot load such file -- mini_portile (LoadError)
    from extconf.rb:292:in `<main>'

extconf failed, exit code 1

Gem files will remain installed in /vagrant/sites/treat-rails/vendor/bundle/ruby/2.1.0/gems/nokogiri-1.6.2.rc2 for inspection.
Results logged to /vagrant/sites/treat-rails/vendor/bundle/ruby/2.1.0/extensions/x86_64-linux/2.1.0-static/nokogiri-1.6.2.rc2/gem_make.out
).
Installing whatlanguage...
Fetching: whatlanguage-1.0.5.gem (100%)
Installing chronic...
Fetching: chronic-0.10.2.gem (100%)
Installing kronic...
Fetching: kronic-1.1.3.gem (100%)
Installing nickel...
Fetching: nickel-0.1.1.gem (100%)
Installing decisiontree...
Fetching: decisiontree-0.4.0.gem (100%)
Installing rb-libsvm...
Fetching: rb-libsvm-1.1.4.gem (100%)
Building native extensions.  This could take a while...
Installing ruby-fann...
Fetching: ruby-fann-1.2.6.gem (100%)
Building native extensions.  This could take a while...
Installing zip...
Fetching: zip-2.0.2.gem (100%)
Installing loggability...
Installing tf-idf-similarity...
Fetching: tf-idf-similarity-0.1.3.gem (100%)
Building native extensions.  This could take a while...
Installing narray...
Fetching: narray-0.6.0.8.gem (100%)
Building native extensions.  This could take a while...
Warning: couldn't install gem 'narray' (ERROR: Failed to build gem native extension.

    /usr/local/rbenv/versions/2.1.1/bin/ruby extconf.rb
checking for stdint.h... yes
checking for u_int8_t... yes
checking for uint8_t... yes
checking for int16_t... yes
checking for int32_t... yes
checking for u_int32_t... yes
checking for uint32_t... yes
creating narray_config.h
creating Makefile

make "DESTDIR=" clean

make "DESTDIR="
compiling narray.c
compiling na_array.c
compiling na_func.c
compiling na_index.c
na_index.c: In function ‘na_aset_array_index’:
na_index.c:761:10: warning: variable ‘total’ set but not used [-Wunused-but-set-variable]
compiling na_random.c
na_random.c: In function ‘n_bits’:
na_random.c:194:13: warning: variable ‘xu’ set but not used [-Wunused-but-set-variable]
na_random.c: In function ‘na_s_srand’:
na_random.c:164:5: warning: call to ‘ruby_safe_level_4_warning’ declared with attribute warning: $SAFE=4 is obsolete [enabled by default]
/usr/local/rbenv/versions/2.1.1/bin/ruby -I. ./mkop.rb
./mkop.rb:1:in `require': cannot load such file -- mknafunc (LoadError)
    from ./mkop.rb:1:in `<main>'
make: *** [na_op.c] Error 1

make failed, exit code 2

Gem files will remain installed in /vagrant/sites/treat-rails/vendor/bundle/ruby/2.1.0/gems/narray-0.6.0.8 for inspection.
Results logged to /vagrant/sites/treat-rails/vendor/bundle/ruby/2.1.0/extensions/x86_64-linux/2.1.0-static/narray-0.6.0.8/gem_make.out
).
Installing fastimage...
Fetching: addressable-2.3.6.gem (100%)
Fetching: fastimage-1.6.1.gem (100%)
Installing fuzzy-string-match...
Fetching: ZenTest-4.9.5.gem (100%)
Fetching: RubyInline-3.12.2.gem (100%)
Fetching: fuzzy-string-match-0.9.6.gem (100%)
Installing levenshtein-ffi...
Fetching: ffi-1.1.6.pre2.gem (100%)
Building native extensions.  This could take a while...
Fetching: levenshtein-ffi-1.0.3.gem (100%)
Building native extensions.  This could take a while...

2. Installing dependencies for the English language.

Installing rbtagger...
Fetching: rbtagger-0.4.7.gem (100%)
Building native extensions.  This could take a while...
Installing ruby-stemmer...
Fetching: ruby-stemmer-0.9.3.gem (100%)
Building native extensions.  This could take a while...
Installing punkt-segmenter...
Fetching: punkt-segmenter-0.9.1.gem (100%)
Installing tactful_tokenizer...
Fetching: tactful_tokenizer-0.0.2.gem (100%)
Installing nickel...
Installing rwordnet...
Fetching: rwordnet-0.1.3.gem (100%)
Installing uea-stemmer...
Fetching: uea-stemmer-0.10.1.gem (100%)
Installing engtagger...
Fetching: engtagger-0.1.2.gem (100%)
Installing activesupport...
Installing srx-english...
Fetching: term-ansicolor-1.0.7.gem (100%)
Fetching: srx-english-0.1.2.gem (100%)
Installing scalpel...
Fetching: scalpel-0.2.1.gem (100%)
=> nil

Is there a reason that there is a separate rake install task to install these gems instead of just adding them to .gemspec as dependencies?

[louismullie]

(Seems like an rbenv problem with the "dynamic installation" of native extensions. I don't have much time to spend on this right now.

Treat lazily loads all the external dependencies it uses that are not language-agnostic. The reason is a) to avoid clutter, b) to avoid people not being able to install the gem due to compatibility issues and c) to separate our dependency management by language.)

If using Treat in an app, you should be adding the gems you require to your app`s Gemfile. You don't actually need to install any language package if you do this. That way, you only need to install the few (probably 4-5 max) gems you will actually be using, and make sure that these are updated along with the rest of your gems.

Since you're not using the installer, you'll have to manually configure dependencies that use JARs or external binaries (which you would need to do anyways in such a setting). Just look here: http://louismullie.com/treat/ for the necessary files, and see the configuration section of the manual on how to specify the paths.

Here's the Gemfile I use for developing my apps (this has most of the stuff that Treat includes).

gem 'linguistics'
gem 'engtagger'
gem 'open-nlp'
gem 'stanford-core-nlp'
gem 'rwordnet'
gem 'scalpel'
gem 'fastimage'
gem 'decisiontree'
gem 'whatlanguage'
gem 'zip'
gem 'nickel'
gem 'tactful_tokenizer'
gem 'srx-english'
gem 'punkt-segmenter'
gem 'chronic'
gem 'uea-stemmer'
gem 'rbtagger'
gem 'ruby-stemmer'
gem 'activesupport'
gem 'rb-libsvm'
gem 'tomz-liblinear-ruby-swig'
gem 'ruby-fann'
gem 'fuzzy-string-match'
gem 'levenshtein-ffi'
gem 'tf-idf-similarity'
gem 'kronic'

Hope this helps - please keep me updated on your progress.

Louis

[aaroncraigongithub]

Thanks for the quick feedback. I didn't realize that it's possible to use Treat without first running the installer. I'll give your advice a shot and let you know how I get on.

[x44x45x41x4E]

Same issue but using RVM. @louismullie, is your suggestion applicable to mine? It doesn't fail on just one gem like @aaroncraigongithub's. Also, my dev't environment is Rails 4.1.1, Ruby 2.1.2p95 and on OS X 10.9.4. I also created my own gemset for this app. Would that have any conflicts? Here's my error log:

▶ rails c
Loading development environment (Rails 4.1.1)
 :001 > require 'treat'
 => false
 :002 > Treat::Core::Installer.install 'english'

Treat Installer, v. 2.1.0


1. Installing core dependencies.

Installing nokogiri...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'nokogiri' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/nokogiri-1.6.3.1 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/nokogiri-1.6.3.1/gem_make.out
).
Installing ferret...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'ferret' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/ferret-0.11.8.5 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/ferret-0.11.8.5/gem_make.out
).
Installing bson_ext...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'bson_ext' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/bson_ext-1.11.1 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/bson_ext-1.11.1/gem_make.out
).
Installing mongo...
Installing lda-ruby...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'lda-ruby' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/lda-ruby-0.3.8 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/lda-ruby-0.3.8/gem_make.out
).
Installing stanford-core-nlp...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'stanford-core-nlp' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/rjb-1.4.9 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/rjb-1.4.9/gem_make.out
).
Installing linguistics...
This library also presents tie-ins for the 'linkparser' and
'wordnet' libraries, which you can enable by installing the
gems of the same name.
Installing ruby-readability...
Warning: couldn't install gem 'ruby-readability' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/nokogiri-1.6.3.1 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/nokogiri-1.6.3.1/gem_make.out
).
Installing whatlanguage...
Installing chronic...
Installing kronic...
Installing nickel...
Installing decisiontree...
Installing rb-libsvm...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'rb-libsvm' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/rb-libsvm-1.1.5 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/rb-libsvm-1.1.5/gem_make.out
).
Installing ruby-fann...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'ruby-fann' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/ruby-fann-1.2.6 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/ruby-fann-1.2.6/gem_make.out
).
Installing zip...
Installing loggability...
Installing tf-idf-similarity...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'tf-idf-similarity' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby mkrf_conf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

rake failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/tf-idf-similarity-0.1.3 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/tf-idf-similarity-0.1.3/gem_make.out
).
Installing narray...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'narray' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/narray-0.6.0.9 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/narray-0.6.0.9/gem_make.out
).
Installing fastimage...
Installing fuzzy-string-match...
Installing levenshtein-ffi...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'levenshtein-ffi' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/ffi-1.9.3 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/ffi-1.9.3/gem_make.out
).

2. Installing dependencies for the English language.

Installing rbtagger...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'rbtagger' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/rbtagger-0.4.7 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/rbtagger-0.4.7/gem_make.out
).
Installing ruby-stemmer...
Building native extensions.  This could take a while...
Warning: couldn't install gem 'ruby-stemmer' (ERROR: Failed to build gem native extension.

    /Users/dean/.rvm/rubies/ruby-2.1.2/bin/ruby extconf.rb
/Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:92:in `block in materialize': Could not find nokogiri-1.6.3.1 in any of the sources (Bundler::GemNotFound)
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `map!'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/spec_set.rb:85:in `materialize'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:132:in `specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:177:in `specs_for'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/definition.rb:166:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/environment.rb:18:in `requested_specs'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/runtime.rb:13:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler.rb:121:in `setup'
    from /Users/dean/.rvm/gems/ruby-2.1.2@global/gems/bundler-1.7.2/lib/bundler/setup.rb:17:in `<top (required)>'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'
    from /Users/dean/.rvm/rubies/ruby-2.1.2/lib/ruby/2.1.0/rubygems/core_ext/kernel_require.rb:55:in `require'

extconf failed, exit code 1

Gem files will remain installed in /Users/dean/.rvm/gems/ruby-2.1.2@app/gems/ruby-stemmer-0.9.3 for inspection.
Results logged to /Users/dean/.rvm/gems/ruby-2.1.2@app/extensions/x86_64-darwin-13/2.1.0/ruby-stemmer-0.9.3/gem_make.out
).
Installing punkt-segmenter...
Installing tactful_tokenizer...
Installing nickel...
Installing rwordnet...
Installing uea-stemmer...
Installing engtagger...
Installing activesupport...
Installing srx-english...
Installing scalpel...
 => nil

Btw, the rake task treat:install doesn't register when running rake -vT, tried it out and of course it fails.

[louismullie]

Hi @x44x45x41x4E,

You seem to have issues building native C extensions - this is most likely a Ruby issue. Are you able to build any of the missing gems individually using gem install?

The rake task is for development purposes only. You could, however, copy it into your app's Rakefile to get a more CI-friendly way of downloading the language package.

Louis

[x44x45x41x4E]

Hi @louismullie,

Using gem install to install the missing gems works. Should I just put them in my Gemfile or will there be a better workaround that will be the "Treat" way of installing them? And is this the rake task you were talking about? Sorry for not getting back at you earlier.

Thanks

[louismullie]

Here's the rake task: https://github.com/louismullie/treat/blob/febc47a9059d02d1f8c09e8ce2afe2df01cade3a/Rakefile

I don't plan on having the time to investigate this soon. You are welcome to try to fix it an submit a PR if you wish :)