To set up hive-tez on an HDP2 Sandbox VM, log in as root and in this repo, do
# make dist install
That should pull tez, hive-tez, build it and install it locally in ./dist/hive.
Starting LLAP, requires you to have a working install of Apache Slider and a Zookeeper instance used by the YARN registry for co-ordination between nodes.
edit slider-gen.sh to fix your JAVA_HOME, pick your Xmx, container and cache sizing (basic rule = container size > (Xmx + cache)).
Run # ./slider-gen.sh
it generates a run.sh script in the local dir with the configuration for running (including date).
./llap-yarn-<date>/run.sh
Confirm application is running with
yarn top
Alternatively, hive llap status tool can be used to check if all nodes are running llap daemons
./dist/hive/bin/hive --service llapstatus -w
If that fails to startup, check whether you have JDK8 in the right location specified in JAVA_HOME.
Finally, to test this out, you can do
# ./dist/hive/bin/beeline -u jdbc://localhost:<port>/
beeline> select count(1) from sample_07;
and it should use LLAP. Switch in and out with hive.llap.execution.mode
, the execution will switch between container
and llap
.
And for anything you want to override in local settings (like HIVE_CONF_DIR), create a file named local.mk and add the Makefile variables to that file.