Environment Variables & Includes

Embulk makes use of Liquid for variables and templating.

The shared config files do not make use of templating, only environment variables. Variables can be exported in your profile. The following are configured for each db.

Variables

See https://www.embulk.org/docs/built-in.html#using-variables

# path setup
export CD_FETCHED="/canvas/data/files-fetched"
export CD_SYNCED="/canvas/data/files-synced"
export CD_UNPACKED="/canvas/data/files-unpacked"

# default timezone
export EMBULK_TZ="America/Los_Angeles"

# mssql
export EMBULK_MSSQL_DRIVER="/driver/path/to/mssql-jdbc-7.2.1.jre8.jar"
export EMBULK_NATIVE_DRIVER="ODBC Driver 17 for SQL Server"
export EMBULK_MSSQLH="host"
export EMBULK_MSSQLHP="1433"
export EMBULK_MSSQLU="user"
export EMBULK_MSSQLP="pass"
export EMBULK_MSSQLDB="database"

# mysql
export EMBULK_MYSQLH="host"
export EMBULK_MYSQLHP="3306"
export EMBULK_MYSQLU="user"
export EMBULK_MYSQLP="pass"
export EMBULK_MYSQLDB="database"

# oracle
export EMBULK_ORACLE_DRIVER="driver/path/to/ojdbc6.jar"
export EMBULK_ORACLEH="host"
export EMBULK_ORACLEHP="1521"
export EMBULK_ORACLEU="user"
export EMBULK_ORACLEP="pass"
export EMBULK_ORACLEDB="servicename"

# postgres
export EMBULK_POSTGRESH="host"
export EMBULK_POSTGRESHP="5432"
export EMBULK_POSTGRESU="user"
export EMBULK_POSTGRESP="pass"
export EMBULK_POSTGRESDB="database"

Includes

See https://www.embulk.org/docs/built-in.html#including-files