Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 6 additions & 4 deletions .github/workflows/master.yml
Original file line number Diff line number Diff line change
Expand Up @@ -53,15 +53,15 @@ jobs:
comment: ["normal"]
include:
- java: 8
spark: '3.2'
spark: '3.3'
spark-archive: '-Dspark.archive.mirror=https://archive.apache.org/dist/spark/spark-3.1.3 -Dspark.archive.name=spark-3.1.3-bin-hadoop3.2.tgz'
exclude-tags: '-Dmaven.plugin.scalatest.exclude.tags=org.scalatest.tags.Slow,org.apache.kyuubi.tags.DeltaTest,org.apache.kyuubi.tags.HudiTest,org.apache.kyuubi.tags.IcebergTest'
comment: 'verify-on-spark-3.1-binary'
- java: 8
spark: '3.2'
spark-archive: '-Dspark.archive.mirror=https://archive.apache.org/dist/spark/spark-3.3.0 -Dspark.archive.name=spark-3.3.0-bin-hadoop3.tgz'
spark: '3.3'
spark-archive: '-Dspark.archive.mirror=https://archive.apache.org/dist/spark/spark-3.2.2 -Dspark.archive.name=spark-3.2.2-bin-hadoop3.2.tgz'
exclude-tags: '-Dmaven.plugin.scalatest.exclude.tags=org.scalatest.tags.Slow,org.apache.kyuubi.tags.DeltaTest,org.apache.kyuubi.tags.HudiTest,org.apache.kyuubi.tags.IcebergTest'
comment: 'verify-on-spark-3.3-binary'
comment: 'verify-on-spark-3.2-binary'
env:
SPARK_LOCAL_IP: localhost
steps:
Expand Down Expand Up @@ -385,10 +385,12 @@ jobs:
kubectl create serviceaccount spark
kubectl create clusterrolebinding spark-role --clusterrole=edit --serviceaccount=default:spark --namespace=default
kubectl get serviceaccount
# TODO Support more Spark version
- name: integration tests
run: >-
./build/mvn ${MVN_OPT} clean install
-Pflink-provided,hive-provided
-Pspark-3.2
Copy link
Contributor Author

@yikf yikf Oct 1, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like that we currently support spark 3.2 only, We should specify the profile here to prevent some incompatibilities (on k8s w/ client mode)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's tricky, what's the specific issue here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In spark on k8s w/ client mode, task deserialization may fail due to inconsistent Jar packages on the Driver and Executor ends

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh sorry, i missed we hardcoded the spark image in code, how about changing it to get from ENV then we can override the in test?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can get the compile Spark version by

SPARK_VERSION=$("$MVN" help:evaluate -Dexpression=spark.version $@ 2>/dev/null\
    | grep -v "INFO"\
    | grep -v "WARNING"\
    | tail -n 1)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I had the idea that we could pass the spark version of the current profile through the maven plugin so that the image version would be consistent with the spark version of the current profile, but I wanted to do this later for two reasons:

  • This is to address the current todo and seems to be unrelated to the current pr
  • The official spark image does not have a sub-version like Spark 3.3.1 https://hub.docker.com/r/apache/spark/tags, the Spark community is currently working on making the spark image the official docker image, maybe we can solve this todo after that?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make sense, thanks

-Pkubernetes-it
-Dtest=none -DwildcardSuites=org.apache.kyuubi.kubernetes.test.spark
- name: Print Driver Pod logs
Expand Down
2 changes: 1 addition & 1 deletion build/release/create-package.sh
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ package_binary() {

echo "Creating binary release tarball ${BIN_TGZ_FILE}"

${KYUUBI_DIR}/build/dist --tgz --spark-provided --flink-provided --hive-provided -Pspark-3.2
${KYUUBI_DIR}/build/dist --tgz --spark-provided --flink-provided --hive-provided

cp "${BIN_TGZ_FILE}" "${RELEASE_DIR}"

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`c_customer_id` STRING NOT NULL
c_customer_id STRING NOT NULL
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`cd_gender` STRING,`cd_marital_status` STRING,`cd_education_status` STRING,`cnt1` BIGINT NOT NULL,`cd_purchase_estimate` INT,`cnt2` BIGINT NOT NULL,`cd_credit_rating` STRING,`cnt3` BIGINT NOT NULL,`cd_dep_count` INT,`cnt4` BIGINT NOT NULL,`cd_dep_employed_count` INT,`cnt5` BIGINT NOT NULL,`cd_dep_college_count` INT,`cnt6` BIGINT NOT NULL
cd_gender STRING,cd_marital_status STRING,cd_education_status STRING,cnt1 BIGINT NOT NULL,cd_purchase_estimate INT,cnt2 BIGINT NOT NULL,cd_credit_rating STRING,cnt3 BIGINT NOT NULL,cd_dep_count INT,cnt4 BIGINT NOT NULL,cd_dep_employed_count INT,cnt5 BIGINT NOT NULL,cd_dep_college_count INT,cnt6 BIGINT NOT NULL
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`customer_id` STRING NOT NULL,`customer_first_name` STRING,`customer_last_name` STRING,`customer_email_address` STRING
customer_id STRING NOT NULL,customer_first_name STRING,customer_last_name STRING,customer_email_address STRING
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING NOT NULL,`i_item_desc` STRING,`i_category` STRING,`i_class` STRING,`i_current_price` DECIMAL(7,2),`itemrevenue` DECIMAL(17,2),`revenueratio` DECIMAL(38,17)
i_item_id STRING NOT NULL,i_item_desc STRING,i_category STRING,i_class STRING,i_current_price DECIMAL(7,2),itemrevenue DECIMAL(17,2),revenueratio DECIMAL(38,17)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`channel` STRING,`i_brand_id` INT,`i_class_id` INT,`i_category_id` INT,`sum(sales)` DECIMAL(38,2),`sum(number_sales)` BIGINT
channel STRING,i_brand_id INT,i_class_id INT,i_category_id INT,`sum(sales)` DECIMAL(38,2),`sum(number_sales)` BIGINT
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`ty_channel` STRING NOT NULL,`ty_brand` INT,`ty_class` INT,`ty_category` INT,`ty_sales` DECIMAL(28,2),`ty_number_sales` BIGINT NOT NULL,`ly_channel` STRING NOT NULL,`ly_brand` INT,`ly_class` INT,`ly_category` INT,`ly_sales` DECIMAL(28,2),`ly_number_sales` BIGINT NOT NULL
ty_channel STRING NOT NULL,ty_brand INT,ty_class INT,ty_category INT,ty_sales DECIMAL(28,2),ty_number_sales BIGINT NOT NULL,ly_channel STRING NOT NULL,ly_brand INT,ly_class INT,ly_category INT,ly_sales DECIMAL(28,2),ly_number_sales BIGINT NOT NULL
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`ca_zip` STRING,`sum(cs_sales_price)` DECIMAL(17,2)
ca_zip STRING,`sum(cs_sales_price)` DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING NOT NULL,`i_item_desc` STRING,`s_state` STRING,`store_sales_quantitycount` BIGINT NOT NULL,`store_sales_quantityave` DOUBLE,`store_sales_quantitystdev` DOUBLE,`store_sales_quantitycov` DOUBLE,`store_returns_quantitycount` BIGINT NOT NULL,`store_returns_quantityave` DOUBLE,`store_returns_quantitystdev` DOUBLE,`store_returns_quantitycov` DOUBLE,`catalog_sales_quantitycount` BIGINT NOT NULL,`catalog_sales_quantityave` DOUBLE,`catalog_sales_quantitystdev` DOUBLE,`catalog_sales_quantitycov` DOUBLE
i_item_id STRING NOT NULL,i_item_desc STRING,s_state STRING,store_sales_quantitycount BIGINT NOT NULL,store_sales_quantityave DOUBLE,store_sales_quantitystdev DOUBLE,store_sales_quantitycov DOUBLE,store_returns_quantitycount BIGINT NOT NULL,store_returns_quantityave DOUBLE,store_returns_quantitystdev DOUBLE,store_returns_quantitycov DOUBLE,catalog_sales_quantitycount BIGINT NOT NULL,catalog_sales_quantityave DOUBLE,catalog_sales_quantitystdev DOUBLE,catalog_sales_quantitycov DOUBLE
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING,`ca_country` STRING,`ca_state` STRING,`ca_county` STRING,`agg1` DECIMAL(16,6),`agg2` DECIMAL(16,6),`agg3` DECIMAL(16,6),`agg4` DECIMAL(16,6),`agg5` DECIMAL(16,6),`agg6` DECIMAL(16,6),`agg7` DECIMAL(16,6)
i_item_id STRING,ca_country STRING,ca_state STRING,ca_county STRING,agg1 DECIMAL(16,6),agg2 DECIMAL(16,6),agg3 DECIMAL(16,6),agg4 DECIMAL(16,6),agg5 DECIMAL(16,6),agg6 DECIMAL(16,6),agg7 DECIMAL(16,6)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`brand_id` INT,`brand` STRING,`i_manufact_id` INT,`i_manufact` STRING,`ext_price` DECIMAL(17,2)
brand_id INT,brand STRING,i_manufact_id INT,i_manufact STRING,ext_price DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`d_week_seq1` INT,`round((sun_sales1 / sun_sales2), 2)` DECIMAL(37,2),`round((mon_sales1 / mon_sales2), 2)` DECIMAL(37,2),`round((tue_sales1 / tue_sales2), 2)` DECIMAL(37,2),`round((wed_sales1 / wed_sales2), 2)` DECIMAL(37,2),`round((thu_sales1 / thu_sales2), 2)` DECIMAL(37,2),`round((fri_sales1 / fri_sales2), 2)` DECIMAL(37,2),`round((sat_sales1 / sat_sales2), 2)` DECIMAL(37,2)
d_week_seq1 INT,`round((sun_sales1 / sun_sales2), 2)` DECIMAL(20,2),`round((mon_sales1 / mon_sales2), 2)` DECIMAL(20,2),`round((tue_sales1 / tue_sales2), 2)` DECIMAL(20,2),`round((wed_sales1 / wed_sales2), 2)` DECIMAL(20,2),`round((thu_sales1 / thu_sales2), 2)` DECIMAL(20,2),`round((fri_sales1 / fri_sales2), 2)` DECIMAL(20,2),`round((sat_sales1 / sat_sales2), 2)` DECIMAL(20,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING NOT NULL,`i_item_desc` STRING,`i_category` STRING,`i_class` STRING,`i_current_price` DECIMAL(7,2),`itemrevenue` DECIMAL(17,2),`revenueratio` DECIMAL(38,17)
i_item_id STRING NOT NULL,i_item_desc STRING,i_category STRING,i_class STRING,i_current_price DECIMAL(7,2),itemrevenue DECIMAL(17,2),revenueratio DECIMAL(38,17)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`w_warehouse_name` STRING,`i_item_id` STRING NOT NULL,`inv_before` BIGINT,`inv_after` BIGINT
w_warehouse_name STRING,i_item_id STRING NOT NULL,inv_before BIGINT,inv_after BIGINT
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_product_name` STRING,`i_brand` STRING,`i_class` STRING,`i_category` STRING,`qoh` DOUBLE
i_product_name STRING,i_brand STRING,i_class STRING,i_category STRING,qoh DOUBLE
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`c_last_name` STRING,`c_first_name` STRING,`sales` DECIMAL(28,2)
c_last_name STRING,c_first_name STRING,sales DECIMAL(28,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`c_last_name` STRING,`c_first_name` STRING,`s_store_name` STRING,`paid` DECIMAL(27,2)
c_last_name STRING,c_first_name STRING,s_store_name STRING,paid DECIMAL(27,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`c_last_name` STRING,`c_first_name` STRING,`s_store_name` STRING,`paid` DECIMAL(27,2)
c_last_name STRING,c_first_name STRING,s_store_name STRING,paid DECIMAL(27,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING NOT NULL,`i_item_desc` STRING,`s_store_id` STRING NOT NULL,`s_store_name` STRING,`store_sales_profit` DECIMAL(17,2),`store_returns_loss` DECIMAL(17,2),`catalog_sales_profit` DECIMAL(17,2)
i_item_id STRING NOT NULL,i_item_desc STRING,s_store_id STRING NOT NULL,s_store_name STRING,store_sales_profit DECIMAL(17,2),store_returns_loss DECIMAL(17,2),catalog_sales_profit DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING NOT NULL,`agg1` DOUBLE,`agg2` DECIMAL(11,6),`agg3` DECIMAL(11,6),`agg4` DECIMAL(11,6)
i_item_id STRING NOT NULL,agg1 DOUBLE,agg2 DECIMAL(11,6),agg3 DECIMAL(11,6),agg4 DECIMAL(11,6)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING,`s_state` STRING,`g_state` TINYINT NOT NULL,`agg1` DOUBLE,`agg2` DECIMAL(11,6),`agg3` DECIMAL(11,6),`agg4` DECIMAL(11,6)
i_item_id STRING,s_state STRING,g_state TINYINT NOT NULL,agg1 DOUBLE,agg2 DECIMAL(11,6),agg3 DECIMAL(11,6),agg4 DECIMAL(11,6)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`B1_LP` DECIMAL(11,6),`B1_CNT` BIGINT NOT NULL,`B1_CNTD` BIGINT NOT NULL,`B2_LP` DECIMAL(11,6),`B2_CNT` BIGINT NOT NULL,`B2_CNTD` BIGINT NOT NULL,`B3_LP` DECIMAL(11,6),`B3_CNT` BIGINT NOT NULL,`B3_CNTD` BIGINT NOT NULL,`B4_LP` DECIMAL(11,6),`B4_CNT` BIGINT NOT NULL,`B4_CNTD` BIGINT NOT NULL,`B5_LP` DECIMAL(11,6),`B5_CNT` BIGINT NOT NULL,`B5_CNTD` BIGINT NOT NULL,`B6_LP` DECIMAL(11,6),`B6_CNT` BIGINT NOT NULL,`B6_CNTD` BIGINT NOT NULL
B1_LP DECIMAL(11,6),B1_CNT BIGINT NOT NULL,B1_CNTD BIGINT NOT NULL,B2_LP DECIMAL(11,6),B2_CNT BIGINT NOT NULL,B2_CNTD BIGINT NOT NULL,B3_LP DECIMAL(11,6),B3_CNT BIGINT NOT NULL,B3_CNTD BIGINT NOT NULL,B4_LP DECIMAL(11,6),B4_CNT BIGINT NOT NULL,B4_CNTD BIGINT NOT NULL,B5_LP DECIMAL(11,6),B5_CNT BIGINT NOT NULL,B5_CNTD BIGINT NOT NULL,B6_LP DECIMAL(11,6),B6_CNT BIGINT NOT NULL,B6_CNTD BIGINT NOT NULL
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING NOT NULL,`i_item_desc` STRING,`s_store_id` STRING NOT NULL,`s_store_name` STRING,`store_sales_quantity` BIGINT,`store_returns_quantity` BIGINT,`catalog_sales_quantity` BIGINT
i_item_id STRING NOT NULL,i_item_desc STRING,s_store_id STRING NOT NULL,s_store_name STRING,store_sales_quantity BIGINT,store_returns_quantity BIGINT,catalog_sales_quantity BIGINT
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`d_year` INT,`brand_id` INT,`brand` STRING,`sum_agg` DECIMAL(17,2)
d_year INT,brand_id INT,brand STRING,sum_agg DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`c_customer_id` STRING NOT NULL,`c_salutation` STRING,`c_first_name` STRING,`c_last_name` STRING,`c_preferred_cust_flag` STRING,`c_birth_day` INT,`c_birth_month` INT,`c_birth_year` INT,`c_birth_country` STRING,`c_login` STRING,`c_email_address` STRING,`c_last_review_date_sk` BIGINT,`ctr_total_return` DECIMAL(17,2)
c_customer_id STRING NOT NULL,c_salutation STRING,c_first_name STRING,c_last_name STRING,c_preferred_cust_flag STRING,c_birth_day INT,c_birth_month INT,c_birth_year INT,c_birth_country STRING,c_login STRING,c_email_address STRING,c_last_review_date_sk BIGINT,ctr_total_return DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`ca_county` STRING,`d_year` INT,`web_q1_q2_increase` DECIMAL(37,20),`store_q1_q2_increase` DECIMAL(37,20),`web_q2_q3_increase` DECIMAL(37,20),`store_q2_q3_increase` DECIMAL(37,20)
ca_county STRING,d_year INT,web_q1_q2_increase DECIMAL(37,20),store_q1_q2_increase DECIMAL(37,20),web_q2_q3_increase DECIMAL(37,20),store_q2_q3_increase DECIMAL(37,20)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_manufact_id` INT,`total_sales` DECIMAL(27,2)
i_manufact_id INT,total_sales DECIMAL(27,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`c_last_name` STRING,`c_first_name` STRING,`c_salutation` STRING,`c_preferred_cust_flag` STRING,`ss_ticket_number` BIGINT NOT NULL,`cnt` BIGINT NOT NULL
c_last_name STRING,c_first_name STRING,c_salutation STRING,c_preferred_cust_flag STRING,ss_ticket_number BIGINT NOT NULL,cnt BIGINT NOT NULL
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`ca_state` STRING,`cd_gender` STRING,`cd_marital_status` STRING,`cd_dep_count` INT,`cnt1` BIGINT NOT NULL,`avg(cd_dep_count)` DOUBLE,`max(cd_dep_count)` INT,`sum(cd_dep_count)` BIGINT,`cd_dep_employed_count` INT,`cnt2` BIGINT NOT NULL,`avg(cd_dep_employed_count)` DOUBLE,`max(cd_dep_employed_count)` INT,`sum(cd_dep_employed_count)` BIGINT,`cd_dep_college_count` INT,`cnt3` BIGINT NOT NULL,`avg(cd_dep_college_count)` DOUBLE,`max(cd_dep_college_count)` INT,`sum(cd_dep_college_count)` BIGINT
ca_state STRING,cd_gender STRING,cd_marital_status STRING,cd_dep_count INT,cnt1 BIGINT NOT NULL,`avg(cd_dep_count)` DOUBLE,`max(cd_dep_count)` INT,`sum(cd_dep_count)` BIGINT,cd_dep_employed_count INT,cnt2 BIGINT NOT NULL,`avg(cd_dep_employed_count)` DOUBLE,`max(cd_dep_employed_count)` INT,`sum(cd_dep_employed_count)` BIGINT,cd_dep_college_count INT,cnt3 BIGINT NOT NULL,`avg(cd_dep_college_count)` DOUBLE,`max(cd_dep_college_count)` INT,`sum(cd_dep_college_count)` BIGINT
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`gross_margin` DECIMAL(37,20),`i_category` STRING,`i_class` STRING,`lochierarchy` TINYINT NOT NULL,`rank_within_parent` INT NOT NULL
gross_margin DECIMAL(37,20),i_category STRING,i_class STRING,lochierarchy TINYINT NOT NULL,rank_within_parent INT NOT NULL
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_item_id` STRING NOT NULL,`i_item_desc` STRING,`i_current_price` DECIMAL(7,2)
i_item_id STRING NOT NULL,i_item_desc STRING,i_current_price DECIMAL(7,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`w_warehouse_sk` BIGINT NOT NULL,`i_item_sk` BIGINT NOT NULL,`d_moy` INT,`mean` DOUBLE,`cov` DOUBLE,`w_warehouse_sk` BIGINT NOT NULL,`i_item_sk` BIGINT NOT NULL,`d_moy` INT,`mean` DOUBLE,`cov` DOUBLE
w_warehouse_sk BIGINT NOT NULL,i_item_sk BIGINT NOT NULL,d_moy INT,mean DOUBLE,cov DOUBLE,w_warehouse_sk BIGINT NOT NULL,i_item_sk BIGINT NOT NULL,d_moy INT,mean DOUBLE,cov DOUBLE
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`w_warehouse_sk` BIGINT NOT NULL,`i_item_sk` BIGINT NOT NULL,`d_moy` INT,`mean` DOUBLE,`cov` DOUBLE,`w_warehouse_sk` BIGINT NOT NULL,`i_item_sk` BIGINT NOT NULL,`d_moy` INT,`mean` DOUBLE,`cov` DOUBLE
w_warehouse_sk BIGINT NOT NULL,i_item_sk BIGINT NOT NULL,d_moy INT,mean DOUBLE,cov DOUBLE,w_warehouse_sk BIGINT NOT NULL,i_item_sk BIGINT NOT NULL,d_moy INT,mean DOUBLE,cov DOUBLE
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`customer_id` STRING NOT NULL,`customer_first_name` STRING,`customer_last_name` STRING,`customer_email_address` STRING
customer_id STRING NOT NULL,customer_first_name STRING,customer_last_name STRING,customer_email_address STRING
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`w_state` STRING,`i_item_id` STRING NOT NULL,`sales_before` DECIMAL(23,2),`sales_after` DECIMAL(23,2)
w_state STRING,i_item_id STRING NOT NULL,sales_before DECIMAL(23,2),sales_after DECIMAL(23,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_product_name` STRING
i_product_name STRING
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`d_year` INT,`i_category_id` INT,`i_category` STRING,`sum(ss_ext_sales_price)` DECIMAL(17,2)
d_year INT,i_category_id INT,i_category STRING,`sum(ss_ext_sales_price)` DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`s_store_name` STRING,`s_store_id` STRING NOT NULL,`sun_sales` DECIMAL(17,2),`mon_sales` DECIMAL(17,2),`tue_sales` DECIMAL(17,2),`wed_sales` DECIMAL(17,2),`thu_sales` DECIMAL(17,2),`fri_sales` DECIMAL(17,2),`sat_sales` DECIMAL(17,2)
s_store_name STRING,s_store_id STRING NOT NULL,sun_sales DECIMAL(17,2),mon_sales DECIMAL(17,2),tue_sales DECIMAL(17,2),wed_sales DECIMAL(17,2),thu_sales DECIMAL(17,2),fri_sales DECIMAL(17,2),sat_sales DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`rnk` INT NOT NULL,`best_performing` STRING,`worst_performing` STRING
rnk INT NOT NULL,best_performing STRING,worst_performing STRING
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`ca_zip` STRING,`ca_county` STRING,`sum(ws_sales_price)` DECIMAL(17,2)
ca_zip STRING,ca_county STRING,`sum(ws_sales_price)` DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`c_last_name` STRING,`c_first_name` STRING,`ca_city` STRING,`bought_city` STRING,`ss_ticket_number` BIGINT NOT NULL,`amt` DECIMAL(17,2),`profit` DECIMAL(17,2)
c_last_name STRING,c_first_name STRING,ca_city STRING,bought_city STRING,ss_ticket_number BIGINT NOT NULL,amt DECIMAL(17,2),profit DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_category` STRING,`i_brand` STRING,`d_year` INT,`d_moy` INT,`avg_monthly_sales` DECIMAL(21,6),`sum_sales` DECIMAL(17,2),`psum` DECIMAL(17,2),`nsum` DECIMAL(17,2)
i_category STRING,i_brand STRING,d_year INT,d_moy INT,avg_monthly_sales DECIMAL(21,6),sum_sales DECIMAL(17,2),psum DECIMAL(17,2),nsum DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`channel` STRING NOT NULL,`item` BIGINT NOT NULL,`return_ratio` DECIMAL(35,20),`return_rank` INT NOT NULL,`currency_rank` INT NOT NULL
channel STRING NOT NULL,item BIGINT NOT NULL,return_ratio DECIMAL(35,20),return_rank INT NOT NULL,currency_rank INT NOT NULL
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`channel` STRING,`id` STRING,`sales` DECIMAL(27,2),`returns` DECIMAL(27,2),`profit` DECIMAL(28,2)
channel STRING,id STRING,sales DECIMAL(27,2),returns DECIMAL(27,2),profit DECIMAL(28,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`s_store_name` STRING,`s_company_id` INT,`s_street_number` STRING,`s_street_name` STRING,`s_street_type` STRING,`s_suite_number` STRING,`s_city` STRING,`s_county` STRING,`s_state` STRING,`s_zip` STRING,`30 days` BIGINT,`31-60 days` BIGINT,`61-90 days` BIGINT,`91-120 days` BIGINT,`>120 days` BIGINT
s_store_name STRING,s_company_id INT,s_street_number STRING,s_street_name STRING,s_street_type STRING,s_suite_number STRING,s_city STRING,s_county STRING,s_state STRING,s_zip STRING,`30 days` BIGINT,`31-60 days` BIGINT,`61-90 days` BIGINT,`91-120 days` BIGINT,`>120 days` BIGINT
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`item_sk` BIGINT,`d_date` DATE,`web_sales` DECIMAL(27,2),`store_sales` DECIMAL(27,2),`web_cumulative` DECIMAL(27,2),`store_cumulative` DECIMAL(27,2)
item_sk BIGINT,d_date DATE,web_sales DECIMAL(27,2),store_sales DECIMAL(27,2),web_cumulative DECIMAL(27,2),store_cumulative DECIMAL(27,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`d_year` INT,`brand_id` INT,`brand` STRING,`ext_price` DECIMAL(17,2)
d_year INT,brand_id INT,brand STRING,ext_price DECIMAL(17,2)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`i_manufact_id` INT,`sum_sales` DECIMAL(17,2),`avg_quarterly_sales` DECIMAL(21,6)
i_manufact_id INT,sum_sales DECIMAL(17,2),avg_quarterly_sales DECIMAL(21,6)
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`segment` INT,`num_customers` BIGINT NOT NULL,`segment_base` INT
segment INT,num_customers BIGINT NOT NULL,segment_base INT
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
* limitations under the License.
*/

`brand_id` INT,`brand` STRING,`ext_price` DECIMAL(17,2)
brand_id INT,brand STRING,ext_price DECIMAL(17,2)
Loading