-
Notifications
You must be signed in to change notification settings - Fork 2.1k
Open
Labels
type/bugSomething isn't workingSomething isn't working
Description
Steps to reproduce the behavior (Required)
- Create a bad parquet with a badDateTimeKey, data like:
"57324-01-20 19:28:48+00:00"
- Create table with this badDateTimeKey as partition key
CREATE TABLE IF NOT EXISTS database.tablename (
`someNonImportantKey` STRING,
`badDateTimeKey` DATETIME
)
ENGINE=OLAP
PARTITION BY date_trunc('day', `badDateTimeKey`)
DISTRIBUTED BY HASH(`someNonImportantKey`) BUCKETS 1
ORDER BY (`someNonImportantKey`, `badDateTimeKey`);
- Broker load ingest the parquet file
LOAD LABEL database.`loadLabelName`
(
DATA INFILE("s3a://...bad.parquet
)
WITH BROKER
(
...
)
PROPERTIES
(
"partial_update" = "FALSE",
"max_filter_ratio" = "0",
"timeout" = "72000"
);
Expected behavior (Required)
Fail with reason like: YYYYY format is invalid
Real behavior (Required)
If use the date time field as partition key: we see error: "type:LOAD_RUN_FAIL; msg:txn_id=373425 failed. Text ';389-08-07 00:00:00' could not be parsed at index 0: BE:493858"
If create table withOUT partition key: it will successfully ingest the out of bound datetime as malformed value ';389-08-07 00:00:00' into the table
StarRocks version (Required)
3.4.2
Metadata
Metadata
Assignees
Labels
type/bugSomething isn't workingSomething isn't working