Skip to content

parser: Add IANA time_zone support for native timestamps #11913

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
edsiper merged 17 commits into from
Jun 4, 2026
Merged

parser: Add IANA time_zone support for native timestamps #11913

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
8c61f77
parser: Handle IANA compatible time zone configurations
cosmo0920 Jun 4, 2026
ca43f2c
parser_json: Follow API signature change
cosmo0920 Jun 4, 2026
fca9aef
parser_logfmt: Follow API signature change
cosmo0920 Jun 4, 2026
42da06c
parser_ltsv: Follow API signature change
cosmo0920 Jun 4, 2026
29c3dce
parser_regex: Follow API Signature change
cosmo0920 Jun 4, 2026
06d155e
tests: internal: parser: Add test cases for IANA compatible looking u…
cosmo0920 Jun 4, 2026
e466b8e
tests: internal: parser_regex: Add test cases for IANA compabitle TZ …
cosmo0920 Jun 4, 2026
80a4f95
tests: integration: Add test cases for handling TZ with in_tail
cosmo0920 Jun 4, 2026
d672a3c
tests: internal: parser: Enable parser internal cases on Windows
cosmo0920 Jun 4, 2026
3aa2b91
github: workflows: Remove the line of disabling internal parser test …
cosmo0920 Jun 4, 2026
1a04aba
parser: Add existence check for tzinfo database
cosmo0920 Jun 4, 2026
0726546
tests: internal: parser: Add existence check for TZ database
cosmo0920 Jun 4, 2026
f207496
tests: internal: parser_regex: Add existence check for TZ database
cosmo0920 Jun 4, 2026
791d8fa
tests: integration: Add an existence check for tzinfo db
cosmo0920 Jun 4, 2026
bc94dbe
parser: Plug issues on parsing time zone
cosmo0920 Jun 4, 2026
5ebf14e
tests: internal: parser: Add a test case for missing year handling
cosmo0920 Jun 4, 2026
6a16277
parser: Introduce caching mechanism for specified timezone
cosmo0920 Jun 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .github/workflows/call-windows-unit-tests.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -216,7 +216,6 @@ jobs:
-D FLB_WITHOUT_flb-rt-out_forward=On `
-D FLB_WITHOUT_flb-rt-in_disk=On `
-D FLB_WITHOUT_flb-rt-in_proc=On `
-D FLB_WITHOUT_flb-it-parser=On `
Comment thread
patrick-stephens marked this conversation as resolved.
-D FLB_WITHOUT_flb-it-unit_sizes=On `
-D FLB_WITHOUT_flb-it-network=On `
-D FLB_WITHOUT_flb-it-pack=On `
Expand Down
20 changes: 20 additions & 0 deletions include/fluent-bit/flb_parser.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,8 @@ struct flb_parser {
char *time_key; /* field name that contains the time */
int time_offset; /* fixed UTC offset */
int time_system_timezone; /* use the system timezone as a fallback */
char *time_zone; /* IANA timezone for naive timestamps */
void *time_zone_data; /* parsed native timezone data */
int time_keep; /* keep time field */
int time_strict; /* parse time field strictly */
int logfmt_no_bare_keys; /* in logfmt parsers, require all keys to have values */
Expand Down Expand Up @@ -91,6 +93,8 @@ static inline time_t flb_parser_tm2time(const struct flb_tm *src,
return res;
}

time_t flb_parser_tm2time_parser(const struct flb_tm *src,
struct flb_parser *parser);

struct flb_parser *flb_parser_create(const char *name, const char *format,
const char *p_regex,
Expand All @@ -105,6 +109,22 @@ struct flb_parser *flb_parser_create(const char *name, const char *format,
int types_len,
struct mk_list *decoders,
struct flb_config *config);
struct flb_parser *flb_parser_create_with_time_zone(const char *name,
const char *format,
const char *p_regex,
int skip_empty,
const char *time_fmt,
const char *time_key,
const char *time_offset,
int time_keep,
int time_strict,
int time_system_timezone,
const char *time_zone,
int logfmt_no_bare_keys,
struct flb_parser_types *types,
int types_len,
struct mk_list *decoders,
struct flb_config *config);
int flb_parser_conf_file_stat(const char *file, struct flb_config *config);
int flb_parser_conf_file(const char *file, struct flb_config *config);
int flb_parser_load_parser_definitions(const char *cfg, struct flb_cf *cf,
Expand Down
Loading
Loading