Skip to content

Spec - Add -1 to Manifest Entry's data_file.record_count to indicate unknown #3284

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kbendick wants to merge 4 commits into from
Closed

Spec - Add -1 to Manifest Entry's data_file.record_count to indicate unknown #3284

Changes from 3 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a204f31
Spec - Add -1 to data_file.record_count to indicate unknown record co…
kbendick Oct 12, 2021
4924662
Remove added period
kbendick Oct 12, 2021
fd501ab
Move -1 to be in description and match the language of row-oriented f…
kbendick Oct 12, 2021
20b9cc3
Simply mention that -1 is unknown without mentioning details
kbendick Oct 13, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion site/docs/spec.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -379,7 +379,7 @@ The schema of a manifest file is a struct called `manifest_entry` with the follo
| _required_ | _required_ | **`100 file_path`** | `string` | Full URI for the file with FS scheme |
| _required_ | _required_ | **`101 file_format`** | `string` | String file format name, avro, orc or parquet |
| _required_ | _required_ | **`102 partition`** | `struct<...>` | Partition data tuple, schema based on the partition spec output using partition field ids for the struct field ids |
| _required_ | _required_ | **`103 record_count`** | `long` | Number of records in this file |
| _required_ | _required_ | **`103 record_count`** | `long` | Number of records in this file. -1 if the count is unknown, for example when importing files directly from row-oriented formats (Avro) |
| _required_ | _required_ | **`104 file_size_in_bytes`** | `long` | Total file size in bytes |
| _required_ | | ~~**`105 block_size_in_bytes`**~~ | `long` | **Deprecated. Always write a default in v1. Do not write in v2.** |
| _optional_ | | ~~**`106 file_ordinal`**~~ | `int` | **Deprecated. Do not write.** |
Expand Down