Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
29df0bf
feat: Add SOURCES.toml for dataset metadata
dsmedia Dec 8, 2024
71456a7
Merge branch 'main' into main
dangotbanned Dec 9, 2024
42b5b25
feat: Migrate sources, licenses and column descriptions out of resour…
dsmedia Dec 10, 2024
dbf4c6f
Merge branch 'main' into main
dangotbanned Dec 10, 2024
5ccfae3
fix: Remove empty `[[resources]]`
dangotbanned Dec 10, 2024
a2b3be0
style: run default `taplo fmt ...`
dangotbanned Dec 10, 2024
1ea2812
style: run `taplo fmt -o "align_entries=true" -o "allowed_blank_lines…
dangotbanned Dec 10, 2024
4ff32cc
style: Use an inline table for `unemployment.tsv` schema
dangotbanned Dec 10, 2024
56e01e9
improve dataset description readability
dsmedia Dec 10, 2024
5f44926
improve dataset description readability
dsmedia Dec 10, 2024
eadf7c5
Reduce line length; move columns to table schema
dsmedia Dec 11, 2024
1ff024c
feat: Integrate `SOURCE.toml`with `datapackage.json`
dangotbanned Dec 11, 2024
6011269
restore URL to single line
dsmedia Dec 12, 2024
e5121d8
fix: avoid breaks in URL and backtick-enclosed strings
dsmedia Dec 12, 2024
7259af4
Remove SOURCES.md in favor of automated generation
dsmedia Dec 12, 2024
e6caa0a
Move and rename SOURCES.toml to _data/datapackage_additions.toml
dsmedia Dec 12, 2024
258ccc8
update filepath of datapackage_additions.toml in build-datapackage.json
dsmedia Dec 13, 2024
dbc1e8d
regenerate datapackage.json following change to _data/datapackage_add…
dsmedia Dec 13, 2024
fbd1be5
refactor(ruff): Fix warnings
dangotbanned Dec 13, 2024
e442c41
style: run `taplo fmt`
dangotbanned Dec 13, 2024
8a00e91
feat: Support multiple sources for package-level metadata
dangotbanned Dec 13, 2024
c0b250a
fix: Removes package-level `[[sources]]`
dangotbanned Dec 13, 2024
b57259c
feat(DRAFT): Generate markdown variants of `datapackage`
dangotbanned Dec 13, 2024
79a30cc
refactor: remove `"both"` option from `output_format`
dangotbanned Dec 13, 2024
80dd7d5
refactor(typing): Always return `Resource` in `ResourceAdapter.from_p…
dangotbanned Dec 13, 2024
51fb7fc
refactor: Remove non-tabular markdown option
dangotbanned Dec 13, 2024
ed5c5c8
feat: Adds `render_markdown_patch`
dangotbanned Dec 13, 2024
20c44f2
feat: Adds template overrides for `Package`, `Resource`
dangotbanned Dec 13, 2024
ea7cbd8
build: generate markdown w/ new templates
dangotbanned Dec 13, 2024
f4c84f7
fix: unpack both sequences during merge
dangotbanned Dec 13, 2024
6c6e575
feat: add link to repo contributors
dangotbanned Dec 13, 2024
6148b8b
fix: correct typo, add link
dangotbanned Dec 13, 2024
6cbe84f
style: Adjust link, date format for markdown
dangotbanned Dec 13, 2024
ed39948
fix: remove unneeded indent
dangotbanned Dec 13, 2024
8b09c39
fix: correct `burtin.json` quote breaks
dangotbanned Dec 13, 2024
9c9eefa
fix: more markdown fixes
dangotbanned Dec 13, 2024
6998e07
fix: move triple quotes to own line
dangotbanned Dec 13, 2024
c97ad7d
refactor: rename `datapackage-tabular.md` -> `datapackage.md`
dangotbanned Dec 14, 2024
d550d8a
docs: Update `README.md` links
dangotbanned Dec 14, 2024
5ce07d5
docs: update description with dataset license information
dsmedia Dec 14, 2024
257bcb7
fix: remove overriden `description`
dangotbanned Dec 14, 2024
35954cf
Merge remote-tracking branch 'upstream/main' into pr/dsmedia/643
dangotbanned Dec 15, 2024
755976f
ci: remove `build_datapackage.py` exclude
dangotbanned Dec 15, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,9 @@ Collection of datasets used in Vega and Vega-Lite examples. This data lives at h

Common repository for example datasets used by Vega related projects. Keep changes to this repository minimal as other projects (Vega, Vega Editor, Vega-Lite, Polestar, Voyager) use this data in their tests and for examples.

The list of sources is in [SOURCES.md](https://github.com/vega/vega-datasets/blob/next/SOURCES.md).
The list of sources is in [datapackage.md](https://github.com/vega/vega-datasets/blob/next/datapackage.md#resources).
This metadata is also available in a machine-readable format at [datapackage.json](https://github.com/vega/vega-datasets/blob/next/datapackage.json).


To access the data in Observable, you can import `vega-dataset`. Try our [example notebook](https://observablehq.com/@vega/vega-datasets). To access these datasets from Python, you can use the [Vega datasets python package](https://github.com/altair-viz/vega_datasets). To access them from Julia, you can use the [VegaDatasets.jl julia package](https://github.com/davidanthoff/VegaDatasets.jl).

Expand Down
423 changes: 0 additions & 423 deletions SOURCES.md

This file was deleted.

966 changes: 966 additions & 0 deletions _data/datapackage_additions.toml

Large diffs are not rendered by default.

15 changes: 15 additions & 0 deletions _data/templates/package-table.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# {{ package.name }}
`{{ package.version }}` | [GitHub]({{ package.homepage }}) | {{ package.created | fmt_date()}}

{{ package.description }}

## licenses
{{ package.licenses | tabulate() }}

## contributors
{{ package.contributors | tabulate() }}

# resources
{% for resource in package.resources %}
{% include 'resource-table.md' %}
{% endfor %}
23 changes: 23 additions & 0 deletions _data/templates/resource-table.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
## `{{ resource.name }}`{% if resource.title %} {{ resource.title }}{% endif %}

{% if resource.path %}
### path
{{ resource.path }}
{% endif %}
{% if resource.description %}
### description
{{ resource.description }}
{% endif %}
{% if resource.schema %}
### schema
{{ resource.schema | filter_dict(exclude=['fields']) | dict_to_markdown(level=2) }}
{{ resource.schema.fields | tabulate() }}
{% endif %}
{% if resource.sources %}
### sources
{{ resource.sources | tabulate() }}
{% endif %}
{% if resource.licenses %}
### licenses
{{ resource.licenses | tabulate() }}
{% endif %}
Loading
Loading