This is python library with a set of tools for extract-map-validate workflows as part of the o2r project:
- schema & documentation of the o2r metadata
- extract - collect meta information from files in a workspace
- broker - translate metadata from o2r to third party schemas
- validate - check if metadata set is valid to the schema
- harvest - collect metadata from external sources via OAI-PMH
- adding new parsers to the program
For their role within o2r, please refer to o2r-architecture.
The full functionality of o2r-meta, including building the documentation and running the tests, requires Python >= 3.7.
git clone https://github.com/o2r-project/o2r-meta.git
cd o2r-meta
pip install -r requirements.txt
pip install -e .
Common pitfall: pygdal version has to match the system GDAL version. Verify the system GDAL version like this:
gdal-config --version
and, if necessary, force pygdal version to be installed as following:
pip install pygdal==x.x.x.x
Another way of installation is provided by the Dockerfile. Build it like this:
git clone https://github.com/o2r-project/o2r-meta.git
cd o2r-meta
docker build -t meta .
And start a tool of o2r-meta like this:
docker run --rm -v $(pwd)/extract/tests/:/testdata:ro meta -debug extract -i /testdata -s
To familiarise with the use of o2r-meta and get access to the How-to guide, we recommend the installation of the documentation before using the tool.
cd docs/
pip install -r requirements-docs.txt
make html
This will create directory build/html under docs, which contains the documentation. The entry point is file index.html.
The o2r-meta tests use pytest. To install the necessary packages:
pip install -U pytest
pip install -U pytest-console-scripts
To run the tests:
cd tests
pytest
To cite this software please use
Nüst, Daniel, 2018. Reproducibility Service for Executable Research Compendia: Technical Specifications and Reference Implementation. Zenodo. doi:10.5281/zenodo.2203843
o2r-meta is licensed under Apache License, Version 2.0, see file LICENSE. Copyright (C) 2016-2020 - o2r project