Skip to content
/ WikidataTextEmbedding Public

Convert a Wikidata Item JSON from the REST API to a list of embedded strings

License

MIT license
1 star 1 fork Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

exowanderer/WikidataTextEmbedding

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

177 Commits
.dockerignore
.dockerignore
 
 
.gitignore
.gitignore
 
 
Dockerfile
Dockerfile
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 
check_max_string_df.py
check_max_string_df.py
 
 
docker_go.sh
docker_go.sh
 
 
docker_go_gpu.sh
docker_go_gpu.sh
 
 
docker_purge.sh
docker_purge.sh
 
 
post_process_embed_df.py
post_process_embed_df.py
 
 
requirements.txt
requirements.txt
 
 
run_wikidata_restapi_textification.py
run_wikidata_restapi_textification.py
 
 
run_wikidata_sparql_textification.py
run_wikidata_sparql_textification.py
 
 
wikidata_astrapy_pipeline_from_csv.py
wikidata_astrapy_pipeline_from_csv.py
 
 
wikidata_datadump_item_textification.py
wikidata_datadump_item_textification.py
 
 
wikidata_datadump_statement_textification.py
wikidata_datadump_statement_textification.py
 
 
wikidata_restapi_textification.py
wikidata_restapi_textification.py
 
 
wikidata_sparql_textification.py
wikidata_sparql_textification.py
 
 

Repository files navigation

wikidata_textification

Convert a Wikidata Item JSON from the REST API to a list of embedded strings

To run more efficiently, it would be best to store the QID PID Sqlite3 DB which stores the list of QID and PID labels for rapid ingestion into the WDTextification pipelne.

About

Convert a Wikidata Item JSON from the REST API to a list of embedded strings

Resources

Readme

License

MIT license
Activity

Stars

1 star

Watchers

2 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published

Languages