Skip to content

data(fallacies): curate Wikipedia interlanguage links (#333) - #349

Closed
jsboige wants to merge 1 commit into
masterfrom
data/curate-wikipedia-links-333
Closed

data(fallacies): curate Wikipedia interlanguage links (#333)#349
jsboige wants to merge 1 commit into
masterfrom
data/curate-wikipedia-links-333

Conversation

@jsboige

@jsboige jsboige commented May 24, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Queried Wikipedia API langlinks from existing link_en/link_fr Wikipedia URLs to fill 585 missing reference links across 6 languages
  • Only fills empty cells — never overwrites existing values
  • Uses csv.writer(QUOTE_MINIMAL) per validated recipe (no corruption)

New links added

Column Before After Delta
link_ru 26 121 +97
link_pt 2 102 +102
link_es 2 105 +105
link_zh 2 88 +88
link_ar 2 102 +102
link_fa 2 91 +91

Method

  • Python script tmp/curate_wikipedia_links.py queries Wikipedia API in batches of 50 titles
  • Source: 813 unique en.wikipedia.org articles + 54 fr.wikipedia.org articles
  • Interlanguage links obtained server-side, URLs built client-side
  • No LLM involved — only real Wikipedia articles with verified interlanguage links

Also included

Closes #333

Test plan

  • All 1408 rows verified at exactly 102 columns
  • csv.reader parse succeeds with no column misalignment
  • No BOM introduced
  • Only link_* columns modified (no other data touched)

🤖 Generated with Claude Code

…/zh/fa (#333)

Query Wikipedia API langlinks from existing en/fr Wikipedia URLs to fill
585 missing link cells across 6 languages:
- link_ru: +97 (26→121), link_pt: +102 (2→104)
- link_es: +105 (2→107), link_zh: +88 (2→90)
- link_ar: +102 (2→104), link_fa: +91 (2→93)

Also fixes 2 misaligned rows (PK 371, 607) with unquoted commas in desc_fr
(same fix as PR #347, pending merge — included for script independence).

Uses csv.writer(QUOTE_MINIMAL) per validated recipe. All 1408 rows verified
at 102 columns.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@jsboige

jsboige commented May 24, 2026

Copy link
Copy Markdown
Contributor Author

Superseded by rebased version on post-#347 master (PK 371/606 fixed). New PR incoming.

@jsboige jsboige closed this May 24, 2026
@jsboige
jsboige deleted the data/curate-wikipedia-links-333 branch June 1, 2026 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

data(fallacies): curate missing Wikipedia interlanguage reference links (link_ru/pt/ar/es/zh/fa)

1 participant