Skip to content

feat(dataset-updater): Virtues PT Wikipedia links (186/223) - #246

Merged
clusterManager-Myia merged 1 commit into
masterfrom
feat/virtues-pt-wikipedia-links
May 4, 2026
Merged

feat(dataset-updater): Virtues PT Wikipedia links (186/223)#246
clusterManager-Myia merged 1 commit into
masterfrom
feat/virtues-pt-wikipedia-links

Conversation

@jsboige

@jsboige jsboige commented May 1, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add dedicated DatasetUpdater task for generating Portuguese Wikipedia links from FR/EN interlanguage references
  • 186/223 Virtues entries now have valid link_pt (83.4% coverage, up from ~0%)
  • New prompt pair (PromptVirtuesLinksPtUser/Assistant) instructs model to use Wikipedia interlanguage links and leave empty if PT article doesn't exist

Files changed

  • DatasetUpdaterRootConfig.cs — new "Generate Virtues Portuguese Wikipedia links" config (47 lines, Enabled=false by default)
  • PromptVirtuesLinksPtUser.txt — user prompt with Wikipedia interlanguage strategy
  • PromptVirtuesLinksPtAssistant.txt — assistant acknowledgment prompt
  • Argumentum Virtues - Taxonomy.csv — 186 link_pt fields populated with https://pt.wikipedia.org/wiki/... URLs

Test plan

  • dotnet build passes
  • DatasetUpdater ran successfully: 186/223 link_pt filled
  • CSV encoding: UTF-8 no-BOM confirmed
  • No modifications to other fields (title_pt, description_pt, etc.)

🤖 Generated with Claude Code

… 83.4%)

New DatasetUpdater config for generating Portuguese Wikipedia links from
FR/EN interlanguage links. Result: 186/223 link_pt filled (83.4% coverage).

- Add PromptVirtuesLinksPtUser/Assistant prompt pair
- Add "Generate Virtues Portuguese Wikipedia links" config (Enabled=false)
- Update Virtues Taxonomy CSV with 186 PT Wikipedia URLs
- Uses gpt-5.4-mini with SelectEmptyTargets=true for empty-only fill

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

@clusterManager-Myia clusterManager-Myia left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

APPROVE — Clean dataset enrichment PR.

  • DatasetUpdater config properly set Enabled=false by default (opt-in)
  • Prompt pair is clear: use Wikipedia interlanguage links, leave empty if PT article doesn't exist
  • 186/223 coverage (83.4%) is reasonable — the remaining 17% are genuinely missing PT Wikipedia articles
  • CSV encoding verified UTF-8 no-BOM
  • No modifications to other fields (title_pt, description_pt, etc.)

No issues found.

@clusterManager-Myia clusterManager-Myia left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Post-hoc review — Hermes (clusterManager-Myia)

PR #246: Virtues PT Wikipedia links (186/223)

Verdict: ✅ APPROVE

Analyse

  • 186/223 = 83.4% coverage Wikipedia PT pour les Vertus
  • Nouveau config DatasetUpdater (gpt-5.4-mini, function calling)
  • Templates de prompts + données CSV mises à jour
  • Pipeline de traduction cohérent avec les configs FR/EN/RU existants

Observations

  • 37/223 (16.6%) sans lien Wikipedia — acceptable (virtus obscures ou sans page PT)
  • Pipeline clean, pas de données corrompues

Pas de régression.

@clusterManager-Myia

Copy link
Copy Markdown
Collaborator

🔍 Deep Review: PR #246 — Virtues PT Wikipedia links (186/223)

Scope

Updates Virtues Taxonomy CSV with 186 PT Wikipedia links, adds a DatasetUpdater config for generating remaining empty links, and adds prompt templates.

✅ Verified Angles

  • DatasetUpdater config Enabled = false — won't run automatically
  • SelectEmptyTargets = true — only fills empty link_pt fields, safe
  • Prompt template is well-structured with clear constraints (URL encoding, don't guess)
  • UseFunctionCalling = true — uses structured output, good for data integrity
  • Model gpt-5.4-mini — appropriate for link lookup tasks
  • BOM preserved in CSV (starts with pk,...)

🐛 Findings

MEDIUM — 37 out of 223 entries still missing PT Wikipedia links

The PR title says "186/223" which means 37 entries have empty link_pt. For a published multilingual product, this creates an inconsistent user experience. Which 37 are missing should be documented.

Impact: Incomplete i18n coverage.

LOW — Prompt template in French for PT link generation (PromptVirtuesLinksPtUser.txt)

The prompt instructions are written in French ("Instructions de Génération de Liens Wikipedia Portugais") but the target output is Portuguese. While GPT handles multilingual prompts fine, it's an inconsistency with the codebase convention.

Impact: Minor style inconsistency.

LOW — Hardcoded ChunkSize = 8 and MaxDegreeOfParallelismWebService = 4 (DatasetUpdaterRootConfig.cs)

These are reasonable defaults but should be configurable or at least documented why these specific values were chosen for Wikipedia link generation.

INFO — TargetPath uses Windows-relative path (DatasetUpdaterRootConfig.cs)

TargetPath = @".\Target\Datasets\Argumentum Virtues - Taxonomy.csv"

Uses backslash paths. Should work on Windows but won't on Linux/Mac.

📊 Summary

Severity Count
MEDIUM 1
LOW 2
INFO 1

Overall: Clean data update. The 37 missing links should be tracked as a follow-up issue. The DatasetUpdater config is safe (disabled by default). Recommend merging with a TODO to track remaining links.

@clusterManager-Myia
clusterManager-Myia merged commit 4394104 into master May 4, 2026
1 check passed
@jsboige
jsboige deleted the feat/virtues-pt-wikipedia-links branch June 1, 2026 21:42
jsboige added a commit that referenced this pull request Jul 1, 2026
…ue (0 Cards/) (#619)

TERTIAIRE of ai-01 deep-queue supersede (msg-...370u0q). Read-only
scoping of the #202 "bulk EN translation" backlog.

Reframe (stale-dispatch pattern, like #609/#618): #202's Phase-2 bulk
counts (Simple_name_en 1348 empty, political_example 1373 empty) are
2-year-old and contradict the live census.

Census on master 18b4d02:
  - Fallacies core text (desc/example/text x8 langs) = 100% (census #609).
  - Only 6 _en columns total. EN > FR source on the bulk-secondary ones:
      nom_vulgarisé (FR=3%) vs Simple_name_en (EN=4%) -> 25 translatable
      exemple politique (FR=3%) vs political_example_en (EN=2%) -> 10
    => EN cells were curated directly in English; FR SOURCE is ~97% empty.
       Cannot translate content never authored.
  - Genuinely FR->EN translatable residue = ~35 cells total (trivial).
  - Scenarii baratineur leak = 0/167 (Phase-2 resolved). Virtues i18n =
    100% (#218/#236/#246/#290/#295). Rules PT fixed (#306).
  - Real i18n gap = link_* (lane #600/#618, DONE), not text.

Recommendation: close or re-scope #202. The concrete residue is (a) FR
source editorial authoring (lane #191, human, not translation), (b) a
~35-cell micro-pass, (c) link_*/AIF lanes already tracked. Do NOT launch
a bulk EN run — no source to translate on secondary cols, core is 100%.
Memory i18n-coverage-gap-is-link-urls honored (measure FR-relatively).

Scope: docs/taxonomy/202-bulk-en-scoping.md only. 0 write Cards/, 0
AssetConverter code change (pre-tag safe). Base 18b4d02.

Relates to #202, #191, #609, #600, #618.

Co-authored-by: Your <your.email@example.com>
Co-authored-by: Claude-Code <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants