docs: add comprehensive token count optimization documentation#760
docs: add comprehensive token count optimization documentation#760
Conversation
…json Added tokenCountTree setting with 50000 token threshold to the default configuration. This enables users to see the token count tree structure for files with significant token counts by default. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
Added comprehensive token count optimization section to English website documentation: - Added Token Count Optimization section to usage guide explaining --token-count-tree option - Updated command-line-options page to match README.md structure with proper groupings - Reorganized CLI options into CLI Input/Output Options and Repomix Output Options - Enhanced token count encoding documentation with tiktoken references This brings the website documentation in sync with the token count features added in commit c30b05a. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
Translated the token count optimization documentation from English to all 11 supported languages: - Added Token Count Optimization sections to usage guides in all languages - Updated command-line-options pages with reorganized CLI option groupings - Translated new CLI Input/Output Options and Repomix Output Options sections - Updated File Selection Options terminology across all languages - Enhanced token count encoding descriptions with tiktoken references This ensures consistency across all language versions following the English documentation updates in c1e9939. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
|
Important Review skippedAuto incremental reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the WalkthroughA new Changes
Sequence Diagram(s)sequenceDiagram
participant User
participant CLI
participant Config
participant TokenAnalyzer
User->>CLI: Run with --token-count-tree [threshold]
CLI->>Config: Load tokenCountTree config (default/override)
CLI->>TokenAnalyzer: Analyze project files for token counts
TokenAnalyzer-->>CLI: Return hierarchical token count tree
CLI->>User: Display token count tree (filtered by threshold if set)
Estimated code review effort🎯 2 (Simple) | ⏱️ ~8 minutes Possibly related PRs
✨ Finishing Touches🧪 Generate unit tests
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. 🪧 TipsChatThere are 3 ways to chat with CodeRabbit:
SupportNeed help? Create a ticket on our support page for assistance with any issues or questions. Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (Invoked using PR comments)
Other keywords and placeholders
Documentation and Community
|
|
Claude finished @yamadashy's task —— View job PR Review: Token Count Optimization DocumentationReview Progress:
SummaryThis is an excellent documentation PR that adds comprehensive token count optimization documentation and improves CLI options organization. The changes are well-structured, technically accurate, and consistently translated across all supported languages. Key Strengths📖 Comprehensive Documentation
🎯 Improved Organization
🌐 Translation Quality
⚙️ Configuration Enhancement
Technical Commentswebsite/client/src/en/guide/usage.md:98-128
website/client/src/en/guide/command-line-options.md:6-13
repomix.config.json:22
Minor Issues Found
Recommendations
Overall AssessmentThis is high-quality documentation work that significantly improves user experience. The token count optimization feature is clearly valuable for AI-focused workflows, and this documentation does an excellent job of explaining both how to use it and why it's beneficial. The multi-language translation effort is impressive and maintains consistency across all versions. The CLI options reorganization makes the tool much more approachable for new users. Recommendation: Approve with minor cleanup - fix the duplicate options issue, but otherwise this is ready to merge. |
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Summary of Changes
Hello @yamadashy, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!
This pull request significantly enhances the project's documentation by introducing a comprehensive guide for the --token-count-tree feature, which helps users visualize and optimize token usage. It also reorganizes the command-line options for better clarity and user experience. All new and updated documentation has been translated into 11 supported languages, ensuring broad accessibility. Additionally, a default token count tree threshold has been added to the main configuration file for consistent behavior.
Highlights
- Token Count Optimization Documentation: Comprehensive documentation has been added for the
--token-count-treefeature, explaining its usage, example outputs, threshold filtering, and benefits for optimizing AI interactions. - CLI Options Reorganization: The command-line options documentation has been restructured into logical groups (CLI Input/Output, Repomix Output, File Selection) for improved clarity and user experience. Descriptions for token count encoding have also been enhanced with
tiktokenreferences. - Multi-language Support: All new and updated documentation content, including the token count optimization and CLI option changes, has been translated and integrated across 11 supported languages.
- Configuration Enhancement: A default
tokenCountTreethreshold of50000has been added torepomix.config.jsonto ensure consistent behavior across installations.
Using Gemini Code Assist
The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.
Invoking Gemini
You can request assistance from Gemini at any point in your pull request via creating an issue comment (i.e. comment on the pull request page) using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands.
| Feature | Command | Description |
|---|---|---|
| Code Review | /gemini review |
Performs a code review for the current pull request in its current state. |
| Pull Request Summary | /gemini summary |
Provides a summary of the current pull request in its current state. |
| Comment | @gemini-code-assist | Responds in comments when explicitly tagged, both in issue comments and review comments. |
| Help | /gemini help |
Displays a list of available commands. |
Customization
To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.
Limitations & Feedback
Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments or fill out our survey to provide feedback.
You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.
Footnotes
-
Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩
There was a problem hiding this comment.
Code Review
This pull request significantly improves the documentation by adding a comprehensive guide on token count optimization and reorganizing the CLI options for better clarity. The changes are consistently applied across all 11 supported languages, which is a commendable effort. The documentation for some languages, like Vietnamese, has been substantially improved by aligning its structure and content with the others. My review includes one medium-severity suggestion to ensure file consistency by adding a final newline character to several documentation files.
There was a problem hiding this comment.
Pull Request Overview
This PR adds comprehensive token count optimization documentation to the website, bringing all language versions up to date with the latest token counting features and reorganizing CLI options for better usability.
- Added new "Token Count Optimization" section explaining the
--token-count-treefeature across all language versions - Restructured command-line options documentation with logical groupings (CLI I/O, Output, File Selection)
- Enhanced token count encoding descriptions with tiktoken references
Reviewed Changes
Copilot reviewed 25 out of 25 changed files in this pull request and generated 12 comments.
| File | Description |
|---|---|
| repomix.config.json | Added default tokenCountTree threshold of 50000 |
| Multiple usage.md files | Added token count optimization section with examples and use cases |
| Multiple command-line-options.md files | Reorganized CLI options into logical groups and enhanced descriptions |
![coderabbitai[bot]](https://avatars.githubusercontent.com/in/347564?s=60&v=4){kind=small}
There was a problem hiding this comment.
Actionable comments posted: 6
🔭 Outside diff range comments (2)
website/client/src/ja/guide/command-line-options.md (1)
55-57: 重複したオプションを削除してください。
--top-files-len/--verbose/--quietは既に “CLI入出力オプション” (Lines 6-14) に記載されています。同一ページ内で二重に説明すると保守が煩雑になります。
同一エントリを “その他のオプション” から削除することを推奨します。website/client/src/en/guide/command-line-options.md (1)
54-57: Eliminate duplicate definitions in “Other Options”.The flags listed here (
--top-files-len,--verbose,--quiet) are already covered in “CLI Input/Output Options” (Lines 6-14). Duplicating them invites drift and reader confusion. Remove the redundant lines or replace with a cross-reference.
🧹 Nitpick comments (17)
website/client/src/pt-br/guide/usage.md (1)
106-116: Add a language hint to the fenced block to satisfy MD040Markdown-lint flags this block because the fence lacks a language.
Just mark it as plain text:-``` +```text 🔢 Token Count Tree: ──────────────────── ...[text is preferable to keep syntax highlighters quiet.] </blockquote></details> <details> <summary>website/client/src/de/guide/usage.md (1)</summary><blockquote> `106-116`: **Missing fenced-block language (`MD040`)** Same issue as in the PT-BR doc: add a language identifier: ```diff -``` +```text 🔢 Token Count Tree: ──────────────────── ...</blockquote></details> <details> <summary>website/client/src/ko/guide/usage.md (1)</summary><blockquote> `106-116`: **Specify a language for the ASCII tree block** ```diff -``` +```text 🔢 Token Count Tree: ──────────────────── ...Applies across languages to keep markdown-lint green. </blockquote></details> <details> <summary>website/client/src/id/guide/usage.md (1)</summary><blockquote> `122-131`: **Fence needs a language hint (`MD040`)** ```diff -``` +```text 🔢 Token Count Tree: ──────────────────── ...This quiets markdown-lint and improves editor rendering. </blockquote></details> <details> <summary>website/client/src/zh-tw/guide/usage.md (1)</summary><blockquote> `106-116`: **Specify a language for the fenced code block** `markdownlint` (rule MD040) complains because the ASCII tree block has no language hint. Adding `text` (or `none`) silences the linter and keeps the rendered result unchanged. ```diff -``` +```text 🔢 Token Count Tree: ──────────────────── …website/client/src/en/guide/usage.md (1)
106-116: Add a language identifier to the token-tree block
Same MD040 issue here—mark the block as plain text.-``` +```text 🔢 Token Count Tree: ──────────────────── …website/client/src/zh-cn/guide/usage.md (1)
106-116: Mark the fenced code block astextto satisfy MD040-``` +```text 🔢 Token Count Tree: ──────────────────── …website/client/src/fr/guide/usage.md (2)
110-120: Provide a language hint for the ASCII tree block-``` +```text 🔢 Token Count Tree: ──────────────────── …
102-104: Minor French typography issues
Language-tool flags a non-breaking space before the colon (…entier :) and double hyphens (--).
Consider replacing:with:or deleting the space, and using an em-dash (—) or a single hyphen according to your house style.website/client/src/es/guide/usage.md (1)
106-116: Include a language tag on the fenced block-``` +```text 🔢 Token Count Tree: ──────────────────── …website/client/src/hi/guide/usage.md (1)
92-101: Specify a language for the fenced code block
markdownlintflags this block (MD040). Add a language identifier (e.g.,text) to avoid the warning and improve syntax-highlighting.-``` +```text 🔢 Token Count Tree: ──────────────────── …website/client/src/ja/guide/usage.md (1)
106-116: Missing language identifier on fenced blockSame MD040 issue as other locales – prepend a language, e.g.
text, to the token-tree example block.-``` +```text 🔢 Token Count Tree: ──────────────────── …website/client/src/vi/guide/usage.md (1)
183-194: Add a language identifier to silence MD040The fenced block that prints the token-count tree has no language tag, triggering markdownlint MD040 and disabling syntax highlighting.
Addtext(ornone) after the opening back-ticks.-``` +```text 🔢 Token Count Tree: ──────────────────── …</blockquote></details> <details> <summary>website/client/src/hi/guide/command-line-options.md (1)</summary><blockquote> `7-14`: **Remove duplicated option entries** `--top-files-len`, `--verbose`, and `--quiet` appear in both “CLI इनपुट/आउटपुट विकल्प” and “अन्य विकल्प”. Listing a flag twice invites drift and translation inconsistencies—keep each flag in a single section. ```diff @@ -## अन्य विकल्प -… -- `--top-files-len <number>`: … -- `--verbose`: … -- `--quiet`: … +## अन्य विकल्प +… <!-- drop the three duplicates -->Also applies to: 55-58
website/client/src/zh-cn/guide/command-line-options.md (1)
7-14: Deduplicate--top-files-len / --verbose / --quietThe three flags are documented twice (CLI 输入/输出选项 and 其他选项).
Retain them in one section only to avoid conflicting edits during future updates.Also applies to: 55-58
website/client/src/fr/guide/command-line-options.md (1)
6-14: Option list contains repeated entries
--top-files-len,--verbose, and--quietare already described under “Options d’entrée/sortie CLI”.
The duplicates under “Autres options” can be safely removed.Also applies to: 55-58
website/client/src/de/guide/command-line-options.md (1)
6-14: Duplicated flags in two sections
--top-files-len,--verbose, and--quietappear both in “CLI Ein-/Ausgabeoptionen” and “Weitere Optionen”.
To keep the German docs tidy, document each flag only once.Also applies to: 54-58
📜 Review details
Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (25)
repomix.config.json(1 hunks)website/client/src/de/guide/command-line-options.md(2 hunks)website/client/src/de/guide/usage.md(1 hunks)website/client/src/en/guide/command-line-options.md(3 hunks)website/client/src/en/guide/usage.md(1 hunks)website/client/src/es/guide/command-line-options.md(3 hunks)website/client/src/es/guide/usage.md(1 hunks)website/client/src/fr/guide/command-line-options.md(3 hunks)website/client/src/fr/guide/usage.md(1 hunks)website/client/src/hi/guide/command-line-options.md(3 hunks)website/client/src/hi/guide/usage.md(1 hunks)website/client/src/id/guide/command-line-options.md(3 hunks)website/client/src/id/guide/usage.md(1 hunks)website/client/src/ja/guide/command-line-options.md(3 hunks)website/client/src/ja/guide/usage.md(1 hunks)website/client/src/ko/guide/command-line-options.md(2 hunks)website/client/src/ko/guide/usage.md(1 hunks)website/client/src/pt-br/guide/command-line-options.md(3 hunks)website/client/src/pt-br/guide/usage.md(1 hunks)website/client/src/vi/guide/command-line-options.md(1 hunks)website/client/src/vi/guide/usage.md(1 hunks)website/client/src/zh-cn/guide/command-line-options.md(4 hunks)website/client/src/zh-cn/guide/usage.md(1 hunks)website/client/src/zh-tw/guide/command-line-options.md(1 hunks)website/client/src/zh-tw/guide/usage.md(1 hunks)
🧰 Additional context used
🪛 LanguageTool
website/client/src/pt-br/guide/usage.md
[uncategorized] ~98-~98: Pontuação duplicada
Context: ...mizar as interações com IA. Use a opção --token-count-tree para visualizar o uso ...
(DOUBLE_PUNCTUATION_XML)
website/client/src/de/guide/usage.md
[grammar] ~125-~125: Passe das Symbol an
Context: ...- Token-schwere Dateien identifizieren - Dateien, die KI-Kontextlimits überschre...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
[uncategorized] ~125-~125: Fehlendes Komma: Teilsätze, Einschübe, Aufzählungen und direkte Rede müssen durch ein Komma vom Rest des Satzes getrennt werden.
Context: ...ien, die KI-Kontextlimits überschreiten könnten - Dateiauswahl optimieren - Verwend...
(AI_DE_KOMMA_MISSING_COMMA)
[grammar] ~126-~126: Passe das Symbol an
Context: ...iten könnten - Dateiauswahl optimieren - Verwendung von --include und `--ignor...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
[grammar] ~126-~126: Ersetze das Satzzeichen
Context: ...eiauswahl optimieren** - Verwendung von --include und --ignore Mustern - **Komprimieru...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_PUNCTUATION_DASHDASHINCLUDE_–INCLUDE)
[grammar] ~126-~126: Passe das Symbol an
Context: ...eren** - Verwendung von --include und --ignore Mustern - Komprimierungsstrategien planen -...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
[grammar] ~127-~127: Passe das Symbol an
Context: ...tern - Komprimierungsstrategien planen - Zielgerichtete Strategien für die größt...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
[grammar] ~128-~128: Passe das Symbol an
Context: ...n - Inhalte vs. Kontext ausbalancieren - Beim Vorbereiten von Code für KI-Analys...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
website/client/src/fr/guide/usage.md
[typographical] ~102-~102: Ces deux traits d’union peuvent être associés pour former un tiret.
Context: ... les interactions IA. Utilisez l'option --token-count-tree pour visualiser l'util...
(TIRET)
[uncategorized] ~102-~102: Les deux-points sont précédés d’une espace insécable.
Context: ...tilisation des jetons dans votre projet entier: bash repomix --token-count-tree ...
(FRENCH_WHITESPACE)
[uncategorized] ~108-~108: Les deux-points sont précédés d’une espace insécable.
Context: ... votre base de code avec les comptes de jetons: ``` 🔢 Token Count Tree: ─────────────...
(FRENCH_WHITESPACE)
[uncategorized] ~122-~122: Les deux-points sont précédés d’une espace insécable.
Context: ...r vous concentrer sur les fichiers plus volumineux: ```bash repomix --token-count-tree 100...
(FRENCH_WHITESPACE)
[uncategorized] ~128-~128: Les deux-points sont précédés d’une espace insécable.
Context: ...s avec 1000+ jetons ``` Cela vous aide à: - **Identifier les fichiers lourds en j...
(FRENCH_WHITESPACE)
[style] ~130-~130: Une autre structure plus directe dynamisera votre phrase.
Context: ...Optimiser la sélection de fichiers* - en utilisant les motifs --include et --ignore - ...
(EN_UTILISANT)
[typographical] ~130-~130: Ces deux traits d’union peuvent être associés pour former un tiret.
Context: ...de fichiers** - en utilisant les motifs --include et --ignore - **Planifier les...
(TIRET)
[uncategorized] ~132-~132: Un point est requis pour indiquer la fin de cette phrase.
Context: ...e la préparation du code pour l'analyse IA ## Formats de sortie ### XML (Par déf...
(POINT)
website/client/src/es/guide/usage.md
[uncategorized] ~98-~98: Probablemente hay un error. Considere aplicar la sugerencia.
Context: ...zar el uso de tokens en todo tu proyecto: bash repomix --token-count-tree ...
(AI_ES_GGEC_REPLACEMENT_PUNCTUATION)
[uncategorized] ~104-~104: Probablemente hay un error. Considere aplicar la sugerencia.
Context: ... tu base de código con conteos de tokens: ``` 🔢 Token Count Tree: ─────────────...
(AI_ES_GGEC_REPLACEMENT_PUNCTUATION)
[uncategorized] ~118-~118: Probablemente hay un error. Considere aplicar la sugerencia.
Context: ...s para enfocarte en archivos más grandes: ```bash repomix --token-count-tree 100...
(AI_ES_GGEC_REPLACEMENT_PUNCTUATION)
[uncategorized] ~126-~126: Asegúrese de que el carácter ‘e’ es correcto y no es un error de escritura.
Context: ...rchivos** - usando patrones --include e --ignore - **Planificar estrategias d...
(E_SINGLE_CHAR)
website/client/src/pt-br/guide/command-line-options.md
[uncategorized] ~19-~19: Sinal de pontuação isolado.
Context: ...tar a contagem de tokens. - --compress: Realizar extração inteligente de código...
(UNLIKELY_OPENING_PUNCTUATION)
website/client/src/fr/guide/command-line-options.md
[uncategorized] ~8-~8: Ce mot doit commencer par une minuscule.
Context: ...a journalisation détaillée - --quiet: Désactiver toute sortie vers stdout - --stdout: ...
(DEUX_POINTS_MAJ)
[typographical] ~9-~9: Caractère d’apostrophe incorrect.
Context: ...(ne peut pas être utilisé avec l'option --output) - --stdin: Lire les chemins de fichi...
(APOS_INCORRECT)
[uncategorized] ~11-~11: Ce mot doit commencer par une minuscule.
Context: ...utomatiquement les fichiers - --copy: Copier en plus la sortie générée dans le press...
(DEUX_POINTS_MAJ)
[uncategorized] ~12-~12: Ce mot doit commencer par une minuscule.
Context: ...ème - --token-count-tree [threshold]: Afficher l'arbre de fichiers avec des résumés de...
(DEUX_POINTS_MAJ)
[uncategorized] ~17-~17: Ce mot doit commencer par une minuscule.
Context: ... fichier de sortie - --style <style>: Spécifier le style de sortie (xml, markdown, ...
(DEUX_POINTS_MAJ)
[typographical] ~17-~17: Caractère d’apostrophe incorrect.
Context: ... <style>: Spécifier le style de sortie (xml, markdown, plain) - --parsable...
(APOS_INCORRECT)
[typographical] ~17-~17: Caractère d’apostrophe incorrect.
Context: ...: Spécifier le style de sortie (xml, markdown, plain) - --parsable-style`: Activer...
(APOS_INCORRECT)
[typographical] ~17-~17: Caractère d’apostrophe incorrect.
Context: ... le style de sortie (xml, markdown, plain) - --parsable-style: Activer la sorti...
(APOS_INCORRECT)
[style] ~18-~18: Utilisé hors du contexte militaire, on préfèrera d’autres tournures à « baser sur ».
Context: ...le-style`: Activer la sortie analysable basée sur le schéma de style choisi. Notez que ce...
(BASER_SUR)
[uncategorized] ~20-~20: Ce mot doit commencer par une minuscule.
Context: ... jetons - --output-show-line-numbers: Afficher les numéros de ligne dans la sortie - `...
(DEUX_POINTS_MAJ)
[uncategorized] ~21-~21: Ce mot doit commencer par une minuscule.
Context: ...e dans la sortie - --no-file-summary: Désactiver la sortie de la section de résumé de fi...
(DEUX_POINTS_MAJ)
[uncategorized] ~22-~22: Ce mot doit commencer par une minuscule.
Context: ...e fichier - --no-directory-structure: Désactiver la sortie de la section de structure de...
(DEUX_POINTS_MAJ)
[uncategorized] ~23-~23: Ce mot doit commencer par une minuscule.
Context: ...structure de répertoire - --no-files: Désactiver la sortie du contenu des fichiers (mode...
(DEUX_POINTS_MAJ)
[uncategorized] ~25-~25: Ce mot doit commencer par une minuscule.
Context: ...ris en charge - --remove-empty-lines: Supprimer les lignes vides de la sortie - `--trun...
(DEUX_POINTS_MAJ)
[uncategorized] ~26-~26: Ce mot doit commencer par une minuscule.
Context: ...des de la sortie - --truncate-base64: Activer la troncature des chaînes de données ba...
(DEUX_POINTS_MAJ)
[uncategorized] ~29-~29: Ce mot doit commencer par une minuscule.
Context: ...illées - --include-empty-directories: Inclure les répertoires vides dans la sortie - ...
(DEUX_POINTS_MAJ)
[uncategorized] ~30-~30: Ce mot doit commencer par une minuscule.
Context: ...des dans la sortie - --include-diffs: Inclure les diffs git dans la sortie (inclut le...
(DEUX_POINTS_MAJ)
[uncategorized] ~37-~37: Ce mot doit commencer par une minuscule.
Context: ...r .gitignore - --no-default-patterns: Désactiver les motifs par défaut ## Options de dé...
(DEUX_POINTS_MAJ)
[uncategorized] ~40-~40: Ce mot doit commencer par une minuscule.
Context: ...ns de dépôt distant - --remote <url>: Traiter un dépôt distant - `--remote-branch <na...
(DEUX_POINTS_MAJ)
[uncategorized] ~41-~41: Ce mot doit commencer par une minuscule.
Context: ...pôt distant - --remote-branch <name>: Spécifier le nom de la branche distante, le tag o...
(DEUX_POINTS_MAJ)
[uncategorized] ~45-~45: Ce mot doit commencer par une minuscule.
Context: ... configuration personnalisé - --init: Créer un fichier de configuration - `--global...
(DEUX_POINTS_MAJ)
[uncategorized] ~46-~46: Ce mot doit commencer par une minuscule.
Context: ... fichier de configuration - --global: Utiliser la configuration globale ## Options de...
(DEUX_POINTS_MAJ)
[uncategorized] ~49-~49: Ce mot doit commencer par une minuscule.
Context: ...ns de sécurité - --no-security-check: Désactiver la vérification de sécurité (par défaut...
(DEUX_POINTS_MAJ)
[typographical] ~49-~49: Caractère d’apostrophe incorrect.
Context: ... vérification de sécurité (par défaut : true) ## Options de comptage de jetons - `-...
(APOS_INCORRECT)
[uncategorized] ~52-~52: Ce mot doit commencer par une minuscule.
Context: ... - --token-count-encoding <encoding>: Spécifier l'encodage de comptage de jetons utilis...
(DEUX_POINTS_MAJ)
[uncategorized] ~52-~52: Une espace doit être ajoutée entre ces deux mots ou intégrez ce nouveau mot à votre dictionnaire personnel.
Context: ...nAI (par exemple, o200k_base pour GPT-4o, cl100k_base pour GPT-4/3.5). Voir [t...
(MOTS_COLLES3)
[typographical] ~55-~55: Caractère d’apostrophe incorrect.
Context: ...ers principaux à afficher (par défaut : 5) - --verbose: Activer la journalisati...
(APOS_INCORRECT)
[uncategorized] ~57-~57: Ce mot doit commencer par une minuscule.
Context: ...a journalisation détaillée - --quiet: Désactiver toute sortie vers stdout ## Exemples ...
(DEUX_POINTS_MAJ)
website/client/src/es/guide/command-line-options.md
[typographical] ~4-~4: Mayúsculas y minúsculas recomendadas.
Context: ... ## Opciones básicas - -v, --version: Mostrar versión de la herramienta ## Opciones ...
(AI_ES_GGEC_REPLACEMENT_CASING_UPPERCASE)
[uncategorized] ~13-~13: Probablemente hay un error. Considere aplicar la sugerencia.
Context: ...texto de IA - --top-files-len <number>: Número de archivos principales a mostra...
(AI_ES_GGEC_REPLACEMENT_PUNCTUATION)
[uncategorized] ~49-~49: Probablemente falta un determinante.
Context: ...d - --no-security-check: Deshabilitar verificación de seguridad (por defecto: true) ## ...
(AI_ES_GGEC_MISSING_DETERMINER)
[uncategorized] ~57-~57: Probablemente hay un error. Considere aplicar la sugerencia.
Context: ...o - --quiet: Deshabilitar toda salida a stdout ## Ejemplos ```bash # Uso básico repo...
(AI_ES_GGEC_REPLACEMENT_OTHER)
website/client/src/de/guide/command-line-options.md
[grammar] ~1-~1: Korrigiere das Wort
Context: # Befehlszeilenoptionen ## Grundlegende Optionen - `-v, --vers...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_ORTHOGRAPHY_SPELLING)
[grammar] ~3-~3: Entferne ein Leerzeichen
Context: ...zeilenoptionen ## Grundlegende Optionen - -v, --version: Tool-Version anzeigen ## CLI Ein-/Aus...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_ORTHOGRAPHY_SPACE)
[grammar] ~6-~6: Entferne ein Leerzeichen
Context: ..., --version: Tool-Version anzeigen ## CLI Ein-/Ausgabeoptionen - --verbose`: Ausführliche Protokollie...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_ORTHOGRAPHY_SPACE)
[grammar] ~9-~9: Entferne ein Satzzeichen
Context: ...out statt in eine Datei (kann nicht mit --output Option verwendet werden) - --stdin: ...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_PUNCTUATION_BACKTICKDASHDASHOUTPUT)
[grammar] ~9-~9: Wähle ein passenderes Wort
Context: ...in eine Datei (kann nicht mit --output Option verwendet werden) - --stdin: Dateipfa...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_NOUN)
[grammar] ~12-~12: Entferne ein Leerzeichen
Context: ...g der Token-Nutzung für KI-Kontextlimits - --top-files-len <number>: Anzahl der Top-Dateien in der Zusammen...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_ORTHOGRAPHY_SPACE)
[grammar] ~15-~15: Ergänze ein Satzzeichen
Context: ... Top-Dateien in der Zusammenfassung ## Repomix-Ausgabeoptionen - -o, --output <file>: Ausgabedateina...
(QB_NEW_DE_OTHER_ERROR_IDS_MISSING_PUNCTUATION_COLON)
[grammar] ~37-~37: Entferne das Symbol
Context: ...g deaktivieren - --no-default-patterns: Standardmuster deaktivieren ## Remote-Repository-Optionen - `--rem...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_OTHER)
[grammar] ~39-~39: Entferne ein Leerzeichen
Context: ...ktivieren ## Remote-Repository-Optionen - --remote <url>: Remote-Repository verarbeiten - `--rem...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_ORTHOGRAPHY_SPACE)
[grammar] ~40-~40: Entferne ein Leerzeichen
Context: ...te : Remote-Repository verarbeiten - --remote-branch `: Remote-Branch-Name, Tag oder Commit-Ha...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_ORTHOGRAPHY_SPACE)
[grammar] ~41-~41: Ergänze ein Satzzeichen
Context: ...(Standard ist Repository-Standard-Branch) ## Konfigurationsoptionen - `-c, --con...
(QB_NEW_DE_OTHER_ERROR_IDS_MISSING_PUNCTUATION_PERIOD)
[grammar] ~43-~43: Passe das Symbol an
Context: ...ndard-Branch) ## Konfigurationsoptionen - -c, --config <path>: Benutzerdefinierten Konfigurationsdateipfad - --init: Kon...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
[grammar] ~44-~44: Korrigiere die Wortstellung
Context: ...utzerdefinierten Konfigurationsdateipfad - --init: Konfigurationsdatei erstellen - `--globa...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_WORD_ORDER)
[grammar] ~45-~45: Korrigiere die Wortstellung
Context: ... --init: Konfigurationsdatei erstellen - --global: Globale Konfiguration verwenden ## Sich...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_WORD_ORDER)
[grammar] ~48-~48: Entferne ein Leerzeichen
Context: ...ration verwenden ## Sicherheitsoptionen - --no-security-check: Sicherheitsprüfung deaktivieren (Stand...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_ORTHOGRAPHY_SPACE)
[grammar] ~51-~51: Entferne ein Leerzeichen
Context: ...ndard: true) ## Token-Anzahl-Optionen - --token-count-encoding <encoding>: Token-Anzahl-Kodierung angeben, die vo...
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_ORTHOGRAPHY_SPACE)
[grammar] ~52-~52: Passe das Symbol an
Context: ...nai/tiktoken) Tokenizer verwendet wird (z.B. o200k_base für GPT-4o, cl100k_base ...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
[grammar] ~52-~52: Entferne das Symbol
Context: ...iktoken) Tokenizer verwendet wird (z.B. o200k_base für GPT-4o, cl100k_base für GPT-4/3.5). Siehe [tiktoken model....
(QB_NEW_DE_OTHER_ERROR_IDS_UNNECESSARY_OTHER)
[grammar] ~52-~52: Passe das Symbol an
Context: ...00k_basefür GPT-4o,cl100k_base` für GPT-4/3.5). Siehe [tiktoken model.py](https://githu...
(QB_NEW_DE_OTHER_ERROR_IDS_REPLACEMENT_OTHER)
🪛 markdownlint-cli2 (0.17.2)
website/client/src/pt-br/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/ko/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/de/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/ja/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/zh-cn/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/en/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/zh-tw/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/es/guide/usage.md
106-106: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/hi/guide/usage.md
91-91: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
website/client/src/vi/guide/usage.md
183-183: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (5)
- GitHub Check: Build and run (windows-latest, 21.x)
- GitHub Check: Build and run (windows-latest, 24.x)
- GitHub Check: Test (windows-latest, 23.x)
- GitHub Check: auto-review
- GitHub Check: Cloudflare Pages
🔇 Additional comments (1)
repomix.config.json (1)
22-22: Confirm schema & CLI support fortokenCountTreeNice to see the default threshold exposed in config.
Please double-check that:
- The JSON schema referenced in Line 2 already defines
output.tokenCountTree(type: integer).- The CLI/parser actually reads this property (otherwise the value is silently ignored).
If either end is missing, users will be confused by a “no-op” setting.
Fixed automated bot feedback from PR #760: - Standardized echo command format to use escaped \n syntax across all language versions - Added final newlines to all command-line-options.md files following standard conventions - Ensured shell compatibility and consistent formatting across 12 language versions This addresses feedback from Copilot and Gemini Code Assist regarding documentation consistency and file formatting standards. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
Deploying repomix with
|
| Latest commit: |
951227d
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://9fa8e6a3.repomix.pages.dev |
| Branch Preview URL: | https://docs-token-count.repomix.pages.dev |
… structure Fixed documentation issues identified in PR review: - Removed duplicate CLI options (--verbose, --quiet, --top-files-len) from "Other Options" sections - Deleted empty "Other Options" section headers across all 12 language versions - Cleaned up formatting and section structure for better readability - Ensured each option appears only once in its appropriate section This resolves duplication concerns raised in PR feedback and improves documentation consistency across all supported languages. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
Summary
This PR adds comprehensive token count optimization documentation to the website, enhancing user understanding of the
--token-count-treefeature and CLI option organization.Changes Made
1. Token Count Optimization Documentation
usage.md--token-count-treeoption to visualize token usage across projects--token-count-tree 1000)2. CLI Options Reorganization
--token-count-tree,--verbose,--quiet, etc.)3. Multi-language Support
4. Configuration Enhancement
tokenCountTree: 50000threshold torepomix.config.jsonFiles Changed
Technical Details
This documentation update brings the website in sync with the token count optimization features added in recent commits, particularly the comprehensive content added to README.md in commit c30b05a. The reorganized CLI options structure improves user experience by grouping related options logically.
Checklist
npm run testnpm run lint