[MEDI] Add TokenCount property to IngestionChunk - #7264

Merged

adamsitnik merged 11 commits into

data-ingestion-preview2from

copilot/extend-ingestionchunk-with-tokencount

Feb 9, 2026

Commits on Feb 4, 2026

Initial plan
Copilot
committed
24b8fe3
Add TokenCount property to IngestionChunk and update chunkers

Copilot
and
adamsitnik
committed
19f1a4a
Add TokenCount verification tests

Copilot
and
adamsitnik
committed
0165dfd
Make tokenCount parameter mandatory and optimize token counting in DocumentTokenChunker

Copilot
and
adamsitnik
committed
9fb650e
Address code review feedback: inline variables, use exact token counts in tests, validate zero token count

Copilot
and
adamsitnik
committed
f749df5

Commits on Feb 5, 2026

Address final code review feedback: enforce non-zero token count, move TestChunkFactory to Utils folder, improve test clarity

Copilot
and
adamsitnik
committed
5d6ecaf

Commits on Feb 6, 2026

Commits on Feb 9, 2026