Skip to content

Commit

Permalink
llama : make cell_id const in inp_s_mask block (#9470)
Browse files Browse the repository at this point in the history
This commit makes the cell_id variable const in the inp_s_mask block.

The motivation for this change is consistency with the code in the
inp_s_copy block.
  • Loading branch information
danbev authored Sep 14, 2024
1 parent feff4aa commit befaf11
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/llama.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -15826,7 +15826,7 @@ static void llama_set_inputs(llama_context & lctx, const llama_ubatch & batch) {

// clear unused states
for (int i = 0; i < n_kv; ++i) {
uint32_t cell_id = i + kv_self.head;
const uint32_t cell_id = i + kv_self.head;
llama_kv_cell & kv_cell = lctx.kv_self.cells[cell_id];

data[i] = (float) (kv_cell.src >= 0);
Expand Down

0 comments on commit befaf11

Please sign in to comment.