Skip to content

Commit

Permalink
chore: fix typo in llama.cpp (#7032)
Browse files Browse the repository at this point in the history
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
  • Loading branch information
alwqx and cebtenzzre committed May 2, 2024
1 parent b0d943d commit 6ecf318
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llama.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -2359,7 +2359,7 @@ static bool llama_kv_cache_init(
cache.recurrent = model.arch == LLM_ARCH_MAMBA;
cache.v_trans = !cparams.flash_attn;

// TODO: support mixed reccurent Transformer architectues
// TODO: support mixed recurrent Transformer architectures
// NOTE: (!a || b) is a logical implication (a -> b)
GGML_ASSERT(!cache.recurrent || n_embd_k_gqa == hparams.n_embd_k_s());
GGML_ASSERT(!cache.recurrent || n_embd_v_gqa == hparams.n_embd_v_s());
Expand Down

0 comments on commit 6ecf318

Please sign in to comment.