Files
oak-gpui/crates
Peter TrippandPatrick Samson b4659bb44e Fix inaccurate Ollama context length for qwen2.5 models (#20933)
Since Ollama/llama.cpp do not currently YARN for context length
extension, the context length is limited to `32768`. This can be
confirmed by the Ollama model card.
See corresponding issue on Ollama repo : 
https://github.com/ollama/ollama/issues/6865

Co-authored-by: Patrick Samson <1416027+patricksamson@users.noreply.github.com>
2024-11-22 10:10:01 -05:00
..
2024-11-11 18:39:05 +01:00
2024-08-13 23:06:07 -07:00
2024-11-18 22:56:34 +01:00
2024-10-02 13:27:16 +02:00