Monday, February 12, 2024

Tested a lot of smaller models and I may have found a winner.

 Tested out a bunch of small ai models, but one of them really stood out: stablelm-zephyr-3b.Q6_K.gguf.

It was very smart, fast, and was better than many 13B models I have tried.  It easily runs on my intel macbook with just 8GB of RAM. 

https://huggingface.co/TheBloke/stablelm-zephyr-3b-GGUF

No comments:

Post a Comment