Tested out a bunch of small ai models, but one of them really stood out: stablelm-zephyr-3b.Q6_K.gguf.
It was very smart, fast, and was better than many 13B models I have tried. It easily runs on my intel macbook with just 8GB of RAM.
https://huggingface.co/TheBloke/stablelm-zephyr-3b-GGUF
No comments:
Post a Comment