Politics, Power, and Science: Tested a lot of smaller models and I may have found a winner.

Mastodon Politics, Power, and Science: Tested a lot of smaller models and I may have found a winner.

Monday, February 12, 2024

Tested a lot of smaller models and I may have found a winner.

Tested out a bunch of small ai models, but one of them really stood out: stablelm-zephyr-3b.Q6_K.gguf.

It was very smart, fast, and was better than many 13B models I have tried. It easily runs on my intel macbook with just 8GB of RAM.

https://huggingface.co/TheBloke/stablelm-zephyr-3b-GGUF

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)