Mastodon Politics, Power, and Science: Tested a lot of smaller models and I may have found a winner.

Monday, February 12, 2024

Tested a lot of smaller models and I may have found a winner.

 Tested out a bunch of small ai models, but one of them really stood out: stablelm-zephyr-3b.Q6_K.gguf.

It was very smart, fast, and was better than many 13B models I have tried.  It easily runs on my intel macbook with just 8GB of RAM. 

https://huggingface.co/TheBloke/stablelm-zephyr-3b-GGUF

at
Labels: ,

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Progress on the campaign manager

You can see that you can build tactical maps automatically from the world map data.  You can place roads, streams, buildings. The framework ...

  • Nothing Up My Sleeve.
    The tent smelled of ozone, sawdust, and cheap miracles. On a rickety stage, a man named Constantine adjusted the frayed cuffs of his tuxedo...
  • 37 sensor kit from Sunfounder lab
    So, I saw this kit on Amazon.  It seemed too good too be true.  The kit was priced right, it was less than 2 dollars for each board.  Of co...
  • Pihole, squid, squidguard on a $5 Pi Zero
    My plan was to get the most use possible from the $5 raspberry Pi Zero that I managed to get my hands onto by buying a full kit that include...