Mastodon Politics, Power, and Science: Tested a lot of smaller models and I may have found a winner.

Monday, February 12, 2024

Tested a lot of smaller models and I may have found a winner.

 Tested out a bunch of small ai models, but one of them really stood out: stablelm-zephyr-3b.Q6_K.gguf.

It was very smart, fast, and was better than many 13B models I have tried.  It easily runs on my intel macbook with just 8GB of RAM. 

https://huggingface.co/TheBloke/stablelm-zephyr-3b-GGUF

at
Labels: ,

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

It is mathematically possible for Democrats to gain a majority before the midterms.

It is mathematically possible for Democrats to gain significant power or even take a technical "majority" if enough Republicans re...

  • Nothing Up My Sleeve.
    The tent smelled of ozone, sawdust, and cheap miracles. On a rickety stage, a man named Constantine adjusted the frayed cuffs of his tuxedo...
  • Got the web server up and running in the cloud now.
    First the bad news. For som e reason the Amazon Web S ervice console was running very badly under F irefox.  It was taking forever to load a...
  • 37 sensor kit from Sunfounder lab
    So, I saw this kit on Amazon.  It seemed too good too be true.  The kit was priced right, it was less than 2 dollars for each board.  Of co...