Mastodon Politics, Power, and Science: New ai technique removes need for array multiplication.

Tuesday, June 25, 2024

New ai technique removes need for array multiplication.

Well, this is a kick in the teeth to all the AI hardware companies. This technique reduces memory size of ai models to 1/10th the size and removes the need for matmult. So no need for GPU or NPU to do ai.

https://arstechnica.com/information-technology/2024/06/researchers-upend-ai-status-quo-by-eliminating-matrix-multiplication-in-llms/

at
Labels: , ,

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

The Planck Scale Is Not a "Pixel": It’s a Measure of You

J. Rogers, SE Ohio For decades, we’ve been told the same story about the Planck Length. Science popularizers often call it the "pixel s...

  • Nothing Up My Sleeve.
    The tent smelled of ozone, sawdust, and cheap miracles. On a rickety stage, a man named Constantine adjusted the frayed cuffs of his tuxedo...
  • 37 sensor kit from Sunfounder lab
    So, I saw this kit on Amazon.  It seemed too good too be true.  The kit was priced right, it was less than 2 dollars for each board.  Of co...
  • Got the web server up and running in the cloud now.
    First the bad news. For som e reason the Amazon Web S ervice console was running very badly under F irefox.  It was taking forever to load a...