The new M5 Max MacBook with 128 GB of RAM can now easily run Llama 70B as a local LLM.


Running that AI 1.5 years ago would’ve taken you a 40k GPU cluster.
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
0/400
No comments
  • Pin