Skip to content

Instantly share code, notes, and snippets.

@Delivator

Delivator/ryzen-ai-300-local-llm-arch.md

Last active May 26, 2025 13:22
Show Gist options
  • Save Delivator/dad87f12d2d83ba078f5940a506c59e6 to your computer and use it in GitHub Desktop.
Save Delivator/dad87f12d2d83ba078f5940a506c59e6 to your computer and use it in GitHub Desktop.
Download ZIP
My attempt on running LLMs locally on my new Framework 13 with a AMD Ryzen AI 9 HX 370
Raw
ryzen-ai-300-local-llm-arch.md

Installing Ryzen AI software

Best resource I found told me to install the Ryzen AI software which should make it easy to try running models locally supported by the NPU. So I followed the guide on https://ryzenai.docs.amd.com/en/latest/rai_linux.html which was super annoying because I had to create a corporate account??? Anyway I created an account and followed the install instructions. Online it said python 3.10+ should be fine but when running it complained that I had python 3.13 so I installed pyenv and installed v3.10.17. It then ran but gave me a warning (or error) that zip and linux-libc-dev were missing. Installed zip and libc++ because apparently thats the package for arch. Still threw the errors after all so no idea what that was about.

Then I found this guide https://ryzenai.docs.amd.com/en/latest/llm/overview.html which linked me to an outdated install guide on github which told me to install lemonade-sdk.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment