OpenAI’s nightmare: Deepseek R1 on a Raspberry Pi

DeepSeek R1 runs on a Pi 5, but don’t believe every headline you read.

Resources referenced in this video:

– DeepSeek R1: https://github.com/deepseek-ai/DeepSeek-R1
– Ollama and llama.cpp benchmarks on Pi 5: https://github.com/geerlingguy/ollama-benchmark/issues/9
– Reuters article on DeepSeek: https://www.reuters.com/technology/artificial-intelligence/what-is-deepseek-why-is-it-disrupting-ai-sector-2025-01-27/
– DeepSeek FAQ from Stratchery: https://stratechery.com/2025/deepseek-faq/

Support me on Patreon: https://www.patreon.com/geerlingguy
Sponsor me on GitHub: https://github.com/sponsors/geerlingguy
Merch: https://www.redshirtjeff.com
2nd Channel: https://www.youtube.com/@GeerlingEngineering
3rd Channel: https://www.youtube.com/@Level2Jeff

Contents:

00:00 – OpenAI’s Nightmare
01:00 – What can a Pi 5 do, really?
01:39 – 671b on AmpereOne
02:00 – Pi 5 14b – CPU inference
02:20 – Pi 5 14b – GPU inference
03:05 – GPUs on Pi (and year of the Arm PC)
03:37 – Still in an AI bubble

source