i'm running qwen3.5:0.8b on my orangepi zero 2w, low token/s but it still runs. I think i paid around £14 for it over a year ago but now the same board is double price. I wouldn't buy a computer right now of any kind. It's a bubble.
Interesting, I have a few Pis laying around, I know they'd be low token use, but debated putting some models on them, whats your setup look like if you don't mind me asking? Is there a specific image or package you're using?
