filister@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoDeepSeek R1 Is Reportedly Running Inference On Huawei's Ascend 910C AI Chips, Showing China's Growing AI Capabilitieswccftech.comexternal-linkmessage-square14fedilinkarrow-up1147arrow-down15
arrow-up1142arrow-down1external-linkDeepSeek R1 Is Reportedly Running Inference On Huawei's Ascend 910C AI Chips, Showing China's Growing AI Capabilitieswccftech.comfilister@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square14fedilink
minus-squareRichard@lemmy.worldlinkfedilinkEnglisharrow-up2·1 day agoYes. You still need similar ones if you want to run the models really fast, but not nearly the same amount or cost. That’s how people run LLMs on their laptops. You don’t even need a GPU, a multi-core CPU is sufficient, just not very fast at it.
Yes. You still need similar ones if you want to run the models really fast, but not nearly the same amount or cost. That’s how people run LLMs on their laptops. You don’t even need a GPU, a multi-core CPU is sufficient, just not very fast at it.