filister@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoDeepSeek R1 Is Reportedly Running Inference On Huawei's Ascend 910C AI Chips, Showing China's Growing AI Capabilitieswccftech.comexternal-linkmessage-square14fedilinkarrow-up1147arrow-down15
arrow-up1142arrow-down1external-linkDeepSeek R1 Is Reportedly Running Inference On Huawei's Ascend 910C AI Chips, Showing China's Growing AI Capabilitieswccftech.comfilister@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square14fedilink
minus-squareSavvyBeardedFish@reddthat.comlinkfedilinkEnglisharrow-up6·1 day agoYes, so R&D and finalizing the model weight is done on NVIDIA GPUs (I guess you need an excessive amount of VRAM). Inference is probably gonna be offloaded to consumers in the end where the NPU is taking care of the inference cost (See Apple, Qualcomm etc)
Yes, so R&D and finalizing the model weight is done on NVIDIA GPUs (I guess you need an excessive amount of VRAM).
Inference is probably gonna be offloaded to consumers in the end where the NPU is taking care of the inference cost (See Apple, Qualcomm etc)