SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 11 hours agoIs there a currently an accurate way to say how much power per prompt LLMs use?message-squaremessage-square9fedilinkarrow-up124arrow-down13
arrow-up121arrow-down1message-squareIs there a currently an accurate way to say how much power per prompt LLMs use?SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 11 hours agomessage-square9fedilink
minus-squarelime!@feddit.nulinkfedilinkarrow-up3·3 hours agowhile this is true in isolation, the amount of users means that inference now uses more power than training for the large actors.
while this is true in isolation, the amount of users means that inference now uses more power than training for the large actors.