sure, hardware wattage × time taken per prompt. which model specifically are you referring to and on what hardware?
Edit:
say, for example, that i’m running a model that takes ten seconds to respond on my Radeon 7900 XTX. it’s power limited to 300W, but the rest of the system also pulls power during runtime so let’s call it 400.
to get watt-hours we take watts times hours. one second is 1/3600th of an hour.
that comes out to 400 × 10 ÷ 3600 ≈ 1.11Wh. so that’s equivalent of leaving a 6W LED light on for about 11 minutes, or an old-fashioned incandescent bulb on for 80 seconds.
sure, hardware wattage × time taken per prompt. which model specifically are you referring to and on what hardware?
Edit:
say, for example, that i’m running a model that takes ten seconds to respond on my Radeon 7900 XTX. it’s power limited to 300W, but the rest of the system also pulls power during runtime so let’s call it 400.
to get watt-hours we take watts times hours. one second is 1/3600th of an hour.
that comes out to 400 × 10 ÷ 3600 ≈ 1.11Wh. so that’s equivalent of leaving a 6W LED light on for about 11 minutes, or an old-fashioned incandescent bulb on for 80 seconds.