ikt@aussie.zone to LocalLLaMA@sh.itjust.worksEnglish · 5 months agoHow Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencearxiv.orgexternal-linkmessage-square17linkfedilinkarrow-up123arrow-down13
arrow-up120arrow-down1external-linkHow Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencearxiv.orgikt@aussie.zone to LocalLLaMA@sh.itjust.worksEnglish · 5 months agomessage-square17linkfedilink
minus-squareSuperSpruce@lemmy.ziplinkfedilinkEnglisharrow-up1·5 months agoIf we were charged the real electric cost of the AI queries, maybe we would stop using it so speculatively.
minus-squareBlaster M@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-21 month ago184w for ~10 sec on my build. If I had an EV, charging that would be magnitudes higher than me poking my local ai models for stuff. Not any worse than playing a VR game in the same span of time. Also, the air conditioner is the biggest eater of my electric bill, not the computer.
If we were charged the real electric cost of the AI queries, maybe we would stop using it so speculatively.
184w for ~10 sec on my build. If I had an EV, charging that would be magnitudes higher than me poking my local ai models for stuff.
Not any worse than playing a VR game in the same span of time.
Also, the air conditioner is the biggest eater of my electric bill, not the computer.