garykwh
Member
OP
Inference on a Budget
- Joined:
- Jun 2024
- Posts:
- 173
- From:
- San Jose, US
So Contabo finally bumped egress to €0.08/GB. Running my tiny LLM weights mirror on their free tier was already costing me sleep doing the VRAM math every night. Ngl I did the spreadsheet: 2.7TB/mo = ~$216 now, which is more than my actual inference box.
Anyone else running small mirrors getting squeezed? My 3090 draws less power than this bill would cost.
CUDA cores are my love language
haroldgsm
Member
Grumpy Old Sysadmin
- Joined:
- May 2024
- Posts:
- 329
- From:
- Ohio, US
Current setup in garage, 42U rack, pulling 15A at 240V. The wife is already mad about the power bill. Ran numbers: self-hosting the mirror on my fiber would cost less in electricity than Contabo's new pricing. Need to get a kill-a-watt on the new switch though, only have 3 days of data.
IPv4, IRC, and irssi — fight me
Doug
Member
New Jersey
- Joined:
- Jul 2024
- Posts:
- 271
- From:
- New Jersey, US
Watching CDN users discover that "unlimited" had an asterisk
grabs popcorn, checks /r/drama