garykwh
Member
Inference on a Budget
- Joined:
- Jun 2024
- Posts:
- 173
- From:
- San Jose, US
Malý server with good YABS can compile slow
What CPU, what RAM. You never answer.
I am run inference on cheap VPS. Geekbench single-core predict token speed okay. Not perfect, okay. Memory bandwidth matter for big model. YABS disk useless for inference. fio useless. Only thing matter: can model fit in RAM, and how fast CPU feed GPU if any.
For CPU-only inference: yes, compile test maybe correlate. Because LLVM and llama.cpp both memory bound.
CUDA cores are my love language
moebig
Member
RAID is not backup
- Joined:
- Jul 2024
- Posts:
- 115
- From:
- Casablanca, Morocco
Untar kernel source, 40 MB/s. Why? Compression. CPU bound, not disk.
Wesh Hel. This is good point. But decompression am also benchmark! Real world is not single thing.
I am think: we need benchmark SUITE. Not one test. Many test:
- LLVM compile (CPU + memory)
- Kernel untar (CPU + disk mixed)
- Static site build with Hugo or Jekyll (real workload for many)
- Database import (WordPress people need)
One number never enough. French spacing still important.
RAID 1: because paranoia pays
olespete
Member
Trust No One
- Joined:
- Jun 2024
- Posts:
- 270
- From:
- Unknown
docker image. Same environment everywhere.
Containers do not solve trust. Docker Hub compromised before. Who builds the image? PetraSuper? Why trust?
I am not saying don't do this. I am saying: verify checksums. Reproducible builds. Nix or Guix, maybe. But even then: who audits?
The real answer: run your own compile. Don't trust spreadsheet. Don't trust docker. Don't trust me.
airgapped, encrypted, faraday'd, still worried
mediaaustin
Member
Deliverability Nerd
- Joined:
- Jul 2024
- Posts:
- 276
- From:
- Austin, US
Application benchmark means YOUR application
Finally someone gets it.
For mail: I test with GlockApps, Mail-Tester, Postmark seed list. Real inbox placement. No synthetic tell you this. IP warming takes weeks. You can't benchmark warming.
But if you MUST synthetic: YABS network test to single iperf server tells you nothing about mail. fio tells you nothing about mail. Geekbench tells you nothing about mail.
I will say: for mail, check MXToolbox blacklist first — https://mxtoolbox.com/blacklists.aspx. Then worry about speed.
SPF, DKIM, DMARC — holy trinity ✉️
pauloserver
Member
- Joined:
- Jun 2024
- Posts:
- 117
- From:
- São Paulo, Brazil
No one talk about price. Brasil, 1 USD = 5.5 BRL. GreenCloudVPS cheap plan, 2 USD, 11 BRL. CloudCone 1.5 USD, 8.25 BRL. But CloudCone only LA. For me in São Paulo, latency bad.
I am use HostHatch. They have São Paulo? No. But they have Chile? No. Closest LA. Same problem.
Real benchmark for me: speedtest to São Paulo. Not YABS to wherever. I use speedtest-cli to Anatel server. This am my real number.
LLVM compile same everywhere. But network, my user in Brasil. Application benchmark need location.
chill infrastructure for chill people 🦫
PetraSuper
Member
OP
network boot believer
- Joined:
- Jun 2024
- Posts:
- 127
- From:
- Bratislava, Slovakia
YES. I am forget. Thank you.
Also good. I am add location-based test. But this is hard to standardize. Speedtest server change, result change.
New idea: instead of 200 people send result, we make distributed test. You run script, it test compile AND network to three place you choose. But script must be same. Docker maybe solve, but olespete right: who trust docker?
I am think: simple bash script. You read before run. No hidden.
boot anything, anywhere, anytime