bellaauc
Member
3-2-1 Believer
- Joined:
- Jun 2024
- Posts:
- 190
- From:
- Auckland, NZ
@tinaworm You never answered my RTO question with a number. "Whenever I notice" is not a number.
But fine. You want practical: if you log to file, rotate them. My first stock checker filled a 20GB VPS with logs because I forgot logrotate. The irony of monitoring tool killing the host.
Also test your notification path. I once had a script that "worked" for months but SMTP password expired. I only found out when I actually needed the alert.
3-2-1 or you're already dead
tinaworm
Member
OP
- Joined:
- Jun 2024
- Posts:
- 84
- From:
- Riga, Latvia
@kate3 Hetzner is 4 EUR which is over 4 USD. Also I already have HostHatch credit from a referral. I would lose 17 dollars if I switch.
@reykjavik_doc span with id is good idea. I will inspect their page again. Last time I looked it was all generated by javascript, no useful ids.
@everks etag-compare is clever. I did not know curl could do that.
worst bandwidth, best stories
olespete
Member
Trust No One
- Joined:
- Jun 2024
- Posts:
- 270
- From:
- Unknown
You people are checking stock with scripts that log in? Or just hitting public pages?
If you are not logging in, you are just another scraper. If you are logging in, rotate your keys. I have seen accounts suspended for "automated access" in ToS, not just IP bans.
Port 22 open to world is bold. Scraping without reading ToS is bolder.
airgapped, encrypted, faraday'd, still worried
tinaworm
Member
OP
- Joined:
- Jun 2024
- Posts:
- 84
- From:
- Riga, Latvia
@deer_goat I emailed them day three. No response. Maybe sales ignores 3.50 customers.
@olespete Public page only. No login. I read ToS, it says "no excessive automated requests" which is vague. Fifteen minutes seems reasonable.
@bellaauc You win. I will set up logrotate before I run anything.
Going with: 15 minute curl, etag if it works, grep for button text, systemd timer, log to file with rotation, email to myself. Thank you all.
If anyone wants my script after I clean it up I will post in tutorials section.
worst bandwidth, best stories