this post was submitted on 21 Nov 2023
1262 points (96.0% liked)

Firefox

17302 readers
800 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 4 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] drathvedro@lemm.ee 38 points 10 months ago (1 children)

The biggest offender is, surprisingly, cloudflare. They will straight up refuse to serve you any site if your user agent is not one of the mainstream ones. It's not even "find the traffic light to prove you're human", but a page basically saying "fuck you, go away".

[–] cucumber_sandwich@lemmy.world 1 points 10 months ago (2 children)

Well their job is to block weird bot-looking traffic...

[–] lseif@sopuli.xyz 33 points 10 months ago (1 children)

what is more likely to be a bot? a unique and trackable useragent for a semi-niche browser engine, or a vanilla Chromium+Windows which half of everyone uses ?

[–] lud@lemm.ee 2 points 10 months ago (1 children)

Most semi and fully legitimate bots use a custom user agent.

[–] lseif@sopuli.xyz 5 points 10 months ago

what about malicious/unwanted bots? if cloudflare is trying to block bots, the bots will want to not look like bots. the easiest way to do that is to use a common user agent.

[–] Karyoplasma@discuss.tchncs.de 6 points 10 months ago

User agent identifier is not useful to block bots. You can literally set it to whatever you like.