@robertgarrigos de res! no és segur que respectin robots.txt, per exemple, Amazonbot no ho fa.Aquesta configuració per nginx els hi posa més difícil:https://mastodont.cat/@spla/115003142925516589
@FediPact I did apply this nginx config to fight against it and many other IA bots and scrappers:https://github.com/kurren/ai-bots-crawlersreturning 444 to them seems a good way to confuse them and decrease server load.