7 () posted 97 days ago by DrLeaks2 97 days ago by DrLeaks2 +7 / -0 7 comments share 7 comments share save hide report block hide replies
This site have robots.txt, but looks like it is common for communities.win
https://conspiracies.win/robots.txt
User-Agent: *
Disallow: /api/
Disallow: /*sort=
Disallow: /*from=
Disallow: c/thedonald/*
However, hardly any crawler really obey that rules.