[14:01:55] Good morning team, I added the __NONINDEX__ magic word to a page according to the instructions here https://www.mediawiki.org/wiki/Manual:Noindex, and cleared the cache for the page as well, but still not seeing the meta being added in html source of the page, not sure what I am missing? here is the page FYI: [14:01:55] https://vimwiki.org/wiki/Abahul%C4%ABkatatt%C4%81 [14:03:59] Paulxu20: the magic word is `__NOINDEX__` not `__NO*N*INDEX__` [14:05:00] Thank you taavi, just checked, "__NOINDEX__" is what I added, sorry for the typo! [14:07:23] you might need to change https://www.mediawiki.org/wiki/Manual:$wgExemptFromUserRobotsControl, IIUC __NOINDEX__ is disabled in all content namespaces by default [14:15:04] It is working, thank you! Lucas_WMDE [18:01:55] Hi team, recently I am seeing very frequent GET requests (like very seconds or so) to my wiki server in apache log, pretty sure these are not actual human users, it is causing the wiki becoming slow, any suggestions on what I can do to block these access? [18:01:55] 104.23.170.72 - - [22/Jul/2025:17:53:20 +0000] "GET /w/index.php?title=Special:%E9%93%BE%E5%87%BA%E6%9B%B4%E6%94%B9&limit=100&from=20250622214944&target=Category%3 [18:01:56] A%E7%AC%AC52%E9%98%BF%E9%82%A3%E5%BE%8B%E7%9B%B8%E5%BA%94 HTTP/1.1" 404 68431 "-" "Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.8 [18:01:56] 64.0 Safari/535.2" [18:01:57] 172.70.211.143 - - [22/Jul/2025:17:52:59 +0000] "GET /w/index.php?action=edit&title=Category%3A%E8%87%AA%E6%9D%80%E7%9B%B8%E5%85%B3%E9%97%AE%E9%A2%98 HTTP/1.1" 200 [18:01:57]  10272 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36" [18:03:01] there are all kinds of access requests like : [18:03:01] GET /w/index.php?oldid=2083&returnto=Category... [18:03:02] GET /w/index.php?diff=prev&oldid=144402... [18:03:02] GET /w/index.php?action=edit&redlink=1&title=... [18:04:20] Paulxu20: the top one is a Cloudflare ip [18:05:02] yes I have been battling this for a long time through cloudflare [18:05:43] what does that mean if cloudflare ip shows up in the list? [18:07:07] Paulxu20: that ip is almost useless to you [18:07:15] ok [18:07:19] You need to have a look at what the Cloudflare portal shows [18:07:34] See if you can turn on manage AI bots or add a challenge or something [18:08:11] You could try their discord for help setting up Cloudflare abuse features, don't believe they have an irc [18:10:53] I have a rate limiting rule that says to block the access if more than 35 requests are made within 10 seconds, but I believe that applies to the same IP, what is happening now is that it seems even though the incoming traffic are heavy, the ip addresses are much different in each request [18:17:56] You're being hit with an ai crawler. They'll follow every link of your wiki even if it's useless to them (diff, special pages), causing major slowness, and they'll try to use very different IPs to break any rate limiting you have, on purpose [18:19:04] https://www.mediawiki.org/wiki/Handling_web_crawlers [18:21:17] sorry was disconncted.. [18:21:53] is there anyway to completely deny access to old versions and version comparison for guest user? [18:25:44] https://www.mediawiki.org/wiki/Handling_web_crawlers [18:26:23] try seeing if you can turn on cloudflare's bot blocking too [18:27:05] Thank you! let me take a look at that [18:28:00] I just turned on the "Bot Fight Mode" in cloudflare but that doesnt seem to help