[00:45:46] how do you disable image embeds in the wiki feed? [00:46:29] just today the wiki feeds on our server suddenly started embedding file images [01:06:19] disable $wgDiscordNotificationShowImage [02:10:15] [1/2] Hey, how can I do this: [02:10:15] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1406460083688181862/image.png?ex=68a28b86&is=68a13a06&hm=c0685d028b36d1a7b5f6a7dbaf3a2250a23459dcf6560ab78370583c70d6c8e0& [02:11:03] like, the posibility to add translations [02:16:18] how people irl are when i ask for sources [02:27:14] Extension:UniversalLanguageSelector [02:27:46] Extension:Translate, though it is not the only extension that allows you to translate wiki pages [02:43:10] How can I configure it [04:29:47] [1/2] https://meta.miraheze.org/wiki/Help:How_to_support_multiple_languages_on_my_wiki [04:29:48] [2/2] Assuming you want to support multiple languages. [05:44:41] And can I add a constructed language? [05:45:14] Or I would have to take another language [06:25:33] Yes, through https://www.mediawiki.org/wiki/Manual:$wgExtraInterlanguageLinkPrefixes [06:25:58] You'd need some some changes from the tech team though. [09:20:04] We are aware of an outage [09:21:25] I find Miraheze's Server is down. [09:22:00] Yes it is [09:22:04] [1/2] Error 503 Backend fetch failed via cp37 at Sun, 17 Aug 2025 09:20:40 GMT [09:22:04] [2/2] Varnish XID 716047832, serving 183.229.203.21 [09:22:10] 503 Error [09:22:16] Unfortunately it's August and it seems half of tech chose to be away at the same time [09:23:02] certified august moment [09:23:18] We are currently trying to find an engineer to threaten the servers [09:23:20] That's not good [09:23:54] [1/2] Oh [09:23:54] [2/2] Miraheze's Server is up now [09:40:12] It's still down for me, I think it's just a matter of whether the page needs to query the database or not [09:40:55] Some pages are in parser cache and don't need to query the database [09:41:52] guys [09:41:56] my wiki's down [09:42:06] https://cdn.discordapp.com/attachments/407537962553966603/1406573797988892723/image.png?ex=68a2f56e&is=68a1a3ee&hm=62c25c397d88063480ee06b67bc3f6d986fb447badd269c418ffdf15a089eede& [09:42:09] wait [09:42:14] are yall having the same issue? [09:47:25] Ye db161 is sleepy [09:50:58] <.tounae_official> Cannot access the database: Too many connections (db161) [09:51:41] We know [09:54:23] she had too much monster, and now we have to stop and restart her heart [09:56:37] https://ampmod.miraheze.org/ cannot log in, cannot login to meta either. [09:57:08] being unable to login to meta feels weird [09:57:18] Not really [09:57:24] CentralAuth is a dumb extension [09:57:43] > (Cannot access the database: Cannot access the database: Too many connections (db161)) [09:57:45] oh, that'd do it. [09:57:52] eightx2: servers are currently a bit sleepy, try again in half an hour [09:58:02] BlankEclair this is exactly what I'm getting [09:58:10] nothing much i can do on my side [09:58:15] yea ik [09:58:18] ah oki ^_^ [10:11:00] it’s shitty code written by the wmf they hacked together to just about work that they recommend you not to use in production what could go wrong [10:28:45] Something went wrong [10:29:00] I can login to meta now [10:29:09] Yes it did [10:29:12] I think you can too [10:29:22] [1/2] Looks like the whole site's down. [10:29:22] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1406585692527661056/image.png?ex=68a30082&is=68a1af02&hm=32a6f13a55cf48d1a3f65098f06ae27445b00348fc6380b9686c3a8d319f6976& [10:29:31] Yup [10:29:39] Something went wrong [10:29:39] how is the united states not affected? [10:29:40] planned downtime? [10:30:01] I live in the UK. Not sure what's going on... [10:30:31] Tech is on it! [10:30:49] No [10:30:57] Tech is not on it [10:31:16] The only person in Infra around is me and I'm on a train with no suspension [10:31:39] Sorry: Rephrasing: "Tech is aware of it" [10:31:49] shit is going down, [10:31:58] explains why I am not affected [10:32:39] since wouldnt planned downtime affect everyone (it affected me and then stopped) [10:32:44] woke up just in time for all the cool stuff [10:33:15] should we save this day's tech ops channel messages [10:33:26] so we can remember so this doesn't happen again [10:33:29] it's down [10:33:57] yes, I can see [10:34:17] oh it's up now [10:34:18] No it's affecting only some wikis [10:34:23] this feels like the github outage that lasted for 40ish seconds and shat on every system they had [10:34:27] Not all wikis are on the same database [10:34:47] One of our databases has decided it's taking the day off responding to any query [10:36:13] this is what happens when you don't give them enough PTO [10:37:32] why is it suddenly recovering [10:38:41] Slow db = all wikis sad, hard down db = only that db's wikis sad [10:38:56] And we're back? [10:39:02] At least Commons is [10:39:50] Battle cats was down, so i joined this discord to see whats up, does someone know what happened? [10:40:29] to paraphrase claire, one of the db servers had a coronary from too much monster [10:40:59] and all of our infra peeps are in a bouncy castle or sleeping [10:41:08] Oh damn [10:41:47] Whats a db server [10:41:57] database [10:42:10] shit storm ig [10:42:21] Im not that deep into tech excuse me if i dont know some things 😓 [10:42:56] Ah [10:42:57] I think the DB servers affected shat themselves from a heart attack, stroke and seizure [10:43:34] Idk but i dont think computers have organs [10:44:11] oh wow, I blink and it's ded [10:44:22] rip db161 [10:44:27] since literally everything is not having a good day, for more than a third of the users, nginx is erroring, DBs lookin like they seen better days and that it is the worst day in miraheze history [10:44:36] r/wooosh [10:44:48] You yourelf sir [10:45:14] Calm down [10:45:23] It's far from the worst day in our history [10:45:36] atleast the worst one I have seen in your history [10:45:44] You've seen nothing then [10:45:50] All the data is still there [10:45:55] then what is the worst day [10:46:18] Either us announcing we were shutting down or when one of our servers crashed and we lost data [10:46:52] Damn [10:46:54] db161 is down, again [10:47:11] i just got out of the shower lol [10:48:01] Is it possible that this is an attack from outside? [10:48:13] no [10:48:20] Unlikely [10:48:39] imma hold back from requesting a wiki so you can focus on the problem [10:48:45] Sometimes the servers just decide to take a sick day [10:48:56] that is what we call a DDoS [10:49:21] the last attacks were wikis being requested by miraheze haters [10:49:22] Yeah i was thinking about using that word but i wasnt sure about that [10:49:40] Denial of Service? Is that right [10:49:50] There is no indication it's a DDoS [10:49:53] if it is on purpose it is a DDoS, if it is not it is some user [10:50:05] Direct Denial of Service [10:50:08] That's not true at all [10:50:12] Neither of them messages [10:50:13] distributed* [10:50:19] ok [10:50:20] db161 seems to be calming down? [10:50:22] DDoS is distributed denial of service [10:50:40] Denials of Service can 100% be accidental and our own fault [10:50:56] They don't have to be intentionally taking us down [10:51:00] [1/2] hey all, got this on my wiki, i presume its nothing to worry about right? im not a tech savvy person so i assume its just an update and not something I did lol [10:51:01] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1406591137858457741/image.png?ex=68a30594&is=68a1b414&hm=bfd87f632330ccb0475668b104e5e1314c616102c9cfa2234a05d0bf43cb1011& [10:51:02] (UK) [10:51:03] I never heard someone say distributed denial of service but you are professionals so i am going to take your word [10:51:13] But I doubt it's traffic at all [10:51:24] You don't seem to know what you're talking about tbh [10:51:28] db161 is not having a good day, that is why this is happening [10:51:33] Servers are sleepy [10:51:51] oke doke thank you! just checking haha, i wouldnt know if i accidentally hit some setting myself looool i can hardly use google [10:51:53] I don't have to deal with DDoSes bc my site is on github pages [10:51:57] tyyyyy have a nice day hope it gets fixed! [10:52:14] lots of egress on db161 interestingly [10:52:21] Im gonna try going on the battle cats Wiki again if thats cool with yall [10:52:22] but cpu seems to be at ~10% now [10:52:32] Oh not this bug again [10:52:36] worth putting it out of maint mode? [10:52:37] oh no [10:52:51] @blankeclair is the thingy script running [10:52:59] you have had this in the past? [10:53:05] not much ingress on mwtask181 [10:53:12] ~69KiB/s [10:53:15] We've had outages before [10:53:20] I am going to request a new wiki so you can focus on the problem [10:53:22] that's what I was gonna say, backups are probably being taken [10:53:25] Still seems to be struggling :/ [10:53:35] Check manageInactiveWikis might be running [10:53:38] not of this exact bug I thought [10:53:38] Or backups [10:53:44] Don't be rude, or I might decline it 😄 [10:53:44] nope [10:53:56] Sad, any other scripts? [10:54:00] can't find backups based on skimming htop either [10:54:04] only CU purge user data [10:54:15] I know outages happen from time to time, it is literally how the internet works [10:54:17] Slow database performance has happened before yes [10:54:32] We've got pretty good uptime compared to some periods [10:55:10] That shouldn't cause problems [10:55:16] eeyup [10:55:27] how is not requesting a wiki while the tech team works rude?, I do understand they don't review but they have to get garbled nonsense from my request [10:55:51] I wouldn't call you rude [10:55:54] Annoying maybe [10:55:55] Just joking mate. [10:56:12] ok [10:56:24] Hence the smiley behind it [10:56:57] the reason I am not going to make wikis on fandom anymore is bc why the fuck can I not change the wiki's title in the tab name [10:56:57] @unknown07724_alt Watch your language. [10:57:03] [1/11] ``` [10:57:04] [2/11] MariaDB [(none)]> SHOW FULL PROCESSLIST; [10:57:04] [3/11] +------+---------------+-------------------+-------------+---------+------+----------+-----------------------+----------+ [10:57:04] [4/11] | Id | User | Host | db | Command | Time | State | Info | Progress | [10:57:04] [5/11] +------+---------------+-------------------+-------------+---------+------+----------+-----------------------+----------+ [10:57:05] [6/11] | 4398 | mediawiki2024 | 10.0.17.123:28608 | parsercache | Sleep | 0 | | NULL | 0.000 | [10:57:06] [7/11] | 4909 | mediawiki2024 | 10.0.18.106:56532 | NULL | Query | 0 | starting | SHOW FULL PROCESSLIST | 0.000 | [10:57:06] [8/11] | 4944 | mediawiki2024 | 10.0.18.155:55590 | parsercache | Sleep | 0 | | NULL | 0.000 | [10:57:06] [9/11] | 4945 | mediawiki2024 | 10.0.20.162:45452 | parsercache | Sleep | 0 | | NULL | 0.000 | [10:57:06] [10/11] +------+---------------+-------------------+-------------+---------+------+----------+-----------------------+----------+ [10:57:06] [11/11] ``` [11:01:29] What is this? It looks cool [11:01:34] it looks like wiki is working now [11:01:36] a table [11:01:54] list of connections to db161 [11:01:57] i.e. virtually nothing [11:02:08] Only 4 wikis? [11:02:27] nah, three parser cache things (?) and one query (for the process list) [11:02:37] i brought the db out of maint mode, so there should be way more queries now tho [11:02:55] Can i try to send a thingy? [11:02:57] Hold on [11:03:01] a thingy? [11:03:01] so is requesting a wiki possible an won't impact your debugging anymore? [11:03:08] yeah? [11:04:22] looks like it is possible it was backups afterall saturating the server https://github.com/miraheze/puppet/blob/main/modules/role/manifests/db.pp#L129C3-L137C6 [11:04:52] By thingy i meant a request to the server, i was opening the battle cats wiki again [11:05:07] Idk if you can see that in the logs? [11:05:11] wouldn't now be 11:05 utc? [11:05:18] i feel like that's okay? [11:05:31]