[17:17:43] https://phabricator.wikimedia.org/T278206 there's a report of a significant slowdown in Lua modules yesterday [17:22:53] That doesn't even relate to the train... [17:34:17] yeah, I also quickly skimmed recent changes to their modules and didn't see anything obvious either [17:35:10] Any recent package/os upgrades? [17:35:30] Or have they just taken a while to notice from the buster upgrades? [17:35:42] legoktm: Just ignore it for years, like he did when we asked him how he licensed his code... :P [17:35:53] :< [17:36:19] not that I'm aware of... [17:43:36] * Reedy tries to load https://web.archive.org/web/20201205115059/https://de.wikivoyage.org/wiki/Halle_(Saale) [17:44:02] archive.org is so far [17:44:04] *fast [17:45:59] legoktm: Compared with 5th December... It does look like something has changed [17:46:09] But certainly that far back, could be OS upgrades and everything else that came along [17:46:27] There's also 20% more wikibase entities loaded [17:47:23] mhm, that's pre-buster [17:48:26] The kernel mitigations affecting PHP also affecting Lua doesn't seem unreasonable from the outset [17:59:13] this week's train also has or.i's patches to reduce how many times Lua calls back into PHP for a perf boost [18:00:23] dewikivoyage isn't group0 though [19:04:03] I see an increase in " Wikimedia\RequestTimeout\RequestTimeoutException: The maximum execution time of 60 seconds was exceeded" since midnight UTC. [19:04:06] for Parsoid. [19:04:22] is T278206 also since midnight? [19:04:23] T278206: Drastic increase of "The time allocated for running scripts has expired." errors for Lua/Scribunto string functions - https://phabricator.wikimedia.org/T278206 [19:06:13] oh .. no ... this one just shifted categories in logstash from filtered timeouts to unfiltered fatals ... but still timeouts .. need to look more closely. [19:07:49] Tim switched timeouts to use the new RequestTimeout library yesterday [19:08:12] I think the exception it throws is different now [19:08:43] https://phabricator.wikimedia.org/T269326 [19:10:11] yes .. i am seeing that. changed from WMFTimeoutException to Wikimedia\RequestTimeout\RequestTimeoutException [19:25:16] fixed logstash dashboard. [23:14:35] TimStarling: I tagged you with https://gerrit.wikimedia.org/r/c/mediawiki/core/+/674196 [23:15:32] ok