[02:15:49] PROBLEM - Host deployment-redis02 is DOWN: CRITICAL - Host Unreachable (10.68.16.231) [02:15:51] PROBLEM - Host deployment-redis01 is DOWN: CRITICAL - Host Unreachable (10.68.16.177) [02:18:01] PROBLEM - Host deployment-dumps-puppetmaster is DOWN: CRITICAL - Host Unreachable (10.68.21.153) [02:24:20] PROBLEM - Host deployment-puppetmaster02 is DOWN: CRITICAL - Host Unreachable (10.68.21.200) [05:12:40] !log ladsgroup@deployment-tin:~$ foreachwikiindblist all-labs deleteAutoPatrolLogs.php [05:12:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:12:58] ^deleted half a million rows from logging table of wikidatawiki in beta cluster [05:14:46] wow nice [07:30:09] 10Continuous-Integration-Config, 10MediaWiki Language Extension Bundle: Run php5 tests for MLEB extensions - https://phabricator.wikimedia.org/T197561#4295973 (10hashar) > > It would be fine if the PHP5 tests are run against an older version of core (it would actually be a good thing), but I don't know if that... [07:35:14] 10Beta-Cluster-Infrastructure, 10ORES, 10Scoring-platform-team, 10Beta-Cluster-reproducible, 10Wikimedia-log-errors: InvalidArgumentException for betacluster eswiki - https://phabricator.wikimedia.org/T197584#4296536 (10Ladsgroup) Yes, After only one edit, the system finds the new models and update the d... [07:41:15] 10Beta-Cluster-Infrastructure, 10ORES, 10Scoring-platform-team, 10Beta-Cluster-reproducible, 10Wikimedia-log-errors: InvalidArgumentException for betacluster eswiki - https://phabricator.wikimedia.org/T197584#4298806 (10awight) 05Open>03Resolved a:03awight @Ladsgroup This is certainly a corner case... [07:45:43] 10Beta-Cluster-Infrastructure, 10ORES, 10Scoring-platform-team, 10Beta-Cluster-reproducible, 10Wikimedia-log-errors: InvalidArgumentException for betacluster eswiki - https://phabricator.wikimedia.org/T197584#4298811 (10Ladsgroup) I agree with that and we should have some sort of phabricator ticket to tr... [08:00:29] 10Gerrit, 10Release-Engineering-Team: gerrit: run "LocalUsernamesToLowerCase" utility on gerrit host to fix mixed case usernames in gerrit's accounts db - https://phabricator.wikimedia.org/T197257#4298818 (10demon) I re-ran it. It dies with an exception anyway :P [08:20:13] 10Release-Engineering-Team, 10Operations: Scap error from mwdebug2001.codfw.wmnet: sync: write failed on "/srv/mediawiki/wmf-config/InitialiseSettings.php": No space left on device (28) - https://phabricator.wikimedia.org/T197275#4298887 (10Joe) So there isn't much I can do right now, the situation recovered;... [08:20:36] 10Release-Engineering-Team, 10Operations: Scap error from mwdebug2001.codfw.wmnet: sync: write failed on "/srv/mediawiki/wmf-config/InitialiseSettings.php": No space left on device (28) - https://phabricator.wikimedia.org/T197275#4298888 (10Joe) 05Open>03Resolved [08:40:25] 10Phabricator, 10Pywikibot-core: Herald rule for adding Upstream when a task is moved to "Upstream issues" column of pywikibot-core workboard - https://phabricator.wikimedia.org/T194009#4298914 (10Dvorapa) [08:46:57] 10Phabricator, 10Pywikibot-core: Herald rule for adding Upstream when a task is moved to "Upstream issues" column of pywikibot-core workboard - https://phabricator.wikimedia.org/T194009#4298938 (10Aklapper) 05stalled>03Invalid Not possible like that. See https://secure.phabricator.com/T5474 for this very r... [09:06:26] 10Continuous-Integration-Config: Some Jenkins jobs lack a timeout (ex: mediawiki-phpunit-coverage-patch ) - https://phabricator.wikimedia.org/T197519#4298984 (10hashar) [09:12:29] 10Phabricator, 10Pywikibot-core: Herald rule for adding Upstream when a task is moved to "Upstream issues" column of pywikibot-core workboard - https://phabricator.wikimedia.org/T194009#4298999 (10Dvorapa) 05Invalid>03stalled Yeah, that is why it was stalled before, waiting for an upstream task to be solved [09:14:12] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4270440 (10Majr) @mmodell Commits from the 9th (rMWe0fab761f34c7c10ba33f0ead4969fe981ce9aa4) to the 12th (rMW67ba3f31ed5ed30c0c08bb5a75bb098e3ffbe824) seem to still be stuck on importing. [10:03:31] (03PS1) 10Hashar: Add timeout to all Jenkins jobs [integration/config] - 10https://gerrit.wikimedia.org/r/441007 (https://phabricator.wikimedia.org/T197519) [10:05:43] (03CR) 10Hashar: "Some jobs do not use any default or they use specific wrappers (which overrides default) and lacked the timeout definition." [integration/config] - 10https://gerrit.wikimedia.org/r/441007 (https://phabricator.wikimedia.org/T197519) (owner: 10Hashar) [10:06:02] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Some Jenkins jobs lack a timeout (ex: mediawiki-phpunit-coverage-patch ) - https://phabricator.wikimedia.org/T197519#4299104 (10hashar) a:03hashar [10:41:25] 10Beta-Cluster-Infrastructure, 10ORES, 10Scoring-platform-team, 10Beta-Cluster-reproducible, 10Wikimedia-log-errors: InvalidArgumentException for betacluster eswiki - https://phabricator.wikimedia.org/T197584#4299291 (10MarcoAurelio) Thanks for your assistance :-) [10:47:50] 10Release-Engineering-Team, 10MediaWiki-General-or-Unknown, 10MW-1.29-release: Formalise and Announce REL1_29 EOL - https://phabricator.wikimedia.org/T197669#4299300 (10Reedy) [11:13:28] (03CR) 10Zfilipin: [C: 031] Add timeout to all Jenkins jobs [integration/config] - 10https://gerrit.wikimedia.org/r/441007 (https://phabricator.wikimedia.org/T197519) (owner: 10Hashar) [11:15:05] (03PS1) 10Lokal Profil: Add André Costa (WMSE) [integration/config] - 10https://gerrit.wikimedia.org/r/441017 [11:58:07] (03PS3) 10Addshore: Added a job for analytics-wmde-toolkit-analyzer [integration/config] - 10https://gerrit.wikimedia.org/r/440149 (owner: 10WMDE-leszek) [12:01:56] (03CR) 10WMDE-leszek: Added WikibaseLexeme project for a daily node selenium test run against beta cluster (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/434025 (https://phabricator.wikimedia.org/T194252) (owner: 10WMDE-leszek) [12:05:56] (03PS6) 10WMDE-leszek: Added WikibaseLexeme project for a daily node selenium test run against beta cluster [integration/config] - 10https://gerrit.wikimedia.org/r/434025 (https://phabricator.wikimedia.org/T194252) [12:10:06] (03PS7) 10WMDE-leszek: Added WikibaseLexeme project for a daily node selenium test run against beta cluster [integration/config] - 10https://gerrit.wikimedia.org/r/434025 (https://phabricator.wikimedia.org/T194252) [12:10:37] (03CR) 10Addshore: [C: 032] Added a job for analytics-wmde-toolkit-analyzer [integration/config] - 10https://gerrit.wikimedia.org/r/440149 (owner: 10WMDE-leszek) [12:12:16] (03CR) 10jerkins-bot: [V: 04-1] Added a job for analytics-wmde-toolkit-analyzer [integration/config] - 10https://gerrit.wikimedia.org/r/440149 (owner: 10WMDE-leszek) [12:16:08] hashar: around? [12:16:20] I just went to run jjb to update the jobs based on the ptach i just merged [12:16:27] but my jjb or something locally ius all screwed up [12:16:34] wondering, if you would be able to? [12:16:40] /merged/+2ed/ [12:33:48] oh we need to set auth.userNameToLowerCase [12:33:57] i wonder if that will cause problems [12:34:00] * paladox will test [12:38:57] hmm [12:39:22] that affects git over ssh [12:43:49] (03PS8) 10WMDE-leszek: Added WikibaseLexeme project for a daily node selenium test run against beta cluster [integration/config] - 10https://gerrit.wikimedia.org/r/434025 (https://phabricator.wikimedia.org/T194252) [12:45:17] (03CR) 10WMDE-leszek: "PS8: Attempts to also install extensions WikibaseLexeme depends on (i.e. Wikibase), as per failures of the early version of the job:" [integration/config] - 10https://gerrit.wikimedia.org/r/434025 (https://phabricator.wikimedia.org/T194252) (owner: 10WMDE-leszek) [12:46:18] (03CR) 10WMDE-leszek: "And regarding the job naming. If the duplicate name is the issue, it would probably be better to rename the ruby selenium job, as the ode " [integration/config] - 10https://gerrit.wikimedia.org/r/434025 (https://phabricator.wikimedia.org/T194252) (owner: 10WMDE-leszek) [12:51:32] 10Gerrit, 10Release-Engineering-Team: Gerrit has created duplicate accounts for some users - https://phabricator.wikimedia.org/T197083#4299578 (10Paladox) [12:54:50] thcipriani twentyafterfour you can use https://gerrit-review.googlesource.com/Documentation/cmd-logging-set-level.html to set AccountManager to debug (without needing ops to merge any changes i think) [12:55:40] ssh -p 29418 @gerrit.wikimedia.org gerrit logging set-level debug com.google.gerrit.server.account.AccountManager [12:56:09] (03PS1) 10WMDE-leszek: Install dependency extensions when running selenium-WikibaseLexeme-chrome [integration/config] - 10https://gerrit.wikimedia.org/r/441035 (https://phabricator.wikimedia.org/T194252) [13:05:35] 10Release-Engineering-Team, 10Operations: Scap error from mwdebug2001.codfw.wmnet: sync: write failed on "/srv/mediawiki/wmf-config/InitialiseSettings.php": No space left on device (28) - https://phabricator.wikimedia.org/T197275#4299619 (10thcipriani) >>! In T197275#4296760, @Reedy wrote: > Although we need t... [13:06:32] oh jenkins redesgned it's login page + new screen when restarting. [13:07:48] 10Release-Engineering-Team, 10Operations: Scap error from mwdebug2001.codfw.wmnet: sync: write failed on "/srv/mediawiki/wmf-config/InitialiseSettings.php": No space left on device (28) - https://phabricator.wikimedia.org/T197275#4299637 (10Reedy) Ok, that makes sense. And further answers Joes question/query t... [13:27:51] addshore: yup. Sorry I was dealing with some paperwork [13:28:53] addshore: maybe you need to reinstall jjb based on integration/jenkins-job-builder [13:38:05] (03CR) 10Hashar: [C: 032] Add André Costa (WMSE) [integration/config] - 10https://gerrit.wikimedia.org/r/441017 (owner: 10Lokal Profil) [13:39:39] (03Merged) 10jenkins-bot: Add André Costa (WMSE) [integration/config] - 10https://gerrit.wikimedia.org/r/441017 (owner: 10Lokal Profil) [13:39:55] (03CR) 10Hashar: [C: 032] ":]" [integration/config] - 10https://gerrit.wikimedia.org/r/441035 (https://phabricator.wikimedia.org/T194252) (owner: 10WMDE-leszek) [13:41:28] (03Merged) 10jenkins-bot: Install dependency extensions when running selenium-WikibaseLexeme-chrome [integration/config] - 10https://gerrit.wikimedia.org/r/441035 (https://phabricator.wikimedia.org/T194252) (owner: 10WMDE-leszek) [13:47:03] (03PS1) 10Hashar: Revert "Install dependency extensions when running selenium-WikibaseLexeme-chrome" [integration/config] - 10https://gerrit.wikimedia.org/r/441042 [13:47:18] (03PS2) 10Hashar: Revert "Install dependency extensions when running selenium-WikibaseLexeme-chrome" [integration/config] - 10https://gerrit.wikimedia.org/r/441042 (https://phabricator.wikimedia.org/T194252) [13:47:34] (03CR) 10Hashar: [C: 032] "Sorry I went too fast on that one :/" [integration/config] - 10https://gerrit.wikimedia.org/r/441042 (https://phabricator.wikimedia.org/T194252) (owner: 10Hashar) [13:49:03] (03Merged) 10jenkins-bot: Revert "Install dependency extensions when running selenium-WikibaseLexeme-chrome" [integration/config] - 10https://gerrit.wikimedia.org/r/441042 (https://phabricator.wikimedia.org/T194252) (owner: 10Hashar) [14:27:05] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4299757 (10hashar) [14:27:17] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4256366 (10hashar) [14:58:43] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4299897 (10hashar) [15:01:00] !log CI docker slaves: docker container prune --force ; docker image prune --force [15:01:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:03:30] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4299919 (10hashar) [15:09:13] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4299932 (10hashar) [15:20:26] (03Merged) 10jenkins-bot: Archive EtherEditor extension [integration/config] - 10https://gerrit.wikimedia.org/r/441058 (https://phabricator.wikimedia.org/T197698) (owner: 10Hashar) [15:42:20] (03PS1) 10Jakob: Make node browser tests voting for WikibaseLexeme [integration/config] - 10https://gerrit.wikimedia.org/r/441060 [16:09:37] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:30:44] (03CR) 10WMDE-leszek: [C: 031] "Tests are now stable and passing, so let's get them vote!" [integration/config] - 10https://gerrit.wikimedia.org/r/441060 (owner: 10Jakob) [17:07:15] (03PS1) 10Hashar: Filter core/vendor for gated Quibble job [integration/config] - 10https://gerrit.wikimedia.org/r/441068 (https://phabricator.wikimedia.org/T197469) [17:29:21] (03CR) 10Hashar: [C: 04-1] "Gotta:" [integration/config] - 10https://gerrit.wikimedia.org/r/441068 (https://phabricator.wikimedia.org/T197469) (owner: 10Hashar) [17:55:15] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512#4300436 (10Umherirrender) [18:00:58] 10Project-Admins: Requesting personal tag User-Herron - https://phabricator.wikimedia.org/T197713#4300445 (10herron) [18:04:36] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Watching / External), 10Recommendation-API, 10Patch-For-Review, 10Scoring-platform-team (Current): What to do with deployment-sca03? - https://phabricator.wikimedia.org/T184501#4300493 (10Aklapper) [18:05:45] 10Beta-Cluster-Infrastructure, 10ORES, 10Puppet, 10Scoring-platform-team (Current), 10User-Ladsgroup: Puppet broken on deployment-ores01 due to missing hieradata - https://phabricator.wikimedia.org/T184478#4300508 (10Aklapper) [18:05:56] 10Continuous-Integration-Config, 10Operations, 10Operations-Software-Development: Puppet tox: properly lint both Py2 and Py3 files - https://phabricator.wikimedia.org/T184435#4300510 (10Aklapper) [18:20:30] Project mwext-phpunit-coverage-publish build #5648: 04FAILURE in 3.6 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/5648/ [18:20:31] Project mwext-phpunit-coverage-publish build #5649: 04STILL FAILING in 0.75 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/5649/ [18:21:09] 10Phabricator (Upstream), 10Upstream: Per-user projects for personal work in progress tracking - https://phabricator.wikimedia.org/T555#4300552 (10Aklapper) [18:21:11] 10Project-Admins: Requesting personal tag User-Herron - https://phabricator.wikimedia.org/T197713#4300551 (10Aklapper) [18:21:41] 10Phabricator (Upstream), 10Upstream: Per-user projects for personal work in progress tracking - https://phabricator.wikimedia.org/T555#1766088 (10Aklapper) [18:21:44] 10Project-Admins: Requesting personal tag User-Herron - https://phabricator.wikimedia.org/T197713#4300445 (10Aklapper) 05Open>03Resolved a:03Aklapper Sure! Here you go: #user-herron [18:23:27] Yippee, build fixed! [18:23:27] Project mwext-phpunit-coverage-publish build #5650: 09FIXED in 2 min 54 sec: https://integration.wikimedia.org/ci/job/mwext-phpunit-coverage-publish/5650/ [18:25:47] 10Project-Admins: Requesting personal tag User-Herron - https://phabricator.wikimedia.org/T197713#4300590 (10herron) Thanks much! [18:27:59] I don't know what should I do. I found some problems in MediaWiki unit test and errors with 1.31 installation using CLI. [18:28:24] Where should I post those errors? [18:28:43] There's a lot of projects in Phabricator [18:32:55] thenets: #mediawiki-unit-tests and #mw-1.31-release (or similar) [18:34:42] Ah, ok! :) thanks greg-g! [18:47:43] (03PS2) 10Hashar: Filter core/vendor for gated Quibble job [integration/config] - 10https://gerrit.wikimedia.org/r/441068 (https://phabricator.wikimedia.org/T197469) [18:48:46] (03PS1) 10Hashar: php55/hhvm experimental Quibble jobs for the gate [integration/config] - 10https://gerrit.wikimedia.org/r/441081 [18:49:33] (03PS3) 10Hashar: Filter core/vendor for gated Quibble job [integration/config] - 10https://gerrit.wikimedia.org/r/441068 (https://phabricator.wikimedia.org/T197469) [18:51:08] (03CR) 10Hashar: [C: 032] php55/hhvm experimental Quibble jobs for the gate [integration/config] - 10https://gerrit.wikimedia.org/r/441081 (owner: 10Hashar) [18:52:48] (03Merged) 10jenkins-bot: php55/hhvm experimental Quibble jobs for the gate [integration/config] - 10https://gerrit.wikimedia.org/r/441081 (owner: 10Hashar) [19:01:01] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: Migrate gated extensions jobs to Quibble/Docker - https://phabricator.wikimedia.org/T197469#4300695 (10hashar) [19:05:55] (03PS1) 10Hashar: Do not run wmf-quibble with php55 [integration/config] - 10https://gerrit.wikimedia.org/r/441086 [19:19:56] (03PS1) 10Hashar: Revert "Do not run wmf-quibble with php55" [integration/config] - 10https://gerrit.wikimedia.org/r/441088 [19:20:04] (03CR) 10Hashar: [C: 032] Revert "Do not run wmf-quibble with php55" [integration/config] - 10https://gerrit.wikimedia.org/r/441088 (owner: 10Hashar) [19:21:55] (03CR) 10Hashar: [C: 04-1] Filter core/vendor for gated Quibble job (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/441068 (https://phabricator.wikimedia.org/T197469) (owner: 10Hashar) [19:22:20] (03Merged) 10jenkins-bot: Revert "Do not run wmf-quibble with php55" [integration/config] - 10https://gerrit.wikimedia.org/r/441088 (owner: 10Hashar) [19:51:24] PROBLEM - Host deployment-mx is DOWN: CRITICAL - Host Unreachable (10.68.17.78) [20:04:26] 10Diffusion, 10Phabricator, 10Release-Engineering-Team: Ignore refs/changes/**/**/meta - https://phabricator.wikimedia.org/T196860#4300801 (10Aklapper) [20:04:28] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4300800 (10Aklapper) [20:09:49] PROBLEM - SSH on deployment-deploy-01 is CRITICAL: Connection refused [20:13:06] 10Phabricator, 10Project-Admins, 10Pywikibot-core: Merge #Pywikibot-General to #Pywikibot-core - https://phabricator.wikimedia.org/T195856#4300815 (10Aklapper) a:03Aklapper [20:14:40] 10Phabricator, 10Project-Admins, 10Pywikibot-core: Merge #Pywikibot-General to #Pywikibot-core - https://phabricator.wikimedia.org/T195856#4239366 (10Aklapper) p:05Triage>03Low Tasks to edit: https://phabricator.wikimedia.org/maniphest/query/IcJUw7Z6jCYz/ Heads-up sent: https://lists.wikimedia.org/piperm... [20:21:18] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4300827 (10Paladox) [20:21:21] 10Diffusion, 10Phabricator, 10Release-Engineering-Team: Ignore refs/changes/**/**/meta - https://phabricator.wikimedia.org/T196860#4300824 (10Paladox) 05Open>03Resolved a:03Paladox Closing as resolved as refs/changes/**/**/meta is ignored and we are using T196855 to report any additional problems. [20:35:33] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: Migrate gated extensions jobs to Quibble/Docker - https://phabricator.wikimedia.org/T197469#4300863 (10hashar) [20:36:00] 10Phabricator (Upstream), 10Upstream: Cannot view pages when logged into Phabricator under a not-yet-approved account. - https://phabricator.wikimedia.org/T197550#4300866 (10Krenair) https://secure.phabricator.com/T13154 got closed wontfix [20:36:12] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: Migrate gated extensions jobs to Quibble/Docker - https://phabricator.wikimedia.org/T197469#4292446 (10hashar) wmf-quibble jobs are blocked by Translate for the wmf/1.3... [20:36:57] 10Phabricator (Upstream), 10Upstream: Remove approval requirement for new accounts, or patch everything in Phabricator to allow unapproved users to be treated as logged out for permissions purposes - https://phabricator.wikimedia.org/T197550#4300870 (10Krenair) [20:37:36] 10Phabricator: Remove approval requirement for new accounts, or patch everything in Phabricator to allow unapproved users to be treated as logged out for permissions purposes - https://phabricator.wikimedia.org/T197550#4295677 (10Krenair) [20:43:12] 10Phabricator: Remove approval requirement for new accounts, or patch everything in Phabricator to allow unapproved users to be treated as logged out for permissions purposes - https://phabricator.wikimedia.org/T197550#4300879 (10Aklapper) Makes sense; quoting from upstream: > But we don't have infinite resource... [20:46:24] 10Phabricator: Remove approval requirement for new accounts, or patch everything in Phabricator to allow unapproved users to be treated as logged out for permissions purposes - https://phabricator.wikimedia.org/T197550#4300888 (10Krenair) Yeah. If that part is declined then I don't think wontfixing this is an op... [20:49:48] 10Continuous-Integration-Infrastructure, 10SyntaxHighlight, 10Patch-For-Review: Failed to invoke Pygments: /usr/bin/env: python: No such file or directory - https://phabricator.wikimedia.org/T197601#4296960 (10Legoktm) >>! In T197601#4297232, @Reedy wrote: > Backports are above. > > I don't really see any r... [20:52:13] 10Phabricator, 10Release-Engineering-Team, 10Mail, 10Operations, and 3 others: Phabricator outbound email seems to have a SPOF of mx1001 - https://phabricator.wikimedia.org/T196916#4300906 (10herron) [20:52:34] 10Continuous-Integration-Infrastructure, 10SyntaxHighlight, 10Patch-For-Review: Failed to invoke Pygments: /usr/bin/env: python: No such file or directory - https://phabricator.wikimedia.org/T197601#4300907 (10Reedy) >>! In T197601#4300900, @Legoktm wrote: >>>! In T197601#4297232, @Reedy wrote: >> Backports... [20:58:25] 10Phabricator, 10Project-Admins, 10Pywikibot-core: Merge #Pywikibot-General to #Pywikibot-core - https://phabricator.wikimedia.org/T195856#4300934 (10Xqt) I guess we can ignore tasks which have a pywikibot-compat Tag. [21:14:02] 10Phabricator, 10Project-Admins, 10Pywikibot-core: Merge #Pywikibot-General to #Pywikibot-core - https://phabricator.wikimedia.org/T195856#4300945 (10Aklapper) >>! In T195856#4300934, @Xqt wrote: > I guess we can ignore tasks which have a pywikibot-compat Tag. Alright! That reduces the number of tasks to up... [21:43:25] PROBLEM - Puppet errors on deployment-cache-text04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0]