[01:04:08] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10Zoranzoki21) [01:18:28] (03PS1) 10Zoranzoki21: Archive TimezoneSelector extension [integration/config] - 10https://gerrit.wikimedia.org/r/550048 (https://phabricator.wikimedia.org/T237894) [04:02:17] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Scoring-platform-team: gerrit: scoring/ores/editquality takes a long time to git gc - https://phabricator.wikimedia.org/T237807 (10thcipriani) FWIW, I ran [[ https://github.com/github/git-sizer | git-sizer ]] on... [04:29:30] PROBLEM - Free space - all mounts on deployment-sca01 is CRITICAL: CRITICAL: deployment-prep.deployment-sca01.diskspace._var.byte_percentfree (No valid datapoints found) deployment-prep.deployment-sca01.diskspace._srv.byte_percentfree (No valid datapoints found) deployment-prep.deployment-sca01.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-sca01.diskspace._var_log.byte_percentfree (No valid [04:29:30] d)deployment-prep.deployment-sca01.diskspace.root.byte_percentfree (<50.00%) [04:41:09] !log apt-get clean/autoclean and purge some 3.16 kernels from deployment-sca01 [04:41:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [04:54:28] RECOVERY - Free space - all mounts on deployment-sca01 is OK: OK: deployment-prep.deployment-sca01.diskspace._var.byte_percentfree (No valid datapoints found) deployment-prep.deployment-sca01.diskspace._srv.byte_percentfree (No valid datapoints found) deployment-prep.deployment-sca01.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-sca01.diskspace._var_log.byte_percentfree (No valid datapoints [05:47:44] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201911), 10Quibble, 10HHVM: Remove HHVM support from Quibble - https://phabricator.wikimedia.org/T236019 (10MaxSem) With the above patch merged, anything else left? [06:25:51] PROBLEM - Puppet staleness on deployment-chromium02 is CRITICAL: (Service Check Timed Out) [06:58:49] starting a 1k batch of upload/caption/depicts for beta commons, just like the ones last week. wait time 10 seconds between edits, as this seems to be ok. can't check maxlag due to the outstanding wikidata dispatch issue (dispatch to nonexistent wikis) [07:53:43] (03PS1) 10Robert Vogel: Add pattern based fallback for branches [integration/quibble] - 10https://gerrit.wikimedia.org/r/550087 [07:54:22] (03CR) 10jerkins-bot: [V: 04-1] Add pattern based fallback for branches [integration/quibble] - 10https://gerrit.wikimedia.org/r/550087 (owner: 10Robert Vogel) [07:55:59] 10Continuous-Integration-Config, 10BlueSpice: BlueSpice related tests fails on gate-and-submit-1.31 in quibble-composer tests - https://phabricator.wikimedia.org/T235807 (10Osnard) @hashar I have uploaded a patchset for the `cloner.py`: https://gerrit.wikimedia.org/r/#/c/integration/quibble/+/550087/ ATTENTION... [10:15:57] (03PS2) 10Robert Vogel: Add pattern based fallback for branches [integration/quibble] - 10https://gerrit.wikimedia.org/r/550087 [10:40:28] uploads are done, adding captions now [14:00:20] captions done, now doing depicts statements [14:56:51] (03PS1) 10Zoranzoki21: Add Jeblad in CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/550308 [14:57:31] (03CR) 10Zoranzoki21: "See https://gerrit.wikimedia.org/r/#/q/owner:%22John+Erling+Blad%22" [integration/config] - 10https://gerrit.wikimedia.org/r/550308 (owner: 10Zoranzoki21) [15:32:33] (03CR) 10Thiemo Kreuz (WMDE): [C: 03+1] Add Jeblad in CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/550308 (owner: 10Zoranzoki21) [16:22:15] (03CR) 10Awight: [C: 04-1] "I'll give this a quick try, I think I see a couple of seams. Thanks for the nudge!" [integration/quibble] - 10https://gerrit.wikimedia.org/r/545309 (owner: 10Awight) [16:24:10] about 420 depicts to go and that will be it for the day [16:44:05] 10Release-Engineering-Team (Code Health), 10MediaWiki-extensions-General, 10Code-Health, 10Discovery-Search (Current work): Migrate CirrusSearch MediaWikiIntegrationTestCase tests to MediaWikiUnitTestCase - https://phabricator.wikimedia.org/T232589 (10Gehel) [16:51:51] (03PS1) 10Awight: Remove deprecated code to hold reference open [integration/quibble] - 10https://gerrit.wikimedia.org/r/550333 [16:52:36] (03PS1) 10Awight: Don't provide parameter defaults [integration/quibble] - 10https://gerrit.wikimedia.org/r/550334 [16:57:01] (03PS1) 10Awight: Move dependencies from object to local scope [integration/quibble] - 10https://gerrit.wikimedia.org/r/550335 [17:01:28] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO (201911), 10International-Developer-Events, 10Wikimedia-Technical-Conference-2019, and 2 others: Wikimedia Technical Conference 2019 Session: System level testing: patterns an... - https://phabricator.wikimedia.org/T234635 [17:04:03] (03PS2) 10Awight: Move dependencies from object to local scope [integration/quibble] - 10https://gerrit.wikimedia.org/r/550335 [17:09:32] (03PS1) 10Awight: Pre-compute which stages will be run [integration/quibble] - 10https://gerrit.wikimedia.org/r/550337 [17:28:53] (03PS1) 10Awight: Move some state variables to local scope [integration/quibble] - 10https://gerrit.wikimedia.org/r/550344 [17:29:49] (03PS1) 10Awight: Cleanup: Pass args directly rather than as state [integration/quibble] - 10https://gerrit.wikimedia.org/r/550345 [17:30:28] (03PS8) 10Awight: Move argument parsing to module scope [integration/quibble] - 10https://gerrit.wikimedia.org/r/546125 [17:30:30] (03PS27) 10Awight: Commands expand recursively [integration/quibble] - 10https://gerrit.wikimedia.org/r/519776 [17:30:32] (03PS4) 10Awight: Cleanup: require all command parameter keywords [integration/quibble] - 10https://gerrit.wikimedia.org/r/546469 [17:30:34] (03PS6) 10Awight: Merge utility functions into calling modules [integration/quibble] - 10https://gerrit.wikimedia.org/r/546434 [17:30:36] (03PS14) 10Awight: Clean up logging [integration/quibble] - 10https://gerrit.wikimedia.org/r/546126 [17:30:38] (03PS10) 10Awight: Replace argparse with docopt [integration/quibble] - 10https://gerrit.wikimedia.org/r/546167 [17:30:40] (03PS11) 10Awight: Prepare to run browser suites in parallel [integration/quibble] - 10https://gerrit.wikimedia.org/r/545661 (https://phabricator.wikimedia.org/T226869) [17:47:53] PROBLEM - Parsoid on deployment-mediawiki-parsoid10 is CRITICAL: connect to address 172.16.0.141 and port 8000: Connection refused [17:47:53] PROBLEM - Parsoid on deployment-parsoid09 is CRITICAL: connect to address 172.16.5.63 and port 8000: Connection refused [18:03:59] depicts are done, and that's it for the day [18:18:48] (03Abandoned) 10Awight: Move class state into local variables [integration/quibble] - 10https://gerrit.wikimedia.org/r/545309 (owner: 10Awight) [18:21:41] (03PS3) 10Awight: Move dependencies from object to local scope [integration/quibble] - 10https://gerrit.wikimedia.org/r/550335 [18:22:21] (03CR) 10Awight: "PS3: restore PS1, there was pollution from another patch in PS2." [integration/quibble] - 10https://gerrit.wikimedia.org/r/550335 (owner: 10Awight) [18:25:32] 10Beta-Cluster-Infrastructure, 10Wikimedia-production-error: Undefined variable: wgGERestbaseUrl in CommonSettings-labs.php - https://phabricator.wikimedia.org/T238011 (10MaxSem) [18:27:16] (03PS2) 10Awight: Pre-compute which stages will be run [integration/quibble] - 10https://gerrit.wikimedia.org/r/550337 [18:27:18] (03PS2) 10Awight: Move some state variables to local scope [integration/quibble] - 10https://gerrit.wikimedia.org/r/550344 [18:27:20] (03PS2) 10Awight: Cleanup: Pass args directly rather than as state [integration/quibble] - 10https://gerrit.wikimedia.org/r/550345 [18:27:22] 10Beta-Cluster-Infrastructure, 10Growth-Team, 10GrowthExperiments, 10Wikimedia-production-error: Undefined variable: wgGERestbaseUrl in CommonSettings-labs.php - https://phabricator.wikimedia.org/T238011 (10Urbanecm) [18:27:24] (03PS9) 10Awight: Move argument parsing to module scope [integration/quibble] - 10https://gerrit.wikimedia.org/r/546125 [18:27:26] (03PS28) 10Awight: Commands expand recursively [integration/quibble] - 10https://gerrit.wikimedia.org/r/519776 [18:27:27] (03PS5) 10Awight: Cleanup: require all command parameter keywords [integration/quibble] - 10https://gerrit.wikimedia.org/r/546469 [18:27:30] (03PS7) 10Awight: Merge utility functions into calling modules [integration/quibble] - 10https://gerrit.wikimedia.org/r/546434 [18:27:32] (03PS15) 10Awight: Clean up logging [integration/quibble] - 10https://gerrit.wikimedia.org/r/546126 [18:27:34] (03PS11) 10Awight: Replace argparse with docopt [integration/quibble] - 10https://gerrit.wikimedia.org/r/546167 [18:27:36] (03PS12) 10Awight: Prepare to run browser suites in parallel [integration/quibble] - 10https://gerrit.wikimedia.org/r/545661 (https://phabricator.wikimedia.org/T226869) [18:47:38] 10Phabricator: Escaped HTML entity (" -> ") in Phabricator search result - https://phabricator.wikimedia.org/T238015 (10Bugreporter) [18:50:45] 10Beta-Cluster-Infrastructure, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10Patch-For-Review, and 2 others: Undefined variable: wgGERestbaseUrl in CommonSettings-labs.php - https://phabricator.wikimedia.org/T238011 (10Urbanecm) p:05Triage→03Low a:03Urbanecm [18:52:59] 10Beta-Cluster-Infrastructure, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-Urbanecm: Undefined variable: wgGERestbaseUrl in CommonSettings-labs.php - https://phabricator.wikimedia.org/T238011 (10Urbanecm) Not a prod error, it _should_ be beta only. [19:02:35] (03CR) 10Awight: "This doesn't feel quite useful enough, since it probably won't generalize beyond the specific use case." [integration/quibble] - 10https://gerrit.wikimedia.org/r/550087 (owner: 10Robert Vogel) [22:35:33] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Patch-For-Review: Upgrade to Gerrit 2.16.13 - https://phabricator.wikimedia.org/T200739 (10Paladox)