[00:52:13] PROBLEM - Puppet errors on integration-logstash-1001 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [01:02:19] PROBLEM - Host integration-logstash-1001 is DOWN: CRITICAL - Host Unreachable (10.68.18.116) [01:08:31] 10Phabricator, 10Security-Team, 10Patch-For-Review: Add 'risk' field to tasks created via advanced template - https://phabricator.wikimedia.org/T204138 (10Dzahn) At T204079#4579063 i renamed an existing ticket and was surprised to see a second action i did related to the Risk Rating. [01:43:20] woah COLORS [01:43:52] hehe, indeed [01:44:01] now that you say it, that's new, is it [01:44:18] or we just never had something going to "purple crit" ? [02:06:35] mutante: the alerts have been going for a while now, but they weren't purple until now... [02:09:45] they look pink :P [02:12:07] (03PS1) 10Legoktm: seccheck: Support older versions of the plugin that used etsy/phan [integration/config] - 10https://gerrit.wikimedia.org/r/460183 (https://phabricator.wikimedia.org/T204175) [02:15:18] (03PS2) 10Legoktm: seccheck: Support older versions of the plugin that used etsy/phan [integration/config] - 10https://gerrit.wikimedia.org/r/460183 (https://phabricator.wikimedia.org/T204175) [02:15:33] (03CR) 10Legoktm: [C: 032] seccheck: Support older versions of the plugin that used etsy/phan [integration/config] - 10https://gerrit.wikimedia.org/r/460183 (https://phabricator.wikimedia.org/T204175) (owner: 10Legoktm) [02:17:16] (03Merged) 10jenkins-bot: seccheck: Support older versions of the plugin that used etsy/phan [integration/config] - 10https://gerrit.wikimedia.org/r/460183 (https://phabricator.wikimedia.org/T204175) (owner: 10Legoktm) [02:19:27] (03PS1) 10Legoktm: Follow-up bbb736f3f19c8: quote "$PHAN" [integration/config] - 10https://gerrit.wikimedia.org/r/460184 [02:19:49] (03CR) 10Legoktm: [C: 032] Follow-up bbb736f3f19c8: quote "$PHAN" [integration/config] - 10https://gerrit.wikimedia.org/r/460184 (owner: 10Legoktm) [02:22:16] (03Merged) 10jenkins-bot: Follow-up bbb736f3f19c8: quote "$PHAN" [integration/config] - 10https://gerrit.wikimedia.org/r/460184 (owner: 10Legoktm) [02:23:02] !log deploying https://gerrit.wikimedia.org/r/460183 / https://gerrit.wikimedia.org/r/460184 [02:23:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [02:24:34] (03PS1) 10Legoktm: Use mediawiki-phan-seccheck:0.3.1 [integration/config] - 10https://gerrit.wikimedia.org/r/460186 [02:32:16] (03CR) 10Legoktm: [C: 032] Use mediawiki-phan-seccheck:0.3.1 [integration/config] - 10https://gerrit.wikimedia.org/r/460186 (owner: 10Legoktm) [02:34:38] (03Merged) 10jenkins-bot: Use mediawiki-phan-seccheck:0.3.1 [integration/config] - 10https://gerrit.wikimedia.org/r/460186 (owner: 10Legoktm) [02:34:50] 10Continuous-Integration-Config, 10Cite, 10Patch-For-Review: mwext-php70-phan-seccheck-docker failing on Cite due to hardcoding phan/phan dependency - https://phabricator.wikimedia.org/T204175 (10Legoktm) 05Open>03Resolved p:05Triage>03High [03:51:56] maintenance-disconnect-full-disks build 2453 integration-slave-docker-1021 (/: 95%): OFFLINE due to disk space [03:51:56] maintenance-disconnect-full-disks build 2453 integration-slave-docker-1021 (/: 95%): OFFLINE due to disk space [03:55:11] maintenance-disconnect-full-disks build 2454 integration-slave-docker-1021: OFFLINE due to disk space [04:00:11] maintenance-disconnect-full-disks build 2455 integration-slave-docker-1021: OFFLINE due to disk space [04:05:12] maintenance-disconnect-full-disks build 2456 integration-slave-docker-1021: OFFLINE due to disk space [04:10:16] maintenance-disconnect-full-disks build 2457 integration-slave-docker-1021: OFFLINE due to disk space [04:15:12] maintenance-disconnect-full-disks build 2458 integration-slave-docker-1021: OFFLINE due to disk space [04:20:13] maintenance-disconnect-full-disks build 2459 integration-slave-docker-1021: OFFLINE due to disk space [04:25:19] maintenance-disconnect-full-disks build 2460 integration-slave-docker-1021: OFFLINE due to disk space [04:30:11] maintenance-disconnect-full-disks build 2461 integration-slave-docker-1021: OFFLINE due to disk space [04:35:11] maintenance-disconnect-full-disks build 2462 integration-slave-docker-1021: OFFLINE due to disk space [04:40:12] maintenance-disconnect-full-disks build 2463 integration-slave-docker-1021: OFFLINE due to disk space [04:45:11] maintenance-disconnect-full-disks build 2464 integration-slave-docker-1021: OFFLINE due to disk space [04:50:12] maintenance-disconnect-full-disks build 2465 integration-slave-docker-1021: OFFLINE due to disk space [04:55:12] maintenance-disconnect-full-disks build 2466 integration-slave-docker-1021: OFFLINE due to disk space [05:00:12] maintenance-disconnect-full-disks build 2467 integration-slave-docker-1021: OFFLINE due to disk space [05:04:21] (03PS1) 10Legoktm: seccheck for WikimediaMaintenance [integration/config] - 10https://gerrit.wikimedia.org/r/460196 [05:05:13] maintenance-disconnect-full-disks build 2468 integration-slave-docker-1021: OFFLINE due to disk space [05:05:39] (03CR) 10Legoktm: [C: 032] seccheck for WikimediaMaintenance [integration/config] - 10https://gerrit.wikimedia.org/r/460196 (owner: 10Legoktm) [05:08:23] (03Merged) 10jenkins-bot: seccheck for WikimediaMaintenance [integration/config] - 10https://gerrit.wikimedia.org/r/460196 (owner: 10Legoktm) [05:08:53] !log deployed [05:08:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:10:11] maintenance-disconnect-full-disks build 2469 integration-slave-docker-1021: OFFLINE due to disk space [05:10:18] ok ok I'll look [05:12:46] !log legoktm@integration-slave-docker-1021:~$ sudo docker rmi $(sudo docker images -q) [05:12:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:13:31] !log onlined integration-slave-docker-1021 [05:13:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:33:47] (03PS1) 10Legoktm: Rename "extension-phan-generic" template to "extension-phan" [integration/config] - 10https://gerrit.wikimedia.org/r/460197 [05:53:30] (03PS1) 10Legoktm: mediawiki-phan: Update to php-ast 0.1.6 from packages.sury.org [integration/config] - 10https://gerrit.wikimedia.org/r/460199 (https://phabricator.wikimedia.org/T174339) [05:53:48] (03CR) 10Legoktm: [C: 032] Rename "extension-phan-generic" template to "extension-phan" [integration/config] - 10https://gerrit.wikimedia.org/r/460197 (owner: 10Legoktm) [05:55:12] (03Merged) 10jenkins-bot: Rename "extension-phan-generic" template to "extension-phan" [integration/config] - 10https://gerrit.wikimedia.org/r/460197 (owner: 10Legoktm) [05:55:46] !log deployed https://gerrit.wikimedia.org/r/460197 (no-op) [05:55:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:56:02] (03CR) 10Legoktm: [C: 032] mediawiki-phan: Update to php-ast 0.1.6 from packages.sury.org [integration/config] - 10https://gerrit.wikimedia.org/r/460199 (https://phabricator.wikimedia.org/T174339) (owner: 10Legoktm) [05:57:51] (03Merged) 10jenkins-bot: mediawiki-phan: Update to php-ast 0.1.6 from packages.sury.org [integration/config] - 10https://gerrit.wikimedia.org/r/460199 (https://phabricator.wikimedia.org/T174339) (owner: 10Legoktm) [05:58:19] !log updating docker for https://gerrit.wikimedia.org/r/460199 [05:58:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:58:59] [contint1001.wikimedia.org] out: ERROR: image docker-registry.discovery.wmnet/releng/mediawiki-phan failed to build, see logs for details [05:59:01] :(( [06:03:21] (03PS1) 10Legoktm: Follow-up 1fb0187414535d: Forgot to git add php-ast.pin [integration/config] - 10https://gerrit.wikimedia.org/r/460201 [06:03:36] (03CR) 10Legoktm: [C: 032] Follow-up 1fb0187414535d: Forgot to git add php-ast.pin [integration/config] - 10https://gerrit.wikimedia.org/r/460201 (owner: 10Legoktm) [06:05:18] (03Merged) 10jenkins-bot: Follow-up 1fb0187414535d: Forgot to git add php-ast.pin [integration/config] - 10https://gerrit.wikimedia.org/r/460201 (owner: 10Legoktm) [06:10:03] (03PS1) 10Legoktm: Use mediawiki-phan:0.1.5 for extensions [integration/config] - 10https://gerrit.wikimedia.org/r/460203 [06:10:05] (03PS1) 10Legoktm: Use mediawiki-phan:0.1.5 for MediaWiki core [integration/config] - 10https://gerrit.wikimedia.org/r/460204 [06:12:07] (03CR) 10Krinkle: [C: 031] Add mw ext ContentTranslation to gated extensions (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/450508 (https://phabricator.wikimedia.org/T86930) (owner: 10Santhosh) [06:14:59] (03CR) 10Legoktm: [C: 04-1] "Dunno why, but this broke our current version of phan. " [integration/config] - 10https://gerrit.wikimedia.org/r/460203 (owner: 10Legoktm) [06:16:42] 10Continuous-Integration-Config, 10Patch-For-Review, 10User-Addshore: Allow use of phan 0.8.5+ in wikimedia CI - https://phabricator.wikimedia.org/T174339 (10Legoktm) The new `php-ast` breaks the existing phan we have, so I haven't rolled it out yet: https://integration.wikimedia.org/ci/job/mwext-php70-phan... [06:17:49] (03CR) 10Legoktm: [C: 04-1] Use mediawiki-phan:0.1.5 for MediaWiki core [integration/config] - 10https://gerrit.wikimedia.org/r/460204 (owner: 10Legoktm) [06:45:54] PROBLEM - Puppet errors on integration-slave-docker-1033 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [07:07:25] 10Continuous-Integration-Config, 10Patch-For-Review, 10User-Addshore: Allow use of phan 0.8.5+ in wikimedia CI - https://phabricator.wikimedia.org/T174339 (10Addshore) I mean, we don't have to use the new version of ast with our current version on phantom though do we? We can continue using the old version,... [07:25:55] RECOVERY - Puppet errors on integration-slave-docker-1033 is OK: OK: Less than 1.00% above the threshold [0.0] [07:29:05] 10MediaWiki-Codesniffer: Add sniff that preg_quote should not be used with 1 argument - https://phabricator.wikimedia.org/T203312 (10Bawolff) FWIW, Personally, I dislike the idea of using brackets as a delimiter. That seems confusing. > Using the taint-check-plugin to ensure that user provided input is escaped... [08:36:53] 10Release-Engineering-Team (Watching / External), 10Core-Platform-Team (CPT-Q1-Jul-Sep-2018), 10Epic, 10User-notice: Deploy refactored comment storage - https://phabricator.wikimedia.org/T166733 (10Marostegui) [08:42:11] !log aborted maintenance-disconnect-full-disks job | T204077 [08:42:17] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:42:17] T204077: maintenance-disconnect-full-disks gets stuck - https://phabricator.wikimedia.org/T204077 [08:43:24] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: maintenance-disconnect-full-disks gets stuck - https://phabricator.wikimedia.org/T204077 (10hashar) The job got stuck eventually ( [[ https://integration.wikimedia.org/ci/job/maintenance-disconnect-full-disks/23... [08:57:37] !log Updating jenkins job mwselenium-quibble-docker to use Chromium 69/Firefox 60 | T203902 [08:57:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:57:43] (03CR) 10Hashar: [C: 032] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/459577 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [08:57:43] T203902: Rebuild quibble images for Chrome 69 and Firefox 60 - https://phabricator.wikimedia.org/T203902 [08:59:51] (03Merged) 10jenkins-bot: Bump wdio selenium jobs Chromium 69/Firefox 60 [integration/config] - 10https://gerrit.wikimedia.org/r/459577 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:00:40] (03PS2) 10Hashar: Quibble Stretch jobs with Chromium 69 [integration/config] - 10https://gerrit.wikimedia.org/r/459576 (https://phabricator.wikimedia.org/T203902) [09:00:50] (03CR) 10Hashar: [C: 032] Quibble Stretch jobs with Chromium 69 [integration/config] - 10https://gerrit.wikimedia.org/r/459576 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:02:32] (03Merged) 10jenkins-bot: Quibble Stretch jobs with Chromium 69 [integration/config] - 10https://gerrit.wikimedia.org/r/459576 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:11:27] (03PS1) 10Cparle: Add ULS to requirements for WikibaseMediainfo [integration/config] - 10https://gerrit.wikimedia.org/r/460285 (https://phabricator.wikimedia.org/T202287) [09:26:31] 10Release-Engineering-Team (Watching / External), 10Core-Platform-Team, 10Wikidata, 10Patch-For-Review: What happens if the Wikibase project specifies a version of a library outside of the range included in mediawiki-vendor? - https://phabricator.wikimedia.org/T179663 (10Addshore) I wrote a crappy script t... [09:32:47] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Rebuild quibble images for Chrome 69 and Firefox 60 - https://phabricator.wikimedia.org/T203902 (10hashar) I have checked all images on contint1001 using: docker images|awk '{ print $1 ":" $2 }'|egre... [09:37:19] (03CR) 10Matthias Mullie: [C: 031] Add ULS to requirements for WikibaseMediainfo [integration/config] - 10https://gerrit.wikimedia.org/r/460285 (https://phabricator.wikimedia.org/T202287) (owner: 10Cparle) [09:37:26] (03PS1) 10Hashar: Update jobs to use releng/npm-browser-test:0.2.0 [integration/config] - 10https://gerrit.wikimedia.org/r/460292 (https://phabricator.wikimedia.org/T203902) [09:39:26] (03CR) 10Hashar: [C: 032] Update jobs to use releng/npm-browser-test:0.2.0 [integration/config] - 10https://gerrit.wikimedia.org/r/460292 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:41:14] (03Merged) 10jenkins-bot: Update jobs to use releng/npm-browser-test:0.2.0 [integration/config] - 10https://gerrit.wikimedia.org/r/460292 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:43:41] (03PS1) 10Hashar: Update Firefox/Chromium for language-screenshots-VisualEditor [integration/config] - 10https://gerrit.wikimedia.org/r/460293 (https://phabricator.wikimedia.org/T203902) [09:44:00] (03CR) 10Hashar: [C: 032] Update Firefox/Chromium for language-screenshots-VisualEditor [integration/config] - 10https://gerrit.wikimedia.org/r/460293 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:45:46] (03Merged) 10jenkins-bot: Update Firefox/Chromium for language-screenshots-VisualEditor [integration/config] - 10https://gerrit.wikimedia.org/r/460293 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:45:57] (03PS1) 10Hashar: Update Firefox/Chromium for selenium-daily-beta-* jobs [integration/config] - 10https://gerrit.wikimedia.org/r/460295 (https://phabricator.wikimedia.org/T203902) [09:46:07] (03CR) 10Hashar: [C: 032] Update Firefox/Chromium for selenium-daily-beta-* jobs [integration/config] - 10https://gerrit.wikimedia.org/r/460295 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:47:53] (03Merged) 10jenkins-bot: Update Firefox/Chromium for selenium-daily-beta-* jobs [integration/config] - 10https://gerrit.wikimedia.org/r/460295 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:52:44] (03PS1) 10Hashar: Update Chromium for mediawiki/services/chromium-render [integration/config] - 10https://gerrit.wikimedia.org/r/460298 (https://phabricator.wikimedia.org/T203902) [09:53:22] (03CR) 10Hashar: [C: 032] Update Chromium for mediawiki/services/chromium-render [integration/config] - 10https://gerrit.wikimedia.org/r/460298 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:55:16] (03Merged) 10jenkins-bot: Update Chromium for mediawiki/services/chromium-render [integration/config] - 10https://gerrit.wikimedia.org/r/460298 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:57:01] (03PS1) 10Hashar: Update Chromium and Firefox for VisualEditor [integration/config] - 10https://gerrit.wikimedia.org/r/460300 (https://phabricator.wikimedia.org/T203902) [09:57:11] (03CR) 10Hashar: [C: 032] Update Chromium and Firefox for VisualEditor [integration/config] - 10https://gerrit.wikimedia.org/r/460300 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [09:59:23] (03Merged) 10jenkins-bot: Update Chromium and Firefox for VisualEditor [integration/config] - 10https://gerrit.wikimedia.org/r/460300 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:01:35] (03PS1) 10Hashar: Update Chromium for oojs/core and oojs/router [integration/config] - 10https://gerrit.wikimedia.org/r/460302 (https://phabricator.wikimedia.org/T203902) [10:01:47] (03CR) 10Hashar: [C: 032] Update Chromium for oojs/core and oojs/router [integration/config] - 10https://gerrit.wikimedia.org/r/460302 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:03:41] (03Merged) 10jenkins-bot: Update Chromium for oojs/core and oojs/router [integration/config] - 10https://gerrit.wikimedia.org/r/460302 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:03:51] (03PS1) 10Hashar: Update Chromium for unicodejs [integration/config] - 10https://gerrit.wikimedia.org/r/460303 (https://phabricator.wikimedia.org/T203902) [10:04:20] (03CR) 10Hashar: [C: 032] Update Chromium for unicodejs [integration/config] - 10https://gerrit.wikimedia.org/r/460303 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:06:16] (03PS1) 10Hashar: Update Chromium for analytics/mediawiki-storage [integration/config] - 10https://gerrit.wikimedia.org/r/460305 (https://phabricator.wikimedia.org/T203902) [10:07:06] (03Merged) 10jenkins-bot: Update Chromium for unicodejs [integration/config] - 10https://gerrit.wikimedia.org/r/460303 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:07:08] (03PS1) 10Hashar: Update Chromium for analytics/wikistats2 [integration/config] - 10https://gerrit.wikimedia.org/r/460306 (https://phabricator.wikimedia.org/T203902) [10:07:20] (03CR) 10Hashar: [C: 032] Update Chromium for analytics/wikistats2 [integration/config] - 10https://gerrit.wikimedia.org/r/460306 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:08:45] (03PS1) 10Hashar: Update Chromium for wikibase/data-values-value [integration/config] - 10https://gerrit.wikimedia.org/r/460308 (https://phabricator.wikimedia.org/T203902) [10:08:47] (03PS1) 10Hashar: Update Chromium for wikibase/javascript-api [integration/config] - 10https://gerrit.wikimedia.org/r/460309 (https://phabricator.wikimedia.org/T203902) [10:09:08] (03CR) 10Hashar: [C: 032] Update Chromium for wikibase/javascript-api [integration/config] - 10https://gerrit.wikimedia.org/r/460309 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:09:12] (03CR) 10Hashar: [C: 032] Update Chromium for wikibase/data-values-value [integration/config] - 10https://gerrit.wikimedia.org/r/460308 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:10:17] (03PS1) 10Hashar: Update Chromium for wikidata/query/gui [integration/config] - 10https://gerrit.wikimedia.org/r/460310 (https://phabricator.wikimedia.org/T203902) [10:10:38] (03CR) 10Hashar: [C: 032] Update Chromium for wikidata/query/gui [integration/config] - 10https://gerrit.wikimedia.org/r/460310 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:11:42] (03PS1) 10Hashar: Update Chromium for wikimedia/portals [integration/config] - 10https://gerrit.wikimedia.org/r/460311 (https://phabricator.wikimedia.org/T203902) [10:13:39] (03PS1) 10Hashar: Update Chromium on mwgate-npm-browser-node-6-docker [integration/config] - 10https://gerrit.wikimedia.org/r/460312 (https://phabricator.wikimedia.org/T203902) [10:14:52] (03PS1) 10Hashar: Update container of {name}-npm-browser-node-6-docker [integration/config] - 10https://gerrit.wikimedia.org/r/460313 (https://phabricator.wikimedia.org/T203902) [10:16:05] (03CR) 10Hashar: [C: 032] Update Chromium for analytics/mediawiki-storage [integration/config] - 10https://gerrit.wikimedia.org/r/460305 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:16:08] (03CR) 10Hashar: [C: 032] Update container of {name}-npm-browser-node-6-docker [integration/config] - 10https://gerrit.wikimedia.org/r/460313 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:16:10] (03CR) 10Hashar: [C: 032] Update Chromium for wikimedia/portals [integration/config] - 10https://gerrit.wikimedia.org/r/460311 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:16:13] (03CR) 10Hashar: [C: 032] Update Chromium on mwgate-npm-browser-node-6-docker [integration/config] - 10https://gerrit.wikimedia.org/r/460312 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:18:01] (03PS4) 10Hashar: selenium-daily-beta jobs for Wikibase/WikibaseLexeme [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [10:18:32] (03Merged) 10jenkins-bot: Update Chromium for analytics/mediawiki-storage [integration/config] - 10https://gerrit.wikimedia.org/r/460305 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:18:42] (03Merged) 10jenkins-bot: Update Chromium for analytics/wikistats2 [integration/config] - 10https://gerrit.wikimedia.org/r/460306 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:18:57] (03Merged) 10jenkins-bot: Update Chromium for wikibase/data-values-value [integration/config] - 10https://gerrit.wikimedia.org/r/460308 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:18:59] (03Merged) 10jenkins-bot: Update Chromium for wikibase/javascript-api [integration/config] - 10https://gerrit.wikimedia.org/r/460309 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:19:02] (03Merged) 10jenkins-bot: Update Chromium for wikidata/query/gui [integration/config] - 10https://gerrit.wikimedia.org/r/460310 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:19:05] (03Merged) 10jenkins-bot: Update Chromium for wikimedia/portals [integration/config] - 10https://gerrit.wikimedia.org/r/460311 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:19:08] (03Merged) 10jenkins-bot: Update Chromium on mwgate-npm-browser-node-6-docker [integration/config] - 10https://gerrit.wikimedia.org/r/460312 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:19:10] (03Merged) 10jenkins-bot: Update container of {name}-npm-browser-node-6-docker [integration/config] - 10https://gerrit.wikimedia.org/r/460313 (https://phabricator.wikimedia.org/T203902) (owner: 10Hashar) [10:19:12] (03CR) 10Hashar: "Rebased and redeployed the dummy jobs to use docker-registry.wikimedia.org/releng/npm-browser-test:0.3.0 that brings Chromium 69 and Fir" [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [10:21:10] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team, 10Quibble, 10Patch-For-Review, 10Regression: Quibble MariaDB should use a tmpfs as a datadir - https://phabricator.wikimedia.org/T203181 (10hashar) [10:21:14] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Rebuild quibble images for Chrome 69 and Firefox 60 - https://phabricator.wikimedia.org/T203902 (10hashar) 05Open>03Resolved I have made a change per repository so we can easily revert if somethin... [10:25:56] 10Continuous-Integration-Config, 10Wikidata, 10Patch-For-Review, 10User-Addshore: Add more Wikibase extensions to gatedextensions - https://phabricator.wikimedia.org/T204153 (10Addshore) a:05daniel>03None [10:26:16] 10Continuous-Integration-Config, 10Wikidata, 10wikidata-tech-focus, 10Patch-For-Review, 10User-Addshore: Add more Wikibase extensions to gatedextensions - https://phabricator.wikimedia.org/T204153 (10Addshore) [10:31:24] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Move CI docker storage engine to device mapper - https://phabricator.wikimedia.org/T203841 (10hashar) >>! In T203841#4575871, @dduvall wrote: > Additionally, there appear to be some issues with the direct-lvm dr... [11:05:31] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [11:10:23] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [11:11:08] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [11:11:57] 10Release-Engineering-Team (Kanban), 10Wikidata, 10Wikidata-Campsite, 10Patch-For-Review, 10User-zeljkofilipin: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432 (10zeljkofilipin) [11:18:15] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [11:41:24] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban): mwselenium-quibble-docker jobs broken on WikibaseLexeme - https://phabricator.wikimedia.org/T204214 (10Jakob_WMDE) p:05Triage>03High [11:43:23] hasharNap: https://phabricator.wikimedia.org/T204214 :( (for when you get back from nap) [11:45:34] addshore: ah that one is easy :) [11:48:45] (03PS1) 10Hashar: Revert "Bump wdio selenium jobs Chromium 69/Firefox 60" [integration/config] - 10https://gerrit.wikimedia.org/r/460330 (https://phabricator.wikimedia.org/T204124) [11:50:10] (03PS2) 10Hashar: Revert "Bump wdio selenium jobs Chromium 69/Firefox 60" [integration/config] - 10https://gerrit.wikimedia.org/r/460330 (https://phabricator.wikimedia.org/T204124) [11:50:52] (03CR) 10Hashar: [C: 032] Revert "Bump wdio selenium jobs Chromium 69/Firefox 60" [integration/config] - 10https://gerrit.wikimedia.org/r/460330 (https://phabricator.wikimedia.org/T204124) (owner: 10Hashar) [11:51:00] addshore: should be good now [11:53:25] (03Merged) 10jenkins-bot: Revert "Bump wdio selenium jobs Chromium 69/Firefox 60" [integration/config] - 10https://gerrit.wikimedia.org/r/460330 (https://phabricator.wikimedia.org/T204124) (owner: 10Hashar) [11:55:13] hey all [11:56:11] quick question, Reading-Web wants to remove the Makefile from MobileFrontend extension, I just want to make sure that none of our stuff (zuul/docs generation etc) uses the make command [12:00:31] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:02:03] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:02:48] (03PS5) 10Zfilipin: selenium-daily-beta jobs [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) [12:04:54] (03CR) 10Zfilipin: "PS5 adds ORES" [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [12:05:17] (03PS6) 10Zfilipin: WIP selenium-daily-beta jobs [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) [12:05:41] (03CR) 10Zfilipin: "PS6 adds WIP to the commit message." [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [12:11:54] https://www.gerritcodereview.com/2018-09-06-gerrit-ux-newsletter-jun-aug-2018.html [12:15:42] (03CR) 10Hashar: [C: 032] "That was for T204214" [integration/config] - 10https://gerrit.wikimedia.org/r/460330 (https://phabricator.wikimedia.org/T204124) (owner: 10Hashar) [12:21:44] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban): mwselenium-quibble-docker jobs broken on WikibaseLexeme - https://phabricator.wikimedia.org/T204214 (10hashar) Reverted with https://gerrit.wikimedia.org/r/#/c/integration/config/+/460330/ The container has updated Firefo... [12:23:38] zeljkof: I have updated Firefox on CI to version 60 which also means that selenium-webdriver can no more drive firefox [12:23:49] some things here and there might be broken as a result [12:24:00] hashar: well, just ruby tests :D [12:24:08] node tests use chrome [12:29:18] pmiazga: Usually, the easiest thing is to make a patch, and commit it and see if/what breaks (at least for normal tests. Doesn't help for doc generation obvs) [13:00:09] Reedy: we have a patch and it looks ok but I'm worried about things like doc generation. That's why I asked [13:06:41] !log Nuking castor cache /srv/jenkins-workspace/caches/mediawiki-vendor mediawiki/vendor fails composer --ansi validate --no-check-publish [13:06:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:06:48] Reedy: ^^ I am cleaning out the cache [13:06:51] thanks [13:07:04] pmiazga: I can't see anything in integration/config special casing MF for either PHP or JS doc (and it's not the only extension) that would suggest that uses the makefile [13:07:45] pmiazga: check on a merged change what kind of jobs ran after the merge, that would give you an indication as to whether make got used [13:07:57] pmiazga: most probably it has not. I don't think we have much jobs running make :] [13:08:24] ok, thx [13:08:40] btw - thats the patch I'm talking about https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/MobileFrontend/+/459854/ [13:29:01] 10Phabricator, 10Security-Team, 10Patch-For-Review: Add 'risk' field to tasks created via advanced template - https://phabricator.wikimedia.org/T204138 (10chasemp) Yes apologies, we reconsidered shortly after we added it to the default advanced edit form. We can look at cleaning up the couple outliers if it... [13:30:05] (03CR) 10Hashar: "Can you split ORES / Wikibase and WikibaseLexeme each in their own changes? They are currently failing for different reasons which would b" [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [13:49:52] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Mail, 10Operations, and 2 others: Ensure Jenkins mail configuration supports outbound smtp server failover - https://phabricator.wikimedia.org/T203607 (10herron) [13:53:43] (03CR) 10Hashar: "Not all slaves have /var/lib/docker so you might want to handle a partition missing?" [integration/config] - 10https://gerrit.wikimedia.org/r/460176 (owner: 10Thcipriani) [14:01:50] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: maintenance-disconnect-full-disks gets stuck - https://phabricator.wikimedia.org/T204077 (10thcipriani) >>! In T204077#4579698, @Stashbot wrote: > {nav icon=file, name=Mentioned in SAL (#wikimedia-releng), href=... [14:03:40] (03PS1) 10Pwirth: Edit Project Config [extensions/NotesLink] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/460364 [14:04:11] (03Abandoned) 10Pwirth: Edit Project Config [extensions/NotesLink] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/460364 (owner: 10Pwirth) [14:04:47] (03CR) 10Thcipriani: "> Not all slaves have /var/lib/docker so you might want to handle a" [integration/config] - 10https://gerrit.wikimedia.org/r/460176 (owner: 10Thcipriani) [14:24:05] Project beta-scap-eqiad build #221838: 04FAILURE in 13 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221838/ [14:24:39] 14:24:04 14:24:04 Last output: [14:24:39] 14:24:04 sudo: a password is required [14:24:39] 14:24:04 14:24:04 Last output: [14:24:39] 14:24:04 sudo: a password is required [14:33:01] Reedy, any idea what command it might be trying to run? [14:34:35] somethign to do with l10nupdate [14:35:18] well okay I got that much from the console log :p [14:37:22] (03PS2) 10Hashar: QA report for gated extensions and their dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/460080 [14:38:40] Yippee, build fixed! [14:38:40] Project beta-scap-eqiad build #221839: 09FIXED in 13 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221839/ [14:40:34] lol [14:40:35] https://github.com/wikimedia/scap/blob/ba6dfc1336caee255e10a3d97de88e2d62b5467e/scap/tasks.py#L509-L552 [14:40:39] Must've been a permissions flap [14:45:32] (03PS3) 10Hashar: QA report for gated extensions and their dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/460080 (https://phabricator.wikimedia.org/T204153) [14:46:52] (03CR) 10Hashar: [C: 032] "Which yields:" [integration/config] - 10https://gerrit.wikimedia.org/r/460080 (https://phabricator.wikimedia.org/T204153) (owner: 10Hashar) [14:48:28] (03Merged) 10jenkins-bot: QA report for gated extensions and their dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/460080 (https://phabricator.wikimedia.org/T204153) (owner: 10Hashar) [14:49:01] 10Continuous-Integration-Config, 10Wikidata, 10wikidata-tech-focus, 10Patch-For-Review, 10User-Addshore: Add more Wikibase extensions to gatedextensions - https://phabricator.wikimedia.org/T204153 (10hashar) I have created a dummy test that tracks whether dependencies of gated extensions are also in the... [14:51:27] (03CR) 10Hashar: [C: 032] "Sounds good :]" [integration/config] - 10https://gerrit.wikimedia.org/r/460285 (https://phabricator.wikimedia.org/T202287) (owner: 10Cparle) [14:53:53] (03Merged) 10jenkins-bot: Add ULS to requirements for WikibaseMediainfo [integration/config] - 10https://gerrit.wikimedia.org/r/460285 (https://phabricator.wikimedia.org/T202287) (owner: 10Cparle) [14:56:38] (03PS1) 10Hashar: Enhance QA output of test_deps_of_gated_are_in_gate [integration/config] - 10https://gerrit.wikimedia.org/r/460373 [14:57:24] (03CR) 10Hashar: [C: 032] Enhance QA output of test_deps_of_gated_are_in_gate [integration/config] - 10https://gerrit.wikimedia.org/r/460373 (owner: 10Hashar) [14:58:48] (03Merged) 10jenkins-bot: Enhance QA output of test_deps_of_gated_are_in_gate [integration/config] - 10https://gerrit.wikimedia.org/r/460373 (owner: 10Hashar) [15:02:43] (03PS1) 10Hashar: Clarify message for test_deps_of_gated_are_in_gate [integration/config] - 10https://gerrit.wikimedia.org/r/460374 [15:03:26] 10Release-Engineering-Team (Watching / External), 10Operations, 10Release Pipeline: Update Debian package of Blubber (0.5.0-1) - https://phabricator.wikimedia.org/T203121 (10akosiaris) 05Open>03Resolved a:03akosiaris Packages built and uploaded to both stretch-wikimedia and jessie-wikimedia. Resolving,... [15:04:37] addshore: and I got a report of gated projects dependencies that are not in the gate: https://integration.wikimedia.org/ci/job/integration-config-qa/lastBuild/testReport/(root)/test_zuul_gate_and_dependencies/ :] [15:19:22] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10hashar) [15:19:51] 10Continuous-Integration-Config, 10Wikidata, 10wikidata-tech-focus, 10Patch-For-Review, 10User-Addshore: Add more Wikibase extensions to gatedextensions - https://phabricator.wikimedia.org/T204153 (10hashar) [15:19:54] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10hashar) [15:20:30] 10Continuous-Integration-Config, 10MediaWiki-extensions-Scribunto, 10Wikidata: [Task] Add Scribunto to extension-gate in CI - https://phabricator.wikimedia.org/T125050 (10hashar) [15:20:34] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10hashar) [15:25:37] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10hashar) [15:26:15] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10hashar) [15:26:18] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Performance-Team (Radar), 10Wikimedia-production-error (Shared Build Failure): Add AntiSpoof to shared extension gate - https://phabricator.wikimedia.org/T198653 (10hashar) [15:28:03] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10hashar) [15:34:25] 10Continuous-Integration-Config, 10Wikidata: Wikibase CI: Quibble job should possibly include Math extension - https://phabricator.wikimedia.org/T201496 (10hashar) Slightly related, 204252 is about having dependencies added for all currently gated extensions. [15:35:33] 10Continuous-Integration-Config, 10Patch-For-Review: Wikibase CI: wmf-quibble-vendor-mysql-hhvm-docker job should include Scribunto - https://phabricator.wikimedia.org/T200976 (10hashar) [15:35:36] 10Continuous-Integration-Config, 10MediaWiki-extensions-Scribunto, 10Wikidata: [Task] Add Scribunto to extension-gate in CI - https://phabricator.wikimedia.org/T125050 (10hashar) [15:36:23] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): Have dependencies of gated extensions in the gate - https://phabricator.wikimedia.org/T204252 (10hashar) [15:40:29] (03PS1) 10Hashar: Add mediawiki/extensions/GoogleAuthenticator [integration/config] - 10https://gerrit.wikimedia.org/r/460383 [15:41:23] hashar: hashar indeed :p [15:41:32] (03PS1) 10Hashar: Add mediawiki/extensions/NotesLink [integration/config] - 10https://gerrit.wikimedia.org/r/460384 [15:41:41] another good test would be deployed extension / extensions in extensions-list that are not in the gate :P [15:41:44] * addshore runs [15:41:51] (03CR) 10Hashar: [C: 032] Add mediawiki/extensions/NotesLink [integration/config] - 10https://gerrit.wikimedia.org/r/460384 (owner: 10Hashar) [15:41:56] (03CR) 10Hashar: [C: 032] Add mediawiki/extensions/GoogleAuthenticator [integration/config] - 10https://gerrit.wikimedia.org/r/460383 (owner: 10Hashar) [15:43:28] (03Merged) 10jenkins-bot: Add mediawiki/extensions/GoogleAuthenticator [integration/config] - 10https://gerrit.wikimedia.org/r/460383 (owner: 10Hashar) [15:44:40] (03Merged) 10jenkins-bot: Add mediawiki/extensions/NotesLink [integration/config] - 10https://gerrit.wikimedia.org/r/460384 (owner: 10Hashar) [15:58:23] (03CR) 10Zfilipin: "> Patch Set 6:" [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [16:16:13] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [16:22:21] !log Cleaning disk space on deployment-deploy01.deployment-prep.eqiad.wmflabs [16:22:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:23:21] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [16:34:13] deployment-deploy01.deployment-prep.eqiad.wmflabs is too full :-((( [16:34:19] /srv/deploy has a lot of things [16:34:37] / has countless copies of mediawiki/core + extensions (cough l10nupdate) [16:36:56] 10Release-Engineering-Team (Watching / External), 10Core-Platform-Team (CPT-Q1-Jul-Sep-2018), 10Epic, 10User-notice: Deploy refactored comment storage - https://phabricator.wikimedia.org/T166733 (10Bstorm) [16:40:50] thcipriani: what is that "new" operations/software/keyholder ??? [16:41:26] * thcipriani looks for context task [16:41:32] hmm got imported somehow from somewhere [16:41:45] I guess it was in puppet.git and got moved to a standalone repo [16:41:55] https://phabricator.wikimedia.org/T203003 [16:41:57] the commit dates are odds [16:42:16] so we created a keyholder repo for the blog post on the foundation site [16:42:18] at least we get the history :] [16:42:41] and then a 3rd party user fixed a bug for us on that repo, which was great [16:42:53] 10Release-Engineering-Team, 10Operations: Keyholder phab repo duplicate work - https://phabricator.wikimedia.org/T203003 (10hashar) Thank you @faidon to have managed to import the git history into operations/software/keyholder that will be very helpful in the future I guess :] [16:42:55] OH YEAH OPEN SOURCE [16:42:56] and then we ran into the same bug for keyholder in puppet [16:43:04] and it was solved again the same way [16:43:11] I guess it might end up being packaged for debian ? [16:43:52] so now we're creating a repo in gerrit that will eventually be used to build a package that will be installed via puppet, rather than have 2 separate repos [16:44:48] ahh [16:44:50] I love that [16:44:56] makes it easire to contribute this way [16:45:16] and faidon has done a lot of work on it, and I haven't been able to review very much yet, but I got CI setup anyway (which is why I poked you for review :)) [16:47:30] (03PS7) 10Zfilipin: WIP selenium-daily-beta jobs [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) [16:48:54] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [16:49:18] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [16:58:03] oh https://gerrit.wikimedia.org/r/#/q/project:operations/software/keyholder+is:open [16:58:07] yeah indeed lot of work :] [16:59:35] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [17:03:05] thcipriani: I also wonder whether some parts of that would be provided by paramiko instead [17:03:49] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [17:06:25] hashar: yes probably [17:19:00] thcipriani: and I caught up again on keyholder/tox https://gerrit.wikimedia.org/r/#/c/operations/software/keyholder/+/460065/ [17:19:13] giuseppe has a nice pattern in docker-pkg to manage dependencies :] [17:19:34] might want to align on that. Namely: they are only defined in setup.py and tox refers to them with some magic syntax [17:19:56] I am off [17:21:25] hasharDinner: neat! thank you for the pointer [17:37:42] (03PS3) 10Legoktm: phan and seccheck for Variables [integration/config] - 10https://gerrit.wikimedia.org/r/457109 (https://phabricator.wikimedia.org/T203364) (owner: 10MGChecker) [17:37:48] (03CR) 10Legoktm: [C: 032] phan and seccheck for Variables [integration/config] - 10https://gerrit.wikimedia.org/r/457109 (https://phabricator.wikimedia.org/T203364) (owner: 10MGChecker) [17:38:27] PROBLEM - Host integration-logstash-1002 is DOWN: CRITICAL - Host Unreachable (10.68.21.156) [17:39:04] (03CR) 10jerkins-bot: [V: 04-1] phan and seccheck for Variables [integration/config] - 10https://gerrit.wikimedia.org/r/457109 (https://phabricator.wikimedia.org/T203364) (owner: 10MGChecker) [17:39:16] (03CR) 10jerkins-bot: [V: 04-1] phan and seccheck for Variables [integration/config] - 10https://gerrit.wikimedia.org/r/457109 (https://phabricator.wikimedia.org/T203364) (owner: 10MGChecker) [17:43:57] 10Release-Engineering-Team (Kanban): Refresh the Production Deployment Review Process (aka Review Queue) - https://phabricator.wikimedia.org/T203697 (10Jrbranaa) @Aklapper you are amazing! I even commented on that task and don't remember it :-) It is a dup. [17:51:59] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Provide dedicated storage space to Docker for images/containers - https://phabricator.wikimedia.org/T203841 (10dduvall) [17:52:11] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Provide dedicated storage space to Docker for images/containers - https://phabricator.wikimedia.org/T203841 (10dduvall) 05Open>03Resolved [17:52:12] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Wikimedia-production-error (Shared Build Failure): mediawiki-quibble docker jobs fails due to disk full - https://phabricator.wikimedia.org/T202457 (10dduvall) [17:53:04] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Wikimedia-production-error (Shared Build Failure): mediawiki-quibble docker jobs fails due to disk full - https://phabricator.wikimedia.org/T202457 (10dduvall) [17:53:07] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Free up LVM extents for Docker devicemapper on new Jenkins Agents - https://phabricator.wikimedia.org/T203842 (10dduvall) 05Open>03declined Solution adopted in {T203841} did not require free LVM extents. [17:53:46] 10Release-Engineering-Team (Kanban): Refresh the Production Deployment Review Process (aka Review Queue) - https://phabricator.wikimedia.org/T203697 (10Jrbranaa) [17:53:48] 10Release-Engineering-Team (Kanban), 10Wikimedia-extension-review-queue: Investigate and make improvements to the extension review process - https://phabricator.wikimedia.org/T195244 (10Jrbranaa) [17:53:50] 10Release-Engineering-Team: Create production code deployment management process - https://phabricator.wikimedia.org/T203703 (10Jrbranaa) [17:54:52] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Wikimedia-production-error (Shared Build Failure): mediawiki-quibble docker jobs fails due to disk full - https://phabricator.wikimedia.org/T202457 (10dduvall) 05Open>03Resolved [[ https://grafana-labs-a... [17:55:07] 10Release-Engineering-Team (Kanban): Refresh the Production Deployment Review Process (aka Review Queue) - https://phabricator.wikimedia.org/T203697 (10Jrbranaa) [17:55:09] 10Release-Engineering-Team (Kanban), 10Wikimedia-extension-review-queue: Investigate and make improvements to the extension review process - https://phabricator.wikimedia.org/T195244 (10Jrbranaa) [17:55:14] 10Release-Engineering-Team (Kanban): Add Code Stewardship review - https://phabricator.wikimedia.org/T203698 (10Jrbranaa) [17:55:56] 10Release-Engineering-Team (Kanban): Refresh the Production Deployment Review Process (aka Review Queue) - https://phabricator.wikimedia.org/T203697 (10Jrbranaa) [17:55:58] 10Release-Engineering-Team (Kanban): Add Services (and other non-extensions) to the deployment review process - https://phabricator.wikimedia.org/T203701 (10Jrbranaa) [17:56:00] 10Release-Engineering-Team (Kanban), 10Wikimedia-extension-review-queue: Investigate and make improvements to the extension review process - https://phabricator.wikimedia.org/T195244 (10Jrbranaa) [17:58:00] 10Release-Engineering-Team (Kanban): Refresh the Production Deployment Review Process (aka Review Queue) - https://phabricator.wikimedia.org/T203697 (10Jrbranaa) [17:58:02] 10Release-Engineering-Team (Kanban), 10Wikimedia-extension-review-queue: Investigate and make improvements to the extension review process - https://phabricator.wikimedia.org/T195244 (10Jrbranaa) [18:01:06] https://gerrit-review.googlesource.com/c/gerrit/+/195930/3 [18:01:18] that will allow us to remove https://www.mediawiki.org/wiki/Git/Creating_new_repositories#cite_note-1 [18:10:34] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10User-Addshore: Add some more m4executor docker slaves for Jenkins - https://phabricator.wikimedia.org/T201972 (10dduvall) 05Open>03Resolved The full-disk issues have been resolved by giving Docker its ow... [18:48:31] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Release Pipeline: Evaluate different strategy for Docker CI instances - https://phabricator.wikimedia.org/T202160 (10dduvall) p:05Triage>03Normal a:03dduvall As of yesterday, we have the following configurations for `m4exec... [18:55:38] marxarelli: https://phabricator.wikimedia.org/T202160#4581843 <-- YUM that is a great summary [18:56:25] hashar: thanks :) [18:57:03] i'm hoping to add mean build duration and difference from total mean duration to that table for each instance type [18:57:40] if one day worth of data is enough. we'll see [18:57:51] i can keep updating it [18:57:55] exciting :) [18:59:29] next step after that is to reconfigure the bigrams to use 6 executors, then compare the results [19:00:01] if we can squeeze 50% more from them, that'll make a big difference in overall capacity [19:00:42] but then again, i'm assuming they were perform better enough to justify a replacing mediums and xlarges across the board. i guess i shouldn't make that assumption :) [19:17:28] (03PS4) 10Legoktm: phan and seccheck for Variables [integration/config] - 10https://gerrit.wikimedia.org/r/457109 (https://phabricator.wikimedia.org/T203364) (owner: 10MGChecker) [19:17:51] (03CR) 10Legoktm: [C: 032] phan and seccheck for Variables [integration/config] - 10https://gerrit.wikimedia.org/r/457109 (https://phabricator.wikimedia.org/T203364) (owner: 10MGChecker) [19:19:27] (03Merged) 10jenkins-bot: phan and seccheck for Variables [integration/config] - 10https://gerrit.wikimedia.org/r/457109 (https://phabricator.wikimedia.org/T203364) (owner: 10MGChecker) [19:20:15] 10Continuous-Integration-Config, 10Patch-For-Review, 10User-Addshore: Allow use of phan 0.8.5+ in wikimedia CI - https://phabricator.wikimedia.org/T174339 (10Legoktm) >>! In T174339#4579536, @Addshore wrote: > I mean, we don't have to use the new version of ast with our current version on phan though do we?... [19:20:50] !log deployed https://gerrit.wikimedia.org/r/457109 [19:20:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:30:13] PROBLEM - SSH on integration-slave-docker-1015 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:30:20] 10Continuous-Integration-Config, 10Patch-For-Review, 10User-Addshore: Allow use of phan 0.8.5+ in wikimedia CI - https://phabricator.wikimedia.org/T174339 (10Legoktm) We're running into https://github.com/phan/phan/issues/1134 ``` Failed to parse line: /srv/phan/vendor/phan/phan/src/Phan/Analysis.php:44 [81... [19:40:02] RECOVERY - SSH on integration-slave-docker-1015 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u7 (protocol 2.0)