[00:07:26] (03PS2) 10Legoktm: [MediaViewer] Run jsduck in gate [integration/config] - 10https://gerrit.wikimedia.org/r/387650 (owner: 10Jforrester) [00:09:10] (03CR) 10Legoktm: [C: 032] [MediaViewer] Run jsduck in gate [integration/config] - 10https://gerrit.wikimedia.org/r/387650 (owner: 10Jforrester) [00:10:21] RECOVERY - Puppet errors on deployment-conf03 is OK: OK: Less than 1.00% above the threshold [0.0] [00:11:13] (03Merged) 10jenkins-bot: [MediaViewer] Run jsduck in gate [integration/config] - 10https://gerrit.wikimedia.org/r/387650 (owner: 10Jforrester) [00:12:58] !log deployed https://gerrit.wikimedia.org/r/387650 [00:13:01] James_F: ^ [00:13:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [00:19:19] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure (shipyard), 10Patch-For-Review: Create composer-php70 job - https://phabricator.wikimedia.org/T144961#3725243 (10hashar) Looks like we are now on strong grounds to build various other images and migrate a lot of the jobs \o/ I am fine... [00:40:07] (03PS2) 10Legoktm: Sync MediaWiki core's clover.xml to docs.wm.o [integration/config] - 10https://gerrit.wikimedia.org/r/386580 [00:40:10] Thanks legoktm. :-) [00:40:25] (03PS3) 10Legoktm: Sync MediaWiki core's clover.xml to docs.wm.o [integration/config] - 10https://gerrit.wikimedia.org/r/386580 [00:41:39] np [00:41:59] (03CR) 10Hashar: [C: 031] Sync MediaWiki core's clover.xml to docs.wm.o [integration/config] - 10https://gerrit.wikimedia.org/r/386580 (owner: 10Legoktm) [00:42:09] :D [00:42:09] hashar: shouldn't you be asleep? [00:42:13] yeah [00:42:20] I was busy reinstalling ring.cx [00:42:54] and played running several containers in // for our tests :) [00:43:07] (use case: have a container for mysql :d ) [00:43:19] but that is going nowhere at 2am So yeah going to rest [00:43:23] ooh :D [00:43:25] good night! [00:43:28] oh [00:43:28] I just kicked off https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/3102/console [00:43:39] and the composer-package-php70-docker job should work fine now [00:43:59] some of the docker slave had a src dir that lacked the group set id flag [00:44:02] ah [00:44:05] so some of the files could not be deleted [00:44:10] probably left over from the prevoius version of the job [00:44:10] I have just purged them and it should be fine [00:44:16] thank you :) [00:44:30] tyler gave me all the details like 8 hours or so agao [00:44:42] seems like some team work got involved to figure out the proper solution [00:44:48] so hmm [00:45:14] legoktm: so in short I think you can close https://phabricator.wikimedia.org/T144961 :] [00:45:27] ok :D [00:45:42] 10Continuous-Integration-Infrastructure, 10Tracking: PHP7 support in CI (tracking) - https://phabricator.wikimedia.org/T144964#3725283 (10Legoktm) [00:45:44] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure (shipyard), 10Patch-For-Review: Create composer-php70 job - https://phabricator.wikimedia.org/T144961#3725281 (10Legoktm) 05Open>03Resolved Yay to team work! [00:45:50] \O/ [00:45:57] Nice. [00:46:07] well [00:46:07] hashar: Shouldn't you be asleep? :-) [00:46:19] we just have like a few thousands of use cases to migrate to docker [00:46:25] that is going to be a busy fiscal year :] [00:46:26] Details. ;-) [00:46:30] yeah yeah [00:47:21] anyway famous last words: E_ASLEEP [00:47:23] !! [01:22:30] 10Release-Engineering-Team, 10Librarization, 10MinervaNeue, 10MobileFrontend, 10Readers-Web-Backlog: Move MobileFrontend/Minerva's svg_check.sh script into a reusable, separate library - https://phabricator.wikimedia.org/T179361#3725383 (10Jdlrobson) Ok I see what you mean. It would still be opt in but h... [02:52:18] PROBLEM - Puppet errors on deployment-kafka01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [03:22:09] 10Release-Engineering-Team: Audit @wikimedia GitHub org access (2017) - https://phabricator.wikimedia.org/T179462#3725495 (10Krinkle) [03:32:18] RECOVERY - Puppet errors on deployment-kafka01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:22:46] 10Release-Engineering-Team, 10GitHub-Mirrors: Audit @wikimedia GitHub org access (2017) - https://phabricator.wikimedia.org/T179462#3725514 (10Legoktm) [05:01:37] (03CR) 10Legoktm: [C: 032] Sync MediaWiki core's clover.xml to docs.wm.o [integration/config] - 10https://gerrit.wikimedia.org/r/386580 (owner: 10Legoktm) [05:02:53] (03Merged) 10jenkins-bot: Sync MediaWiki core's clover.xml to docs.wm.o [integration/config] - 10https://gerrit.wikimedia.org/r/386580 (owner: 10Legoktm) [05:05:53] (03PS1) 10Legoktm: Drop /php directory from MediaWiki core code coverage [integration/config] - 10https://gerrit.wikimedia.org/r/387768 [05:10:02] (03CR) 10Legoktm: [C: 032] Drop /php directory from MediaWiki core code coverage [integration/config] - 10https://gerrit.wikimedia.org/r/387768 (owner: 10Legoktm) [05:11:58] (03Merged) 10jenkins-bot: Drop /php directory from MediaWiki core code coverage [integration/config] - 10https://gerrit.wikimedia.org/r/387768 (owner: 10Legoktm) [05:13:00] (03PS1) 10Krinkle: cover: Render progress-bar before directory names [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) [05:14:55] (03CR) 10Krinkle: Show code coverage percent on index page (031 comment) [integration/docroot] - 10https://gerrit.wikimedia.org/r/386565 (https://phabricator.wikimedia.org/T146970) (owner: 10Legoktm) [05:27:48] (03CR) 10Legoktm: "Nice :D The only functional difference I see is that the navigation element used to be clickable for the full width of the page but no lon" [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) (owner: 10Krinkle) [05:33:56] (03CR) 10Krinkle: "To achieve that, the anchor link will need to be separated from the inline-flex. E.g. keep the anchor link as display:block child of the n" [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) (owner: 10Krinkle) [05:36:00] PROBLEM - Puppet errors on deployment-aqs01 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [05:47:29] (03CR) 10Krinkle: "It's still in /master, though." [integration/config] - 10https://gerrit.wikimedia.org/r/387768 (owner: 10Legoktm) [05:47:32] legoktm: ^ [06:09:06] (03CR) 10Legoktm: "Ugh, I wasn't thinking." [integration/config] - 10https://gerrit.wikimedia.org/r/387768 (owner: 10Legoktm) [06:09:10] (03PS1) 10Legoktm: Revert "Drop /php directory from MediaWiki core code coverage" [integration/config] - 10https://gerrit.wikimedia.org/r/387771 [06:09:15] (03CR) 10Legoktm: [C: 032] Revert "Drop /php directory from MediaWiki core code coverage" [integration/config] - 10https://gerrit.wikimedia.org/r/387771 (owner: 10Legoktm) [06:11:01] RECOVERY - Puppet errors on deployment-aqs01 is OK: OK: Less than 1.00% above the threshold [0.0] [06:11:11] * legoktm goes to sleep as clearly not awake [06:11:32] (03Merged) 10jenkins-bot: Revert "Drop /php directory from MediaWiki core code coverage" [integration/config] - 10https://gerrit.wikimedia.org/r/387771 (owner: 10Legoktm) [06:29:07] 10Release-Engineering-Team, 10GitHub-Mirrors: Audit @wikimedia GitHub org access (2017) - https://phabricator.wikimedia.org/T179462#3725495 (10Tgr) AUIU the scary powers in Github are: * force push - can cause data loss and utter confusion, not too hard to do accidentally * force push tags - can be used to set... [06:32:00] PROBLEM - Puppet errors on deployment-aqs01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [06:36:19] PROBLEM - Puppet errors on deployment-conf03 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [06:52:15] PROBLEM - Puppet errors on deployment-ores-redis-01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [07:11:19] RECOVERY - Puppet errors on deployment-conf03 is OK: OK: Less than 1.00% above the threshold [0.0] [07:12:00] RECOVERY - Puppet errors on deployment-aqs01 is OK: OK: Less than 1.00% above the threshold [0.0] [07:32:15] RECOVERY - Puppet errors on deployment-ores-redis-01 is OK: OK: Less than 1.00% above the threshold [0.0] [07:34:53] PROBLEM - Free space - all mounts on integration-slave-jessie-1004 is CRITICAL: CRITICAL: integration.integration-slave-jessie-1004.diskspace._srv.byte_percentfree (<10.00%) [08:00:42] 10Gerrit, 10Patch-For-Review: Gerrit: Convert Velocity templates to Closure Templates - https://phabricator.wikimedia.org/T158008#3725645 (10Paladox) [08:41:48] 10Continuous-Integration-Config, 10Wikidata: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds - https://phabricator.wikimedia.org/T179465#3725671 (10WMDE-leszek) [09:02:22] PROBLEM - Puppet errors on deployment-conf03 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [09:04:25] PROBLEM - Puppet errors on deployment-kafka-jumbo-1 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [09:42:19] RECOVERY - Puppet errors on deployment-conf03 is OK: OK: Less than 1.00% above the threshold [0.0] [09:42:51] 10Release-Engineering-Team (Watching / External), 10Scap, 10Operations: Scap: Standardize git version - https://phabricator.wikimedia.org/T179353#3725775 (10MoritzMuehlenhoff) silver will be replaced by the new labweb* hosts using stretch soon, so that should be resolved soon. Is that the only one deployment... [09:44:25] RECOVERY - Puppet errors on deployment-kafka-jumbo-1 is OK: OK: Less than 1.00% above the threshold [0.0] [10:37:37] 10Continuous-Integration-Config, 10Wikidata: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds - https://phabricator.wikimedia.org/T179465#3725671 (10hashar) The root cause is the tarball is compressed with bzip2 and the Docker container lacks `/usr/bin/bz2`. ``` > phantomjs-p... [10:37:55] 10Continuous-Integration-Infrastructure (shipyard): Create "npm-browser" docker image with npm, xvfb, chromium, and firefox installed - https://phabricator.wikimedia.org/T179360#3722269 (10hashar) T179465 is about `wmfreleng/npm-test` lacking PhantomJS. [10:47:04] (03PS1) 10Hashar: Move npm for WikibaseJavaScriptApi back to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/387780 (https://phabricator.wikimedia.org/T179465) [10:50:38] (03CR) 10Hashar: [C: 032] Move npm for WikibaseJavaScriptApi back to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/387780 (https://phabricator.wikimedia.org/T179465) (owner: 10Hashar) [10:53:07] (03Merged) 10jenkins-bot: Move npm for WikibaseJavaScriptApi back to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/387780 (https://phabricator.wikimedia.org/T179465) (owner: 10Hashar) [10:58:16] 10Continuous-Integration-Config, 10Wikidata, 10Patch-For-Review: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds - https://phabricator.wikimedia.org/T179465#3725961 (10hashar) So WikibaseJavaScriptApi is fixed now, as such this task is fixed. Then it is all about whether w... [11:09:56] PROBLEM - Free space - all mounts on deployment-mediawiki04 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree (<10.00%) [11:25:30] 10Continuous-Integration-Config, 10Wikidata, 10Patch-For-Review: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds - https://phabricator.wikimedia.org/T179465#3726076 (10WMDE-leszek) Thanks @hashar! So could this be closed or do you want to use it for tracking making this dec... [11:53:17] PROBLEM - Puppet errors on deployment-kafka01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [11:54:57] PROBLEM - Puppet errors on deployment-apertium02 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [11:55:54] PROBLEM - Puppet errors on deployment-mira is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [12:22:43] Project selenium-GettingStarted » firefox,beta,Linux,BrowserTests build #573: 04FAILURE in 42 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/573/ [12:23:09] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [12:30:53] RECOVERY - Puppet errors on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [12:33:19] RECOVERY - Puppet errors on deployment-kafka01 is OK: OK: Less than 1.00% above the threshold [0.0] [12:34:55] RECOVERY - Puppet errors on deployment-apertium02 is OK: OK: Less than 1.00% above the threshold [0.0] [12:54:01] 10Release-Engineering-Team (Kanban), 10Scap, 10ORES, 10Scoring-platform-team: ORES deploy submodule 504 - https://phabricator.wikimedia.org/T179336#3726164 (10mmodell) Phabricator has [[ https://secure.phabricator.com/T4369 | this really horrible bug (T4369)]]: you can't fetch git repositories larger than... [13:04:34] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Wikidata, and 3 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#3726174 (10WMDE-leszek) @zeljkofilipin: I don't have rights to see the config of th... [13:06:00] (03CR) 10Esanders: [C: 04-1] "I would just make .progress use display:inline-block and vertical-align:middle. Then you'll get the correct layout and the clickability." [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) (owner: 10Krinkle) [13:17:18] 10Release-Engineering-Team (Kanban), 10Scap, 10ORES, 10Scoring-platform-team: ORES deploy submodule 504 - https://phabricator.wikimedia.org/T179336#3726180 (10mmodell) >>! In T179336#3721358, @thcipriani wrote: > We should be: > > 1. Writing .gitmodules > 2. Calling `git submodule update --init` > > Whic... [13:23:16] PROBLEM - Puppet errors on deployment-ores-redis-01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [13:25:48] PROBLEM - Puppet errors on deployment-urldownloader is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [13:33:57] 10Continuous-Integration-Infrastructure (shipyard): Create "npm-browser" docker image with npm, xvfb, chromium, and firefox installed - https://phabricator.wikimedia.org/T179360#3726230 (10hashar) [13:34:15] 10Continuous-Integration-Config, 10Wikidata, 10Patch-For-Review: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds - https://phabricator.wikimedia.org/T179465#3726232 (10hashar) 05Open>03Resolved a:03hashar Yup we can follow up on T179360 [13:58:15] RECOVERY - Puppet errors on deployment-ores-redis-01 is OK: OK: Less than 1.00% above the threshold [0.0] [14:00:49] RECOVERY - Puppet errors on deployment-urldownloader is OK: OK: Less than 1.00% above the threshold [0.0] [14:11:15] (03PS2) 10Hashar: docker: add dev dependencies to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387723 [14:33:36] Project selenium-WikiLove » firefox,beta,Linux,BrowserTests build #564: 04FAILURE in 1 min 36 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/564/ [14:51:46] PROBLEM - Puppet errors on deployment-urldownloader is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [14:55:57] PROBLEM - Puppet errors on deployment-apertium02 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [15:10:51] awight: so yesterday you had 2 errors for ores2003 and ores2007 but the thing is I don't see those in puppet anywhere https://github.com/wikimedia/puppet/blob/production/manifests/site.pp#L1976-L1988 and the deploy-service user can't ssh there from tin so there's some problem (I think) with the setup of those machines [15:11:27] thcipriani: Cool, thanks for looking. I’m thinking the same thing, pinged akosiaris about that in -operations. [15:11:57] cool :) [15:12:52] I think I’m almost out of things to bother you about, though :p [15:13:14] Aha! No, I can be distressed by the git-lfs situation for a while yet. [15:13:15] nice :) [15:22:52] PROBLEM - Free space - all mounts on deployment-sca03 is CRITICAL: CRITICAL: deployment-prep.deployment-sca03.diskspace._srv.byte_percentfree (<22.22%) [15:30:59] RECOVERY - Puppet errors on deployment-apertium02 is OK: OK: Less than 1.00% above the threshold [0.0] [15:31:49] RECOVERY - Puppet errors on deployment-urldownloader is OK: OK: Less than 1.00% above the threshold [0.0] [15:42:02] (03PS3) 10Hashar: docker: add dev dependencies to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387723 [15:45:10] (03CR) 10jerkins-bot: [V: 04-1] docker: add dev dependencies to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387723 (owner: 10Hashar) [15:46:32] !log docker push wmfreleng/tox:v2017.11.01.15.29 | https://gerrit.wikimedia.org/r/#/c/387723/ [15:46:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:46:44] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/387723 (owner: 10Hashar) [15:46:49] integration-config-tox-docker ABORTED in 3m 01s [15:46:50] GR [16:06:59] (03PS2) 10Hashar: dockerfile: add libmysqlclient-dev to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387728 (https://phabricator.wikimedia.org/T179392) [16:07:22] (03CR) 10Hashar: [C: 032] docker: add dev dependencies to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387723 (owner: 10Hashar) [16:07:35] (03CR) 10Hashar: [C: 04-1] dockerfile: add libmysqlclient-dev to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387728 (https://phabricator.wikimedia.org/T179392) (owner: 10Hashar) [16:10:25] (03Merged) 10jenkins-bot: docker: add dev dependencies to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387723 (owner: 10Hashar) [16:23:59] 10Continuous-Integration-Infrastructure (shipyard), 10Patch-For-Review: tox-docker fails to install MySQL-python: EnvironmentError: mysql_config not found - https://phabricator.wikimedia.org/T179392#3726917 (10hashar) [16:31:05] !log docker push wmfreleng/tox:v2017.11.01.16.28 | add libmysqlclient-dev | T179392 [16:31:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:31:09] T179392: tox-docker fails to install MySQL-python: EnvironmentError: mysql_config not found - https://phabricator.wikimedia.org/T179392 [16:34:10] 10Continuous-Integration-Infrastructure (shipyard): sdist on wmfreleng/tox Docker causes: WARNING:could not copy distfile to /nonexistent/.tox/distshare - https://phabricator.wikimedia.org/T179506#3726947 (10hashar) [16:34:31] (03PS3) 10Hashar: dockerfile: add libmysqlclient-dev to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387728 (https://phabricator.wikimedia.org/T179392) [16:35:44] (03PS1) 10Legoktm: Treat WikibaseJavaScriptApi as an independent library, not an extension [integration/config] - 10https://gerrit.wikimedia.org/r/387816 (https://phabricator.wikimedia.org/T178088) [16:37:43] (03CR) 10jerkins-bot: [V: 04-1] dockerfile: add libmysqlclient-dev to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387728 (https://phabricator.wikimedia.org/T179392) (owner: 10Hashar) [16:38:48] (03CR) 10WMDE-leszek: [C: 031] Treat WikibaseJavaScriptApi as an independent library, not an extension [integration/config] - 10https://gerrit.wikimedia.org/r/387816 (https://phabricator.wikimedia.org/T178088) (owner: 10Legoktm) [16:38:52] (03CR) 10jerkins-bot: [V: 04-1] Treat WikibaseJavaScriptApi as an independent library, not an extension [integration/config] - 10https://gerrit.wikimedia.org/r/387816 (https://phabricator.wikimedia.org/T178088) (owner: 10Legoktm) [16:39:39] (03CR) 10Hashar: "check experimental" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/376236 (owner: 10Hashar) [16:41:43] (03CR) 10jenkins-bot: Jenkins job validation (DO NOT SUBMIT) [integration/jenkins] - 10https://gerrit.wikimedia.org/r/376236 (owner: 10Hashar) [16:45:05] 10Release-Engineering-Team (Kanban), 10GitHub-Mirrors: Enable github mirroring / diffusion for discovery parent pom - https://phabricator.wikimedia.org/T179018#3727017 (10Gehel) 05Resolved>03Open Thanks for the creation! The repos on Diffusion look good, but the one on Github are empty. Since it has alrea... [16:45:55] (03Abandoned) 10WMDE-leszek: Only run npm job for changes in mediawiki/extensions/WikibaseJavaScriptApi [integration/config] - 10https://gerrit.wikimedia.org/r/384236 (https://phabricator.wikimedia.org/T178225) (owner: 10WMDE-leszek) [16:50:17] (03PS4) 10Hashar: dockerfile: add libmysqlclient-dev to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387728 (https://phabricator.wikimedia.org/T179392) [16:51:38] (03PS1) 10Hashar: Update reason for sticking to tox-jessie [integration/config] - 10https://gerrit.wikimedia.org/r/387820 [16:53:11] (03PS1) 10Hashar: Switch pybal integration/jenkins tox job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/387821 [16:53:29] (03CR) 10Hashar: [C: 032] dockerfile: add libmysqlclient-dev to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387728 (https://phabricator.wikimedia.org/T179392) (owner: 10Hashar) [16:53:40] (03CR) 10Hashar: [C: 032] Update reason for sticking to tox-jessie [integration/config] - 10https://gerrit.wikimedia.org/r/387820 (owner: 10Hashar) [16:53:52] (03CR) 10Hashar: [C: 032] Switch pybal integration/jenkins tox job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/387821 (owner: 10Hashar) [16:54:12] ^^ that is a bit selfish [16:54:45] ? [16:54:58] 10Scap, 10ORES, 10Operations, 10Scoring-platform-team: Use external dsh group to list pooled ORES nodes - https://phabricator.wikimedia.org/T179501#3727071 (10Halfak) p:05Triage>03Low [16:55:52] (03Merged) 10jenkins-bot: dockerfile: add libmysqlclient-dev to tox [integration/config] - 10https://gerrit.wikimedia.org/r/387728 (https://phabricator.wikimedia.org/T179392) (owner: 10Hashar) [16:56:31] (03Merged) 10jenkins-bot: Update reason for sticking to tox-jessie [integration/config] - 10https://gerrit.wikimedia.org/r/387820 (owner: 10Hashar) [16:56:33] (03Merged) 10jenkins-bot: Switch pybal integration/jenkins tox job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/387821 (owner: 10Hashar) [16:59:23] 10Continuous-Integration-Infrastructure (shipyard): sdist on wmfreleng/tox Docker causes: WARNING:could not copy distfile to /nonexistent/.tox/distshare - https://phabricator.wikimedia.org/T179506#3727100 (10hashar) The job uses the `docker-zuul-env` macro which does inject JENKINS_URL. We solved that in 7ef356e... [17:01:27] 10Release-Engineering-Team (Kanban), 10GitHub-Mirrors: Enable github mirroring / diffusion for discovery parent pom - https://phabricator.wikimedia.org/T179018#3727113 (10demon) Wow, I'm an idiot. There shouldn't be an extra -discovery- in those. [17:05:31] (03PS1) 10Hashar: docker: pass JENKINS_URL in wmfreleng/tox example [integration/config] - 10https://gerrit.wikimedia.org/r/387822 (https://phabricator.wikimedia.org/T179506) [17:05:54] 10Release-Engineering-Team (Kanban), 10GitHub-Mirrors: Enable github mirroring / diffusion for discovery parent pom - https://phabricator.wikimedia.org/T179018#3727137 (10demon) 05Open>03Resolved Yes there should. But there's an extra wikimedia I dropped out of habit. Naming is hard ;-) https://github.com... [17:07:57] (03CR) 10Hashar: [C: 032] docker: pass JENKINS_URL in wmfreleng/tox example [integration/config] - 10https://gerrit.wikimedia.org/r/387822 (https://phabricator.wikimedia.org/T179506) (owner: 10Hashar) [17:08:09] 10Continuous-Integration-Infrastructure (shipyard), 10Patch-For-Review: sdist on wmfreleng/tox Docker causes: WARNING:could not copy distfile to /nonexistent/.tox/distshare - https://phabricator.wikimedia.org/T179506#3727143 (10hashar) 05Open>03Resolved a:03hashar [17:09:24] (03Merged) 10jenkins-bot: docker: pass JENKINS_URL in wmfreleng/tox example [integration/config] - 10https://gerrit.wikimedia.org/r/387822 (https://phabricator.wikimedia.org/T179506) (owner: 10Hashar) [17:11:14] no_justification i wonder should we enable gpg on gerrit? [17:11:23] i doint think it forces users to use it [17:11:29] Why? [17:11:31] it just lets users who want to use it, use it. [17:11:48] No reason. Just in case users want to use it like github. [17:12:04] That's not a reason to enable things [17:12:05] :) [17:12:18] heh [17:12:21] I need a better reason than "someone might want it" :) [17:12:41] Someone might also want gerrit to provide them with pony rides. Doesn't mean it should :) [17:12:56] ah ok. nvm then :). No one's requested it so low priority heh [17:12:59] and lol @ pony [17:17:07] 10Gerrit, 10Operations, 10Readers-Web-Backlog, 10Patch-For-Review, and 2 others: [subtask] Temporarily allow pushing large objects - https://phabricator.wikimedia.org/T178189#3727197 (10Niedzielski) [17:19:26] no_justification i think eventually i am going to make an its-phabricator plugin for polygerrit for performance reasons heh (not sure yet). But parsing json in java is slowwwwwww, whereas javascript is really fast :). [17:20:11] Does it add a noticeable performance hit to users though? I mean, if it ain't broke don't fix it :) [17:20:39] no_justification performance is it should take a 1 or 2 secs, where as currently it's like 3-4 secs :) [17:20:55] this is ui rise. [17:20:57] But...for the user? Or just the bot that's handling the request? [17:21:06] it should be for the user. [17:21:10] and the bot [17:21:12] I mean, I don't see a 3-4 second lag on every change [17:21:13] i think [17:22:13] i guess it's slow because java is the backend and javascript is the frontend so it's executed on the device instead of the server. [17:24:28] (03PS1) 10Hashar: Migrate more tox jobs to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/387829 [17:26:01] (03CR) 10Hashar: [C: 032] Migrate more tox jobs to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/387829 (owner: 10Hashar) [17:26:11] hashar: We should do a docker job for mw-config :) [17:28:33] (03Merged) 10jenkins-bot: Migrate more tox jobs to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/387829 (owner: 10Hashar) [17:46:53] (03PS4) 10EBernhardson: Run search/mjolnir pyspark tests via tox [integration/config] - 10https://gerrit.wikimedia.org/r/387658 [17:47:39] (03CR) 10EBernhardson: "I've updated mjolnir so test runs respect XDG_CACHE_HOME for the ivy cache dir, and updated here to remove the extra user. Needs mjolnir p" [integration/config] - 10https://gerrit.wikimedia.org/r/387682 (owner: 10Hashar) [17:47:49] (03CR) 10EBernhardson: "wrong commit .." [integration/config] - 10https://gerrit.wikimedia.org/r/387682 (owner: 10Hashar) [17:48:06] (03CR) 10EBernhardson: "I've updated mjolnir so test runs respect XDG_CACHE_HOME for the ivy cache dir, and updated here to remove the extra user. Needs mjolnir p" [integration/config] - 10https://gerrit.wikimedia.org/r/387658 (owner: 10EBernhardson) [17:48:12] ebernhardson: !!!! Will catch up later after dinner :} [17:49:41] hasharDinner: thanks! [18:09:06] 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2): Scap failing to rewrite submodule urls in beta - https://phabricator.wikimedia.org/T179013#3727445 (10mmodell) @thcipriani: I'm at a loss for why this isn't working. {D826} + {D849} + {D854} are the relevant changes. [18:09:09] 10Release-Engineering-Team (Watching / External), 10Librarization, 10MinervaNeue, 10MobileFrontend, 10Readers-Web-Backlog: Move MobileFrontend/Minerva's svg_check.sh script into a reusable, separate library - https://phabricator.wikimedia.org/T179361#3727448 (10greg) [18:17:30] (03CR) 10Chad: "Forge Author is already granted on all repositories. Forge committer we don't grant anywhere. I'm not sure what you're trying to fix here." [integration/zuul] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/386201 (owner: 10Paladox) [18:18:31] (03CR) 10Paladox: "> Forge Author is already granted on all repositories. Forge" [integration/zuul] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/386201 (owner: 10Paladox) [18:18:33] (03Abandoned) 10Paladox: Allows users to merge branches on refs/for/* [integration/zuul] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/386201 (owner: 10Paladox) [18:26:26] 10MediaWiki-Codesniffer, 10Patch-For-Review: Take advantage of PHPCS's parallel feature - https://phabricator.wikimedia.org/T169189#3727502 (10Legoktm) a:05Legoktm>03None [19:07:55] Project selenium-MinervaNeue » chrome,beta,Linux,BrowserTests build #183: 04FAILURE in 18 min: https://integration.wikimedia.org/ci/job/selenium-MinervaNeue/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/183/ [19:14:09] greg-g: Mind if I grab a window to push an UBN fix? [19:15:12] Well, it's my window for train :p [19:15:17] So yes, please [19:15:23] Please unbreak ORES :P [19:15:25] lol exvellent [19:15:45] ok merging to wmf.5 and wmf.6 [19:16:09] https://www.mediawiki.org/wiki/MediaWiki_1.31/Roadmap must be out of date btw. [19:17:02] Updated [19:19:15] Project selenium-MinervaNeue » firefox,beta,Linux,BrowserTests build #183: 04FAILURE in 30 min: https://integration.wikimedia.org/ci/job/selenium-MinervaNeue/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/183/ [19:21:32] no_justification: OK, I’m ready to deploy. How about now? [19:21:45] Go forth and conquer [19:21:54] * awight reminds self to buy a juice for whoever wrote the submodule merge thing [19:23:31] AndyRussG|afk: I see a big CentralNotice patch sitting on wmf.5, I assume I should step around that? [19:24:17] no_justification: In that case ^, is it better to rebase core and only submodule update my extension, or maybe scap-dir is still a thing? [19:24:45] meanwhile I’m deploying wmf.6 first [19:25:17] ZeroPortal has undeployed changes on wmf.6 [19:28:01] AndyRussG|afk: NBD, I see that sync-file still works! [19:28:15] * awight oils rusty joints [19:33:12] no_justification: Everything looks good. Please ping if you see more (or new and exciting!) errors [19:33:16] sync-file learned how to speak directories [19:33:24] sync-dir is a deprecated back-compat alias [19:33:39] submodule update rebases by default, keeping local patches intact [19:33:51] (by default in how I have tin setup :p) [19:34:27] It was smooth like bad peanut butter. [19:52:40] (03CR) 10Krinkle: "That's already the case in this patch. The issue is that previously the in
  • was given display:block by Bootstrap, whereas now it's" [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) (owner: 10Krinkle) [19:52:51] (03PS2) 10Krinkle: cover: Render progress-bar before directory names [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) [19:53:12] (03CR) 10Krinkle: [C: 032] cover: Render progress-bar before directory names [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) (owner: 10Krinkle) [19:53:59] (03Merged) 10jenkins-bot: cover: Render progress-bar before directory names [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) (owner: 10Krinkle) [19:54:05] (03CR) 10jenkins-bot: cover: Render progress-bar before directory names [integration/docroot] - 10https://gerrit.wikimedia.org/r/387769 (https://phabricator.wikimedia.org/T146970) (owner: 10Krinkle) [19:55:06] 10MediaWiki-Codesniffer: Take advantage of PHPCS's parallel feature - https://phabricator.wikimedia.org/T169189#3727764 (10Krinkle) [19:56:02] AndyRussG|afk: fr-tech: no_justification and I were just discussing something interesting: if CentralNotice is deployed to wmf.6, for example, then the wmf_deploy branch is also cut to wmf.5, and anyone running a full rebase+submodule update+scap will be deploying your branch by surprise. [20:00:28] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Fundraising-Backlog: Determine status of fundraising-related branches and tags - https://phabricator.wikimedia.org/T177334#3727783 (10awight) From what I remember, it should be safe to delete all branches except the last two. @Ejegg can confirm that. I don't... [20:03:14] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Fundraising-Backlog: Determine status of fundraising-related branches and tags - https://phabricator.wikimedia.org/T177334#3727792 (10Ejegg) Hi @demon, fundraising is on the long term support 1_27 tag. branches 1_22 through 1_26 and tags 1.20 and 1.22 can be d... [20:10:33] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Fundraising-Backlog: Determine status of fundraising-related branches and tags - https://phabricator.wikimedia.org/T177334#3727820 (10demon) 05Open>03Resolved a:03demon Awesome thanks! Pruned all the old ones from the repo [20:13:10] 10MediaWiki-Codesniffer: Take advantage of PHPCS's parallel feature - https://phabricator.wikimedia.org/T169189#3727827 (10hashar) p:05Triage>03Low [20:15:36] 10MediaWiki-Releasing, 10Release-Engineering-Team (Long-Lived-Branches), 10MediaWiki-General-or-Unknown: Remove EOL MediaWiki release branches - https://phabricator.wikimedia.org/T92503#3727834 (10demon) 05declined>03Open Changed my mind. [20:15:46] Krinkle: Hehe ^ [20:16:06] :) [20:17:13] * no_justification just deleted 26 branches [20:17:40] I could technically delete REL1_28 since I EOL'd it earlier today, but I'll keep it around a bit longer [20:20:47] Drop 26 branches, repack the repo, it doubles in size [20:20:49] I <3 u git [20:20:57] you so funny git [20:28:14] lol [20:42:29] Ah, better repack -> 440MB [20:42:32] Not bad, not bad [20:45:23] PROBLEM - Puppet errors on deployment-logstash2 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [20:45:24] 10MediaWiki-Releasing, 10Release-Engineering-Team (Long-Lived-Branches), 10MediaWiki-General-or-Unknown: Remove EOL MediaWiki release branches - https://phabricator.wikimedia.org/T92503#3727876 (10demon) 05Open>03Resolved a:03demon [20:57:35] ebernhardson: I am back around :) [20:58:17] 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2): Scap failing to rewrite submodule urls in beta - https://phabricator.wikimedia.org/T179013#3727907 (10mmodell) [21:02:42] error: not enough disk space [21:02:45] !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! [21:12:36] hashar: #1 error in this chan i see from shinken-wm xD [21:17:55] I was just looking at the branches in my main mediawiki clone and found that I still have wmf/1.25wmf12 & wmf/1.25wmf13 checked out from scap testing. Time flies. [21:20:21] RECOVERY - Puppet errors on deployment-logstash2 is OK: OK: Less than 1.00% above the threshold [0.0] [21:24:06] bd808: my core repo needs git pulled im still on files from 1.29 xD [21:51:20] (03CR) 10Hashar: Run search/mjolnir pyspark tests via tox (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/387658 (owner: 10EBernhardson) [21:51:27] (03PS5) 10Hashar: Run search/mjolnir pyspark tests via tox [integration/config] - 10https://gerrit.wikimedia.org/r/387658 (owner: 10EBernhardson) [21:55:24] (03CR) 10Hashar: "I have addressed a few very tiny issues I found while running it locally." [integration/config] - 10https://gerrit.wikimedia.org/r/387658 (owner: 10EBernhardson) [21:57:00] awight: no_justification fr-tech Hey, just saw the pings apologies... did something bad happen? [21:57:23] No, but we got surprised and it could've been bad :) [21:57:30] cf T179536 [21:57:30] T179536: Unexpected side-effect of CentralNotice wmf_deploy branch strategy - https://phabricator.wikimedia.org/T179536 [21:57:47] AndyRussG: Hi! Nothing bad, I avoided deploying CN to wmf.5 though, you might want to check it out. And ^ that :) [21:58:15] Or… hehe no_justification may have deployed it. [21:58:19] * awight runs away [21:58:38] (03CR) 10Hashar: [C: 04-1] "Hmm on a second try:" [integration/config] - 10https://gerrit.wikimedia.org/r/387658 (owner: 10EBernhardson) [21:58:42] Well, I cleaned up the git repo. Tbh, it probably got deployed by someone else [21:58:44] Prior [21:59:07] woo i finally found a fix for caching change edit's in polygerrit https://gerrit-review.googlesource.com/#/c/gerrit/+/138250/ :) [21:59:14] ebernhardson: mjolnir pyspark tests seem to work for me now :] Though they fail on first run [21:59:21] awight: no_justification the only submodule bump was the one that I +2'd yesterday before the train [21:59:25] afik [21:59:47] It looked wholesome, it’s just that I believe it was deployed to wmf.6 and not to wmf.5 [22:00:01] Possibly train-related, now that you point it out! [22:00:19] AndyRussG: Right. But because *all* wmf.XX branches track wmf_deploy on CN, it means we didn't /just/ deploy to wmf.6 with train [22:00:23] It also went to wmf.5 [22:00:36] no_justification: ah I see [22:00:37] hum [22:00:41] Which may be ok, but it was a serious WTF OH YEAH THAT'S RIGHT moment for me. [22:00:53] must that not be the way it's always worked? Indeed doesn't sound quite right, tho [22:01:02] hehe. Meanwhile, I was diving under tables having flashbacks [22:01:08] not to imply that the always been that way means it's ok [22:01:28] It’s possible that the awesome automatic submodule bumper exacerbated the issue. [22:01:40] No, it's been like that the whole time [22:01:43] We haven't made any changes recently to the deploy strategy, and have put a plenty of things on the train recently [22:01:43] I just f'ing forgot [22:02:14] no_justification: certainly not your fault if it's completely non-standard, apologies... [22:02:56] We should make it work at least more similarly to other extensions, if not identically [22:03:10] Well, the task is filed. We really really need to have a serious discussion about wmf_deploy going forward. Special snowflake deployment strategies are going the way of the dodo bird [22:03:12] :) [22:03:20] cf: wikidata [22:03:26] yeah makes sense fer sure [22:03:52] awight: no_justification: so if I understand correctly, no terrible badness about to hit the servers in the coming hour or anything like that, correct? [22:04:09] Well, if there was terrible badness it already hit the servers :P [22:04:15] heheh [22:04:30] fortunately nothing bad in what I sent to the wmf_deploy branch yesterday [22:04:42] practically just a bunch of no-ops, code cleanup and the like [22:05:01] more significant changes have gone in their own deploy slots or on SWAT deploys [22:05:57] K I'll look at the ticket then........ thanks much and apologies that we've kept putting off considering better strategies for this!!! :) [22:08:03] CN is still chugging along... https://en.wikipedia.org/?country=RU [22:08:35] no_justification: awight: K I have a bit more afk-ness to be, thanks and apologies again, back in a bit! [22:08:46] o/ ! [22:08:51] ;) [22:11:44] 10Release-Engineering-Team (Watching / External), 10Scap, 10Operations: Scap: Standardize git version - https://phabricator.wikimedia.org/T179353#3721967 (10greg) From moritz: P6242 (machines still running trusty) [22:18:06] (03CR) 10Hashar: "Full paste of the issue I have with an empty cache: P6243" [integration/config] - 10https://gerrit.wikimedia.org/r/387658 (owner: 10EBernhardson) [22:24:20] PROBLEM - Puppet errors on deployment-kafka01 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [22:28:46] 10Release-Engineering-Team (Watching / External), 10Scap, 10Operations: Scap: Standardize git version - https://phabricator.wikimedia.org/T179353#3728176 (10greg) From that paste and https://phabricator.wikimedia.org/source/operations-puppet/browse/production/hieradata/common/scap/dsh.yaml * snapshot hosts... [22:29:08] 10Release-Engineering-Team (Watching / External), 10Librarization, 10MinervaNeue, 10MobileFrontend, 10Readers-Web-Backlog: Move MobileFrontend/Minerva's svg_check.sh script into a reusable, separate library - https://phabricator.wikimedia.org/T179361#3728178 (10bmansurov) Looks like the task is clear. Mo... [22:40:35] (03CR) 10EBernhardson: "that content length issue is a weird one, i'll dig into it a bit. I suppose i've been re-using a cache for awhile and didn't notice that" [integration/config] - 10https://gerrit.wikimedia.org/r/387658 (owner: 10EBernhardson) [22:43:24] 10Release-Engineering-Team, 10Page-Previews, 10Readers-Web-Backlog (Tracking), 10User-zeljkofilipin: Popups Selenium tests daily targeting beta cluster - https://phabricator.wikimedia.org/T179546#3728211 (10Jdlrobson) [22:46:31] 10Release-Engineering-Team (Backlog), 10Page-Previews, 10Browser-Tests, 10Readers-Web-Backlog (Tracking), 10User-zeljkofilipin: Popups Selenium tests daily targeting beta cluster - https://phabricator.wikimedia.org/T179546#3728238 (10greg) [22:52:19] > - etsy/phan 0.8.0 requires php ~7.0.0 -> your PHP version (7.1.10) does not satisfy that requirement. [22:52:25] >.> [22:53:59] legoktm there's Development Release 0.8.1 [22:54:03] for php 7.1 [22:54:09] https://github.com/phan/phan/releases?after=0.8.6 [22:55:06] or 0.9.0 but then it breaks php 7.0.0 support [22:59:19] RECOVERY - Puppet errors on deployment-kafka01 is OK: OK: Less than 1.00% above the threshold [0.0] [23:23:36] (03PS2) 10Legoktm: Treat WikibaseJavaScriptApi as an independent library, not an extension [integration/config] - 10https://gerrit.wikimedia.org/r/387816 (https://phabricator.wikimedia.org/T178088) [23:24:51] (03CR) 10jerkins-bot: [V: 04-1] Treat WikibaseJavaScriptApi as an independent library, not an extension [integration/config] - 10https://gerrit.wikimedia.org/r/387816 (https://phabricator.wikimedia.org/T178088) (owner: 10Legoktm) [23:25:13] (03PS1) 10Legoktm: Run phan for mediawiki/extensions/ParserMigration [integration/config] - 10https://gerrit.wikimedia.org/r/387960 [23:27:02] (03CR) 10Hashar: [C: 04-1] "Can't we move it out of mediawiki/extensions/* and create some new git repo?" [integration/config] - 10https://gerrit.wikimedia.org/r/387816 (https://phabricator.wikimedia.org/T178088) (owner: 10Legoktm) [23:32:05] 10MediaWiki-Releasing, 10Release-Engineering-Team (Long-Lived-Branches), 10MediaWiki-General-or-Unknown: Remove EOL MediaWiki release branches - https://phabricator.wikimedia.org/T92503#3728357 (10hashar) >>! In T92503#3727834, @demon wrote: > Changed my mind. So what have you done in the end? [23:33:06] 10MediaWiki-Releasing, 10Release-Engineering-Team (Long-Lived-Branches), 10MediaWiki-General-or-Unknown: Remove EOL MediaWiki release branches - https://phabricator.wikimedia.org/T92503#1113228 (10Paladox) @hashar he removed all the EOL branches. See https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki... [23:38:40] 10Release-Engineering-Team (Backlog), 10Deployments, 10Operations, 10Beta-Cluster-reproducible, and 2 others: Switch mwscript from Zend PHP5 to default php alternative (e.g. HHVM or PHP7) - https://phabricator.wikimedia.org/T146285#3728364 (10hashar) I am fine with https://gerrit.wikimedia.org/r/#/c/358896... [23:39:02] I wonder whether Hashar Standard Time already made the DST switchover or not? [23:39:51] it fluctuates [23:44:26] legoktm yeh we made the switch at the weekend. [23:45:10] though i am one hour behind him :) [23:46:18] paladox: I think you missed the joke ;) "Hashar Standard Time" isn't a real thing :p [23:46:38] Oh i see [23:46:39] heheh [23:51:35] Children don't understand DST [23:51:47] hashar standard time == go time: all the time. [23:53:13] aside from the 3 or 4 hours he seems to sleep