[00:17:17] 10Release-Engineering-Team (Kanban), 10Phabricator: Allow users to restrict View Policy when creating Pastes - https://phabricator.wikimedia.org/T145749#3659300 (10Tgr) >>! In T145749#3659174, @greg wrote: > Except it's actually not possible to do so via the web interface; an admin would need to do so via the... [00:59:47] PROBLEM - Puppet errors on deployment-puppetdb01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [00:59:50] 10Continuous-Integration-Config, 10Wikipedia-Android-App-Backlog: Limit Android CI jobs to running only when relevant files change - https://phabricator.wikimedia.org/T177016#3659414 (10Mholloway) p:05Triage>03Low [01:39:48] RECOVERY - Puppet errors on deployment-puppetdb01 is OK: OK: Less than 1.00% above the threshold [0.0] [01:51:10] 10Release-Engineering-Team (Kanban), 10Phabricator: Allow users to restrict View Policy when creating Pastes - https://phabricator.wikimedia.org/T145749#3659455 (10zhuyifei1999) >>! In T145749#3659300, @Tgr wrote: > That ability *has* been removed (from most users) For reference, this was https://phabricator.... [02:14:23] (03PS1) 10Legoktm: Add --no-cache argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382339 [02:14:26] (03PS1) 10Legoktm: Add --run-tests argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382340 [02:14:28] (03PS1) 10Legoktm: Add --update-jjb argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382341 [02:39:03] (03PS1) 10Legoktm: docker: Directly inherit from composer image [integration/config] - 10https://gerrit.wikimedia.org/r/382345 [02:53:28] (03PS1) 10Legoktm: build.py: Improve "docker push" output [integration/config] - 10https://gerrit.wikimedia.org/r/382347 [02:54:40] (03CR) 10jerkins-bot: [V: 04-1] build.py: Improve "docker push" output [integration/config] - 10https://gerrit.wikimedia.org/r/382347 (owner: 10Legoktm) [02:55:24] (03PS2) 10Legoktm: build.py: Improve "docker push" output [integration/config] - 10https://gerrit.wikimedia.org/r/382347 [03:07:03] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<20.00%) [03:08:30] (03PS1) 10Legoktm: Bump composer-package and mediawiki-phpcs images [integration/config] - 10https://gerrit.wikimedia.org/r/382348 [03:12:04] (03CR) 10Legoktm: [C: 032] Merge php-mediawiki image into php [integration/config] - 10https://gerrit.wikimedia.org/r/382192 (owner: 10Legoktm) [03:12:13] (03CR) 10Legoktm: [C: 032] docker: Directly inherit from composer image [integration/config] - 10https://gerrit.wikimedia.org/r/382345 (owner: 10Legoktm) [03:12:17] (03CR) 10Legoktm: [C: 032] Bump composer-package and mediawiki-phpcs images [integration/config] - 10https://gerrit.wikimedia.org/r/382348 (owner: 10Legoktm) [03:13:09] (03Merged) 10jenkins-bot: Merge php-mediawiki image into php [integration/config] - 10https://gerrit.wikimedia.org/r/382192 (owner: 10Legoktm) [03:13:14] (03Merged) 10jenkins-bot: docker: Directly inherit from composer image [integration/config] - 10https://gerrit.wikimedia.org/r/382345 (owner: 10Legoktm) [03:13:29] (03Merged) 10jenkins-bot: Bump composer-package and mediawiki-phpcs images [integration/config] - 10https://gerrit.wikimedia.org/r/382348 (owner: 10Legoktm) [03:47:09] (03PS1) 10Legoktm: Add sanity checking example-run.sh for composer image [integration/config] - 10https://gerrit.wikimedia.org/r/382352 [04:00:45] PROBLEM - Puppet errors on deployment-kafka03 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [04:09:36] (03PS1) 10Legoktm: Port composer-php70 job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/382354 [04:14:34] (03CR) 10Legoktm: [C: 032] Port composer-php70 job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/382354 (owner: 10Legoktm) [04:15:45] (03Merged) 10jenkins-bot: Port composer-php70 job to docker [integration/config] - 10https://gerrit.wikimedia.org/r/382354 (owner: 10Legoktm) [04:16:38] !log deploying https://gerrit.wikimedia.org/r/382354 [04:16:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [04:18:05] (03CR) 10jenkins-bot: Drop script mw-install-postgre since it is a duplicate of mw-install-postgresql [integration/jenkins] - 10https://gerrit.wikimedia.org/r/316231 (owner: 10Paladox) [04:19:44] (03CR) 10jenkins-bot: Update Wikidata [tools/release] - 10https://gerrit.wikimedia.org/r/381974 (owner: 10Aude) [04:40:45] RECOVERY - Puppet errors on deployment-kafka03 is OK: OK: Less than 1.00% above the threshold [0.0] [05:20:05] (03PS2) 10Legoktm: Add --no-cache argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382339 [05:20:07] (03PS2) 10Legoktm: Add --run-tests argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382340 [05:20:09] (03PS2) 10Legoktm: Add --update-jjb argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382341 [05:20:11] (03PS3) 10Legoktm: build.py: Improve "docker push" output [integration/config] - 10https://gerrit.wikimedia.org/r/382347 [05:20:13] (03PS5) 10Legoktm: docker: Recursively build images in order [integration/config] - 10https://gerrit.wikimedia.org/r/381761 (https://phabricator.wikimedia.org/T176318) (owner: 10Hashar) [05:21:29] (03CR) 10jerkins-bot: [V: 04-1] docker: Recursively build images in order [integration/config] - 10https://gerrit.wikimedia.org/r/381761 (https://phabricator.wikimedia.org/T176318) (owner: 10Hashar) [05:22:10] (03CR) 10Legoktm: "Yay! That was really helpful, I integrated it into the build script based on your logic :)" [integration/config] - 10https://gerrit.wikimedia.org/r/381761 (https://phabricator.wikimedia.org/T176318) (owner: 10Hashar) [05:26:51] (03PS6) 10Legoktm: docker: Recursively build images in order [integration/config] - 10https://gerrit.wikimedia.org/r/381761 (https://phabricator.wikimedia.org/T176318) (owner: 10Hashar) [05:39:06] (03Abandoned) 10Legoktm: Remove all traces of mediawiki-core-phpcs-jessie [integration/config] - 10https://gerrit.wikimedia.org/r/381255 (owner: 10Addshore) [05:41:24] (03PS1) 10Legoktm: Add php7.0-curl to php image [integration/config] - 10https://gerrit.wikimedia.org/r/382358 [05:41:45] ^ Created by $ ./build.py php --run-tests --update-jjb --recurse [05:46:50] (03CR) 10Legoktm: [C: 032] Add php7.0-curl to php image [integration/config] - 10https://gerrit.wikimedia.org/r/382358 (owner: 10Legoktm) [05:48:04] (03Merged) 10jenkins-bot: Add php7.0-curl to php image [integration/config] - 10https://gerrit.wikimedia.org/r/382358 (owner: 10Legoktm) [05:48:52] (03PS1) 10Legoktm: Move composer-php70-docker out of experimental [integration/config] - 10https://gerrit.wikimedia.org/r/382361 [05:54:17] (03CR) 10Legoktm: [C: 032] Move composer-php70-docker out of experimental [integration/config] - 10https://gerrit.wikimedia.org/r/382361 (owner: 10Legoktm) [05:56:34] (03Merged) 10jenkins-bot: Move composer-php70-docker out of experimental [integration/config] - 10https://gerrit.wikimedia.org/r/382361 (owner: 10Legoktm) [05:56:43] !log deploying https://gerrit.wikimedia.org/r/382361 [05:56:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [06:09:02] (03CR) 10Dzahn: "merged in August, build succesful in October ? heh :)" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/316231 (owner: 10Paladox) [06:11:08] mutante: that was me :) I was making sure the new job I just added passes [06:11:23] legoktm: ah :) hehe [06:11:34] i was thinking "well that job took really long" [06:11:46] (03CR) 10Hashar: [C: 032] Add --no-cache argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382339 (owner: 10Legoktm) [06:13:28] (03Merged) 10jenkins-bot: Add --no-cache argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382339 (owner: 10Legoktm) [06:14:18] 10Continuous-Integration-Infrastructure, 10Tracking: PHP7 support in CI (tracking) - https://phabricator.wikimedia.org/T144964#3659559 (10Legoktm) [06:14:20] 10Continuous-Integration-Config, 10Patch-For-Review: Create composer-php70 job - https://phabricator.wikimedia.org/T144961#3659557 (10Legoktm) 05Open>03Resolved OK, composer-package-php70-docker and composer-php70-docker are voting on all repositories that have the corresponding php55/hhvm jobs except for... [06:33:10] 10Continuous-Integration-Config, 10Release-Engineering-Team: Composer failed in Selenium job but job didn't stop - https://phabricator.wikimedia.org/T177047#3659577 (10Legoktm) p:05Triage>03Low [06:39:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [06:57:18] PROBLEM - Puppet errors on deployment-kafka01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [07:07:01] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:39:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [08:49:51] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [08:54:19] 10Release-Engineering-Team (Next), 10Release Pipeline, 10User-Joe: Prove helm as a potential k8s deployment tool - https://phabricator.wikimedia.org/T173129#3659842 (10Joe) [09:00:50] RECOVERY - Puppet errors on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [09:02:02] PROBLEM - Puppet errors on deployment-trending01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:10:25] RECOVERY - Puppet errors on deployment-kafka-jumbo-1 is OK: OK: Less than 1.00% above the threshold [0.0] [09:11:58] RECOVERY - Puppet errors on deployment-kafka-jumbo-2 is OK: OK: Less than 1.00% above the threshold [0.0] [09:19:07] RECOVERY - Puppet errors on deployment-cache-upload04 is OK: OK: Less than 1.00% above the threshold [0.0] [09:47:54] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Jenkins, 10Patch-For-Review: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3659949 (10hashar) [10:32:13] Those mediawiki error rates above were me, resolution ed now [10:32:16] Resolved now [10:53:50] (03CR) 10MarcoAurelio: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/381717 (owner: 10Zoranzoki21) [10:55:28] (03PS6) 10MarcoAurelio: Whitelist user Jayprakash12345 on Zuul [integration/config] - 10https://gerrit.wikimedia.org/r/381717 (owner: 10Zoranzoki21) [10:56:15] !log integration: unbreak the puppet master. Was stuck do a cherry pick that needed a rebase [10:56:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:59:18] (03Draft1) 10MarcoAurelio: Archive Extension:AntiBot [integration/config] - 10https://gerrit.wikimedia.org/r/382422 (https://phabricator.wikimedia.org/T177082) [10:59:22] (03PS2) 10MarcoAurelio: Archive Extension:AntiBot [integration/config] - 10https://gerrit.wikimedia.org/r/382422 (https://phabricator.wikimedia.org/T177082) [10:59:45] PROBLEM - Puppet errors on saucelabs-01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [11:00:35] PROBLEM - Puppet errors on integration-slave-docker-1003 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [11:00:37] PROBLEM - Puppet errors on integration-puppetmaster01 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [11:01:05] PROBLEM - Puppet errors on jenkinstest is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [11:02:20] PROBLEM - Puppet errors on saucelabs-03 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [11:02:26] PROBLEM - Puppet errors on castor02 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [11:02:32] PROBLEM - Puppet errors on integration-slave-docker-1004 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [11:02:34] PROBLEM - Puppet errors on integration-slave-docker-c2-m4-d40-1005 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [11:02:36] PROBLEM - Puppet errors on integration-r-lang-01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [11:03:04] PROBLEM - Puppet errors on integration-slave-docker-1002 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [11:03:32] PROBLEM - Puppet errors on integration-slave-docker-1705 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [11:03:44] PROBLEM - Puppet errors on integration-slave-jessie-android is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [11:03:56] PROBLEM - Puppet errors on integration-cumin is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [11:04:18] PROBLEM - Puppet errors on integration-slave-docker-1001 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [11:04:40] PROBLEM - Puppet errors on saucelabs-02 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [11:04:42] PROBLEM - Puppet errors on webperformance is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [11:06:21] bah [11:08:34] =o [11:08:55] RECOVERY - Puppet errors on integration-cumin is OK: OK: Less than 1.00% above the threshold [0.0] [11:09:17] RECOVERY - Puppet errors on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [11:09:41] RECOVERY - Puppet errors on webperformance is OK: OK: Less than 1.00% above the threshold [0.0] [11:10:11] RECOVERY - Puppet errors on integration-slave-jessie-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [11:10:41] RECOVERY - Puppet errors on integration-puppetmaster01 is OK: OK: Less than 1.00% above the threshold [0.0] [11:12:19] RECOVERY - Puppet errors on saucelabs-03 is OK: OK: Less than 1.00% above the threshold [0.0] [11:12:28] RECOVERY - Puppet errors on castor02 is OK: OK: Less than 1.00% above the threshold [0.0] [11:12:36] RECOVERY - Puppet errors on integration-r-lang-01 is OK: OK: Less than 1.00% above the threshold [0.0] [11:13:24] RECOVERY - Puppet errors on integration-slave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [11:13:48] RECOVERY - Puppet errors on integration-slave-jessie-1003 is OK: OK: Less than 1.00% above the threshold [0.0] [11:14:42] RECOVERY - Puppet errors on saucelabs-02 is OK: OK: Less than 1.00% above the threshold [0.0] [11:15:13] * hashar waits for scap [11:16:04] RECOVERY - Puppet errors on jenkinstest is OK: OK: Less than 1.00% above the threshold [0.0] [11:17:32] RECOVERY - Puppet errors on integration-slave-docker-c2-m4-d40-1005 is OK: OK: Less than 1.00% above the threshold [0.0] [11:17:32] RECOVERY - Puppet errors on integration-slave-docker-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [11:18:04] RECOVERY - Puppet errors on integration-slave-docker-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [11:18:30] RECOVERY - Puppet errors on integration-slave-docker-1705 is OK: OK: Less than 1.00% above the threshold [0.0] [11:18:45] RECOVERY - Puppet errors on integration-slave-jessie-android is OK: OK: Less than 1.00% above the threshold [0.0] [11:19:47] RECOVERY - Puppet errors on saucelabs-01 is OK: OK: Less than 1.00% above the threshold [0.0] [11:20:37] RECOVERY - Puppet errors on integration-slave-docker-1003 is OK: OK: Less than 1.00% above the threshold [0.0] [11:22:25] RECOVERY - Puppet errors on integration-slave-jessie-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [11:30:17] (03PS1) 10Hashar: Switch Nodepool Jenkins agent to java 8 [integration/config] - 10https://gerrit.wikimedia.org/r/382424 (https://phabricator.wikimedia.org/T162828) [11:31:21] (03CR) 10jerkins-bot: [V: 04-1] Switch Nodepool Jenkins agent to java 8 [integration/config] - 10https://gerrit.wikimedia.org/r/382424 (https://phabricator.wikimedia.org/T162828) (owner: 10Hashar) [11:34:49] (03PS2) 10Hashar: dib: switch Nodepool Jenkins agent to java 8 [integration/config] - 10https://gerrit.wikimedia.org/r/382424 (https://phabricator.wikimedia.org/T162828) [11:34:51] (03PS1) 10Hashar: dib: rely on jenkins::comon Jenkins agent jre [integration/config] - 10https://gerrit.wikimedia.org/r/382425 (https://phabricator.wikimedia.org/T162828) [11:37:57] PROBLEM - App Server Main HTTP Response on deployment-mediawiki07 is CRITICAL: HTTP CRITICAL: HTTP/1.1 404 Not Found - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 392 bytes in 0.003 second response time [11:38:36] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3660320 (10Tobi_WMDE_SW) a:03jkroll [11:45:10] (03CR) 10Hashar: [C: 032] dib: switch Nodepool Jenkins agent to java 8 [integration/config] - 10https://gerrit.wikimedia.org/r/382424 (https://phabricator.wikimedia.org/T162828) (owner: 10Hashar) [11:46:15] (03Merged) 10jenkins-bot: dib: switch Nodepool Jenkins agent to java 8 [integration/config] - 10https://gerrit.wikimedia.org/r/382424 (https://phabricator.wikimedia.org/T162828) (owner: 10Hashar) [11:47:02] !log Refreshing Nodepool Jessie snapshot to get java 8 by default - T162828 [11:47:08] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:47:08] T162828: Upgrade jenkins server and jenkins slaves to java 8 - https://phabricator.wikimedia.org/T162828 [11:50:38] 2017-10-05 11:50:11,738 INFO nodepool.image.build.wmflabs-eqiad.snapshot-ci-jessie: Error: Duplicate declaration: Apt::Repository[jessie-ci-php55] is already declared in file /puppet/modules/contint/manifests/packages/php.pp:71; cannot redeclare at /opt/git/integration/config/dib/puppet/ciimage.pp:44 on node snapshot-ci-jessie-1507204001.eqiad.wmflabs [11:50:40] that is never ending :D [11:53:46] (03PS1) 10Hashar: Revert "dib: php5.5 packages are now in contint::packages::php" [integration/config] - 10https://gerrit.wikimedia.org/r/382427 [11:53:50] (03PS2) 10Hashar: Revert "dib: php5.5 packages are now in contint::packages::php" [integration/config] - 10https://gerrit.wikimedia.org/r/382427 [11:55:26] (03CR) 10jerkins-bot: [V: 04-1] Revert "dib: php5.5 packages are now in contint::packages::php" [integration/config] - 10https://gerrit.wikimedia.org/r/382427 (owner: 10Hashar) [11:57:12] (03PS3) 10Hashar: Revert "dib: php5.5 packages are now in contint::packages::php" [integration/config] - 10https://gerrit.wikimedia.org/r/382427 [12:00:55] (03CR) 10Hashar: [C: 032] Revert "dib: php5.5 packages are now in contint::packages::php" [integration/config] - 10https://gerrit.wikimedia.org/r/382427 (owner: 10Hashar) [12:02:02] (03Merged) 10jenkins-bot: Revert "dib: php5.5 packages are now in contint::packages::php" [integration/config] - 10https://gerrit.wikimedia.org/r/382427 (owner: 10Hashar) [12:25:16] (03PS1) 10Hashar: dib: attempt to fix dependency hell [integration/config] - 10https://gerrit.wikimedia.org/r/382431 [12:27:05] (03CR) 10jerkins-bot: [V: 04-1] dib: attempt to fix dependency hell [integration/config] - 10https://gerrit.wikimedia.org/r/382431 (owner: 10Hashar) [12:31:50] (03PS2) 10Hashar: dib: attempt to fix dependency hell [integration/config] - 10https://gerrit.wikimedia.org/r/382431 [12:31:52] (03PS1) 10Hashar: dib: fix lsbdistrelease in spec [integration/config] - 10https://gerrit.wikimedia.org/r/382433 [12:39:36] (03CR) 10Hashar: [C: 032] dib: fix lsbdistrelease in spec [integration/config] - 10https://gerrit.wikimedia.org/r/382433 (owner: 10Hashar) [12:39:41] (03CR) 10Hashar: [C: 032] dib: attempt to fix dependency hell [integration/config] - 10https://gerrit.wikimedia.org/r/382431 (owner: 10Hashar) [12:41:36] (03Merged) 10jenkins-bot: dib: fix lsbdistrelease in spec [integration/config] - 10https://gerrit.wikimedia.org/r/382433 (owner: 10Hashar) [12:41:38] (03Merged) 10jenkins-bot: dib: attempt to fix dependency hell [integration/config] - 10https://gerrit.wikimedia.org/r/382431 (owner: 10Hashar) [12:47:40] (03CR) 10Hashar: [C: 032] Archive Extension:AntiBot [integration/config] - 10https://gerrit.wikimedia.org/r/382422 (https://phabricator.wikimedia.org/T177082) (owner: 10MarcoAurelio) [12:48:39] (03Merged) 10jenkins-bot: Archive Extension:AntiBot [integration/config] - 10https://gerrit.wikimedia.org/r/382422 (https://phabricator.wikimedia.org/T177082) (owner: 10MarcoAurelio) [12:59:20] (03PS1) 10Hashar: dib: ugly dependency hell fixup [integration/config] - 10https://gerrit.wikimedia.org/r/382437 [12:59:50] 10Release-Engineering-Team (Kanban), 10Analytics, 10Patch-For-Review: Move Wikistats 2 from Differential to Gerrit - https://phabricator.wikimedia.org/T177288#3660553 (10fdans) a:05hashar>03fdans [13:16:18] !log Image snapshot-ci-jessie-1507208677 in wmflabs-eqiad is ready [13:16:22] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:20:54] 10Gerrit, 10MediaWiki-Vagrant, 10Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#2863456 (10Kamsuri5) Hi @Tgr ! I have installed Mediawiki( cloned it using git clone https://gerrit.wikimedia.org/r/p/mediawiki/core.git) in the vagrant... [13:44:57] 10Release-Engineering-Team (Kanban), 10Analytics-Kanban, 10Patch-For-Review: Move Wikistats 2 from Differential to Gerrit - https://phabricator.wikimedia.org/T177288#3660665 (10fdans) [13:59:39] PROBLEM - Puppet errors on deployment-imagescaler01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [14:06:02] 10Continuous-Integration-Infrastructure (shipyard): mediawiki-core-phpcs-docker jobs running on integration-slave-docker-1001 are running significantly slower than other slaves - https://phabricator.wikimedia.org/T177039#3660777 (10hashar) Please keep integration-slave-docker-1002 around. I guess we can try to... [14:11:33] 10Release-Engineering-Team (Kanban), 10Readers-Web-Backlog, 10RelatedArticles, 10Browser-Tests, and 3 others: Automated browser tests cannot create pages on the Beta Cluster as anonymous user in RelatedArticles tests - https://phabricator.wikimedia.org/T176315#3660785 (10zeljkofilipin) Build [[ https://int... [14:24:49] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team: On CI, upgrade docker-ce from 17.06.2 to 17.09.0 - https://phabricator.wikimedia.org/T177499#3660834 (10hashar) [14:32:17] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Watching / External), 10Cloud-VPS, 10Nodepool, and 2 others: figure out if nodepool is overwhelming rabbitmq and/or nova - https://phabricator.wikimedia.org/T170492#3660861 (10Andrew) 05Open>03Resolved rabbit is now much quieter, so t... [14:39:38] RECOVERY - Puppet errors on deployment-imagescaler01 is OK: OK: Less than 1.00% above the threshold [0.0] [14:51:51] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Jenkins, 10Patch-For-Review: Upgrade jenkins server and jenkins slaves to java 8 - https://phabricator.wikimedia.org/T162828#3176110 (10hashar) I have upgraded all slaves to use Java 8 (deploy... [14:59:11] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Jenkins: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3660984 (10hashar) For #operations , we would need the Jenkins 2.73.1 Debian package to be made available on apt.wik... [15:00:57] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Jenkins: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3370797 (10MoritzMuehlenhoff) @hashar: I need to finish some other tasks today, but I can help with that tomorrow mo... [15:08:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Jenkins: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3661059 (10hashar) @MoritzMuehlenhoff definitely. I was planning to poke you about it tomorrow :] The aim is just t... [15:10:11] PROBLEM - Puppet errors on deployment-cache-upload04 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [15:15:47] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Wikidata, and 3 others: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432#3661087 (10zeljkofilipin) Looks like this is where the error message comes from: h... [15:21:50] PROBLEM - Puppet errors on deployment-cache-text04 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [15:34:04] PROBLEM - Free space - all mounts on deployment-kafka01 is CRITICAL: CRITICAL: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree (<100.00%) [15:36:36] hasharAway :) :) :) [15:36:40] thanks :) [15:47:31] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team: On CI, upgrade docker-ce from 17.06.2 to 17.09.0 - https://phabricator.wikimedia.org/T177499#3661237 (10Addshore) > Add --chown flag to ADD/COPY commands in Dockerfile That is awesome [15:49:30] Hey... Does anyone know if it's possible to make a private file attachment for a private task on Phabricator? [15:50:01] yep [15:50:13] Just click on the file upload on the task [15:50:23] which should make sure the file is private. [15:50:23] indeed, https://phabricator.wikimedia.org/file/upload/ [15:58:10] paladox addshore ah fantasmic, thanks a ton! [15:58:19] your welcome :) [15:59:01] see https://www.mediawiki.org/wiki/Phabricator/Help#Uploading_file_attachments [17:23:12] 10Continuous-Integration-Config, 10Release-Engineering-Team (Watching / External), 10Discovery, 10Discovery-Analysis (Current work), 10Patch-For-Review: Add lint/CI to all wikimedia/discovery analytics repositories - https://phabricator.wikimedia.org/T153856#2893206 (10Legoktm) @mpopov is the current job... [17:26:33] (03PS5) 10EddieGP: Add Zoranzoki21 to CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/380989 [17:26:39] (03PS3) 10EddieGP: Add Jayprakash12345 to CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/381639 [17:58:30] paladox: addshore andre__ hmm somehow I'm unable to effectively restrict permissions on a file I upload. Even when I create it from a private task, I'm still able to view it from a private window/from a different browser [17:58:58] Tried dragging into a comment on the private task, and also going to the upload page and setting visibility before uploading [17:58:59] hmm [17:59:02] AndyRussG: please ping twentyafterfour with those things [17:59:04] it should work [18:00:03] paladox: it does say that the permissions for viewing are restricted, but when I copy and past the link just to view the image elsewhere, it still shows up [18:00:15] greg-g: thanks well do! twentyafterfour....... ^ :) thx!!! [18:00:19] *will [18:00:43] pm me the url? [18:05:28] greg-g: I deleted the file... Lemme make a new one with something that's not really private [18:05:38] word [18:06:21] AndyRussG: phabricator files can always be viewed if you have the link to them [18:06:40] it's essentially security through obscurity [18:06:48] twentyafterfour: aaaah OK gotcha [18:07:18] greg-g ^ [18:08:08] twentyafterfour: so basically something that merits a more hardened protection should just not be uploaded to Phabricator, correct? [18:08:33] Hmmm I guess if all connections are https it should be relatively safe [18:08:44] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:09:01] AndyRussG: right, yeah the URL is extremely hard to guess so it's pseudo-secure [18:09:14] May I suggest a mention of this issue here https://www.mediawiki.org/wiki/Phabricator/Help#Uploading_file_attachments so people don't accidentally share links? [18:09:31] AndyRussG: probably a good idea [18:12:26] wtf translated pages make visual editor worthless [18:13:34] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 35332 bytes in 0.991 second response time [18:14:39] twentyafterfour: yuuuuuuuup [18:14:54] it makes me not do drive by fixes, sadly :( [18:19:07] that's lame, it should just ignore the translate tags [18:19:16] merged -> contint: Make php.pp compatible with stretch https://gerrit.wikimedia.org/r/#/c/361680/ should fix puppet on jenkins-slave-01.git.eqiad.wmflabs is CRIT [18:19:30] tx paladox [18:19:30] cool! [18:25:32] your welcome :) [18:28:02] 10Release-Engineering-Team (Kanban), 10Wikimedia-Blog-Content: Code Health and the Code Health Group - https://phabricator.wikimedia.org/T175187#3661920 (10Jrbranaa) 05Open>03Resolved Sorry Mel, should have looked at this task prior to asking you about the status. Is there a standard lead time for approva... [18:29:44] 10Release-Engineering-Team (Kanban): Identify Orphaned components/code - https://phabricator.wikimedia.org/T173349#3661926 (10Jrbranaa) Have received a fair bit of feedback/recommendations on some of the orphaned components. Will be updating the Developers/Maintainers page with those that are straight forward,... [18:30:34] 10Release-Engineering-Team (Kanban), 10Wikimedia-Blog-Content: [Technical Debt Series]What is Technical Debt - https://phabricator.wikimedia.org/T175181#3661927 (10Jrbranaa) 05Open>03Resolved p:05Triage>03Normal [18:30:45] 10Release-Engineering-Team (Kanban), 10Wikimedia-Blog-Content: [Technical Debt Series]What is Technical Debt - https://phabricator.wikimedia.org/T175181#3585333 (10Jrbranaa) 05Resolved>03Open [18:33:18] 10Release-Engineering-Team (Kanban), 10Wikimedia-Blog-Content: Code Health and the Code Health Group - https://phabricator.wikimedia.org/T175187#3661953 (10MelodyKramer) Once all approvals are in, we can publish as soon as there's a window. Would you like to aim for mid-next week? Mel [18:42:30] https://usercontent.irccloud-cdn.com/file/jxB7FVys/phab-on-crack.png [18:42:36] Phabricator is a bit... confused :) [18:55:09] heh [19:02:24] AndyRussG: https://www.mediawiki.org/w/index.php?title=Phabricator/Help&diff=2579122&oldid=2562897 [19:03:17] twentyafterfour: cool beans! [19:03:21] Thanks for the help :) [19:03:31] No problem! :) [19:11:03] 10Continuous-Integration-Infrastructure (shipyard): mediawiki-core-phpcs-docker jobs running on integration-slave-docker-1001 are running significantly slower than other slaves - https://phabricator.wikimedia.org/T177039#3662020 (10hashar) Since I suspect a kernel leak, Tyler pointed out that the 1001 and 1002... [19:11:33] !log rebooting integration-slave-jessie-1002 to catch with kernel upgrade and pooling it back in Jenkins - T177039 [19:11:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:11:39] T177039: mediawiki-core-phpcs-docker jobs running on integration-slave-docker-1001 are running significantly slower than other slaves - https://phabricator.wikimedia.org/T177039 [19:14:54] bah rebooted the wrong one [19:15:00] !log rebooting integration-slave-docker-1002 to catch with kernel upgrade and pooling it back in Jenkins - T177039 [19:15:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:15:47] 10Continuous-Integration-Infrastructure (shipyard): mediawiki-core-phpcs-docker jobs running on integration-slave-docker-1001 are running significantly slower than other slaves - https://phabricator.wikimedia.org/T177039#3662026 (10hashar) https://grafana-labs.wikimedia.org/dashboard/db/labs-project-board?panelI... [19:17:24] Project selenium-MinervaNeue ยป firefox,beta,Linux,BrowserTests build #151: 04FAILURE in 28 min: https://integration.wikimedia.org/ci/job/selenium-MinervaNeue/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/151/ [19:23:07] (03CR) 10EddieGP: "https://gerrit.wikimedia.org/r/#/c/381639/ does the same thing." [integration/config] - 10https://gerrit.wikimedia.org/r/381717 (owner: 10Zoranzoki21) [19:47:41] thcipriani: if you're interested, I have some patches open for improvements to build.py script: https://gerrit.wikimedia.org/r/#/q/topic:docker-build+status:open [19:48:19] 10Release-Engineering-Team, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, 10Beta-Cluster-reproducible, and 3 others: Jobs invoking SiteConfiguration::getConfig cause HHVM to fail updating the bytecode cache due to being filesize limited to 512MByte... - https://phabricator.wikimedia.org/T145819#3662129 [19:49:24] legoktm: neat :) [19:50:20] will take a look when I finish up an extended edition of swat. [19:54:48] ok, thanks :) [20:10:47] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.31.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T174358#3662250 (10mmodell) [20:29:32] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.31.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T174358#3662287 (10mmodell) [20:32:44] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.31.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T174358#3662309 (10mmodell) [20:46:16] (03PS3) 10Thcipriani: Add --run-tests argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382340 (owner: 10Legoktm) [20:48:20] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Jenkins: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3662359 (10hashar) [20:48:23] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Jenkins, 10Patch-For-Review: Upgrade jenkins server and jenkins slaves to java 8 - https://phabricator.wikimedia.org/T162828#3662356 (10hashar) 05Open>03Resolved Solved! With help of @Pala... [20:51:47] (03Abandoned) 10Zoranzoki21: Whitelist user Jayprakash12345 on Zuul [integration/config] - 10https://gerrit.wikimedia.org/r/381717 (owner: 10Zoranzoki21) [20:52:16] (03CR) 10Thcipriani: [C: 032] Add --run-tests argument to build.py (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/382340 (owner: 10Legoktm) [20:53:28] (03CR) 10Zoranzoki21: "When patch for whitelist will be deployed? No only for whitelisting me." [integration/config] - 10https://gerrit.wikimedia.org/r/380989 (owner: 10EddieGP) [20:55:02] (03Merged) 10jenkins-bot: Add --run-tests argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382340 (owner: 10Legoktm) [20:55:11] hashar: Could you have a look at ^ and the other CI whitelist patch https://gerrit.wikimedia.org/r/#/c/381639/ I mentioned earlier? Or alternatively tell me when to ask again? :) [20:56:39] eddiegp: but why dont they get merged automagically??? :) [20:57:10] (03CR) 10Hashar: [C: 032] Add Jayprakash12345 to CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/381639 (owner: 10EddieGP) [20:57:18] lol, maybe because that would make a whitelist useless :D [20:57:53] I promise that whitelist will be gone eventually [20:58:44] (03Merged) 10jenkins-bot: Add Jayprakash12345 to CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/381639 (owner: 10EddieGP) [20:58:52] (03PS6) 10Hashar: Add Zoranzoki21 to CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/380989 (owner: 10EddieGP) [20:58:57] (03CR) 10Hashar: [C: 032] Add Zoranzoki21 to CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/380989 (owner: 10EddieGP) [20:58:58] I'm waiting for it, it's really a PITA for newcomers ;) [20:59:55] (03Merged) 10jenkins-bot: Add Zoranzoki21 to CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/380989 (owner: 10EddieGP) [21:00:38] eddiegp: then a simple +1 would trigger the test [21:00:46] so there is at least that [21:00:53] but yeah, the CI is terribly dated :( [21:00:56] Yeah, I'm doing that regularly. [21:01:17] It's just that someone needs to see the patch and take manual action, which takes time. [21:01:32] yeah I should do better [21:01:34] CI response is close-to-immediately (some minutes) compared to code-review times. [21:01:46] I do get the mail notification , and supposedly look at open changes regularly [21:02:00] but i have been quite busy the last weeks or so so that adds some delay [21:02:42] and deployed! [21:02:49] I am off now :] thank you for the patches eddiegp! [21:02:54] What's needed to get rid of it after all? I believe it was something about putting all jobs into throw-away vms/containers, right? [21:03:04] Okay :) [21:03:22] (03CR) 10Thcipriani: [C: 04-1] "Cool feature :)" (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/382341 (owner: 10Legoktm) [21:06:57] (03CR) 10Hashar: "I am not sure I am a huge fan of having to bump the version in the Jenkins job over and over. That is a bit spammy isn't it?" [integration/config] - 10https://gerrit.wikimedia.org/r/382341 (owner: 10Legoktm) [21:10:45] (03CR) 10Thcipriani: [C: 031] "for some reason the rebase button on gerrit is grayed out...so I'll see if giving this a +1 jars something loose." [integration/config] - 10https://gerrit.wikimedia.org/r/382347 (owner: 10Legoktm) [21:11:01] (03CR) 10Thcipriani: [C: 032] build.py: Improve "docker push" output [integration/config] - 10https://gerrit.wikimedia.org/r/382347 (owner: 10Legoktm) [21:36:26] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.31.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T174358#3662503 (10mmodell) [21:52:06] 10Gerrit, 10MediaWiki-Vagrant, 10Patch-For-Review: "index-pack failed" when installing new MediaWiki-Vagrant box - https://phabricator.wikimedia.org/T152801#3662573 (10Tgr) @Kamsuri sounds like your git clone ended up in the wrong place. It should be at `/mediawiki` (specifically the installer c... [22:06:55] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.31.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T174358#3662666 (10mmodell) [22:09:12] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Watching / External), 10Cloud-VPS, 10Nodepool, and 2 others: figure out if nodepool is overwhelming rabbitmq and/or nova - https://phabricator.wikimedia.org/T170492#3662674 (10hashar) Did you have a chance to look at the `notifications.er... [22:26:37] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Watching / External), 10Cloud-VPS, 10Nodepool, and 2 others: figure out if nodepool is overwhelming rabbitmq and/or nova - https://phabricator.wikimedia.org/T170492#3662741 (10bd808) >>! In T170492#3662674, @hashar wrote: > Did you have a... [23:48:58] (03CR) 10Legoktm: "> And to promote an image simply tag it 'stable'." (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/382341 (owner: 10Legoktm) [23:49:02] (03PS3) 10Legoktm: Add --update-jjb argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382341 [23:49:09] (03CR) 10jerkins-bot: [V: 04-1] Add --update-jjb argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382341 (owner: 10Legoktm) [23:50:08] (03PS4) 10Legoktm: Add --update-jjb argument to build.py [integration/config] - 10https://gerrit.wikimedia.org/r/382341 [23:51:02] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.31.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T174358#3663062 (10mmodell) 05Open>03Resolved [23:51:06] (03PS4) 10Legoktm: build.py: Improve "docker push" output [integration/config] - 10https://gerrit.wikimedia.org/r/382347 [23:51:08] (03PS7) 10Legoktm: docker: Recursively build images in order [integration/config] - 10https://gerrit.wikimedia.org/r/381761 (https://phabricator.wikimedia.org/T176318) (owner: 10Hashar)