[00:03:43] Project beta-code-update-eqiad build #183565: 04FAILURE in 43 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/183565/ [00:04:00] 10Beta-Cluster-Infrastructure, 10Community-Tech, 10MediaWiki-extensions-LoginNotify, 10Wikimedia-Site-requests: Clarify LoginNotify emails are from beta - https://phabricator.wikimedia.org/T181908#3806307 (10Reedy) [00:13:38] Yippee, build fixed! [00:13:38] Project beta-code-update-eqiad build #183566: 09FIXED in 37 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/183566/ [00:15:20] 10MediaWiki-Codesniffer: Create sniff to detect NULL rather than null - https://phabricator.wikimedia.org/T181909#3806325 (10Reedy) [00:52:36] 10Beta-Cluster-Infrastructure, 10Wikimedia-extension-review-queue: Deploy StopForumSpam to the Beta Cluster - https://phabricator.wikimedia.org/T181217#3806403 (10TerraCodes) [01:36:26] PROBLEM - Free space - all mounts on integration-slave-docker-1002 is CRITICAL: CRITICAL: integration.integration-slave-docker-1002.diskspace.root.byte_percentfree (<33.33%) [01:38:35] 10Continuous-Integration-Config, 10Pywikibot-core, 10Pywikibot-tests: pywikibot-core-tox-doc-docker timeouts sporadically - https://phabricator.wikimedia.org/T181881#3806436 (10Dalba) [01:58:17] 10MediaWiki-Codesniffer: Create sniff to detect NULL rather than null - https://phabricator.wikimedia.org/T181909#3806325 (10Legoktm) Unfortunately there's no specific token for null, it's just T_STRING. [01:59:25] (03PS1) 10Dalba: Increase pywikibot-core-tox-doc-docker timeout to 5 minutes [integration/config] - 10https://gerrit.wikimedia.org/r/394824 (https://phabricator.wikimedia.org/T181881) [02:02:19] 10MediaWiki-Codesniffer: Create sniff to detect NULL rather than null - https://phabricator.wikimedia.org/T181909#3806445 (10Legoktm) 05Open>03Invalid The sniff already exists and runs properly, it just didn't run for that user since they aren't whitelisted yet: ``` 02:01:41 FILE: ...jessie/src/extensions/Be... [02:28:32] 10Continuous-Integration-Config, 10Pywikibot-core, 10Patch-For-Review, 10Pywikibot-tests: pywikibot-core-tox-doc-docker timeouts sporadically - https://phabricator.wikimedia.org/T181881#3806463 (10Dalba) [04:17:31] Project selenium-MultimediaViewer ยป firefox,beta,Linux,BrowserTests build #596: 04FAILURE in 21 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/596/ [04:51:49] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [05:21:48] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [07:10:02] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:57:11] (03PS1) 10Legoktm: Use only PSR2.Files.EndFileNewline [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/394840 (https://phabricator.wikimedia.org/T179998) [08:54:11] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:38:39] PROBLEM - Parsoid on deployment-parsoid09 is CRITICAL: HTTP CRITICAL - No data received from host [09:43:42] RECOVERY - Parsoid on deployment-parsoid09 is OK: HTTP OK: HTTP/1.1 200 OK - 1051 bytes in 0.109 second response time [10:20:13] PROBLEM - Free space - all mounts on integration-slave-docker-1001 is CRITICAL: CRITICAL: integration.integration-slave-docker-1001.diskspace.root.byte_percentfree (<100.00%) [11:00:00] (03CR) 10Umherirrender: [C: 032] "PSR2.Files.EndFileNewline also find two or more lines at end of file, while the generic does not" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/394840 (https://phabricator.wikimedia.org/T179998) (owner: 10Legoktm) [11:00:29] 10MediaWiki-Codesniffer, 10Patch-For-Review: Only run one EndFileNewline.NotFound sniff, not two - https://phabricator.wikimedia.org/T179998#3806743 (10Umherirrender) 05Open>03Resolved p:05Triage>03Normal a:03Legoktm [11:00:48] (03Merged) 10jenkins-bot: Use only PSR2.Files.EndFileNewline [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/394840 (https://phabricator.wikimedia.org/T179998) (owner: 10Legoktm) [12:06:31] 10Continuous-Integration-Config, 10Wikidata: Wikibase\Repo\Tests\Actions\ViewEntityActionTest::testShowDiff failing on CI - https://phabricator.wikimedia.org/T181928#3806840 (10MarcoAurelio) [12:50:33] 10Beta-Cluster-Infrastructure, 10Community-Tech, 10MediaWiki-extensions-LoginNotify, 10Wikimedia-Site-requests: Clarify LoginNotify emails are from beta - https://phabricator.wikimedia.org/T181908#3806293 (10MarcoAurelio) Maybe those emails are using `{{SITENAME}}` (have not checked); so we could maybe jus... [16:22:04] 10Continuous-Integration-Infrastructure: mw-fetch-composer-dev.sh is to naieve with value handling - https://phabricator.wikimedia.org/T181937#3807127 (10Reedy) [16:24:22] 10Continuous-Integration-Infrastructure: Swap node for jq in mw-fetch-composer-dev.sh - https://phabricator.wikimedia.org/T181938#3807139 (10Reedy) [16:25:13] 10Continuous-Integration-Infrastructure: mw-fetch-composer-dev.sh/composer-dev-args.js is too naive with value handling - https://phabricator.wikimedia.org/T181937#3807151 (10Reedy) [16:26:07] (03Draft2) 10Reedy: Wrap values in composer-dev-args.js [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394855 (https://phabricator.wikimedia.org/T181937) [16:28:05] (03Draft2) 10Reedy: Swap node for jq [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394856 (https://phabricator.wikimedia.org/T181938) [16:28:48] 10Continuous-Integration-Infrastructure: mw-fetch-composer-dev.sh/composer-dev-args.js is too naive with value handling - https://phabricator.wikimedia.org/T181937#3807153 (10Reedy) https://gerrit.wikimedia.org/r/#/c/394855/ [16:29:43] 10Continuous-Integration-Infrastructure: Swap node for jq in mw-fetch-composer-dev.sh - https://phabricator.wikimedia.org/T181938#3807156 (10Reedy) https://gerrit.wikimedia.org/r/394856 But then that removes the fix for T181937 in https://gerrit.wikimedia.org/r/#/c/394855/ [16:30:56] (03PS3) 10Reedy: Swap node for jq [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394856 (https://phabricator.wikimedia.org/T181938) [16:33:17] (03CR) 10Paladox: "If this file is being removed in https://gerrit.wikimedia.org/r/#/c/394856/ is there any point in updating this file only for it to be rem" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394855 (https://phabricator.wikimedia.org/T181937) (owner: 10Reedy) [16:35:11] (03CR) 10Reedy: "is jq installed?" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394856 (https://phabricator.wikimedia.org/T181938) (owner: 10Reedy) [16:35:22] 10Continuous-Integration-Infrastructure: Swap node for jq in mw-fetch-composer-dev.sh - https://phabricator.wikimedia.org/T181938#3807171 (10Reedy) Is jq installed? [16:35:46] (03CR) 10Reedy: "Depends if/when things get merged. This one can go in now, and the other one later, maybe. Depends how hashar is feeling ;)" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394855 (https://phabricator.wikimedia.org/T181937) (owner: 10Reedy) [16:38:12] 10Continuous-Integration-Infrastructure: Swap node for jq in mw-fetch-composer-dev.sh - https://phabricator.wikimedia.org/T181938#3807139 (10Paladox) Yes root@jenkins-slave-01:/home/paladox# jq jq - commandline JSON processor [version 1.5-1-a5b5cbe] Usage: jq [options] [file...] Im running jenkins... [16:38:19] (03CR) 10Reedy: "root@ubuntu64-web-esxi:/var/www/wiki/mediawiki/core# jq -r '.["require-dev"]|to_entries|map([.key,.value])[]|join("=")' composer.json" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394856 (https://phabricator.wikimedia.org/T181938) (owner: 10Reedy) [16:39:28] 10Continuous-Integration-Infrastructure: Swap node for jq in mw-fetch-composer-dev.sh - https://phabricator.wikimedia.org/T181938#3807181 (10Reedy) WMF is running on jessie ;) But if you haven't installed it manually, that should mean that puppet did, and we're all good :) [16:39:57] (03PS4) 10Reedy: Swap node for jq [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394856 (https://phabricator.wikimedia.org/T181938) [16:40:10] (03Abandoned) 10Reedy: Wrap values in composer-dev-args.js [integration/jenkins] - 10https://gerrit.wikimedia.org/r/394855 (https://phabricator.wikimedia.org/T181937) (owner: 10Reedy) [16:47:45] paladox: Do we still use https://github.com/wikimedia/integration-composer ? [16:47:54] If so, why are we using such an old version? ;) [16:47:55] I think so. [16:48:05] i have a patch that should update it [16:48:16] * paladox looks [16:48:29] 10Continuous-Integration-Infrastructure: Address fixme in mw-fetch-composer-dev.sh - https://phabricator.wikimedia.org/T181940#3807197 (10Reedy) [16:48:34] Reedy https://gerrit.wikimedia.org/r/#/c/340791/ [16:48:42] i guess that needs updating to the new update heh [16:48:43] :) [16:48:43] I noticed it when just filing that bug above [16:49:00] We probably don't need to be on the newest possible... [16:49:04] but 1.1.3 seems a bit old [16:49:21] ok. I guess 1.4 is ok for now. then after we should try 1.5+ [16:49:49] 1.5 seems buggy [16:49:49] 1.5.5 (2017-12-01) [16:49:49] 1.5.4 (2017-12-01) [16:49:49] 1.5.3 (2017-11-30) [16:49:49] i should update it to 1.4.3 [16:49:52] 1.5.2 (2017-09-11) [16:49:53] :D [16:49:55] yeh [16:50:05] Yeah, if we're gonna upgrade, might aswell use the latest patch of 1.4 [16:50:46] yeh /me is doing :) [16:51:40] don't forget to change the commit summary too ;) [16:51:57] (03PS6) 10Paladox: Update composer to 1.4.3 [integration/composer] - 10https://gerrit.wikimedia.org/r/340791 (https://phabricator.wikimedia.org/T125343) [16:52:01] heh done :) [16:54:23] (03CR) 10Reedy: [C: 031] "LGTM. 1.4 vs 1.5 makes sense for the moment" [integration/composer] - 10https://gerrit.wikimedia.org/r/340791 (https://phabricator.wikimedia.org/T125343) (owner: 10Paladox) [16:57:28] (03PS1) 10Reedy: Minor README.md updates [integration/composer] - 10https://gerrit.wikimedia.org/r/394858 [16:58:26] paladox: debian stable has composer 1.2.2 packaged! [16:58:34] https://packages.debian.org/stretch/composer [16:58:41] heh [16:58:49] LMAO (pardon my french) [16:58:51] that's old [16:59:18] that's old @ debian stable [16:59:25] everything is old in debian stable [16:59:37] unless something hasn't been updated at all upstream :) [17:02:23] Reedy i think i can test that on jenkins-slave-01 :). Though it will be on stretch so im hopping there wont be any problems on jessie. [17:02:35] Test which one? :P [17:03:06] it works [17:03:09] Composer version 1.4.3 2017-08-06 15:00:25 [17:03:17] Reedy https://gerrit.wikimedia.org/r/#/c/340791/ [17:03:40] I wonder if I can just CR+2 it [17:03:45] Or whether it actually needs deploying [17:04:23] hmm maybe, not sure if it's auto deployed but we could possibly recheck some mw changes with it then revert if any fail with the new composer version. [17:06:14] I wonder how to check [17:06:27] Is there a puppet "ensure latest" for the git repo? [17:08:52] i will check :) [17:09:26] https://github.com/wikimedia/puppet/blob/a618a00c216c2a76ebc5ce682b549628b49232ac/modules/contint/manifests/composer.pp#L10 [17:09:30] yeh reedy ^^ [17:11:46] It's auto deployed so it should be pretty easy to revert (hopping). [17:14:00] (03CR) 10Reedy: [C: 032] "leeeerroooooyyyyyyy" [integration/composer] - 10https://gerrit.wikimedia.org/r/340791 (https://phabricator.wikimedia.org/T125343) (owner: 10Paladox) [17:14:07] lol :) [17:14:11] (03Merged) 10jenkins-bot: Update composer to 1.4.3 [integration/composer] - 10https://gerrit.wikimedia.org/r/340791 (https://phabricator.wikimedia.org/T125343) (owner: 10Paladox) [17:14:44] that... was very quick [17:14:50] heh yeh [17:14:56] Let's give puppet a bit of time to run and then go and recheck [17:15:08] yeh [17:15:24] 10Continuous-Integration-Infrastructure, 10Composer, 10Patch-For-Review: Upgrade integration/composer to 1.4.3 stable - https://phabricator.wikimedia.org/T125343#3807257 (10Reedy) [17:15:32] paladox: https://phabricator.wikimedia.org/T125343#2254606 [17:15:38] I *think* that was one reason it was blocking [17:15:41] Which isn't a problem now [17:15:46] yeh [17:16:04] hashar only recently got rid of trusty in the summer. [17:16:09] heh [17:16:23] Looking through the task... We should do some test commits on repos like CirrusSearch that seemed to break last time [17:16:25] which allowed us to update jenkins too [17:16:31] yeh [17:16:44] i guess wait an hour, most of ci should have been updated [17:17:09] except from nodepool. which im guessing will be updated at 2pm tommror. [17:21:35] Jobs should run composer --version first though tbh [17:21:42] Some.. Do/might? [17:22:26] seems not. [17:23:35] 10Continuous-Integration-Infrastructure: Run composer --version in CI jobs - https://phabricator.wikimedia.org/T181942#3807260 (10Reedy) [17:23:40] 10Continuous-Integration-Infrastructure: Run composer --version in CI jobs - https://phabricator.wikimedia.org/T181942#3807272 (10Reedy) p:05Triage>03Low [17:26:52] (03CR) 10Paladox: [C: 031] Minor README.md updates [integration/composer] - 10https://gerrit.wikimedia.org/r/394858 (owner: 10Reedy) [17:54:32] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Beta-Cluster-reproducible, 10User-Addshore, 10Wikimedia-log-errors: dewiktionary on beta gives Undefined variable: wmgWikibaseSiteGroup - https://phabricator.wikimedia.org/T168035#3807306 (10Addshore) 05Open>03Resolved a:03Addshore I ran this myself and... [18:05:41] 10Continuous-Integration-Infrastructure: Address fixme in mw-fetch-composer-dev.sh - https://phabricator.wikimedia.org/T181940#3807339 (10Reedy) I can't work out what is special about `1.0.0-alpha11`... https://github.com/composer/composer/blob/1.0.0-alpha11/CHANGELOG.md [18:06:40] hah Reedy [18:09:15] ohai addshore [18:09:18] Wassup? [18:17:43] i was laughing at "I can't work out what is special about `1.0.0-alpha11" [18:31:44] 10Gerrit, 10Release-Engineering-Team: Unable to log in into gerrit: "Cannot assign user name "ashley" to account ; name already in use." - https://phabricator.wikimedia.org/T181945#3807362 (10ashley) [18:32:43] paladox: ^ it's back again [18:41:48] 10Gerrit, 10Release-Engineering-Team: Unable to log in into gerrit: "Cannot assign user name "ashley" to account ; name already in use." - https://phabricator.wikimedia.org/T181945#3807381 (10Aklapper) Please check T152640 for workarounds and report back. Thanks! [18:42:47] oh no, not that bug again [18:42:50] no_justification, ^^ [18:59:00] 10Gerrit, 10Release-Engineering-Team: Unable to log in into gerrit: "Cannot assign user name "ashley" to account ; name already in use." - https://phabricator.wikimedia.org/T181945#3807389 (10ashley) >>! In T181945#3807381, @Aklapper wrote: > Please check T152640 for workarounds and report back. T... [19:04:39] 10Continuous-Integration-Config, 10Wikidata: Wikibase\Repo\Tests\Actions\ViewEntityActionTest::testShowDiff failing on CI - https://phabricator.wikimedia.org/T181928#3807390 (10aude) fixed by https://gerrit.wikimedia.org/r/#/c/394642/ (in review) [19:16:25] Reedy thank you [19:16:41] someone with admin permissions needs to run a reindex on that account [19:16:53] (03PS2) 10Reedy: Minor README.md updates [integration/composer] - 10https://gerrit.wikimedia.org/r/394858 [19:16:56] (03CR) 10Reedy: [C: 032] Minor README.md updates [integration/composer] - 10https://gerrit.wikimedia.org/r/394858 (owner: 10Reedy) [19:17:07] Not me then ;D [19:17:07] (03Merged) 10jenkins-bot: Minor README.md updates [integration/composer] - 10https://gerrit.wikimedia.org/r/394858 (owner: 10Reedy) [19:19:29] that bug may be fixed once everything is mgirated to notedb. Though there's a fix in 2.14 and it was backported back to 2.13 but we are running the commit behind it. There was a patch on 2.13 that fixed it for us, but it is checking in both places now, whereas the fix that was landed only checks the db. [19:19:47] computers suck [19:19:50] and the external id is most likly missing from the db. [19:19:51] (for that user) [19:26:27] Im wondering could this be releated to an ldap account being changed. ie T171417 [19:26:28] T171417: Request rename of "Alangi derick" to "Alangi Derick" on wikitech/LDAP/Gerrit - https://phabricator.wikimedia.org/T171417 [19:28:01] 10Gerrit, 10Release-Engineering-Team: Unable to log in into gerrit: "Cannot assign user name "ashley" to account ; name already in use." - https://phabricator.wikimedia.org/T181945#3807431 (10Paladox) Your external id is most likly messed up in the db and will need fixing by someone with access to... [19:30:12] no_justification this may be a long shot but what if changing an ldap account (someone elses), could that affect gerrit i wonder. Since we havent changed the user account ^^ recently or from what i am aware. [20:20:53] PROBLEM - Puppet errors on deployment-ms-be04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:21:45] PROBLEM - Puppet errors on integration-slave-jessie-1003 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:22:29] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:32:09] PROBLEM - Puppet errors on integration-slave-jessie-1004 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:46:29] PROBLEM - Puppet errors on deployment-ms-be03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:02:20] (03Draft2) 10Zppix: Add GCI 2017 student: Albert221 to whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/394872 [21:08:52] (03PS3) 10Zppix: Add GCI 2017 student: Albert221 to whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/394872 [21:26:43] this is getting ridiculous [21:26:44] The last Puppet run was at Wed Nov 29 19:48:50 UTC 2017 (5857 minutes ago). [21:26:48] /dev/mapper/vd-second--local--disk 21G 20G 0 100% /srv [21:27:15] !log legoktm@integration-slave-jessie-1001:/srv/jenkins-workspace/workspace$ sudo rm -rf * # to clear out full /srv [21:27:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:28:19] /dev/mapper/vd-second--local--disk 21G 6.5G 13G 34% /srv [21:30:50] PROBLEM - Free space - all mounts on deployment-sca03 is CRITICAL: CRITICAL: deployment-prep.deployment-sca03.diskspace._srv.byte_percentfree (<100.00%) [21:36:38] Jesus... 5857 mins thats what 4 days [21:39:59] RECOVERY - Free space - all mounts on integration-slave-jessie-1001 is OK: OK: integration.integration-slave-jessie-1001.diskspace._mnt.byte_percentfree (No valid datapoints found) [23:21:18] paladox: If we rename an account on wikitech/LDAP, it requires gerrit being renamed too. Such renames are rare, and done with caution. I don't see how spurious renames could cause the longstanding bug. [23:21:31] (also, I'm going to upgrade soon, I need to pick a date) [23:21:39] (also also: I shouldn't be on IRC, it's sunday) [23:22:18] ditto [23:24:19] everyone's favorite christmas present - gerrit upgrades! [23:30:46] 10Release-Engineering-Team (Kanban), 10MediaWiki-Cache, 10MediaWiki-Vagrant, 10Performance-Team (Radar), 10User-zeljkofilipin: MediaWiki core Selenium tests fail when targeting Vagrant - https://phabricator.wikimedia.org/T180035#3744406 (10greg) it's in our respective done columns, so is it resolved? :)...