[06:22:00] Yippee, build fixed! [06:22:00] Project selenium-Wikibase » chrome,test,Linux,BrowserTests build #379: 09FIXED in 1 hr 41 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=BrowserTests/379/ [07:41:45] (03Abandoned) 10Phedenskog: Add Linux location for WebPageTest [integration/config] - 10https://gerrit.wikimedia.org/r/354385 (owner: 10Phedenskog) [09:45:18] (03CR) 10Hashar: [C: 032] "I have grepped phpunit=3 in the CI log and found only one build that relied on this." [integration/jenkins] - 10https://gerrit.wikimedia.org/r/356606 (https://phabricator.wikimedia.org/T166706) (owner: 10Hashar) [09:45:59] (03Merged) 10jenkins-bot: composer-dev-args: remove phpunit=3.7.37 for REL1_23 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/356606 (https://phabricator.wikimedia.org/T166706) (owner: 10Hashar) [12:12:51] !log jenkins: rebuild logstash plugin from HEAD of master for jenkins 2 back compat. logstash-1.2.0-4-gbcbc19e - T78705 [12:12:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:12:55] T78705: Send Jenkins build log and results to ElasticSearch - https://phabricator.wikimedia.org/T78705 [13:04:24] Project selenium-Math » chrome,beta,Linux,BrowserTests build #410: 04FAILURE in 23 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/410/ [13:04:34] Project selenium-Math » firefox,beta,Linux,BrowserTests build #410: 04FAILURE in 33 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/410/ [13:10:09] PROBLEM - Puppet errors on deployment-aqs02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:12:11] PROBLEM - Puppet errors on deployment-aqs03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:15:34] PROBLEM - Puppet errors on deployment-restbase01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:32:34] PROBLEM - Puppet errors on deployment-restbase02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:32:34] PROBLEM - Puppet errors on deployment-aqs01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:34:36] PROBLEM - Puppet errors on jenkinstest is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [13:44:39] RECOVERY - Puppet errors on jenkinstest is OK: OK: Less than 1.00% above the threshold [0.0] [13:46:51] Yippee, build fixed! [13:46:52] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #416: 09FIXED in 2 min 51 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/416/ [14:29:36] PROBLEM - Host deployment-phab02 is DOWN: CRITICAL - Host Unreachable (10.68.19.232) [15:11:44] who can I blame for this torrent of emails from phab-01.wmflabs.org [15:12:00] apparently reminding me of not only every commit I ever made to MediaWiki core, but also every single patch set [15:12:22] including prior revisions [15:12:42] tto oh, i just pulled in mediawiki/core [15:12:45] sorry about that [15:13:10] I'm going to bed now, wonder how many emails I'll have tomorrow? several hundred at least [15:13:18] at least it'll be Saturday [15:13:32] there'll be time to clear out the rubbish [15:14:01] You will only have several hundred if you created several hundred commits since march 2017 in mediawiki/core [15:14:13] i wonder how prod phab keeps silent for commits [15:14:37] oh, that's a relief. lucky I haven't been very active in the past few months then [15:14:48] paladox: https://en.wikipedia.org/wiki/Template:Trout anyway [15:15:10] ok [15:15:35] did it send everybody an email? [15:16:09] twentyafterfour hi, how do i do what prod does by not sending notifications from diffusion please? [15:48:28] Yippee, build fixed! [15:48:28] Project selenium-MobileFrontend » chrome,beta,Linux,BrowserTests build #442: 09FIXED in 26 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/442/ [19:43:16] ebernhardson: guten tag :] I have a jenkins sending some log to relforge1001.eqiad.wmnet. I was wondering whether there is a kibana front end for it :] [19:44:32] hashar: nope, we actually haven't used it for anything logstash related previously. Putting up a kibana in labs to talk to it should be really simple though, install the package and make a simple /etc//kibanba/kibana.yml to point it at the right host [19:45:07] * hashar goes to apply whatever puppet class makes it happen :] [19:45:14] unfortunately the puppet for kibana isn't parameterized to provide that hostname yet, we've only used the default of localhost:920 [19:45:28] so puppet will keep overwriting your kibana.yml with one that doesn't have a hostname [19:46:36] and I found out that whenever a line is emitted in the jenkins console, the plugin does a https query to send it to logstash [19:47:00] hashar: yea thats going to be slow, especially if its not async. It should really be using the bulk indexing api [19:50:05] i can probably get kibana installed to jenkinstest in a few minutes if you like [19:50:30] ebernhardson: if you have cycles for that, for sure! [19:50:56] hashar: heh, actually i don't have sudo on integration project it seems [19:51:45] ebernhardson: granted [19:51:57] !log integration: granted ebernhardson sudo [19:51:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:04:51] hashar: it's up and running, can use `ssh -L 5601:localhost:5601 jenkinstest.integration.eqiad.wmflabs` to get a port forward into it, or i suppose could setup a proxy in horizon to make it public [20:06:39] ebernhardson: whaouuu thank you [20:06:51] ebernhardson: and I have made a lame puppet patch to let one set any kibana.yaml setting [20:07:08] hashar: excellent, should make it much more generally useful [20:07:20] potentially :] [20:09:41] ebernhardson: you are magic! [20:11:32] now for the fun part of figuring out what can actually be done with the data :) kibana dashboards are powerful but a bit of a pain [20:12:18] at least it is easier to me compared to trying to figure out the proper curl commands! [22:23:39] Project beta-code-update-eqiad build #158224: 04FAILURE in 39 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/158224/ [22:25:06] PROBLEM - Puppet errors on integration-slave-jessie-1002 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [22:25:16] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [22:27:49] PROBLEM - Puppet errors on integration-slave-trusty-1006 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [22:27:54] PROBLEM - Puppet errors on saucelabs-01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [22:33:41] Yippee, build fixed! [22:33:42] Project beta-code-update-eqiad build #158225: 09FIXED in 40 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/158225/ [22:35:38] Hi all! Is it possible to set a full name in gerrit? Or will it always show your wikitech username as full name for actions taken via UI ? [22:36:25] Hi, It takes it's value from ldap which is from wikitech. [22:40:44] it's possible if it was set to that when creating the wikitech user, renaming it afterwards is "manual and very painful" [22:40:47] https://phabricator.wikimedia.org/T85913#957896 [22:41:04] i would like my personal one changed as well, but cant rewrite git history [22:41:11] and then i'd have 2 different ones [22:41:17] a split history i mean [22:41:28] it's not impossible though, it happened for about 1 user [22:41:36] who legally changed his name [23:00:03] RECOVERY - Puppet errors on integration-slave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [23:00:16] RECOVERY - Puppet errors on integration-slave-jessie-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [23:02:38] RECOVERY - Puppet errors on integration-slave-trusty-1006 is OK: OK: Less than 1.00% above the threshold [0.0] [23:02:44] RECOVERY - Puppet errors on saucelabs-01 is OK: OK: Less than 1.00% above the threshold [0.0]