[00:19:23] Project selenium-Flow » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #207: 04FAILURE in 3 min 22 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/207/ [00:19:26] Project selenium-Flow » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #207: 04FAILURE in 3 min 25 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/207/ [01:17:43] heh, commons is dead? https://commons.wikimedia.beta.wmflabs.org/wiki/Main_Page [01:17:46] on beta labs [01:17:49] cluster [01:17:50] thingy [01:26:35] yeah, it's not just commons [01:26:38] the whole thing is broken [01:26:57] probably this is the beta infra doing what it's intended to do and catch such bugs in the code [01:27:29] IIRC there was a commit in this area earlier [01:28:08] Yeah they removed a hook function without removing a reference to it [01:29:14] I'll patch it up [01:32:17] yurik, https://gerrit.wikimedia.org/r/#/c/321580/ [01:33:14] * yurik looks [01:34:16] legoktm already +2'd it [01:34:17] Krenair, legoktm already +2ed [01:34:19] hehe [01:34:22] me slow [01:34:32] beta will deploy it soon [01:34:53] i wish it was this easy to update labs-configs ;/ [01:35:31] it is [01:35:49] well, if you ignore the keep-prod-in-sync bit [01:47:49] yurik, shinken thinks it's back up [01:48:03] * yurik looks [01:48:11] yeippi!! [01:48:12] thx :) [01:48:34] and yes, that's the painful bit that keeps annoying me :) [06:31:19] Yippee, build fixed! [06:31:19] Project selenium-Wikibase » chrome,test,Linux,contintLabsSlave && UbuntuTrusty build #175: 09FIXED in 1 hr 51 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/175/ [08:18:07] (03Restored) 10Hashar: [timeline] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/291670 (owner: 10Paladox) [08:19:52] (03PS6) 10Hashar: [timeline] Add composer test [integration/config] - 10https://gerrit.wikimedia.org/r/291670 (owner: 10Paladox) [08:20:49] (03CR) 10jenkins-bot: [V: 04-1] [timeline] Add composer test [integration/config] - 10https://gerrit.wikimedia.org/r/291670 (owner: 10Paladox) [08:25:36] (03PS7) 10Hashar: [timeline] Add composer test [integration/config] - 10https://gerrit.wikimedia.org/r/291670 (owner: 10Paladox) [08:25:38] (03PS1) 10Hashar: Fix new flake8 errors [integration/config] - 10https://gerrit.wikimedia.org/r/321610 [08:28:07] (03CR) 10Hashar: [C: 032] Fix new flake8 errors [integration/config] - 10https://gerrit.wikimedia.org/r/321610 (owner: 10Hashar) [08:28:11] (03CR) 10Hashar: [C: 032] [timeline] Add composer test [integration/config] - 10https://gerrit.wikimedia.org/r/291670 (owner: 10Paladox) [08:28:58] (03Merged) 10jenkins-bot: Fix new flake8 errors [integration/config] - 10https://gerrit.wikimedia.org/r/321610 (owner: 10Hashar) [08:29:03] (03Merged) 10jenkins-bot: [timeline] Add composer test [integration/config] - 10https://gerrit.wikimedia.org/r/291670 (owner: 10Paladox) [09:51:33] PROBLEM - Puppet run on deployment-apertium01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [10:19:38] (03PS2) 10Hashar: Add Genealogy extension with standard testing templates [integration/config] - 10https://gerrit.wikimedia.org/r/321340 (owner: 10Samwilson) [10:33:36] Project beta-code-update-eqiad build #130235: 04FAILURE in 35 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/130235/ [10:37:00] (03CR) 10Hashar: "Thanks Sam!" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/321340 (owner: 10Samwilson) [10:43:36] Project beta-code-update-eqiad build #130236: 04STILL FAILING in 35 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/130236/ [10:53:34] Project beta-code-update-eqiad build #130237: 04STILL FAILING in 34 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/130237/ [10:56:54] 00:00:32.872 No submodule mapping found in .gitmodules for path 'WikimediaPageViewInfo' [10:56:54] 00:00:32.874 INFO:mwextupdate:Exit code: 1 [10:56:55] bah [10:58:39] fixed by https://gerrit.wikimedia.org/r/#/c/321630/ [11:00:37] Yippee, build fixed! [11:00:38] Project beta-code-update-eqiad build #130238: 09FIXED in 1 min 51 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/130238/ [11:20:32] (03PS1) 10Hashar: [mapdata] add npm [integration/config] - 10https://gerrit.wikimedia.org/r/321632 (https://phabricator.wikimedia.org/T150677) [11:24:58] (03PS2) 10Hashar: [mapdata] add npm [integration/config] - 10https://gerrit.wikimedia.org/r/321632 (https://phabricator.wikimedia.org/T150677) [11:26:53] (03PS3) 10Hashar: [mapdata] add npm [integration/config] - 10https://gerrit.wikimedia.org/r/321632 (https://phabricator.wikimedia.org/T150677) [11:28:32] (03CR) 10Hashar: [C: 032] [mapdata] add npm [integration/config] - 10https://gerrit.wikimedia.org/r/321632 (https://phabricator.wikimedia.org/T150677) (owner: 10Hashar) [11:29:58] (03Merged) 10jenkins-bot: [mapdata] add npm [integration/config] - 10https://gerrit.wikimedia.org/r/321632 (https://phabricator.wikimedia.org/T150677) (owner: 10Hashar) [12:30:33] (03PS3) 10Samwilson: Add Genealogy extension with standard testing templates [integration/config] - 10https://gerrit.wikimedia.org/r/321340 [12:33:20] (03CR) 10Samwilson: "Thanks Hashar!" [integration/config] - 10https://gerrit.wikimedia.org/r/321340 (owner: 10Samwilson) [12:38:10] (03CR) 10Hashar: "Yup the CI layout looks fine :]" [integration/config] - 10https://gerrit.wikimedia.org/r/321340 (owner: 10Samwilson) [12:47:00] (03CR) 10Samwilson: "> Next step: get a change in Genealogy extension that would be able to pass the test and then we can enable the CI config :]" [integration/config] - 10https://gerrit.wikimedia.org/r/321340 (owner: 10Samwilson) [14:05:07] (03PS1) 10Aude: Update Wikidata branch - wmf/1.29.0-wmf.3 [tools/release] - 10https://gerrit.wikimedia.org/r/321656 [14:05:48] (03CR) 10jenkins-bot: [V: 04-1] Update Wikidata branch - wmf/1.29.0-wmf.3 [tools/release] - 10https://gerrit.wikimedia.org/r/321656 (owner: 10Aude) [14:07:47] (03CR) 10Aude: "recheck" [tools/release] - 10https://gerrit.wikimedia.org/r/321656 (owner: 10Aude) [14:18:39] (03PS2) 10Hashar: Update Wikidata branch - wmf/1.29.0-wmf.3 [tools/release] - 10https://gerrit.wikimedia.org/r/321656 (owner: 10Aude) [14:18:41] (03PS1) 10Hashar: Match latest flake8 expectations [tools/release] - 10https://gerrit.wikimedia.org/r/321658 [14:21:44] ugh [14:26:13] (03CR) 10Aude: [C: 032] Update Wikidata branch - wmf/1.29.0-wmf.3 [tools/release] - 10https://gerrit.wikimedia.org/r/321656 (owner: 10Aude) [14:26:29] hi twentyafterfour [14:26:40] hopefully the branch update is okay now [14:40:12] thcipriani|afk: ^^ [14:40:17] https://gerrit.wikimedia.org/r/#/c/321656/2/make-wmf-branch/config.json bumps wikidata [14:40:23] I think tyler cuts the branch today [14:45:50] hashar: WMDE is working on Extension/Colgnate to get automatic sitelinks for wiktionary, In order to test it properly we need at least two wiktionaries in beta cluster but per https://en.wikipedia.beta.wmflabs.org/wiki/Special:SiteMatrix there is one, building it won't be hard but I want to know if RelEng people are okay and there is enough capacity in beta [14:45:50] to do it or not [14:48:38] Amir1: yeah it is all fine :] [14:48:47] fill in a task and start adding an hewiktionary for example :D [14:49:05] hashar: nice, thanks. I would prefer de :D [14:49:07] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/Add_a_wiki is the doc [14:49:12] it might be out of date though [14:49:26] so make sure to fill in a task, try the step there and report back on task with progress/failure etc :] [14:49:29] and we can assist from there [14:49:39] gotta run out, but others can catch up [14:53:12] PROBLEM - Host deployment-pdf02 is DOWN: CRITICAL - Host Unreachable (10.68.16.129) [14:53:38] Thanks [14:54:30] PROBLEM - Host deployment-conftool is DOWN: CRITICAL - Host Unreachable (10.68.20.30) [15:03:02] I think jenkins is down [15:03:08] https://gerrit.wikimedia.org/r/#/c/321662/2 [15:03:30] Okay not down [15:14:49] (03CR) 1020after4: [C: 032] Match latest flake8 expectations [tools/release] - 10https://gerrit.wikimedia.org/r/321658 (owner: 10Hashar) [15:31:32] Amir1: just very slow :( [15:31:51] Yeah :((((( [15:39:49] PROBLEM - Puppet run on deployment-phab02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:46:09] For releng people: https://gerrit.wikimedia.org/r/321673 [15:51:04] PROBLEM - Puppet run on deployment-phab01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:03:48] !log adding thcipriani to the labs "git" project maintained by paladox [16:03:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:08:10] thcipriani: https://wikitech.wikimedia.org/wiki/Hiera:Git [16:15:45] thcipriani: jenkins 2.x task https://phabricator.wikimedia.org/T144106 [16:20:20] * Sagan waves [16:24:07] :) [16:29:15] hasharAway thanks for merging my changes today :) [18:24:52] Project beta-code-update-eqiad build #130283: 04FAILURE in 1 min 51 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/130283/ [18:27:06] That should self correct ^ [18:27:52] gerrit looks down to me [18:27:55] is it just me? [18:28:03] Amir1: updates [18:28:25] PROBLEM - Puppet run on integration-slave-trusty-1004 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [18:28:28] zppix|mobile: thanks [18:28:32] Np [18:34:58] Yippee, build fixed! [18:34:59] Project beta-code-update-eqiad build #130284: 09FIXED in 1 min 58 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/130284/ [18:37:25] PROBLEM - Host deployment-puppetmaster is DOWN: CRITICAL - Host Unreachable (10.68.16.63) [18:52:18] Oooh, just found gerrit's "parentproject:" selector (e.g. https://gerrit.wikimedia.org/r/#/q/owner:self+status:open+parentproject:mediawiki ) — very helpful [18:55:10] James_F: Oooh, could use that to find repos that aren't properly inheriting.... [18:55:45] fuzzy match like "mediawiki/extensions" and "-parentproject:mediawiki/extensions" [18:56:34] Eh, fuzzy match sucks [18:56:37] nvm [18:58:04] Aha! [18:58:06] https://gerrit.wikimedia.org/r/#/q/projects:mediawiki/extensions+-parentproject:mediawiki/extensions [18:58:31] Found 1, fixed [18:58:34] That's so useful [18:58:35] :D [19:00:15] 10Gerrit, 06Operations, 07LDAP: Change LDAP cn to something more useful (was Rename "Dzahn" to "Daniel Zahn" in Gerrit) - https://phabricator.wikimedia.org/T113792#2796678 (10demon) [19:03:25] RECOVERY - Puppet run on integration-slave-trusty-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [19:10:55] 10Gerrit, 06Labs, 10wikitech.wikimedia.org, 07LDAP: Alter full name on Gerrit - https://phabricator.wikimedia.org/T149976#2796754 (10demon) 05Open>03Resolved Sorry for the delay, all done. Please note, your shell name remains `gryllida` as those are not changed. Your display name and what you login to... [19:16:30] twentyafterfour I was thinking for using arc on nodepool to access arc we could potentially setup a small webpage with the token to be able to download the patches with arc. I mean use curl to download a file that it can only access it internally and then we could parse it in the .arcconfig file. [19:16:31] ? [19:17:31] paladox: there is another way, using jenkins 'credentials' plugin [19:17:33] I thought the Jenkin's secrets funcationality worked in this case? [19:17:39] er, credentials, whatever it's called :) [19:17:47] Oh, yes that will work [19:20:21] Project beta-update-databases-eqiad build #12822: 04FAILURE in 21 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/12822/ [19:35:06] ostriches: Glad it's helpful. :-) [19:52:05] > [19:52:07] Hi Kunal, [19:52:07] I tried to call you earlier but didn't reach you. I'm with the Jenkins Enterprise Company, CloudBees. We enhance capabilities and functionality within the Jenkins realm. Our plugins and professional support aren't available in the open source community. We help our customers eliminate downtime, improve software quality and release cycles, accelerate time to market and more. I'd like to arrange a short conversation to discuss your objectives [19:52:07] and how we can help. [19:52:10] > [19:53:05] greg-g, hasharAway: ^ do any of you want to talk to them? or can I just respond with "sorry not interested in closed source stuff" [19:53:43] legoktm: not interested in closed source stuff, indeed. Feel free to reply or forward to me for me to do it. [19:58:27] responded [20:05:39] PROBLEM - Puppet run on deployment-memc05 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [20:07:13] PROBLEM - Puppet run on deployment-memc04 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [20:10:46] 10Gerrit: 'f' key doesn't take into account the ability to compare a file in two different patchsets - https://phabricator.wikimedia.org/T45349#2796932 (10Krenair) nope [20:11:56] 10Gerrit: 'f' key doesn't take into account the ability to compare a file in two different patchsets - https://phabricator.wikimedia.org/T45349#2796933 (10demon) 05Open>03Invalid [20:14:28] 10Beta-Cluster-Infrastructure, 06Operations, 10Thumbor: Thumbor keeps losing Swift auth on beta - https://phabricator.wikimedia.org/T150649#2796944 (10Krenair) does prod also show u'www-authenticate': u'Swift realm="unknown"' ? [20:20:23] Project beta-update-databases-eqiad build #12823: 04STILL FAILING in 22 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/12823/ [20:32:13] RECOVERY - Puppet run on deployment-memc04 is OK: OK: Less than 1.00% above the threshold [0.0] [20:35:41] RECOVERY - Puppet run on deployment-memc05 is OK: OK: Less than 1.00% above the threshold [0.0] [20:47:18] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Secondary production Jenkins for CI - https://phabricator.wikimedia.org/T150771#2797011 (10Dzahn) +1 , i think it's a very good idea to have a warm standby server. this would be contint2001 to match contint1001 which replaced gallium [21:07:23] 10Continuous-Integration-Config, 10commit-message-validator, 10Pywikibot-core: Check the style of the commit message - https://phabricator.wikimedia.org/T109119#2797119 (10Magul) [21:13:30] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Pywikibot-core, 07Pywikibot-tests: Run pywikibot test suite regularly on beta cluster as part of MediaWiki/Wikimedia CI - https://phabricator.wikimedia.org/T100903#2797164 (10Magul) [21:15:31] paste now supports debian control syntax: https://phabricator.wikimedia.org/P4444 (plus a few other new ones like IRC logs, ini files, rust, scheme, elisp and vim script) [21:15:51] thcipriani: ^ you might appreciate a couple of those additions [21:16:11] oooh, fancy :) [21:19:06] :) [21:20:21] Project beta-update-databases-eqiad build #12824: 04STILL FAILING in 20 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/12824/ [22:17:26] ^ seems to be failing on FlowCreateTemplates [22:17:38] but I have no idea what FlowCreateTemplates is or how this job actually works [22:20:20] Project beta-update-databases-eqiad build #12825: 04STILL FAILING in 20 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/12825/ [22:27:00] matt_flaschen: RoanKattouw ^^ see what twentyafterfour just said [22:29:58] twentyafterfour, greg-g, do you know where I can find the error? [22:30:06] The console just says it's already been completed. [22:31:28] twentyafterfour, I'll try running it manually on Beta. [22:31:34] It's apparently /usr/local/bin/mwscript update.php --wiki=dewiktionary --quick [22:31:55] matt_flaschen: I only intuited that it's failing on that job because it cuts of at "...Update 'FlowUpdateWorkflowPageId' already logged as completed." [22:32:05] (for dewiktionary) [22:32:29] and that comes immediately before "FlowCreateTemplates" in the last non-failing build [22:32:39] Thanks. Yeah, I saw that after I asked. [22:33:16] had to copy the output to a text editor and replace \\n with \n to read it ;) [22:34:02] :) [22:36:03] twentyafterfour, de.wiktionary.beta.wmflabs.org (which I guess is new) is very broken. [22:36:12] The SSL cert doesn't include it, and I think all edits will fail once I bypass that. [22:36:31] ugh, yeah, that was just "created" last night [22:36:31] I changed Beta to use External Store a while back, and apparently someone set up de.wikt without adding the External Store. [22:36:48] ohh [22:36:50] https://phabricator.wikimedia.org/T150764 [22:36:58] https://gerrit.wikimedia.org/r/#/c/321673/ [22:37:51] er, this morning [22:38:08] greg-g, twentyafterfour, on the plus side, there is documentation on this, on the downside it's incomplete. [22:38:10] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/Add_a_wiki [22:40:01] it does handle External Store, though, so apparently they didn't run that. [22:40:22] greg-g, twentyafterfour, any idea how to regenerate the cert? [22:41:16] https://phabricator.wikimedia.org/P4445 [23:13:25] 10Beta-Cluster-Infrastructure, 06WMDE-TLA-Team, 13Patch-For-Review, 15User-Ladsgroup: Make beta German Wiktionary - https://phabricator.wikimedia.org/T150764#2795757 (10Krenair) https://wikitech.wikimedia.org/wiki/Hiera:Deployment-prep/host/deployment-cache-text04 is used for #1 [23:20:18] Project beta-update-databases-eqiad build #12826: 04STILL FAILING in 18 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/12826/ [23:24:50] It's not primarily a Flow issue, but while looking at addWiki.php I did see a Flow issue that would affect Beta. [23:24:53] Fixed in https://gerrit.wikimedia.org/r/321810, needs review. [23:30:11] greg-g, twentyafterfour, Reedy, I'd like to get that change reviewed soon, then drop the dewiktionary database, and re-run addWiki.php. [23:34:36] 10Beta-Cluster-Infrastructure, 06WMDE-TLA-Team, 13Patch-For-Review, 15User-Ladsgroup: Make beta German Wiktionary - https://phabricator.wikimedia.org/T150764#2797608 (10Mattflaschen-WMF) Ran: ``` mwscript extensions/WikimediaMaintenance/filebackend/setZoneAccess.php dewiktionary --backend=local-multiwrite... [23:35:09] 10Beta-Cluster-Infrastructure, 06WMDE-TLA-Team, 13Patch-For-Review, 15User-Ladsgroup: Make beta German Wiktionary - https://phabricator.wikimedia.org/T150764#2797609 (10Mattflaschen-WMF) a:05Ladsgroup>03Mattflaschen-WMF [23:43:35] 10Beta-Cluster-Infrastructure, 06WMDE-TLA-Team, 13Patch-For-Review, 15User-Ladsgroup: Make beta German Wiktionary - https://phabricator.wikimedia.org/T150764#2797636 (10Mattflaschen-WMF) Thanks, @Krenair. Is the TLS certificate fully automatic except for editing the wiki page? [23:48:37] 10Beta-Cluster-Infrastructure, 06WMDE-TLA-Team, 13Patch-For-Review, 15User-Ladsgroup: Make beta German Wiktionary - https://phabricator.wikimedia.org/T150764#2797654 (10Krenair) >>! In T150764#2797636, @Mattflaschen-WMF wrote: > Thanks, @Krenair. Is the TLS certificate fully automatic except for editing t... [23:56:28] 10Beta-Cluster-Infrastructure, 06WMDE-TLA-Team, 13Patch-For-Review, 15User-Ladsgroup: Make beta German Wiktionary - https://phabricator.wikimedia.org/T150764#2797669 (10Mattflaschen-WMF) >>! In T150764#2797654, @Krenair wrote: > your first edit was correct, the second was not (I've reverted it). puppet on...