[00:06:29] (03PS1) 10Krinkle: Add NavigationTiming to the list of gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/338486 (https://phabricator.wikimedia.org/T157835) [00:07:29] PROBLEM - Free space - all mounts on integration-slave-jessie-android is CRITICAL: CRITICAL: integration.integration-slave-jessie-android.diskspace._mnt.byte_percentfree (No valid datapoints found)integration.integration-slave-jessie-android.diskspace._srv.byte_percentfree (<20.00%) [00:08:04] (03CR) 10jerkins-bot: [V: 04-1] Add NavigationTiming to the list of gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/338486 (https://phabricator.wikimedia.org/T157835) (owner: 10Krinkle) [00:09:56] mdholloway: Well, isn't that special [00:10:02] As it installed all versions... Including obsolete [00:10:32] it seems /srv is now full [00:10:33] Reedy: sigh. [00:11:44] It'd be nice if it had a flag to install only latest point releases of each [00:11:48] Hopefully gradle improves on that [00:11:57] 53G ./android-sdk [00:13:24] /dev/mapper/vd-second--local--disk 64G 48G 14G 79% /srv [00:13:26] Ok, better [00:13:33] Removed the android tv/wear system images [00:13:53] Reedy: yes, no need for any of that [00:14:58] mdholloway: Try kicking off a job and see what it does :) [00:15:39] Reedy: all right, here goes! [00:17:38] (03PS2) 10Krinkle: Add NavigationTiming to the list of gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/338486 (https://phabricator.wikimedia.org/T157835) [00:19:02] (03CR) 10jerkins-bot: [V: 04-1] Add NavigationTiming to the list of gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/338486 (https://phabricator.wikimedia.org/T157835) (owner: 10Krinkle) [00:24:50] Reedy: hmm, same result as before, and even the same notice that the emulator is out of date: https://integration.wikimedia.org/ci/job/apps-android-wikipedia-periodic-test/1392/console [00:25:18] does adb need restarting or something? [00:26:38] * Reedy restarts abd and rebuilds hte bukld [00:27:29] RECOVERY - Free space - all mounts on integration-slave-jessie-android is OK: OK: integration.integration-slave-jessie-android.diskspace._mnt.byte_percentfree (No valid datapoints found) [00:28:55] 00:27:20 emulator: WARNING: Requested adb port (5753) is outside the recommended range [5555,5586]. ADB may not function properly for the emulator. See -help-port for details. [00:28:59] That's kinda amusing [00:29:31] 00:28:19 $ /srv/jenkins-workspace/tools/android-sdk/platform-tools/adb -s emulator-5752 wait-for-device shell getprop init.svc.bootanim [00:29:31] 00:29:05 ERROR: Timeout after 45000 milliseconds [00:30:01] mdholloway: Same overall error, at least, without the out of date error [00:31:01] 9953 jenkins+ 20 0 1984368 661672 27012 S 44.2 8.1 2:38.51 emulator64-x86 [00:33:27] * mdholloway goes to look at the output for a successful job [00:33:40] I wonder if 45 seconds just isn't long enough for some reason [00:34:46] 00:33:39 ERROR: Timeout after 45000 milliseconds [00:34:46] 00:33:49 [android] Timed-out after waiting 360 seconds for emulator [00:35:36] Reedy: could be. looks like it timed out after one 45s wait on the most recent successful build, just eventually got through [00:37:15] blech. does the mediawiki gate and submit queue effectively block all other jobs right now by soaking up all the jessie job runners? [00:38:44] depends [00:39:16] * bd808 wants nodepool to go away [00:39:27] Some tests have been updated to stop mediawiki doing that to these tests. [00:39:45] But this is more of a zuul issue [00:39:59] This is a more of we only do one thing at a time issue [00:40:17] (03PS1) 10Umherirrender: [ChangeAuthor] Add npm job [integration/config] - 10https://gerrit.wikimedia.org/r/338505 [00:40:24] Reedy: i tried bumping it to 60 seconds in the advanced emulator options in the job config for this run but apparently got it wrong, since it actually dropped the timeout to 7500 ms: https://integration.wikimedia.org/ci/job/apps-android-wikipedia-periodic-test/1390/console [00:43:08] I still don't know why jenkins runs the test once to do V+2, and then again for gate and submit [00:43:12] Seems pretty pointless [00:43:16] mdholloway: lol :D [00:44:31] mdholloway: I see a... [00:44:32] https://integration.wikimedia.org/ci/job/apps-android-wikipedia-periodic-test/configure [00:44:40] "Startup timeout" [00:44:47] yep, that's the one i set [00:45:01] but, it looks like there's a ADB_INSTALL_TIMEOUT environment variable i can try setting [00:47:11] (03PS3) 10Krinkle: Add NavigationTiming to the list of gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/338486 (https://phabricator.wikimedia.org/T157835) [00:51:54] Reedy yep, i was wondering that too. [00:52:16] It should be if you have it in the gate and submit, it should abort the test pipeline. [01:04:16] Reedy: well, i think i'll call it a night. thanks for your help! [01:12:39] (03PS1) 10Umherirrender: Make some tests non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/338506 [01:15:57] (03PS2) 10Umherirrender: Make some tests non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/338506 [01:38:07] (03CR) 10Krinkle: [C: 032] Add NavigationTiming to the list of gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/338486 (https://phabricator.wikimedia.org/T157835) (owner: 10Krinkle) [01:38:59] (03Merged) 10jenkins-bot: Add NavigationTiming to the list of gated extensions [integration/config] - 10https://gerrit.wikimedia.org/r/338486 (https://phabricator.wikimedia.org/T157835) (owner: 10Krinkle) [01:51:09] (03PS1) 10Krinkle: NavigationTiming: Re-add extension-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/338507 [01:51:21] (03CR) 10Krinkle: [C: 032] NavigationTiming: Re-add extension-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/338507 (owner: 10Krinkle) [01:52:13] (03Merged) 10jenkins-bot: NavigationTiming: Re-add extension-qunit-generic [integration/config] - 10https://gerrit.wikimedia.org/r/338507 (owner: 10Krinkle) [01:59:14] 10Continuous-Integration-Config, 10MediaWiki-extensions-NavigationTiming, 06Performance-Team: Create QUnit tests for NavigationTiming extension - https://phabricator.wikimedia.org/T157835#3037741 (10Krinkle) 05Open>03Resolved [06:37:38] Yippee, build fixed! [06:37:39] Project selenium-Wikibase » chrome,test,Linux,contintLabsSlave && UbuntuTrusty build #274: 09FIXED in 1 hr 57 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/274/ [06:56:53] Project selenium-Wikibase » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #274: 04FAILURE in 2 hr 16 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/274/ [08:34:27] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:20:08] 10Continuous-Integration-Config, 05Goal, 07I18n, 13Patch-For-Review: Configure banana checker for i18n files to run on all MediaWiki extensions and skins - https://phabricator.wikimedia.org/T94547#3038004 (10Umherirrender) I want note, that not all developer loves qqq and therefore may not all extensions c... [13:02:53] 06Release-Engineering-Team, 10Elasticsearch, 10Phabricator (Search): phab+elasticsearch: support multiple elasticsearch clusters / datacenters - https://phabricator.wikimedia.org/T157156#3038110 (10Paladox) @mmodell has created this patch https://secure.phabricator.com/D17384 upstream :) [13:46:12] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #310: 04FAILURE in 2 min 12 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/310/ [13:49:08] PROBLEM - Puppet run on buildlog is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [14:24:58] PROBLEM - Puppet run on deployment-mira is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [15:05:00] RECOVERY - Puppet run on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [18:02:30] 10Gerrit: Decide how to support polygerrit - https://phabricator.wikimedia.org/T158479#3038357 (10Paladox) [18:03:38] 10Gerrit: Decide how to support polygerrit - https://phabricator.wikimedia.org/T158479#3038372 (10Paladox) [18:03:40] 10Gerrit, 06Release-Engineering-Team: Update gerrit to 2.14 - https://phabricator.wikimedia.org/T156120#3038371 (10Paladox) [18:05:21] 10Gerrit: Gerrit needs a very wide screen or has big horizontal scroll - https://phabricator.wikimedia.org/T38471#3038374 (10Paladox) I have filled this T158479 as we need to figure out a way to get polygerrit to work on our url. [18:08:43] 10Gerrit: Decide how to support polygerrit - https://phabricator.wikimedia.org/T158479#3038388 (10Paladox) This will require upstream to fix it for it to work 100% , but if someone else knows how to fix it upstream are more then wiling to review your patches. polygerrit works 100% on urls like / but not on pref... [18:25:51] 10Gerrit: Decide how to support polygerrit - https://phabricator.wikimedia.org/T158479#3038420 (10Paladox) [18:25:59] PROBLEM - Puppet run on deployment-mira is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [18:49:22] 10Gerrit: Gerrit needs a very wide screen or has big horizontal scroll - https://phabricator.wikimedia.org/T38471#3038450 (10MZMcBride) >>! In T38471#404368, @Krinkle wrote: > The problem (screenshot of current deployment, no changes): > - http://cl.ly/image/37370E3p1v2a > > > Screenshot with Iaedbea9b5f43ac,p... [19:01:00] RECOVERY - Puppet run on deployment-mira is OK: OK: Less than 1.00% above the threshold [0.0] [19:12:28] 10Gerrit, 06Operations: Decide how to support polygerrit - https://phabricator.wikimedia.org/T158479#3038496 (10Paladox) [19:13:11] 10Gerrit, 06Release-Engineering-Team: Update gerrit to 2.14 - https://phabricator.wikimedia.org/T156120#3038500 (10demon) [19:13:13] 10Gerrit, 06Operations: Decide how to support polygerrit - https://phabricator.wikimedia.org/T158479#3038497 (10demon) 05Open>03Resolved a:03demon Decision: let's just wait for them to fix the bug. [22:06:14] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Differential, 10Developer-Wishlist (2017), 07Jenkins: Add support for a wmf-ci.yaml type file for wikimedia jenkins - https://phabricator.wikimedia.org/T145669#3038589 (10scfc) >>! In T145669#3003039, @Legoktm wrote: > […] > I do... [22:10:15] 10Continuous-Integration-Config, 10MediaWiki-General-or-Unknown, 10MediaWiki-Unit-tests, 07Tracking: Let ApiDocumentationTest structure test pass on all repos - https://phabricator.wikimedia.org/T154838#3038593 (10Umherirrender)