[00:57:57] 5Gerrit-Migration, 10Gitblit-Deprecate, 6Release-Engineering-Team, 10Diffusion, and 2 others: Import all gerrit.wikimedia.org repositories with Diffusion - https://phabricator.wikimedia.org/T616#13641 (10Krenair) [01:16:25] greg-g: you there ? [01:21:16] matanya: ish, I just woke up from a nap, I took most of the afternoon off [01:24:23] have some time for my rants greg-g ? [01:41:13] anybody here who knows mediawiki/ruby/api? [01:41:39] or at least can point me where I can submit bugs for it? [01:49:42] 6Release-Engineering-Team: Ruby mediawiki_api client hides error details - https://phabricator.wikimedia.org/T127786#2053902 (10Smalyshev) [01:49:50] Heads up! I just merged https://gerrit.wikimedia.org/r/#/c/270485/ which changes the PHPUnit version on master. [01:56:31] 6Release-Engineering-Team: Ruby mediawiki_api client hides error details - https://phabricator.wikimedia.org/T127786#2053923 (10Smalyshev) [02:46:18] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: Upgrade PHP_CodeCoverage - https://phabricator.wikimedia.org/T122530#2053988 (10Ricordisamoa) [02:47:13] 10Continuous-Integration-Infrastructure: make CI for extensions able to run PHPUnit from composer instead of a system wide installation - https://phabricator.wikimedia.org/T112867#2053991 (10Krinkle) [02:47:15] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: Fetch dependencies using composer instead of cloning mediawiki/vendor for non-wmf branches - https://phabricator.wikimedia.org/T90303#2053992 (10Krinkle) [02:47:33] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: Upgrade PHP_CodeCoverage - https://phabricator.wikimedia.org/T122530#1906714 (10Ricordisamoa) [03:10:32] Project beta-scap-eqiad build #90740: 04FAILURE in 5 min 45 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90740/ [03:14:50] Yippee, build fixed! [03:14:51] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #987: 09FIXED in 32 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/987/ [03:20:12] Yippee, build fixed! [03:20:12] Project beta-scap-eqiad build #90741: 09FIXED in 5 min 28 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90741/ [03:35:07] (03PS1) 10Krinkle: Don't ignore exit code in mediawik-core-code-coverage [integration/config] - 10https://gerrit.wikimedia.org/r/272662 [04:01:55] 10Beta-Cluster-Infrastructure, 6Labs, 10Labs-Infrastructure: Make labs wikitech role aware - https://phabricator.wikimedia.org/T127771#2053464 (10scfc) Some Labs projects use the `classes` Hiera variable set for example at https://wikitech.wikimedia.org/wiki/Hiera:Tools to apply (role) classes to all instanc... [04:23:56] (03CR) 10Jforrester: [C: 031] "Thank you for noticing this." [integration/config] - 10https://gerrit.wikimedia.org/r/272662 (owner: 10Krinkle) [08:59:19] 10Continuous-Integration-Config, 10Wikidata, 13Patch-For-Review, 3Wikidata-Sprint-2016-02-16: [Task] use generic composer based Jenkins jobs for WikibaseJavaScriptApi CI - https://phabricator.wikimedia.org/T100654#2054466 (10adrianheine) 5Open>3Resolved [09:15:01] (03CR) 10Hashar: [C: 04-1] "The commit message 'archive limn' does not match the change which removes a lot more repositories..." [integration/config] - 10https://gerrit.wikimedia.org/r/272631 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:19:10] (03CR) 10Paladox: "Whoops sorry, it must not have reset from my previous change. I can fix that later tonight when I'm near a laptop." [integration/config] - 10https://gerrit.wikimedia.org/r/272631 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:20:21] 10Continuous-Integration-Infrastructure, 6Operations, 7Blocked-on-Operations, 7HHVM: /usr/lib/x86_64-linux-gnu/hhvm/extensions/current/luasandbox.so no such file or directory - https://phabricator.wikimedia.org/T126658#2054518 (10ema) p:5Triage>3Normal [09:23:44] 10Continuous-Integration-Infrastructure, 6Operations, 7Blocked-on-Operations, 7HHVM: /usr/lib/x86_64-linux-gnu/hhvm/extensions/current/luasandbox.so no such file or directory - https://phabricator.wikimedia.org/T126658#2020104 (10Joe) @hashar no we definitely don't want the debian package to deal with this... [09:33:29] (03CR) 10Hashar: [C: 032] "Impressive change Paladox and all the recheck to make sure the jobs are passing just fine are a 5/5! Thank you very much!" [integration/config] - 10https://gerrit.wikimedia.org/r/272629 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:35:53] (03Merged) 10jenkins-bot: Replace jslint test with jshint and jsonlint tests [integration/config] - 10https://gerrit.wikimedia.org/r/272629 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:38:38] Yippee, build fixed! [09:38:39] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #782: 09FIXED in 1 min 37 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/782/ [09:39:40] (03CR) 10Hashar: "Looks like it is mixed up with https://gerrit.wikimedia.org/r/#/c/272629/ which has been merged a minute or so ago. Rebasing should clear " [integration/config] - 10https://gerrit.wikimedia.org/r/272631 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:39:45] (03PS2) 10Hashar: [Limn] Archive repo [integration/config] - 10https://gerrit.wikimedia.org/r/272631 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:40:14] (03CR) 10Hashar: [C: 032] "better! thank you" [integration/config] - 10https://gerrit.wikimedia.org/r/272631 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:41:39] (03Merged) 10jenkins-bot: [Limn] Archive repo [integration/config] - 10https://gerrit.wikimedia.org/r/272631 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [09:47:49] (03CR) 10Hashar: "Eek! Another reason for ignoring the exit code is that some tests fail when run with xdebug/coverage. On failure nothing is published." [integration/config] - 10https://gerrit.wikimedia.org/r/272662 (owner: 10Krinkle) [09:53:38] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: doc.wikimedia.org should be running PHP 5.5+, not 5.3 -> demos etc. don't work - https://phabricator.wikimedia.org/T127504#2054615 (10Legoktm) [09:56:39] (03PS1) 10Legoktm: doc: Hide link to OOUI PHP demos because they're broken [integration/docroot] - 10https://gerrit.wikimedia.org/r/272690 (https://phabricator.wikimedia.org/T127809) [09:57:02] (03CR) 10Legoktm: [C: 032] doc: Hide link to OOUI PHP demos because they're broken [integration/docroot] - 10https://gerrit.wikimedia.org/r/272690 (https://phabricator.wikimedia.org/T127809) (owner: 10Legoktm) [09:59:36] !log Deleted a bunch of mwext-.*-jslint jobs that are no more in used (migrated to either 'npm' or 'jshint' / 'jsonlint' ) [09:59:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:00:11] (03Merged) 10jenkins-bot: doc: Hide link to OOUI PHP demos because they're broken [integration/docroot] - 10https://gerrit.wikimedia.org/r/272690 (https://phabricator.wikimedia.org/T127809) (owner: 10Legoktm) [10:06:33] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: doc.wikimedia.org should be running PHP 5.5+, not 5.3 -> demos etc. don't work - https://phabricator.wikimedia.org/T127504#2054664 (10Legoktm) I'm not sure it needs to be drastic...we trust generated docs because they were merged through CR, b... [10:31:48] (03PS3) 10Hashar: Migrate test mediawiki-vagrant-puppet-doc-publish to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/270658 (owner: 10Paladox) [10:32:18] (03CR) 10Hashar: [C: 032] Migrate test mediawiki-vagrant-puppet-doc-publish to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/270658 (owner: 10Paladox) [10:33:58] (03Merged) 10jenkins-bot: Migrate test mediawiki-vagrant-puppet-doc-publish to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/270658 (owner: 10Paladox) [10:34:46] (03PS2) 10Hashar: [SolrStore] Add SemanticMediaWiki dependency support [integration/config] - 10https://gerrit.wikimedia.org/r/271137 (owner: 10Paladox) [10:35:04] (03CR) 10jenkins-bot: [V: 04-1] [SolrStore] Add SemanticMediaWiki dependency support [integration/config] - 10https://gerrit.wikimedia.org/r/271137 (owner: 10Paladox) [10:36:22] (03PS3) 10Hashar: [SolrStore] Add SemanticMediaWiki dependency support [integration/config] - 10https://gerrit.wikimedia.org/r/271137 (owner: 10Paladox) [10:36:35] (03CR) 10Hashar: [C: 032] [SolrStore] Add SemanticMediaWiki dependency support [integration/config] - 10https://gerrit.wikimedia.org/r/271137 (owner: 10Paladox) [10:37:29] (03Merged) 10jenkins-bot: [SolrStore] Add SemanticMediaWiki dependency support [integration/config] - 10https://gerrit.wikimedia.org/r/271137 (owner: 10Paladox) [10:50:55] RECOVERY - Free space - all mounts on deployment-fluorine is OK: OK: All targets OK [10:51:28] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/270658 (owner: 10Paladox) [10:51:44] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/271137 (owner: 10Paladox) [10:53:23] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<11.11%) [10:53:34] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/272629 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [10:55:00] (03PS2) 10Paladox: Add mw-fetch-composer-dev to 'mwext-testextension-{phpflavor}-non-voting' [integration/config] - 10https://gerrit.wikimedia.org/r/272634 [10:55:19] (03CR) 10Paladox: "@Hashar please review and merge this." [integration/config] - 10https://gerrit.wikimedia.org/r/272634 (owner: 10Paladox) [10:56:02] (03CR) 10Paladox: "Thanks and sorry about that." [integration/config] - 10https://gerrit.wikimedia.org/r/272631 (https://phabricator.wikimedia.org/T127362) (owner: 10Paladox) [10:58:27] RECOVERY - Free space - all mounts on deployment-bastion is OK: OK: All targets OK [11:03:24] (03Abandoned) 10Hashar: Add some experimental tests to extension-checks template [integration/config] - 10https://gerrit.wikimedia.org/r/264358 (owner: 10Paladox) [11:05:45] (03PS3) 10Hashar: [SocialProfile] Replace deprecated jslint test with npm and add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/264762 (owner: 10Paladox) [11:06:52] (03CR) 10Hashar: [C: 032] [SocialProfile] Replace deprecated jslint test with npm and add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/264762 (owner: 10Paladox) [11:07:31] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/264762 (owner: 10Paladox) [11:08:15] (03Merged) 10jenkins-bot: [SocialProfile] Replace deprecated jslint test with npm and add composer-test test [integration/config] - 10https://gerrit.wikimedia.org/r/264762 (owner: 10Paladox) [11:15:07] hashar could you merge https://gerrit.wikimedia.org/r/#/c/272634/ please. [11:15:41] paladox: I am reviewing a lot of your patches this morning :) [11:17:05] (03PS3) 10Hashar: Add mw-fetch-composer-dev to 'mwext-testextension-{phpflavor}-non-voting' [integration/config] - 10https://gerrit.wikimedia.org/r/272634 (owner: 10Paladox) [11:17:53] (03PS4) 10Hashar: Add mw-fetch-composer-dev to 'mwext-testextension-{phpflavor}-non-voting' [integration/config] - 10https://gerrit.wikimedia.org/r/272634 (owner: 10Paladox) [11:18:46] (03CR) 10Hashar: [C: 032] "Refreshed the three jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/272634 (owner: 10Paladox) [11:18:55] paladox: deployed! that is a good catch! [11:20:32] (03Merged) 10jenkins-bot: Add mw-fetch-composer-dev to 'mwext-testextension-{phpflavor}-non-voting' [integration/config] - 10https://gerrit.wikimedia.org/r/272634 (owner: 10Paladox) [11:27:19] PROBLEM - English Wikipedia Mobile Main page on beta-cluster is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:27:19] PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:27:19] PROBLEM - App Server Main HTTP Response on deployment-mediawiki02 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:30:32] RECOVERY - English Wikipedia Mobile Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 29459 bytes in 0.596 second response time [11:30:34] RECOVERY - App Server Main HTTP Response on deployment-mediawiki01 is OK: HTTP OK: HTTP/1.1 200 OK - 40338 bytes in 0.542 second response time [11:36:34] RECOVERY - App Server Main HTTP Response on deployment-mediawiki02 is OK: HTTP OK: HTTP/1.1 200 OK - 40348 bytes in 0.976 second response time [11:45:46] 10Deployment-Systems, 3Scap3: Update Debian Package for Scap3 - https://phabricator.wikimedia.org/T127762#2054924 (10fgiunchedi) I've uploaded scap 3.0.2-1 to carbon This time was trickier than usual because master isn't at 3.0.2 afaics? anyway to convince git-buildpackage to DTRT in this case you have to be... [11:45:51] 10Deployment-Systems, 3Scap3: Update Debian Package for Scap3 - https://phabricator.wikimedia.org/T127762#2054925 (10fgiunchedi) 5Open>3Resolved [12:10:51] (03CR) 10Thiemo Mättig (WMDE): [C: 031] Utility script for trimming i18n files. [tools/code-utils] - 10https://gerrit.wikimedia.org/r/190825 (owner: 10Daniel Kinzler) [12:13:48] 7Browser-Tests, 10Wikidata: Make Wikidata performance test again able to load Italy - https://phabricator.wikimedia.org/T119950#2055031 (10adrianheine) p:5High>3Normal We have the [WebPageTest dashboard](https://grafana.wikimedia.org/dashboard/db/wikidata-webpagetest) which fulfills the requirements of the... [12:38:21] 10Deployment-Systems, 3Scap3: Update Debian Package for Scap3 - https://phabricator.wikimedia.org/T127762#2053246 (10hashar) ``` * 91cdbe4 - (HEAD -> master, origin/master, origin/HEAD) Add coverage for current link replacement (Mon Feb 22 17:13:56 2016 -0800) | * e786a9b - (tag: 3.0.2) Update cha... [12:44:55] 10Deployment-Systems, 3Scap3: scap3 upstream/debian versioning - https://phabricator.wikimedia.org/T127828#2055121 (10fgiunchedi) [12:46:26] 10Deployment-Systems, 3Scap3: scap3 upstream/debian versioning - https://phabricator.wikimedia.org/T127828#2055145 (10hashar) From T127762#2053246 ``` * 91cdbe4 - (HEAD -> master, origin/master, origin/HEAD) Add coverage for current link replacement (Mon Feb 22 17:13:56 2016 -0800) | * e786a9b - (... [12:47:20] 10Continuous-Integration-Infrastructure, 10scap, 10Packaging: Develop a CI Testing and Release pipeline for the SCAP package (and potentially other debian packages that we maintain) - https://phabricator.wikimedia.org/T127741#2052522 (10hashar) See also {T127828} which is about providing a sane configuratio... [12:48:46] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/272634 (owner: 10Paladox) [12:54:20] PROBLEM - Host deployment-mediawiki01 is DOWN: PING CRITICAL - Packet loss = 80%, RTA = 2479.61 ms [12:54:36] RECOVERY - Puppet failure on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [12:56:38] (03CR) 10Hashar: [C: 04-1] "I dont think there is much use to split jsonlint and jshint there. Specially given we want to phase out those jobs. Maybe migrate them in" [integration/config] - 10https://gerrit.wikimedia.org/r/271725 (https://phabricator.wikimedia.org/T62619) (owner: 10Paladox) [12:57:04] Project beta-scap-eqiad build #90800: 04FAILURE in 12 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90800/ [12:58:54] RECOVERY - Host deployment-mediawiki01 is UP: PING OK - Packet loss = 0%, RTA = 0.93 ms [13:01:45] (03PS2) 10Paladox: Add mwext-{name}-testextension-hhvm to experimental: for some templates [integration/config] - 10https://gerrit.wikimedia.org/r/264355 [13:02:06] (03PS8) 10Paladox: Lets install MySQL before installing dependacy extensions [integration/config] - 10https://gerrit.wikimedia.org/r/264333 [13:02:15] (03PS9) 10Paladox: Lets install MySQL before installing dependacy extensions [integration/config] - 10https://gerrit.wikimedia.org/r/264333 [13:02:57] (03PS3) 10Paladox: [SemanticDrilldown] Remove mw-checks-test test [integration/config] - 10https://gerrit.wikimedia.org/r/263377 [13:03:36] (03PS4) 10Paladox: [SemanticDrilldown] Add npm and composer-test tests [integration/config] - 10https://gerrit.wikimedia.org/r/263065 [13:03:58] (03CR) 10Paladox: "@Hashar could you merge this please since the required patch has been merged." [integration/config] - 10https://gerrit.wikimedia.org/r/263065 (owner: 10Paladox) [13:05:16] (03PS5) 10Paladox: Fix dirty VisualEditor submodule [integration/config] - 10https://gerrit.wikimedia.org/r/262432 (https://phabricator.wikimedia.org/T121479) [13:05:23] Yippee, build fixed! [13:05:23] Project beta-scap-eqiad build #90801: 09FIXED in 6 min 36 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90801/ [13:05:23] (03Abandoned) 10Hashar: [MobileFrontend] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/270474 (owner: 10Paladox) [13:06:45] (03PS5) 10Paladox: Add new hhvm lint and use it [integration/config] - 10https://gerrit.wikimedia.org/r/270938 (https://phabricator.wikimedia.org/T97889) [14:00:12] Reedy: hey, around? [14:01:24] Aye [14:02:31] Amir1_: Wassup? [14:03:43] Reedy: we deployed the ORES extension into beta clsuter but it's not working at all [14:03:55] it is in Special:Version but not in beta features [14:05:29] it works here: http://mw-revscoring.wmflabs.org/wiki/Special:Preferences#mw-prefsection-betafeatures [14:06:00] This feels very dejavu [14:06:02] (for other extensions [14:06:39] :D [14:08:22] let me check other ones [14:08:26] to see what's wrong [14:08:47] deployment-bastion is giving a weird message [14:08:48] If you want to deploy software, you should /not/ do it from here; if [14:08:48] will probably work, but the next deployer could lose track of any of [14:08:48] your canges. Connect to 'deployment.eqiad.wmnet' instead, it will [14:08:48] route you to the correct server. [14:08:53] canges is a typo [14:12:59] And it's php 5.3 [14:13:00] gj [14:15:10] Reedy: I don't have access to deployment project [14:15:25] That can't be good [14:15:25] Catchable fatal error: Argument 1 passed to CirrusSearch\Hooks::getBetaFeaturePreferences() must be an instance of User, undefined variable given in /srv/mediawiki/php-master/extensions/CirrusSearch/includes/Hooks.php on line 672 [14:16:03] Amir1_: The first betafeatures hook seems to be dying [14:16:43] Oh, no, that's me doing it wrong [14:16:44] xD [14:18:49] Amir1_: It's caching, it seems [14:18:49] http://en.wikipedia.beta.wmflabs.org/w/api.php?action=query&list=betafeatures&bfcounts= [14:18:56] "ores-enabled": { [14:18:56] "name": "ores-enabled", [14:18:56] "count": 0 [14:18:56] } [14:19:11] I guessed [14:19:22] How can we purge it somehow? [14:19:45] I'm just trying to work out where it's cached :) [14:23:57] PROBLEM - Free space - all mounts on deployment-fluorine is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine.diskspace._srv.byte_percentfree (<20.00%) [14:25:03] awesome thanks [14:27:06] MarkTraceur: About? [14:27:15] Yippee, build fixed! [14:27:15] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #800: 09FIXED in 1 min 47 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/800/ [14:27:25] Do you remember how to purge betafeatures cache stuff when the preferences don't update? [14:27:49] Erm [14:28:01] It's very much dejavu [14:28:04] I know we've had the issue before [14:28:05] Reedy, no, sorry, slipping my mind at the moment [14:28:11] Yeah sounds familiar [14:28:19] Part of me just wants to restart memcached [14:28:20] :D [14:28:28] Maybe there's a maintenance script in BF [14:28:45] If not yeah, that's what I'd suggest, something something memcached [14:29:14] The only obvious one I see is $key = $cache->makeKey( __CLASS__, 'prefs-update', $user->getId() ); [14:29:17] But I don't think it's that [14:31:00] Back in a few [14:34:25] 10Browser-Tests-Infrastructure, 5Release-Engineering-Epics, 7Epic, 7Tracking: Disable scenarios that fail at en.wikipedia.beta.wmflabs.org from running daily - https://phabricator.wikimedia.org/T94150#2055343 (10zeljkofilipin) [14:37:59] Yippee, build fixed! [14:37:59] Project browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #185: 09FIXED in 4 min 17 sec: https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/185/ [14:40:45] hashar: hey, we figured out it's a caching issue. it's there but cached :) [15:10:15] 7Browser-Tests, 10Wikidata: Make Wikidata performance test again able to load Italy - https://phabricator.wikimedia.org/T119950#2055387 (10Tobi_WMDE_SW) Do we then need this browser test again at all? Or should be rather change the task to "Remove Wikidata performance test"? [15:11:45] Project beta-scap-eqiad build #90815: 04FAILURE in 6 min 37 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90815/ [15:14:58] PROBLEM - Puppet failure on deployment-elastic08 is CRITICAL: CRITICAL: 12.50% of data above the critical threshold [0.0] [15:16:24] PROBLEM - Puppet failure on deployment-mathoid is CRITICAL: CRITICAL: 37.50% of data above the critical threshold [0.0] [15:17:32] 7Browser-Tests, 10MediaWiki-extensions-MultimediaViewer: Fix failed MultimediaViewer browsertests Jenkins jobs - https://phabricator.wikimedia.org/T94157#2055394 (10zeljkofilipin) a:3zeljkofilipin [15:18:07] 7Browser-Tests, 10MediaWiki-extensions-MultimediaViewer: Disable MultimediaViewer scenarios that fail at en.wikipedia.beta.wmflabs.org from running daily - https://phabricator.wikimedia.org/T94157#1156464 (10zeljkofilipin) [15:19:37] PROBLEM - Puppet failure on deployment-cache-text04 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [15:21:15] PROBLEM - Puppet failure on deployment-zotero01 is CRITICAL: CRITICAL: 28.57% of data above the critical threshold [0.0] [15:23:58] PROBLEM - Puppet failure on deployment-elastic06 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [15:24:19] PROBLEM - Puppet failure on integration-slave-trusty-1001 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [15:31:28] Yippee, build fixed! [15:31:29] Project beta-scap-eqiad build #90817: 09FIXED in 6 min 43 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90817/ [15:39:37] 10Browser-Tests-Infrastructure, 5Release-Engineering-Epics, 7Epic, 7Tracking: Disable scenarios that fail at en.wikipedia.beta.wmflabs.org from running daily - https://phabricator.wikimedia.org/T94150#2055452 (10zeljkofilipin) [15:40:03] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer: undefined method `test_name' for # (NoMethodError) - https://phabricator.wikimedia.org/T125072#2055453 (10zeljkofilipin) a:3zeljkofilipin [15:40:55] 10Browser-Tests-Infrastructure, 5Testing-Initiative-2015, 7JavaScript, 13Patch-For-Review: Experiment with browser testing in other software languages - https://phabricator.wikimedia.org/T108874#1532739 (10zeljkofilipin) a:3zeljkofilipin [15:42:51] 7Browser-Tests, 13Patch-For-Review: Investigate QuickSurveys browser tests failures - https://phabricator.wikimedia.org/T113534#2055461 (10zeljkofilipin) [15:42:53] 10Browser-Tests-Infrastructure, 6Release-Engineering-Team, 10Reading-Web, 13Patch-For-Review: MW-Selenium associates wrong SauceLabs job with Jenkins artifact - https://phabricator.wikimedia.org/T105589#2055459 (10zeljkofilipin) 5Open>3Resolved I think this is fixed. Please reopen if there is something... [15:43:31] ostriches: will there be a train later? [15:43:46] or anyone know? [15:43:57] Plan as of yesterday was no train [15:44:05] * ostriches puts away his conductor hat and whistle :( [15:44:22] hmm, ok [15:44:47] i'll need to deploy something later then, which includes adding stuff to wikimedia messages and doing scap [15:44:57] for https://phabricator.wikimedia.org/T109675 [15:45:16] Oh no, Phabricator contains a blog tool now. Should we disable that? [15:45:34] Krinkle: It's had that forever. Mukunda just turned it *on* the other day [15:45:36] We don't need to install every new tool by default, right? We've got enough places people publish content already. [15:45:42] Why? [15:45:47] Wanted to use it :) [15:46:11] I get it. We don't like using MediaWiki. Admit it. [15:46:30] Is MediaWiki a blogging platform now? [15:46:31] * andre__ enables the Phabricator wiki [15:46:37] :) [15:46:47] Krinkle: Collective "we" is never a useful generalization :D [15:47:08] Not to mention the calendar feature. [15:47:14] But people started using that too [15:47:20] This seems like a good use of it -- https://phabricator.wikimedia.org/phame/post/view/1/what_s_new_lots_of_improvements_on_phabricator.wikimedia.org/ [15:47:28] Yes, that's what made me aware of it [15:47:44] There's at least a dozen places that could've been posted. This is making our communication chaos wose. [15:47:48] worse* [15:48:00] Anyway, I rest my case. Clearly this was done on purpose. [15:48:12] I could paste the whole thing into IRC if you'd prefer :D [15:48:21] Maybe nice as a proof of concept for the first post, but I sure hope it doesn't get used for anything we expect people to discover or read for real. [15:50:47] andre__: you are evil [15:50:55] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer: undefined method `test_name' for # (NoMethodError) - https://phabricator.wikimedia.org/T125072#2055489 (10zeljkofilipin) This is breaking all MMV selenium tests. :( [15:51:17] Krinkle: Phabricator is kind of like a virus. It is slowly taking over the world ;D [15:51:32] RECOVERY - Puppet failure on deployment-mathoid is OK: OK: Less than 1.00% above the threshold [0.0] [15:51:35] Next time someone goes to write something, they'll have even more choices. And people to read stuff will have even more arbitrary variation in figuring out to access and experience the text (worse for those using assistive technology). And those who read something but didn't book mark now have even more places to search. Speaking of, does phab have a good [15:51:35] search for phames? [15:51:39] hashar: me? [15:51:41] :D [15:52:01] I already look in 5 places to find that page I read the other day. [15:52:25] Krinkle: I have long stopped reading the so many communication channels we have. I just wait for people to paste link on IRC to consume them [15:52:44] I call that my intelligent twitter feed. i.e. human being do the noise reduction for me [15:53:10] hashar: thanks for reviewing my patches today :) [15:53:41] and if I ever look for something I even have an IRC / human driven system which goes on like: "I remember having read something about 'some topic', can't really remember where but it was 'summary'" [15:53:58] it is a bit slow, but usually after a couple of minutes the appropriate URL pop up as a reply in the IRC channel [15:54:10] hashar: Oh ok. [15:54:11] Yep. Many of us use IRC that way. It's the only way left in all the chaos. And more seriously, I"m sure that contributes to our inability to attrack many competent volunteers in engineering. Other organisations put less effort into that problem and get more out of it by having less chaos. [15:54:14] paladox: tried my best. There are still a whole lot pending ;) [15:54:38] hashar: Yes [15:54:40] RECOVERY - Puppet failure on deployment-cache-text04 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:58] RECOVERY - Puppet failure on deployment-elastic08 is OK: OK: Less than 1.00% above the threshold [0.0] [15:55:15] Krinkle: from my acquaintances lot think WMF only hire rock star people and that you got to relocate to SF and that they would never cut HR pre screening or the first dev interview if being contractors [15:55:30] Krinkle: we are also terrible at marketing all the code we produce :/ [15:55:40] hashar: Could we use extension dependacys in the non voting extension unit tests if not could we add support so we can start the migration from using the extensions unit tests with the name of the extension infront of it (non generic version) [15:56:16] paladox: yup I guess the dependencies should be injected in the -nonvoting flavor of jobs [15:56:29] paladox: for Semantic* extensions I think we need something clever though [15:56:37] hashar: Ok. [15:56:49] paladox: probably have a common test job that clones SemanticMediaWiki and all the extensions and test them all together [15:57:00] paladox: that would solve the crazy dependency tree [15:57:41] hashar: Hum yes. But also need to fix the mysql thing since we need to run install mysql before installing any extensions, then run the updater. [15:57:44] Krinkle: paladox: we are going to have a CI / browser test checkin in a couple minutes via Google Hangouts if you wanna join / chat ( https://plus.google.com/hangouts/_/wikimedia.org/btest-ci-weekly ) [15:58:14] not much about technical details, merely a status update usually [15:59:19] Oh ok. It says i have to install a plugin [15:59:21] RECOVERY - Puppet failure on integration-slave-trusty-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:39] hashar ^^ [16:01:03] paladox: ah yeah google hangouts use a proprietary software [16:01:14] hashar oh. [16:05:32] (03PS1) 10Paladox: Migrate operations-puppet tests to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/272743 [16:10:51] (03PS1) 10Paladox: Migrate php-extensions to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/272746 [16:12:30] paladox: :-) [16:12:38] (03PS1) 10Paladox: Migrate python-jobs to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/272747 [16:12:46] we will end phasing out Precise nodes faster than envisioned ! [16:12:56] hashar: Yes. :) [16:13:13] hashar: Im going through the list here https://github.com/wikimedia/integration-config/search?utf8=%E2%9C%93&q=UbuntuPrecise&type=Code [16:13:28] paladox: though sometime the jobs are on Precise for a good reason [16:13:42] hashar: Im not sure weather some need to be put into the same patch. Oh, do you know which ones. [16:13:54] no clue, review will tell [16:14:01] it is a good thing to have separate changes [16:14:16] will review that tomorrow I guess [16:14:22] hashar: Yes. and thanks. [16:14:26] got meetings all this evening [16:16:02] hashar: Oh ok. [16:16:36] (03PS1) 10Paladox: Migrate integration to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/272748 [16:17:39] hashar: the above is migrating ^^ integration tests to UbuntuTrusty so you should notice improvements in speed once migrated. [16:19:00] (03PS1) 10Paladox: Migrate job-templates to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/272749 [16:20:45] hashar: Should we get rid of parsoidsvc-{repository}-npm-0.8 or can it be migrated to Trusty. [16:21:07] paladox: keep it [16:21:37] paladox: the reason some jobs are on Precise is that we need version of software that are only on Precise and not on Trusty [16:21:41] npm 0.8 is an example [16:21:55] hashar: Ok so npm 0.8 should stay on precise. [16:21:55] on Trusty npm is 0.10 so if we want to test with npm 0.8 we need Precise [16:22:04] yeah and python jobs have similar requierments [16:22:04] hashar: Ok. [16:22:10] different python versions [16:22:39] hashar: Oh ok. But would it be possible to dual load different python versions as we do with php 5.3, 5.5 and hhvm. [16:22:48] for php [16:22:57] we have 5.3 routed on Precise, 5.5 and hhvm on Trusty [16:23:01] for python it is similar [16:23:07] (03PS1) 10Paladox: Migrate mediawiki to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/272752 [16:23:14] iirc python 3.4 is only available on Trusty [16:23:19] hashar: Oh. [16:24:07] paladox: so it is not as simple as just replacing UbuntuPrecise with UbuntuTrusty :-D [16:24:17] like "Migrate mediawiki to UbuntuTrusty [integration/config] - https://gerrit.wikimedia.org/r/272752 " [16:24:35] that change assert the integration/phpunit copy works fine on the various release branch of mediawiki we support [16:24:49] hashar: Oh. [16:24:55] so for release up to 1.26 that needs to run with PHP 5.3 and thus on Precise [16:25:25] and for 1.27 and future it is no more needed because we are grabbing phpunit from composer instead of our copy integration/phpunit (recent change) [16:25:36] hashar: Maybe this will help https://www.howtoforge.com/how-to-use-multiple-php-versions-php-fpm-and-fastcgi-with-ispconfig-3-ubuntu-12.10 [16:26:04] paladox: yeah we are going to go with something like that [16:26:16] ie build our own php versions using 'php-build' [16:26:25] have them in the new Jessie instances [16:26:30] hashar: Maybe we can create a test for integration/phpunit, One that uses php55 and hhvm and one that uses php53 [16:26:37] hashar: Ok. [16:26:44] then we can set PHP_BIN to which ever version we want. example: PHP_BIN=/opt/php/php7/bin/php [16:26:57] and integration/phpunit is legacy [16:27:21] I dont think we need it anymore for master / REL1_27 , havent keep track of the recent changes on that front [16:27:32] hashar: Yes and oh ok, So that is used by older releases. [16:27:32] but the idea is to inject composer requireDev in the job, which include PHPUnit [16:27:37] Ok. [16:27:39] and thus bring us phpunit 4.x [16:27:54] so yeah just for the older releases [16:27:59] Ok. [16:28:03] gotta find out / ask which old releases we still support [16:28:35] hashar: I belive it is mediawiki 1.26, 1.23. But not sure about 1.25 and 1.24 [16:29:23] hashar: Looking at https://www.mediawiki.org/wiki/Download 1.25 is supported as a legacy version and 1.24 discontinued. [16:30:13] matanya: hey, sorry, right after I said I was kinda there I had to go afk, feel free to PM me your rant :) [16:30:56] (03Abandoned) 10Paladox: Migrate mediawiki to UbuntuTrusty [integration/config] - 10https://gerrit.wikimedia.org/r/272752 (owner: 10Paladox) [16:33:57] hashar: Looking at http://packages.ubuntu.com/trusty/python you can install both python 2.7 for trusty and 3.4. Same as you have done for precise. [16:41:39] greg-g: good morning :) [16:42:01] greg-g: if you get some idle time today, can you look at fixing the team channel that prevent us from joining back? :D [16:42:17] paladox: yeah so maybe python 2.7 job can switch [16:42:34] paladox: though most of them should be on Jessie already now. Will check that tomorrow and clean up as needed [16:43:07] hashar: yeah, you should be able to /invite yourself [16:43:23] hashar: Yep and ok. Is dual python supported on precise since on one of the comments in the integration/config says that precise can use python 2.7 and 3.2. [16:43:24] hashar: but that's not my preferred outcome, I didn't get a chance to futz with it yesterday, I took a 2 hour nap instead :/ [16:45:46] greg-g: no worries :-) [16:49:23] hashar: hey, any ideas how to purge to cache? [16:50:48] (03PS1) 10Paladox: [Babel] Use generic test instead [integration/config] - 10https://gerrit.wikimedia.org/r/272758 [16:52:03] 10Continuous-Integration-Infrastructure, 7Tracking: MediaWiki extensions with failing phpunit tests (tracking) - https://phabricator.wikimedia.org/T67874#2055766 (10Krinkle) 5Open>3Resolved [16:52:55] 10Continuous-Integration-Infrastructure: Jenkins: Assert no PHP errors (notices, warnings) were raised or exceptions were thrown - https://phabricator.wikimedia.org/T50002#2055770 (10Krinkle) [16:52:57] 10Continuous-Integration-Infrastructure, 10Wikidata: Cannot find site jenkins_u3_mw - https://phabricator.wikimedia.org/T121083#2055771 (10Krinkle) [16:53:25] 10MediaWiki-Codesniffer, 10Possible-Tech-Projects: Improving static analysis tools for MediaWiki - https://phabricator.wikimedia.org/T89682#2055776 (10Sumit) >>! In T89682#2046748, @EBernhardson wrote: > In addition to phpcs, which is a frankly very minor start, I would really love to see this expand to runnin... [16:54:26] 10Continuous-Integration-Infrastructure, 7Zuul: mwext-*-testextension shouldn't be limited to one per node - https://phabricator.wikimedia.org/T96034#2055781 (10Krinkle) [16:54:42] 10Continuous-Integration-Infrastructure: reduce copies of mediawiki/core in workspaces - https://phabricator.wikimedia.org/T93703#2055784 (10Krinkle) [16:54:44] 10Continuous-Integration-Infrastructure, 7Zuul: mwext-*-testextension shouldn't be limited to one per node - https://phabricator.wikimedia.org/T96034#1206804 (10Krinkle) [16:55:25] 10Continuous-Integration-Infrastructure, 7Zuul: mwext-*-testextension shouldn't be limited to one per node - https://phabricator.wikimedia.org/T96034#2055793 (10Krinkle) 5Open>3declined >>! In T96687#1705237, @hashar wrote: > This will be done as part of migrating to #nodepool instances. The specific task... [16:57:54] hashar: Does flow need to use the non generic unit tests or can it be converted to generic and have its dependacys loaded through that way. That way the tests are done quicker. [16:59:56] RECOVERY - Puppet failure on deployment-elastic06 is OK: OK: Less than 1.00% above the threshold [0.0] [17:00:10] 10Browser-Tests-Infrastructure, 10MediaWiki-extensions-MultimediaViewer: undefined method `test_name' for # (NoMethodError) - https://phabricator.wikimedia.org/T125072#2055809 (10zeljkofilipin) In fe66fdc6be91 `test_name` has been removed. [17:02:29] hashar: Could we allow npm to do check: on apps/android/wikipedia or would that be a security risk since users that arn't whitelisted can run npm on that repo. [17:02:52] hashar: Also which npm template should i use. [17:03:05] paladox: just add it to test I guess [17:03:46] I am off! [17:03:48] hashar: Oh ok. should we use npm-node-4.3 [17:03:52] hashar: Ok. [17:04:04] paladox: yeah npm-node-4.3 will do [17:04:10] ;D [17:04:15] hashar: Ok. :) [17:06:11] (03PS1) 10Paladox: Add npm-node-4.3 to a few of apps/* templates in experimental: [integration/config] - 10https://gerrit.wikimedia.org/r/272765 [17:09:25] (03CR) 10Paladox: "Were in the process of removing jslint tests, But first we need to replace all tests that depend on this with alternatives. We are going t" [integration/config] - 10https://gerrit.wikimedia.org/r/272765 (owner: 10Paladox) [17:10:36] 10Beta-Cluster-Infrastructure, 6Release-Engineering-Team, 6Operations, 7Puppet: deployment-tin puppet Error 400 on SERVER: Failed to parse template nutcracker/nutcracker.yml.erb - https://phabricator.wikimedia.org/T127845#2055880 (10thcipriani) [17:23:15] (03CR) 10Niedzielski: Add npm-node-4.3 to a few of apps/* templates in experimental: (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/272765 (owner: 10Paladox) [17:25:10] (03CR) 10Paladox: Add npm-node-4.3 to a few of apps/* templates in experimental: (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/272765 (owner: 10Paladox) [17:28:19] RECOVERY - Puppet failure on deployment-zotero01 is OK: OK: Less than 1.00% above the threshold [0.0] [17:53:51] Krinkle: no better place to post that than in phabricator where it's intended audience is [17:55:06] Trolling, but by that logic we should really deploy mechanical pigeons into the world instructed to put post-it notes on your screen, which is where our intended audience will be looking at. [17:55:36] or just use mediawiki :-P [17:56:00] I assure you, nobody will be going to /phame/ to discover the post. It doesn't exist. People got it through the URL. Which could've been a markdown rendered GH Gist or Phab Pastie just the same. [17:56:13] the audience was on the mailing list [17:56:31] it's on the front page of phabricator.wikimedia.org [17:56:48] for people who didn't customize it [17:57:16] I intended to post it to the mailing list after a few proof reads [17:57:38] in text form so nobody has to load any web page. [17:58:05] there is absolutely no harm in usint phame instead of a gist or a paste [17:58:47] for one thing, a gist wouldn't render all the links nicely. a paste is just a weird way to publish the same thing [18:01:46] RECOVERY - Puppet failure on deployment-cache-upload04 is OK: OK: Less than 1.00% above the threshold [0.0] [18:29:57] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: Upgrade PHP_CodeCoverage - https://phabricator.wikimedia.org/T122530#2056316 (10Krinkle) [18:30:53] 10Continuous-Integration-Infrastructure: Upgrade PHP_CodeCoverage - https://phabricator.wikimedia.org/T122530#1906714 (10Krinkle) 5Open>3Resolved a:3Krinkle [18:32:33] 10Continuous-Integration-Infrastructure: Upgrade PHP_CodeCoverage - https://phabricator.wikimedia.org/T122530#2056328 (10Krinkle) As part of T99982, `phpunit/php-code-coverage` was implicitly upgraded to v2.2.4 as it is a dependency of PHPUnit, which specifies which version it uses. (It shouldn't be overridden s... [18:58:58] (03PS1) 10Paladox: Lets install the dependant extension first then the actual extension [integration/config] - 10https://gerrit.wikimedia.org/r/272794 [19:03:34] Krinkle you know phpunit, with the update you did to allow phpunit through composer, can individual extensions/skins use a different phpunit version since composer merges the package in the extension with the one in core on composer tests. [19:03:39] Just wondering. [19:04:14] paladox: No, and that shouldn't be possible, either. The extension plugs into core, and core runs the test. [19:04:26] Krinkle oh ok. [19:04:31] Other versions would not be compatible with the core class anyway [19:05:56] Ok. [19:07:31] (03CR) 10Paladox: "This fixes the issue since if you see" [integration/config] - 10https://gerrit.wikimedia.org/r/264333 (owner: 10Paladox) [19:12:38] (03PS1) 10Paladox: [SemanticFormsInputs] Use extension-unittests-generic tests [integration/config] - 10https://gerrit.wikimedia.org/r/272796 [19:15:18] (03CR) 10Paladox: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/173831 (owner: 10Hashar) [19:22:54] (03PS7) 10Paladox: (WIP) test Zuul gate configuration (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/173831 (owner: 10Hashar) [19:23:06] (03CR) 10Paladox: "Rebased." [integration/config] - 10https://gerrit.wikimedia.org/r/173831 (owner: 10Hashar) [19:23:48] (03CR) 10jenkins-bot: [V: 04-1] (WIP) test Zuul gate configuration (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/173831 (owner: 10Hashar) [19:46:42] twentyafterfour: you are pretty much right re: that dump job, the back story is I am not sure what it is FOR really, originally it was a "hey I wonder if we can do our own non sprint app thing and I want to do a quick poc" [19:46:46] but it has lived on and lived on [19:46:57] and I have no time for it but also mainly as...who is using it and why? [19:47:05] these questions I have asked previously without good answers [19:47:09] re: why it's shitty [19:50:26] There's a burning joke in there somewhere [19:55:06] (03Abandoned) 10Paladox: [SemanticForms] Add dependance on OpenLayers extension [integration/config] - 10https://gerrit.wikimedia.org/r/266067 (owner: 10Paladox) [19:59:54] (03PS3) 10Paladox: [SemanticGenealogy] Add dependance on SemanticMediaWiki and SemanticMaps [integration/config] - 10https://gerrit.wikimedia.org/r/266069 [20:03:33] (03Abandoned) 10Paladox: [SemanticForms] Add dependance on WikiEditor [integration/config] - 10https://gerrit.wikimedia.org/r/264764 (owner: 10Paladox) [20:08:07] (03PS2) 10Paladox: [SemanticRating] Update jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/264750 [20:12:45] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [20:13:57] (03Abandoned) 10Paladox: Move SemanticFormsInputs back to mediawiki-extensions.yaml file [integration/config] - 10https://gerrit.wikimedia.org/r/264349 (owner: 10Paladox) [20:23:28] PROBLEM - Free space - all mounts on deployment-bastion is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_percentfree (<11.11%) [20:28:33] RECOVERY - Free space - all mounts on deployment-bastion is OK: OK: All targets OK [21:03:57] 5Gerrit-Migration, 10MediaWiki-Vagrant: Pull repos from phabricator instead of gerrit - https://phabricator.wikimedia.org/T127873#2057131 (10Luke081515) [21:04:17] 5Gerrit-Migration, 10MediaWiki-Vagrant: Pull repos from phabricator instead of gerrit - https://phabricator.wikimedia.org/T127873#2057143 (10Luke081515) p:5Triage>3Low [21:17:44] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-ORES, 6Revision-Scoring-As-A-Service, 13Patch-For-Review: Deploy ORES extension to beta cluster - https://phabricator.wikimedia.org/T127661#2057256 (10Ladsgroup) OK, everything is there but we can't see it in [[http://en.wikipedia.beta.wmflabs.org/wiki/... [21:30:57] PROBLEM - Free space - all mounts on deployment-jobrunner01 is CRITICAL: CRITICAL: deployment-prep.deployment-jobrunner01.diskspace.root.byte_percentfree (<30.00%) [21:31:29] umm, on https://gerrit.wikimedia.org/r/#/c/272688/1, the "Image result browser" related change links to some broken phab url [21:31:40] Why doesn't it link to the gerrit change? [21:33:35] ostriches: ^? [21:34:40] No it doesn't? [21:34:45] It links to gerrit for me [21:34:51] (assuming you mean the parent in the deps box) [21:35:08] Now the (diffusion) link is broken, yes. [21:37:26] ostriches: are you using the new changes screen? [21:37:39] No :p [21:37:56] On 2.8.x it's vastly inferior to the old screen :p [21:38:29] Ok, I see what it's doing. That's really freaking dumb behavior gerrit. [21:38:35] I wonder if that's fixed on upgrade... [21:38:41] ostriches: https://i.imgur.com/HjZUBRG.png [21:38:52] Yeah I swapped /c/ for /c2/ and saw it [21:39:04] oh, I didn't know you could do that :D [21:39:20] aww, too bad /c1/ doesn't work :P [21:40:25] legoktm: thats because they need to update the redirection script on phabricator. [21:40:55] the repo is phabricator/extensions but they prefer to do it in stages. [21:41:48] legoktm: Also the repo needs to be created in phabricator so that may be why it wasent created when ever the script was updated. [21:42:39] twentyafterfour: Hi could you import https://gerrit.wikimedia.org/r/#/admin/projects/wikidata/query/gui into phabricator and if possible update the redirection script for it please. Per above ^^ [21:48:35] paladox: as stated many times, ostriches imports repos to phabricator from gerrit occassionally and in bulk. pinging people to do it only distracts them from their other work [21:49:05] Reedy: I found what you were talking about: https://phabricator.wikimedia.org/T92232 [21:49:25] greg-g: I seem to be lacking my +i for the other place. Lost my invite when I disconnected last night [21:49:42] grumble grumble [21:49:45] greg-g: Ok sorry. I was requesting that the repo be create but if possible could the redirection script be updated. I know that someone bulks updates. [21:50:44] ostriches: try just joining now? [21:51:06] You need an invitation to join.... [21:51:18] kk [21:51:22] /msg chanserv invite ##sekritchannel [21:51:46] ostriches: try again? [21:51:51] lego shush now everyone will know where we hatch our plans [21:52:04] greg-g: Same... [21:52:18] $@!*!@%$% let's just use slack [21:52:21] (I kid) [21:52:32] (but dannng) [21:52:44] you mean slack, where you still need invites to join channels? :P [21:55:02] legoktm: Do you know what 'mediawiki.api.query' was replaced with in resourceloader. Or krinkle [21:55:04] please. [21:56:26] Krinkle ^^ [22:00:49] paladox: I'm not sure that ever existed. [22:01:21] it probably would have been listed on https://www.mediawiki.org/wiki/ResourceLoader/Modules if it did [22:01:28] legoktm: Yep sorry, i did some searching it is hard to find but the patch existed but was abandoned because it was not needed any more. [22:02:13] legoktm: https://gerrit.wikimedia.org/r/#/c/72844/ [22:03:23] legoktm: Would this work https://gerrit.wikimedia.org/r/#/c/272748/ for integration/config. And Would this https://gerrit.wikimedia.org/r/#/c/272794/ work for extensions. [22:05:19] (03CR) 10Legoktm: [C: 04-2] "The comments say "Same distro as the prod machine hosting Zuul server", so as long as zuul runs on gallium, it should stay on precise." [integration/config] - 10https://gerrit.wikimedia.org/r/272748 (owner: 10Paladox) [22:06:03] Project beta-scap-eqiad build #90856: 04FAILURE in 15 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90856/ [22:06:42] legoktm: Would these two https://gerrit.wikimedia.org/r/#/c/272746/ and https://gerrit.wikimedia.org/r/#/c/272743/ work on trusty [22:06:52] (03CR) 10Legoktm: [C: 04-2] "This doesn't actually make a difference for what you describe in the commit message. This only affects the order in what repositories are " [integration/config] - 10https://gerrit.wikimedia.org/r/272794 (owner: 10Paladox) [22:07:49] paladox: off the top of my head, I'm not sure. the operations-puppet ones are probably fine [22:08:10] (03CR) 10Paladox: "@Legoktm nope when the extension is loaded it does the main extension then the dependant extension. Would that mean it is a bug and should" [integration/config] - 10https://gerrit.wikimedia.org/r/272794 (owner: 10Paladox) [22:08:17] legoktm: thanks. [22:08:57] (03CR) 10JanZerebecki: "I think that if the order of those two matter, that there is a bug somewhere else. As nothing should use src/extensions_load.txt until aft" [integration/config] - 10https://gerrit.wikimedia.org/r/264333 (owner: 10Paladox) [22:08:59] legoktm: Im aware the python ones need more work then just a switch, Also the one in mediawiki is blocked until php can run mutiple versions on trusty. [22:09:43] (03CR) 10Paladox: "Yes maybe a bug." [integration/config] - 10https://gerrit.wikimedia.org/r/264333 (owner: 10Paladox) [22:11:20] legoktm: do you have a min. to check the caching problem? please [22:11:24] :D [22:11:35] ostriches: try now? [22:11:46] * greg-g is trying things [22:16:05] Amir1_: yeah, let me do that now before I get distracted. [22:16:17] thanks [22:16:26] though I suppose you're the one distracting me ;-) [22:19:39] legoktm@deployment-tin:~$ mwscript eval.php --wiki=enwiki [22:19:39] > var_dump($wmgUseORES); [22:19:39] bool(true) [22:19:41] okay... [22:19:59] > var_dump(ExtensionRegistry::getInstance()->isLoaded('ORES')); [22:19:59] bool(true) [22:20:26] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-ORES, 6Revision-Scoring-As-A-Service, 13Patch-For-Review: Deploy ORES extension to beta cluster - https://phabricator.wikimedia.org/T127661#2057572 (10hashar) What is the caching issue about? Seems to me beta features are registered via the hook `GetB... [22:21:33] what in the world... [22:23:13] Amir1_: well, I found the issue. [22:23:16] legoktm: Reedy suggested it's memcache and I have no idea what that is [22:23:22] legoktm: awesome [22:24:06] 5Gerrit-Migration, 10Differential, 10Wikibugs: Broadcast Differential activity to IRC - https://phabricator.wikimedia.org/T116330#2057600 (10greg) 5Open>3stalled [22:24:38] 10Beta-Cluster-Infrastructure: deployment-mediawiki02 has outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2057601 (10Legoktm) [22:25:08] !log running sync-common manually on deployment-mediawiki02 [22:25:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:26:11] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-ORES, 6Revision-Scoring-As-A-Service, 13Patch-For-Review: Deploy ORES extension to beta cluster - https://phabricator.wikimedia.org/T127661#2057627 (10Legoktm) The issue is {T127888}. [22:30:03] heh, I bet deployment-mediawiki01 is out of date too. [22:30:58] 10Browser-Tests-Infrastructure, 6Release-Engineering-Team, 10Reading-Web, 13Patch-For-Review: MW-Selenium associates wrong SauceLabs job with Jenkins artifact - https://phabricator.wikimedia.org/T105589#2057640 (10hashar) I haven't verified, should be solved by mediawiki_selenium 1.6.4 (one really want >=... [22:31:52] 10Beta-Cluster-Infrastructure: deployment-mediawiki02 has outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2057641 (10Legoktm) deployment-mediawiki01 is also out of date. [22:32:01] 10Beta-Cluster-Infrastructure: deployment-mediawiki0[12] have outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2057642 (10Legoktm) [22:33:05] 10Beta-Cluster-Infrastructure: deployment-mediawiki0[12] have outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2057601 (10Legoktm) I ran sync-common on deployment-mediawiki02, but it didn't make a difference: ``` legoktm@deployment-mediawiki02:/srv/mediawiki$ sync-common 22:24:58 Copying to... [22:33:48] 10Beta-Cluster-Infrastructure: deployment-mediawiki0[12] have outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2057645 (10Legoktm) p:5Triage>3Unbreak! [22:34:09] marxarelli, thcipriani, twentyafterfour: ^ I'm not sure what's wrong [22:35:59] 10Beta-Cluster-Infrastructure: deployment-mediawiki0[12] have outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2057652 (10Legoktm) [22:36:01] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-ORES, 6Revision-Scoring-As-A-Service, 13Patch-For-Review: Deploy ORES extension to beta cluster - https://phabricator.wikimedia.org/T127661#2057651 (10Legoktm) [22:36:18] good whatever time [22:38:19] lets pretend its morning [22:38:24] good morning hashar! :) [22:38:25] huh, I wonder if all the mediawiki machines have been syncing from deployment-bastion? [22:38:52] well I am in my bed (but wearing a pant as per policy) [22:39:13] doing mail triage while pondering which documentary to watch [22:39:53] legoktm: thcipriani about ORES / deployment-mediawiki02 being stalled [22:40:05] could it be that the git remote on mediawiki02 still point to deployment-bastion? [22:40:20] cause the beta-scap-eqiad seems all fine [22:40:26] yeah, I think that is the problem. I forgot we brought that box back up. [22:41:15] Amir on the ORES task confused me using "broken because of cache" [22:41:53] hashar: What tests should i add to DjangoAnalytics since it seems to only have a mix of .py files and sql files yet the repo has jslint and extension unit tests non voting as tests. [22:41:53] :D [22:42:00] it's on Reedy :D [22:42:12] Amir1_: no worries ;-) [22:43:07] thcipriani: which would mean beta cluster has been stall for ~10 days or so ? :-( [22:44:10] hashar: I don't think so. Somehow that cherry pick went missing. It's in the upstream patch: https://gerrit.wikimedia.org/r/#/c/270343/5/modules/scap/files/scap.cfg [22:44:10] and maybe https://integration.wikimedia.org/ci/job/beta-scap-eqiad/ should run scap with --verbose [22:44:32] * hashar raises fists at upstream [22:44:37] wait [22:44:39] that is us [22:45:17] thcipriani: sounds like a bunch of cherry picks went missing on the puppet master so [22:45:19] deployment-puppetmaster is in a weird rebase state [22:45:28] !log deployment-puppetmaster is in a weird rebase state [22:45:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [22:45:33] yeah that is a cron job attempting to rebase [22:45:47] and whenever rebase fail, the workspace is left in a dirty state [22:45:53] pending human fixing [22:46:14] (03PS1) 10Paladox: Replace jslint test with jshint and jsonlint tests [integration/config] - 10https://gerrit.wikimedia.org/r/272902 [22:46:30] ideally the script should attempt the rebase out of the workspace (not sure it is doable with git though) and only checkout the result when the rebase has been successful [22:46:46] like git rebase --do-your-crap-in-memory-only [22:47:01] hashar: your command flags have the best names :P [22:47:15] wait for my command names [22:48:02] and my project names acronyms (teaser one such project is ALIX , named after my daughter or Awesome Life Improver under uniX) [22:48:23] I secretly hope that a decade from now she will propose a pull request to it [22:48:41] anyway rebase always checkout .. [22:49:10] :D [22:49:33] (03PS2) 10Paladox: Replace jslint test with jshint and jsonlint tests [integration/config] - 10https://gerrit.wikimedia.org/r/272902 [22:49:34] thcipriani: I would split https://gerrit.wikimedia.org/r/#/c/270343/ in more manageable chunks that are easier to review/approve via ops / deployers [22:50:27] hashar or legoktm could you review https://gerrit.wikimedia.org/r/#/c/272902/ please. Im going to do the next batch after that. [22:50:37] for example a change just changing the ip, another one for scap, last patch for beta [22:51:07] paladox: I probably won't have time today, will look tomorrow. [22:51:16] legoktm: Ok thanks. [22:52:49] hashar or legoktm could you merge https://gerrit.wikimedia.org/r/#/c/272765/ please. This patch is different. It adds npm to experimental on apps/* repos only two repos. Ones for android and other for ios. It allows me to test npm on those repos so we can swtich from jslint to npm. [22:52:50] hashar: that's a good idea, for now I'm going to re-cherry pick to beta-puppetmaster to get scap fixed, then I'll split it. [22:57:34] paladox: nice batch ( https://gerrit.wikimedia.org/r/#/c/272902/ ) , too late to do any +2 really [22:57:44] hashar: Oh ok. [22:57:48] paladox: but can follow tomorrow unless someone beat me to it ;} [22:57:58] hashar: Ok. [23:03:21] 10Deployment-Systems, 13Patch-For-Review, 15User-bd808: [l10n] Use Scap in Localisation Update - https://phabricator.wikimedia.org/T72443#2057763 (10greg) [23:03:21] 10scap: [l10n] [scap] Are Scap and LocalisationUpdate actually fighting over l10nupdates? - https://phabricator.wikimedia.org/T72446#2057761 (10greg) 5Open>3Resolved I'm going to close this per @Krinkle's comment. If anyone sees anything to prove otherwise, please reopen. [23:10:30] greg-g since callsigns are now optional in phabricator and when you create repos it now users the name of the repo as the path, Do we still create a callsign or do we allow it to be set as the local path. [23:10:41] 20afterfour: ^^ [23:10:48] Per https://github.com/phacility/phabricator/commit/b63eb09cacf1214fe98e03558336231bd087ead2 [23:10:56] and https://secure.phabricator.com/w/changelog/2016.08/ [23:11:09] Project browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #429: 04FAILURE in 14 min: https://integration.wikimedia.org/ci/job/browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/429/ [23:16:44] RECOVERY - Puppet failure on deployment-tmh01 is OK: OK: Less than 1.00% above the threshold [0.0] [23:27:26] 10Beta-Cluster-Infrastructure: deployment-mediawiki0[12] have outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2057601 (10greg) The beta-scap-eqiad job has been failing since 21:50 UTC today (Feb 23rd): https://integration.wikimedia.org/ci/job/beta-scap-eqiad/ [23:29:26] 10Deployment-Systems, 6Operations: Have fallback communication channel when freenode has problems - https://phabricator.wikimedia.org/T127904#2058062 (10ArielGlenn) p:5Triage>3High [23:30:12] 10Deployment-Systems, 6Operations: Have fallback communication channel when freenode has problems - https://phabricator.wikimedia.org/T127904#2057999 (10ArielGlenn) I slapped deployment-systems on here because people doing deployments will be one of the main users of such a fallback setup. Yeha, that's not ex... [23:31:37] Yippee, build fixed! [23:31:38] Project beta-scap-eqiad build #90864: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90864/ [23:32:05] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-ORES, 6Revision-Scoring-As-A-Service, 13Patch-For-Review: Deploy ORES extension to beta cluster - https://phabricator.wikimedia.org/T127661#2058090 (10thcipriani) [23:32:07] 10Beta-Cluster-Infrastructure: deployment-mediawiki0[12] have outdated mediawiki-config - https://phabricator.wikimedia.org/T127888#2058088 (10thcipriani) 5Open>3Resolved Should be fixed. Had to re-cherry-pick https://gerrit.wikimedia.org/r/#/c/270343/5 :( then run puppet on a few machines. ``` thcipriani@d... [23:32:27] 10Beta-Cluster-Infrastructure, 10scap: beta-scap-eqiad failing with "sudo: /usr/bin/[sync-common|scap-rebuild-cdbs]: command not found" - https://phabricator.wikimedia.org/T127907#2058091 (10greg) [23:32:37] 10Beta-Cluster-Infrastructure, 10scap: beta-scap-eqiad failing with "sudo: /usr/bin/[sync-common|scap-rebuild-cdbs]: command not found" - https://phabricator.wikimedia.org/T127907#2058103 (10greg) p:5Triage>3Unbreak! [23:32:49] oh, of course, now you're fixed.... [23:33:01] * greg-g grumbles [23:33:31] 10Beta-Cluster-Infrastructure, 10scap: beta-scap-eqiad failing with "sudo: /usr/bin/[sync-common|scap-rebuild-cdbs]: command not found" - https://phabricator.wikimedia.org/T127907#2058091 (10greg) 5Open>3Invalid muther ef, the last job worked, no errors like the above [23:33:39] greg-g: sorry :P [23:34:15] thcipriani: :P [23:34:19] thcipriani: it's still not there: http://en.wikipedia.beta.wmflabs.org/wiki/Special:Preferences#mw-prefsection-betafeatures [23:34:20] 10Beta-Cluster-Infrastructure, 10scap: beta-scap-eqiad failing with "sudo: /usr/bin/[sync-common|scap-rebuild-cdbs]: command not found" - https://phabricator.wikimedia.org/T127907#2058091 (10hashar) Was being working on as part of {T127888} :-D [23:34:37] maybe we need to manually resync again? [23:35:47] Amir1_: it's doing another right now [23:36:00] https://integration.wikimedia.org/ci/job/beta-scap-eqiad/90865/console [23:36:03] thanks greg-g :) [23:49:44] 10Deployment-Systems, 6Operations: Have fallback communication channel when freenode has problems - https://phabricator.wikimedia.org/T127904#2058180 (10Krinkle) >>! In T127904#2058053, @greg wrote: > Can't tell if trolling or not ;) But, that's actually not a bad idea. Yep. Despite my trolling earlier, this... [23:49:56] OK. Two resyncs have been finished and it's still not there [23:50:01] legoktm: ^ [23:51:01] I tried clreaing every type of client caching [23:51:28] 10Deployment-Systems, 6Operations: Have fallback communication channel when freenode has problems - https://phabricator.wikimedia.org/T127904#2058182 (10ArielGlenn) Etherpad is public, which might not be cool, a chunk of what we do might want to wind up in a private space. But it could replace _operations tem... [23:52:31] 10Deployment-Systems, 6Operations: Have fallback communication channel when freenode has problems - https://phabricator.wikimedia.org/T127904#2058185 (10greg) >>! In T127904#2058062, @ArielGlenn wrote: > I slapped deployment-systems on here because people doing deployments will be one of the main users of such... [23:54:39] 10Deployment-Systems, 6Operations: Have fallback communication channel when freenode has problems - https://phabricator.wikimedia.org/T127904#2058216 (10greg) >>! In T127904#2058182, @ArielGlenn wrote: > Etherpad is public, which might not be cool, a chunk of what we do might want to wind up in a private space...