[00:00:53] 3Beta-Cluster: Remove beta specific mediawiki roles - https://phabricator.wikimedia.org/T87210#985990 (10yuvipanda) 3NEW [00:25:45] RECOVERY - Puppet failure on deployment-videoscaler01 is OK: OK: Less than 1.00% above the threshold [0.0] [00:30:01] 3pywikibot-core, Continuous-Integration: run pep8 and pep257 for pywikibot/core - https://phabricator.wikimedia.org/T87169#986113 (10jayvdb) @legoktm pointed me towards this as where the mediawiki linter is hardwired into jenkins https://github.com/wikimedia/integration-config/blob/master/jjb/job-templates.yaml#... [01:03:42] PROBLEM - Puppet failure on deployment-jobrunner01 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [01:13:45] RECOVERY - Puppet failure on deployment-jobrunner01 is OK: OK: Less than 1.00% above the threshold [0.0] [01:15:41] 3Beta-Cluster: Migrate beta cluster jobrunner to HAT - https://phabricator.wikimedia.org/T87214#986207 (10yuvipanda) 3NEW [01:17:37] 3Beta-Cluster: Migrate beta cluster jobrunner to HAT - https://phabricator.wikimedia.org/T87214#986221 (10yuvipanda) [01:17:46] 3Beta-Cluster: Migrate beta cluster jobrunner to HAT - https://phabricator.wikimedia.org/T87214#986207 (10yuvipanda) Shouldn't do this until T87003 is done. [01:49:30] 3Release-Engineering, Continuous-Integration: Zuul-cloner forgets to clear workspace - https://phabricator.wikimedia.org/T76304#986276 (10Krinkle) a:3ori [01:54:18] (03PS2) 10Ori.livneh: Reset & clean workspace repo for better hygiene [integration/zuul] - 10https://gerrit.wikimedia.org/r/185686 (https://phabricator.wikimedia.org/T76304) [02:14:36] Project beta-scap-eqiad build #38709: FAILURE in 40 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38709/ [02:24:40] Project beta-scap-eqiad build #38710: STILL FAILING in 42 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38710/ [02:34:58] Yippee, build fixed! [02:34:59] Project beta-scap-eqiad build #38711: FIXED in 1 min 7 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38711/ [02:55:52] PROBLEM - Puppet failure on deployment-mediawiki04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [03:15:52] RECOVERY - Puppet failure on deployment-mediawiki04 is OK: OK: Less than 1.00% above the threshold [0.0] [03:21:52] PROBLEM - Puppet failure on deployment-mediawiki04 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [03:31:57] RECOVERY - Puppet failure on deployment-mediawiki04 is OK: OK: Less than 1.00% above the threshold [0.0] [03:53:43] 3Engineering-Community, pywikibot-core, Phabricator: Projects for outreach programs (FOSS OPW, Google Code-in...) - https://phabricator.wikimedia.org/T1148#986343 (10jayvdb) #pywikibot-core has one person already doing a microtask for Google Summer of Code 2015. Are we going to be part of it; is there a project... [03:54:17] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #489: FAILURE in 43 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/489/ [04:02:44] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #317: FAILURE in 9 min 13 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/317/ [04:27:27] PROBLEM - Puppet failure on deployment-mediawiki01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [04:28:43] PROBLEM - Puppet failure on deployment-fluoride is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [04:31:44] PROBLEM - Puppet failure on deployment-videoscaler01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [04:36:14] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #298: FAILURE in 8 min 32 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/298/ [04:39:15] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce build #263: FAILURE in 47 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce/263/ [04:53:50] 3Phabricator: Phabricator should only notify changes to the "Security" field if it is indeed changed - https://phabricator.wikimedia.org/T87135#986352 (10mmodell) I'm not really sure what could be the cause of this but it's likely an upstream issue. :-/ [04:56:45] RECOVERY - Puppet failure on deployment-videoscaler01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:57:21] RECOVERY - Puppet failure on deployment-mediawiki01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:58:39] RECOVERY - Puppet failure on deployment-fluoride is OK: OK: Less than 1.00% above the threshold [0.0] [06:31:58] Yippee, build fixed! [06:31:58] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #262: FIXED in 37 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/262/ [08:19:24] 3Beta-Cluster, operations: Minimize differences between beta and production - https://phabricator.wikimedia.org/T87220#986422 (10yuvipanda) 3NEW [08:22:06] 3Beta-Cluster: Remove beta specific mediawiki roles - https://phabricator.wikimedia.org/T87210#986429 (10yuvipanda) a:3yuvipanda [08:22:19] 3Beta-Cluster: Remove beta specific mediawiki roles - https://phabricator.wikimedia.org/T87210#985990 (10yuvipanda) [08:22:19] 3Beta-Cluster: Migrate beta cluster jobrunner to HAT - https://phabricator.wikimedia.org/T87214#986432 (10yuvipanda) [08:22:21] 3Beta-Cluster, operations: Unify ::production / ::beta roles for *oid - https://phabricator.wikimedia.org/T86633#986433 (10yuvipanda) [08:22:22] 3Release-Engineering: Rework beta apache config - https://phabricator.wikimedia.org/T1256#986434 (10yuvipanda) [08:22:23] 3Beta-Cluster, operations: Minimize differences between beta and production - https://phabricator.wikimedia.org/T87220#986430 (10yuvipanda) [08:23:27] 3Beta-Cluster, operations: Set 'cluster' salt grain appropriately for all instances in beta cluster - https://phabricator.wikimedia.org/T87199#986436 (10yuvipanda) [08:23:29] 3Beta-Cluster, operations: Minimize differences between beta and production - https://phabricator.wikimedia.org/T87220#986422 (10yuvipanda) [08:25:12] 3Beta-Cluster, operations: Unify ::production / ::beta roles for *oid - https://phabricator.wikimedia.org/T86633#986438 (10yuvipanda) [08:25:14] 3Beta-Cluster, Release-Engineering: Reduce [LOCAL HACK] changes on Beta Cluster to zero - https://phabricator.wikimedia.org/T76392#986439 (10yuvipanda) [08:25:15] 3Beta-Cluster: Remove all ::beta roles in puppet - https://phabricator.wikimedia.org/T86644#986440 (10yuvipanda) [08:25:16] 3Beta-Cluster: deployment-mx is its own puppetmaster - https://phabricator.wikimedia.org/T86575#986441 (10yuvipanda) [08:25:17] 3Beta-Cluster, operations: Minimize differences between beta and production - https://phabricator.wikimedia.org/T87220#986437 (10yuvipanda) [08:28:03] 3Beta-Cluster, operations: Move scap puppet code into a module - https://phabricator.wikimedia.org/T87221#986442 (10yuvipanda) 3NEW [08:28:18] 3Beta-Cluster, operations: Move scap puppet code into a module - https://phabricator.wikimedia.org/T87221#986457 (10yuvipanda) [08:28:20] 3Beta-Cluster, operations: Minimize differences between beta and production - https://phabricator.wikimedia.org/T87220#986456 (10yuvipanda) [08:29:45] 3Beta-Cluster, operations: Move deployment-prep hiera data values into ops/puppet.git repo - https://phabricator.wikimedia.org/T87223#986458 (10yuvipanda) 3NEW [08:30:27] 3Beta-Cluster, operations: Move deployment-prep hiera data values into ops/puppet.git repo - https://phabricator.wikimedia.org/T87223#986458 (10yuvipanda) [08:30:28] 3Beta-Cluster, operations: Minimize differences between beta and production - https://phabricator.wikimedia.org/T87220#986464 (10yuvipanda) [08:34:01] 3Beta-Cluster: Convert puppetmaster sync cronjob to Jenkins job - https://phabricator.wikimedia.org/T73305#986474 (10yuvipanda) Well, what we should instead do is convert the auto updater script to python and send metrics from *that* to graphite and alert based on that with shinken (BUZZWORDBINGOOOO!) :) [08:34:35] Project beta-scap-eqiad build #38747: FAILURE in 39 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38747/ [08:36:05] 3Beta-Cluster, operations: Minimize differences between beta and production (Tracking) - https://phabricator.wikimedia.org/T87220#986475 (10yuvipanda) [08:36:31] 3Beta-Cluster, operations: Minimize differences between beta and production (Tracking) - https://phabricator.wikimedia.org/T87220#986422 (10yuvipanda) [08:44:55] Project beta-scap-eqiad build #38748: STILL FAILING in 54 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38748/ [08:55:00] Yippee, build fixed! [08:55:00] Project beta-scap-eqiad build #38749: FIXED in 1 min 1 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38749/ [08:56:11] 3Quality-Assurance: write up "making sense of Jenkins browser test results" - https://phabricator.wikimedia.org/T87225#986481 (10Spage) 3NEW [09:02:22] 3Phabricator: Change color of #Patch-For-Review project to something more unique - https://phabricator.wikimedia.org/T87226#986489 (10matmarex) 3NEW [10:20:15] (03PS18) 10Adrian Lang: Fix WikibaseJavaScriptApi tests [integration/config] - 10https://gerrit.wikimedia.org/r/180418 (https://phabricator.wikimedia.org/T86176) [10:25:50] (03CR) 10Adrian Lang: "What's the current status of this? Right now we can't really work on WikibaseJavaScriptApi, since all jobs fail on testextension. We can a" [integration/config] - 10https://gerrit.wikimedia.org/r/180418 (https://phabricator.wikimedia.org/T86176) (owner: 10Adrian Lang) [10:53:35] Hello ! [12:37:36] PROBLEM - SSH on deployment-lucid-salt is CRITICAL: Connection refused [14:54:39] Project beta-scap-eqiad build #38785: FAILURE in 44 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38785/ [15:04:35] Project beta-scap-eqiad build #38786: STILL FAILING in 42 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38786/ [15:14:56] Yippee, build fixed! [15:14:56] Project beta-scap-eqiad build #38787: FIXED in 1 min 3 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/38787/ [16:32:06] geeez YuviPanda, I woke up to yuvibugmailspam today :) [16:36:24] greg-g: :) [16:36:45] greg-g: i’ve killed about 50% of the beta module yesterday :) [16:36:56] YuviPanda: bad. [16:37:02] hehe :) [16:37:04] YuviPanda: CQ? [16:37:11] need to kill about 40% more [16:37:13] kart_: yeah [16:37:19] about to go shower [16:37:25] ops offsite! [16:37:44] YuviPanda: nice. Say hi to all mighty OPsens. [16:38:04] greg-g: over the next few days i hope to 1. make the tiny /var not an issue anymore and 2. re-image some of the mw servers [16:38:14] YuviPanda: thanks man, I'll have to catch up to where you were last night soon, I'm ignoring bugmail for the next couple of hours [16:38:21] should have minimal disruption [16:38:23] yay! [16:38:57] greg-g: yeah :) and the videoscaler seems to have never worked? I’ve fixed parts of it yesterday, and put in place more work to fix the rest of it..l. [16:39:07] probably not so much work today, because ops offsite, but tomorrow etc [16:39:21] :) [16:40:08] anyway, off to shower now! I’ll keep you updated on labs goals, etc. (just as a fyi) [16:40:11] later [17:41:16] 3MediaWiki-extensions-WikibaseRepository, Continuous-Integration: Enable the CLDR extension for Wikibase Repo unit tests - https://phabricator.wikimedia.org/T87242#986813 (10daniel) 3NEW [18:14:50] * greg-g goes to an appt, be back after lunch [18:29:39] 3Phabricator, Legalpad: Make mediawiki username searchable - https://phabricator.wikimedia.org/T783#986908 (10mmodell) @qgil: I'm not sure but I will look into it... [18:40:02] 3MediaWiki-extensions-Comments, Continuous-Integration: Merged commit not mirrored to Github - https://phabricator.wikimedia.org/T87248#986942 (10UltrasonicNXT) 3NEW [18:49:56] !log Reconfigure Jenkins default language back to 'en' as it was set to Turkish [18:50:01] Logged the message, Master [19:13:03] 3MediaWiki-Core-Team, Project-Creators, Phabricator, MediaWiki-General-or-Unknown: Allow to search tasks about MediaWiki core and core only (create MediaWiki umbrella project?) - https://phabricator.wikimedia.org/T76942#987051 (10Aklapper) p:5High>3Normal [19:15:12] 3Phabricator, Phabricator.org: Get rid of "Export to Excel" - https://phabricator.wikimedia.org/T257#987063 (10Aklapper) a:5Aklapper>3None [19:24:10] 3Wikidata, MediaWiki-extensions-WikibaseRepository, Continuous-Integration: Enable the CLDR extension for Wikibase Repo unit tests - https://phabricator.wikimedia.org/T87242#987086 (10Lydia_Pintscher) [19:24:22] 3Wikidata, MediaWiki-extensions-WikibaseRepository, Continuous-Integration: Enable the CLDR extension for Wikibase Repo unit tests - https://phabricator.wikimedia.org/T87242#987096 (10Lydia_Pintscher) p:5Triage>3Normal [19:56:45] 3MediaWiki-extensions-Comments, Continuous-Integration: Merged commit not mirrored to Github - https://phabricator.wikimedia.org/T87248#987244 (10MarkTraceur) [20:33:29] (03PS1) 10Legoktm: Whitelist UltrasonicNXT (Adam Carter) [integration/config] - 10https://gerrit.wikimedia.org/r/186019 [20:33:57] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #467: FAILURE in 21 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/467/ [20:42:20] 3Phabricator: Change color of #Patch-For-Review project to something more unique - https://phabricator.wikimedia.org/T87226#987376 (10Aklapper) p:5Triage>3Normal While I'm afraid of special-casing too much stuff, this one might make sense because it indicates "here is something to look at to actually make pr... [20:51:29] (03PS4) 10Krinkle: macro: Factor out 'prepare-qunit-localhost' builder [integration/config] - 10https://gerrit.wikimedia.org/r/185580 [20:59:10] PROBLEM - Puppet failure on deployment-db1 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [21:09:59] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #417: FAILURE in 36 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/417/ [21:17:45] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #290: FAILURE in 1 min 5 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/290/ [21:24:10] RECOVERY - Puppet failure on deployment-db1 is OK: OK: Less than 1.00% above the threshold [0.0] [21:45:13] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #263: FAILURE in 35 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/263/ [22:19:37] 3Phabricator: Delete LikeLifer username - https://phabricator.wikimedia.org/T87092#987613 (10Aklapper) Needs someone with shell access; adding Chase [22:19:42] 3Phabricator: Delete LikeLifer username - https://phabricator.wikimedia.org/T87092#987615 (10Aklapper) p:5Triage>3Normal [22:23:26] 3Code-Review, Wikimedia-General-or-Unknown: Implement a sane code-review process for MediaWiki JS/CSS pages on Wikimedia sites - https://phabricator.wikimedia.org/T71445#987624 (10Krenair) >>! In T71445#968958, @Steinsplitter wrote: >>>! In T71445#968625, @Krenair wrote: >> All currently-on-wiki gadgets/scripts... [22:29:40] 3Phabricator, Wikimedia-Bugzilla: Create a static HTML version of Bugzilla - https://phabricator.wikimedia.org/T85140#987636 (10Dzahn) [22:29:52] 3Phabricator, Wikimedia-Bugzilla: Bugzilla HTML static version and database dump - https://phabricator.wikimedia.org/T1198#987639 (10Dzahn) [22:30:08] 3Wikimedia-Bugzilla, Phabricator, operations, ops-core: Sanitise a Bugzilla database dump - https://phabricator.wikimedia.org/T85141#987640 (10Dzahn) [22:30:57] (03PS5) 10Krinkle: macro: Factor out 'prepare-qunit-localhost' builder [integration/config] - 10https://gerrit.wikimedia.org/r/185580 [22:35:21] 3MediaWiki-Core-Team, MediaWiki-Configuration, Continuous-Integration: Update jenkins for extension registration changes - https://phabricator.wikimedia.org/T86359#987650 (10Legoktm) >>! In T86359#981543, @hashar wrote: > As I understand it, wfLoadExtensions() would end up loading any present extension under /e... [22:44:34] (03PS6) 10Krinkle: macro: Factor out 'prepare-qunit-localhost' builder [integration/config] - 10https://gerrit.wikimedia.org/r/185580 [22:49:23] Krinkle: [22:49:24] colordiff -u <(cat /tmp/master) <(jenkins-jobs test config/jjb mediawiki-core-qunit) [22:49:39] bash stuff :d [23:03:14] (03CR) 10Krinkle: [C: 032] "Deployed. Effectively no-op." [integration/config] - 10https://gerrit.wikimedia.org/r/185580 (owner: 10Krinkle) [23:07:24] 3Phabricator: Enabling Herald - https://phabricator.wikimedia.org/T630#987709 (10Aklapper) p:5Normal>3Low [23:09:57] (03Merged) 10jenkins-bot: macro: Factor out 'prepare-qunit-localhost' builder [integration/config] - 10https://gerrit.wikimedia.org/r/185580 (owner: 10Krinkle) [23:12:35] hashar: https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm/920/console [23:14:33] 3Phabricator: Change color of #Patch-For-Review project to something more unique - https://phabricator.wikimedia.org/T87226#987749 (10chasemp) Make it red? Draws attention. [23:14:53] 3Deployment-Systems: Keep wikitech.wikimedia.org in sync (possibly on delay) with WMF production cluster - https://phabricator.wikimedia.org/T64496#987751 (10Dzahn) please link to the T in phabricator now [23:28:43] 3MediaWiki-Core-Team, Phabricator, Security-Reviews: Install PHPExcel so I can export reports - https://phabricator.wikimedia.org/T152#987780 (10Aklapper) Need input / judgement here from csteipp / Security whether review is definitely required before trying to install this on production (I'd guess so). Upstrea... [23:29:40] 3Phabricator: Improvements to Wikimedia SUL login dialog UI - https://phabricator.wikimedia.org/T542#987792 (10Aklapper) p:5Low>3Volunteer? [23:29:49] 3Continuous-Integration: HHVM Jenkins job throw: Unable to set CoreFileSize to 8589934592: Operation not permitted (1) - https://phabricator.wikimedia.org/T78799#987794 (10Krinkle) Sample ``` 23:11:45 ++ [[ -d /mnt/jenkins-workspace/workspace/mediawiki-extensions-hhvm/src ]] 23:11:45 ++ MW_INSTALL_PATH=/mnt/jen... [23:29:56] 3Phabricator, Wikimedia-Bugzilla: Create a static HTML version of Bugzilla - https://phabricator.wikimedia.org/T85140#987797 (10jayvdb) Currently, attachments are missing from static-bugzilla.wikimedia.org. Sorry if this is already known. As the obsolete attachments were not migrated to Phab, I hope that old-b... [23:32:40] hashar: https://github.com/Krinkle/dotfiles/blob/master/gitconfig#L14-L15 [23:33:08] and for bash: alias gti=git [23:33:09] :D [23:33:38] 3MediaWiki-Core-Team, Phabricator, Security-Reviews: Install PHPExcel so I can export reports - https://phabricator.wikimedia.org/T152#987801 (10Chad) Let's drop the owncloud package. It's completely unrelated and we don't need it. We'd just deploy this via git-deploy or something else sane. [23:33:47] hashar: https://github.com/Krinkle/dotfiles/blob/master/hosts/KrinkleMac/modules/aliases.sh#L11-L16 [23:35:42] hashar: https://github.com/rwos/gti ! [23:37:21] 3Phabricator: Adapting Gadget-BugStatusUpdate.js to Phabricator - https://phabricator.wikimedia.org/T539#987803 (10Aklapper) p:5Normal>3Low > I'm going to try the approach of a JSONP proxy on Wikimedia Labs. @Mattflaschen: If you found some time or made any progress, feel free to share it here. :) [23:39:23] 3Phabricator: Searchable "Reference" custom field - https://phabricator.wikimedia.org/T991#987812 (10Aklapper) p:5Normal>3Low [23:46:29] PROBLEM - Free space - all mounts on deployment-cache-upload02 is CRITICAL: CRITICAL: deployment-prep.deployment-cache-upload02.diskspace._srv_vdb.byte_percentfree.value (<100.00%)