[00:11:39] (03PS1) 10Krinkle: civi-ci: Use BUILD_TAG instead of JOB_NAME + BUILD_ID [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197811 [00:13:43] (03CR) 10Krinkle: [C: 032] civi-ci: Use BUILD_TAG instead of JOB_NAME + BUILD_ID [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197811 (owner: 10Krinkle) [00:14:30] (03Merged) 10jenkins-bot: civi-ci: Use BUILD_TAG instead of JOB_NAME + BUILD_ID [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197811 (owner: 10Krinkle) [00:15:37] (03PS1) 10Awight: Remove unused Civi MySQL support scripts [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197814 [00:16:59] (03CR) 10Krinkle: [C: 032] Remove unused Civi MySQL support scripts [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197814 (owner: 10Awight) [00:17:33] (03Merged) 10jenkins-bot: Remove unused Civi MySQL support scripts [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197814 (owner: 10Awight) [00:21:16] 6Release-Engineering, 6MediaWiki-Core-Team, 6Multimedia, 6Parsoid-Team, and 3 others: Prepare Platform/Ops April 2015 quarterly review presentation - https://phabricator.wikimedia.org/T91803#1130789 (10RobLa-WMF) [00:32:09] (03PS15) 10Awight: Jenkins job builder definition for CRM job [integration/config] - 10https://gerrit.wikimedia.org/r/195063 (https://phabricator.wikimedia.org/T91895) [00:32:11] (03PS1) 10Awight: Run the Civi tests on all subrepo changes [integration/config] - 10https://gerrit.wikimedia.org/r/197816 (https://phabricator.wikimedia.org/T91895) [00:37:27] Anyone feel like a quick CR? https://gerrit.wikimedia.org/r/#/c/197816/ -- This is blocking my work... [00:51:24] (03PS3) 10Krinkle: Drop jslint jobs for fundraising CRM submodules [integration/config] - 10https://gerrit.wikimedia.org/r/196847 (https://phabricator.wikimedia.org/T91895) (owner: 10Awight) [00:51:50] (03CR) 10Krinkle: [C: 032] Drop jslint jobs for fundraising CRM submodules [integration/config] - 10https://gerrit.wikimedia.org/r/196847 (https://phabricator.wikimedia.org/T91895) (owner: 10Awight) [00:52:04] heh, I was just looking at that [00:52:40] (03CR) 10Krinkle: "Deleted wikimedia-fundraising-crm-drupal-jslint and wikimedia-fundraising-crm-civicrm-jslint on the server." [integration/config] - 10https://gerrit.wikimedia.org/r/196847 (https://phabricator.wikimedia.org/T91895) (owner: 10Awight) [00:52:47] (03PS2) 10Krinkle: Run the Civi tests on all subrepo changes [integration/config] - 10https://gerrit.wikimedia.org/r/197816 (https://phabricator.wikimedia.org/T91895) (owner: 10Awight) [00:53:19] (03CR) 10Krinkle: [C: 032] Run the Civi tests on all subrepo changes [integration/config] - 10https://gerrit.wikimedia.org/r/197816 (https://phabricator.wikimedia.org/T91895) (owner: 10Awight) [00:55:49] (03PS1) 10Krinkle: mw-set-env: Use BUILDL_TAG instead of `basename $WORKSPACE` [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197820 [00:55:59] (03PS2) 10Krinkle: mw-set-env: Use BUILD_TAG instead of `basename $WORKSPACE` [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197820 [00:56:22] (03CR) 10Krinkle: [C: 032] mw-set-env: Use BUILD_TAG instead of `basename $WORKSPACE` [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197820 (owner: 10Krinkle) [00:56:58] (03Merged) 10jenkins-bot: Drop jslint jobs for fundraising CRM submodules [integration/config] - 10https://gerrit.wikimedia.org/r/196847 (https://phabricator.wikimedia.org/T91895) (owner: 10Awight) [00:57:01] (03Merged) 10jenkins-bot: Run the Civi tests on all subrepo changes [integration/config] - 10https://gerrit.wikimedia.org/r/197816 (https://phabricator.wikimedia.org/T91895) (owner: 10Awight) [00:57:30] (03Merged) 10jenkins-bot: mw-set-env: Use BUILD_TAG instead of `basename $WORKSPACE` [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197820 (owner: 10Krinkle) [00:57:42] !log Reloading Zuul to deploy Ie1d7bf114b34f9 [00:57:47] Logged the message, Master [01:42:31] 10Beta-Cluster, 10Flow, 5Patch-For-Review: beta-update-databases-eqiad hasn't completed in 22 days because of (?) FlowUpdateRevisionContentLength:version2 - https://phabricator.wikimedia.org/T92906#1130939 (10Jdforrester-WMF) [02:32:55] 10Beta-Cluster, 10Flow, 5Patch-For-Review: beta-update-databases-eqiad hasn't completed in 22 days because of (?) FlowUpdateRevisionContentLength:version2 - https://phabricator.wikimedia.org/T92906#1131004 (10Mattflaschen) p:5High>3Unbreak! [02:41:19] (03PS1) 10Krinkle: Implement mw-install-mysql and mw-teardown-mysql [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197847 (https://phabricator.wikimedia.org/T57788) [02:51:48] (03PS2) 10Krinkle: Implement mw-install-mysql and mw-teardown-mysql [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197847 (https://phabricator.wikimedia.org/T57788) [02:56:16] (03CR) 10Krinkle: [C: 032] Implement mw-install-mysql and mw-teardown-mysql [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197847 (https://phabricator.wikimedia.org/T57788) (owner: 10Krinkle) [02:56:51] (03Merged) 10jenkins-bot: Implement mw-install-mysql and mw-teardown-mysql [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197847 (https://phabricator.wikimedia.org/T57788) (owner: 10Krinkle) [03:44:14] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8.1-internet_explorer-11-sauce build #379: FAILURE in 37 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8.1-internet_explorer-11-sauce/379/ [04:48:17] (03PS1) 10Legoktm: Create generic "bundle-{bundlecommand}" jobs, replace most non-generic ones [integration/config] - 10https://gerrit.wikimedia.org/r/197853 [04:56:12] Yippee, build fixed! [04:56:13] Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #506: FIXED in 3 min 0 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/506/ [05:00:47] (03CR) 10Legoktm: [C: 032] Create generic "bundle-{bundlecommand}" jobs, replace most non-generic ones [integration/config] - 10https://gerrit.wikimedia.org/r/197853 (owner: 10Legoktm) [05:02:04] "integration-jjb-config-diff Please carefully review the XML difference before deploying/merging your change. in 4m 22s" [05:02:05] :D [05:04:30] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #548: FAILURE in 29 min: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/548/ [05:05:20] (03Merged) 10jenkins-bot: Create generic "bundle-{bundlecommand}" jobs, replace most non-generic ones [integration/config] - 10https://gerrit.wikimedia.org/r/197853 (owner: 10Legoktm) [05:06:46] !log deployed https://gerrit.wikimedia.org/r/197853 [05:06:49] Logged the message, Master [05:10:21] (03PS1) 10Legoktm: jenkins job validation, do not submit [ruby/api] - 10https://gerrit.wikimedia.org/r/197855 [05:10:52] (03CR) 10jenkins-bot: [V: 04-1] jenkins job validation, do not submit [ruby/api] - 10https://gerrit.wikimedia.org/r/197855 (owner: 10Legoktm) [05:12:14] (03PS2) 10Legoktm: jenkins job validation, do not submit [ruby/api] - 10https://gerrit.wikimedia.org/r/197855 [05:14:37] (03Abandoned) 10Legoktm: jenkins job validation, do not submit [ruby/api] - 10https://gerrit.wikimedia.org/r/197855 (owner: 10Legoktm) [05:20:36] !log deleting 'mediawiki-ruby-api-bundle-*' 'mediawiki-selenium-bundle-*' 'mwext-*-bundle-*' jobs [05:20:39] Logged the message, Master [05:45:45] (03PS1) 10Legoktm: Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 [05:51:51] (03CR) 10Legoktm: [C: 032] Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 (owner: 10Legoktm) [05:52:47] oops. [05:56:15] (03CR) 10jenkins-bot: [V: 04-1] Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 (owner: 10Legoktm) [05:56:40] (03CR) 10Legoktm: [C: 032] Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 (owner: 10Legoktm) [06:01:09] (03CR) 10jenkins-bot: [V: 04-1] Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 (owner: 10Legoktm) [06:01:27] (03PS2) 10Legoktm: Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 [06:01:28] (03PS1) 10Legoktm: Remove 'mediawiki-selenium-bundle-rspec' reference [integration/config] - 10https://gerrit.wikimedia.org/r/197860 [06:04:22] (03CR) 10Legoktm: [C: 032] Remove 'mediawiki-selenium-bundle-rspec' reference [integration/config] - 10https://gerrit.wikimedia.org/r/197860 (owner: 10Legoktm) [06:04:49] (03CR) 10Legoktm: [C: 032] Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 (owner: 10Legoktm) [06:05:28] (03Merged) 10jenkins-bot: Remove 'mediawiki-selenium-bundle-rspec' reference [integration/config] - 10https://gerrit.wikimedia.org/r/197860 (owner: 10Legoktm) [06:09:20] (03Merged) 10jenkins-bot: Create generic 'bundle17-*' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197858 (owner: 10Legoktm) [06:12:56] 10Continuous-Integration: Replace project-specific "{name}-thing" jobs with generic "thing" ones - https://phabricator.wikimedia.org/T91997#1131058 (10Legoktm) [06:14:02] (03PS1) 10Mattflaschen: Add VisualEditor as dependency for Flow [integration/config] - 10https://gerrit.wikimedia.org/r/197862 (https://phabricator.wikimedia.org/T90764) [06:18:23] !log deployed https://gerrit.wikimedia.org/r/197860 & https://gerrit.wikimedia.org/r/197858 [06:18:25] Logged the message, Master [06:22:59] (03CR) 10Legoktm: [C: 032] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/197862 (https://phabricator.wikimedia.org/T90764) (owner: 10Mattflaschen) [06:27:41] (03Merged) 10jenkins-bot: Add VisualEditor as dependency for Flow [integration/config] - 10https://gerrit.wikimedia.org/r/197862 (https://phabricator.wikimedia.org/T90764) (owner: 10Mattflaschen) [06:33:36] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #524: FAILURE in 14 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/524/ [06:35:36] [km@km-tp jenkins-job-builder]$ ls output | wc -l [06:35:36] 2352 [06:35:44] :D [06:47:40] Yippee, build fixed! [06:47:41] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #374: FIXED in 44 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/374/ [07:28:51] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 5Patch-For-Review: the message Helppage-top-gethelp doesn't appear deployed to the Hebrew Wikipedia - https://phabricator.wikimedia.org/T92823#1131096 (10Nikerabbit) The message is fixed, though I dunno why. I still see many errors in... [07:29:12] almost but not quite ^^ [08:37:13] 10Beta-Cluster, 10Flow, 5Patch-For-Review: beta-update-databases-eqiad hasn't completed in 22 days because of (?) FlowUpdateRevisionContentLength:version2 - https://phabricator.wikimedia.org/T92906#1131157 (10hashar) There is some Flow updater which hammer the parsoid varnish cache with requests such as:... [08:51:20] 10Beta-Cluster, 10MediaWiki-User-preferences, 10MediaWiki-extensions-ContentTranslation, 5ContentTranslation-Release4, 3LE-Sprint-84: CX beta-feature does not stay enabled in http://en.wikipedia.beta.wmflabs.org/ - https://phabricator.wikimedia.org/T92232#1131177 (10Nikerabbit) [10:05:35] zeljkof: yo [10:32:16] (03PS2) 10Hashar: check-voter ignore l10-bot + tests [integration/config] - 10https://gerrit.wikimedia.org/r/197649 [10:32:33] (03CR) 10Hashar: [C: 032] check-voter ignore l10-bot + tests [integration/config] - 10https://gerrit.wikimedia.org/r/197649 (owner: 10Hashar) [10:33:57] (03Merged) 10jenkins-bot: check-voter ignore l10-bot + tests [integration/config] - 10https://gerrit.wikimedia.org/r/197649 (owner: 10Hashar) [10:45:33] 10Continuous-Integration, 6operations, 7Blocked-on-Operations, 3Continuous-Integration-Isolation, and 2 others: Create a Debian package for Zuul - https://phabricator.wikimedia.org/T48552#1131481 (10hashar) 1/1 with Filippo is scheduled for Tuesday 3/24 9:30am CET. [10:58:53] (03PS1) 10Hashar: Set build log rotation on some beta jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197880 [11:00:53] 10Continuous-Integration, 5Patch-For-Review: Write a JJB config tests to ensure all jobs logrotate their build history - https://phabricator.wikimedia.org/T93189#1131506 (10hashar) 3NEW a:3hashar [11:00:59] 10Continuous-Integration: Write a JJB config tests to ensure all jobs logrotate their build history - https://phabricator.wikimedia.org/T93189#1131506 (10hashar) [11:03:51] (03CR) 10Hashar: [C: 032] "Jobs updated." [integration/config] - 10https://gerrit.wikimedia.org/r/197880 (owner: 10Hashar) [11:08:13] (03Merged) 10jenkins-bot: Set build log rotation on some beta jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197880 (owner: 10Hashar) [11:25:05] !log refreshing configuration of all beta* jenkins jobs [11:25:10] Logged the message, Master [11:48:12] 6Release-Engineering, 10MediaWiki-extensions-UploadWizard, 6Multimedia, 7Browser-Tests: Firefogg browser test - https://phabricator.wikimedia.org/T93174#1131585 (10zeljkofilipin) [12:14:04] 6Release-Engineering, 10Ops-Access-Requests, 6Phabricator, 6operations, 5Patch-For-Review: Mukunda needs sudo on iridium (phab host) - https://phabricator.wikimedia.org/T93151#1131619 (10Aklapper) p:5Triage>3Normal [12:15:05] zeljkof: yo [12:15:07] https://gerrit.wikimedia.org/r/#/c/197886/ [12:16:08] aharoni: +2d! :) [12:16:16] thanks [12:16:22] some more on the way :) [12:19:55] aharoni: I am here all day! :) [12:28:29] zeljkof: another little thing: https://gerrit.wikimedia.org/r/#/c/197890/ [12:29:05] aharoni: +2 [12:29:09] funny, I'm ending up committing code to the VE browser tests, and *some* of it is *not* only about language screenshots [12:32:04] aharoni: I have added you to a few rubocop fixes in core, feel free to +1 [12:37:36] PROBLEM - SSH on deployment-lucid-salt is CRITICAL: Connection refused [12:45:17] zeljkof: I am having a WTF moment. [12:45:30] aharoni: what is the problem? [12:45:49] zeljkof: can you try running the scenario on line 35 in language_screenshots.feature? [12:45:57] Scenario: VisualEditor_save_dialog [12:46:43] For me it fails in shared_steps.rb line 51 [12:46:47] page.disabled_save_button_element.when_not_visible(15) [12:46:55] It says "element still visible" [12:47:01] but that element doesn't exist! [12:47:07] how can it be visible if it doesn't exist? [12:47:26] aharoni: sorry, in the middle of something else [12:47:30] It happens to be the same element that I changed in my recent patch, so it's probably related somehow, but the code looks correct. [12:47:33] NP, not urgent. [12:47:37] aharoni: but let me try it quickly [12:47:38] maybe I'll report a bug something. [12:47:55] aharoni: please do report the bug and add me to cc, I will take a look [12:56:01] zeljkof: I think that I resolved it here: https://gerrit.wikimedia.org/r/#/c/197894/ [12:56:17] I mean, the test now passes and the code makes more sense this way in any case. [12:56:27] I still don't understand why did it fail, however. [12:56:56] aharoni: maybe something changed in VE [12:59:43] zeljkof: you are quick with +2s today!!! [12:59:44] thanks a lot [13:14:32] aharoni: the fastest +2 east of atlantic ;) [13:14:46] zeljkof: so here's another one: https://github.com/amire80/screenshot/pull/11/files [13:17:00] zeljkof: or better: https://github.com/amire80/screenshot/pull/11 [13:17:43] aharoni: merged! [13:19:49] <^d> Fasted +2? Dear sir, I believe we shall need to duel! [13:20:04] <^d> Nobody can +2 like me! [13:20:20] <^d> *fastest even [13:21:59] !log refreshed our JJB fork 7ad4386..8928b66 . No difference in our jobs. [13:22:01] Logged the message, Master [13:22:22] zeljkof: and finally, a trivial one: https://gerrit.wikimedia.org/r/#/c/197898/ [13:22:41] USA is waking up :) [13:22:45] hi lubaochuan, ^d [13:23:02] aharoni: east coast only, probably :) [13:23:05] aharoni: +2 [13:23:10] aharoni, Hi. [13:24:40] aharoni, with UniversalLanguageSelector my content translation extension now works. [13:24:48] lubaochuan: excellent! [13:26:01] aharoni, however it doesn't seem to auto save my translations. What do you think is the issue? [13:26:26] lubaochuan: I'll continue in #mediawiki-i18n [13:26:38] OK. [13:27:40] ^d: you should be sleeping / having breakfast! [13:28:17] <^d> I woke up at 5am this morning lol :p [13:28:31] ^d: enough passes at the puppet compiler? [13:28:42] * YuviPanda is on a shaky shitty connection atm [13:28:57] <^d> I haven't touched that again this morning yet [13:29:28] <^d> I'm still stuck on how to figure out the $rack and $row in https://gerrit.wikimedia.org/r/#/c/197533/3/manifests/role/elasticsearch.pp [13:29:46] <^d> Without adding per-host definitions for /every/ host [13:29:54] cool [13:29:58] I can take a look when I’m on less shitty internet in a few hours. [13:30:07] also, asking _joe_ often helps :D [13:30:07] ^d ^ [13:30:20] <^d> Yeah he said yesterday he'd probably give it a review over the weekend [13:30:38] ah cool [13:31:45] <^d> I discovered has_lvs yesterday too, which meant I could move the lvs::realserver bit outside of the production realm check [13:31:52] <^d> For a future day in which staging supports lvs [13:33:08] :) [13:47:08] 10Beta-Cluster, 10MediaWiki-User-preferences, 10MediaWiki-extensions-ContentTranslation, 5ContentTranslation-Release4, 3LE-Sprint-84: CX beta-feature does not stay enabled in http://en.wikipedia.beta.wmflabs.org/ - https://phabricator.wikimedia.org/T92232#1131813 (10Arrbee) This is still a problem. Even... [14:00:10] 10Beta-Cluster, 10RESTBase, 5Patch-For-Review: Update / maintain Beta Cluster restbase cluster - https://phabricator.wikimedia.org/T91102#1131820 (10mobrovac) [14:09:07] !log Further updated our JJB fork to upstream commit 4bf020e07 which version 1.1.0-3 [14:09:10] Logged the message, Master [14:40:18] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate: LocalisationUpdate failed: git pull of extensions failed - https://phabricator.wikimedia.org/T88778#1131934 (10Aklapper) >>! In T88778#1026685, @greg wrote: > Feb 7th, 8th, and 9th all completed successfully. Not sure what happened. Lowering prio... [14:53:28] 10Continuous-Integration, 5Patch-For-Review: Generic phplint job is extremely slow for mediawiki/core - https://phabricator.wikimedia.org/T92042#1131974 (10hashar) This one is solved by disabling submodules isn't it? [14:54:43] anybody rebasing ATM @ deployment-salt.eqiad.wmflabs ? [15:02:05] (03PS1) 10Hashar: Logrotate search* jobs after 15 days [integration/config] - 10https://gerrit.wikimedia.org/r/197908 [15:02:27] (03CR) 10Hashar: [C: 032] Logrotate search* jobs after 15 days [integration/config] - 10https://gerrit.wikimedia.org/r/197908 (owner: 10Hashar) [15:06:58] (03Merged) 10jenkins-bot: Logrotate search* jobs after 15 days [integration/config] - 10https://gerrit.wikimedia.org/r/197908 (owner: 10Hashar) [15:07:28] 10Continuous-Integration, 6operations, 7Blocked-on-Operations, 3Continuous-Integration-Isolation, and 2 others: Create a Debian package for Zuul - https://phabricator.wikimedia.org/T48552#1132011 (10akosiaris) [15:07:48] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 5Patch-For-Review: the message Helppage-top-gethelp doesn't appear deployed to the Hebrew Wikipedia - https://phabricator.wikimedia.org/T92823#1132013 (10greg) >>! In T92823#1131096, @Nikerabbit wrote: > At the end there is: > ``` > Th... [15:11:33] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate: LocalisationUpdate failed: git pull of extensions failed - https://phabricator.wikimedia.org/T88778#1132020 (10greg) 5Open>3declined a:3greg Let's go with magic and/or all of the other l10nupdate changes that happened lately. Please re-open... [15:17:46] (03PS1) 10Hashar: Customize Jenkins top left icon [integration/docroot] - 10https://gerrit.wikimedia.org/r/197910 [15:56:06] 10Continuous-Integration, 5Patch-For-Review: Generic phplint job is extremely slow for mediawiki/core - https://phabricator.wikimedia.org/T92042#1132166 (10Legoktm) 5Open>3Resolved a:3Legoktm Yes, and we created a specific mediawiki-core-phplint job so it has a proper workspace that can be re-used. [16:18:16] 10Beta-Cluster, 6Labs, 10Tool-Labs, 5Patch-For-Review: Private SSL key got removed on tools-webproxy-01/tools-webproxy-02 and maybe other Labs instances as well - https://phabricator.wikimedia.org/T93212#1132260 (10scfc) p:5Triage>3Normal [16:18:31] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 5Patch-For-Review: the message Helppage-top-gethelp doesn't appear deployed to the Hebrew Wikipedia - https://phabricator.wikimedia.org/T92823#1132265 (10bd808) >>! In T92823#1131096, @Nikerabbit wrote: > The message is fixed, though I... [16:23:55] <^d> YuviPanda: Where are we storing the host -> role definitions now? [16:24:00] <^d> In staging/common.yaml? [16:50:04] 10Beta-Cluster, 6Labs, 10Tool-Labs: Private SSL key got removed on tools-webproxy-01/tools-webproxy-02 and maybe other Labs instances as well - https://phabricator.wikimedia.org/T93212#1132375 (10scfc) a:5scfc>3None [16:52:11] ^d: nodes/labs/staging.yaml for roles [16:52:47] ...only 30mins late :) [16:52:55] <^d> Ah ok [16:52:56] <^d> thx [16:54:30] 10Beta-Cluster, 6Labs, 10Tool-Labs: Private SSL key got removed on tools-webproxy-01/tools-webproxy-02 and maybe other Labs instances as well - https://phabricator.wikimedia.org/T93212#1132386 (10scfc) I think I was too optimistic about the filebucket: ``` scfc@tools-webproxy-01:~$ sudo puppet filebucket re... [17:03:52] 6Release-Engineering, 10Wikimedia-Hackathon-2015: Try out hack ( 10Beta-Cluster, 10MediaWiki-User-preferences, 10MediaWiki-extensions-ContentTranslation, 5ContentTranslation-Release4, 3LE-Sprint-84: CX beta-feature does not stay enabled in http://en.wikipedia.beta.wmflabs.org/ - https://phabricator.wikimedia.org/T92232#1132457 (10Nikerabbit) Similar thing is happening... [17:23:39] ^d: thcipriani still much faster than me :) [17:25:11] (03PS1) 10Legoktm: Create zend pipeline to manually trigger slower zend jobs [integration/config] - 10https://gerrit.wikimedia.org/r/197951 [17:28:18] (03PS4) 10AndyRussG: CentralNotice browser tests: even more platforms and browsers [integration/config] - 10https://gerrit.wikimedia.org/r/193556 (https://phabricator.wikimedia.org/T86092) [17:32:29] (03CR) 10AndyRussG: "This PS: just rebased..." [integration/config] - 10https://gerrit.wikimedia.org/r/193556 (https://phabricator.wikimedia.org/T86092) (owner: 10AndyRussG) [17:33:00] <^d> YuviPanda: Now it's all automated :) [17:33:07] <^d> spinning up a new instance is trivial [17:35:19] PROBLEM - Puppet failure on deployment-pdf02 is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [0.0] [17:39:56] (03PS1) 10Krinkle: mw-teardown-mysql: Include mw-teardown.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197956 (https://phabricator.wikimedia.org/T57788) [17:40:05] (03CR) 10Krinkle: [C: 032] mw-teardown-mysql: Include mw-teardown.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197956 (https://phabricator.wikimedia.org/T57788) (owner: 10Krinkle) [17:41:15] (03Merged) 10jenkins-bot: mw-teardown-mysql: Include mw-teardown.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/197956 (https://phabricator.wikimedia.org/T57788) (owner: 10Krinkle) [17:41:40] ^d: yeah, totally :) that’s the idea [17:42:01] ^d: so you technically never have to use that wikitech checkbox interface againn [17:43:20] (03PS1) 10Krinkle: [WIP] Convert MediaWiki jobs from sqlite to mysql [integration/config] - 10https://gerrit.wikimedia.org/r/197958 [17:58:21] :) [18:06:25] Krinkle: &&& Exciting. [18:14:01] (03PS1) 10AndyRussG: BrowserTests: support iphone [integration/config] - 10https://gerrit.wikimedia.org/r/197967 [18:18:59] PROBLEM - Puppet failure on deployment-kafka02 is CRITICAL: CRITICAL: 14.29% of data above the critical threshold [0.0] [18:22:38] PROBLEM - Puppet failure on deployment-logstash1 is CRITICAL: CRITICAL: 88.89% of data above the critical threshold [0.0] [18:23:05] PROBLEM - Puppet failure on deployment-parsoid01-test is CRITICAL: CRITICAL: 25.00% of data above the critical threshold [0.0] [18:23:55] PROBLEM - Puppet failure on deployment-cxserver03 is CRITICAL: CRITICAL: 75.00% of data above the critical threshold [0.0] [18:25:17] PROBLEM - Puppet failure on deployment-parsoidcache02 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [18:27:01] 6Release-Engineering, 10Ops-Access-Requests, 6Phabricator, 6operations, 5Patch-For-Review: Mukunda needs sudo on iridium (phab host) - https://phabricator.wikimedia.org/T93151#1132820 (10RobH) a:3mmodell @mmodell, Please read and sign https://phabricator.wikimedia.org/L3. This is now required for any... [18:28:16] Damn it. It's too fast. I can't debug it without a 'sleep' command, unlike the old sqlite builds [18:28:17] James_F: :P [18:28:47] PROBLEM - Puppet failure on deployment-sca01 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [18:28:52] It takes only 15 seconds to run the entire qunit build instead of 1-2 minutes [18:30:38] :DD [18:32:44] Krinkle: That sounds terrible. ;-) [18:32:49] Krinkle: (Does it actually work?) [18:33:08] Yeah, the guts of it works. [18:33:11] https://integration.wikimedia.org/ci/job/krinkle-mwcore-mysql-qunit/5/console [18:33:38] Though there's a weird jenkins exception before/after, and when inspecting the database, the db user grant is never done. [18:33:50] (03PS2) 10AndyRussG: BrowserTests: support iphone [integration/config] - 10https://gerrit.wikimedia.org/r/197967 (https://phabricator.wikimedia.org/T86092) [18:33:51] So it's probably falling back inside mediawiki and doing something to work around that [18:37:18] Krinkle: So… how? [18:37:39] I'm doing it manually now to see what it does. Won't be long :) [18:37:44] * James_F grins. [18:37:47] stepping through [18:40:45] (03PS5) 10AndyRussG: CentralNotice browser tests: even more platforms and browsers [integration/config] - 10https://gerrit.wikimedia.org/r/193556 (https://phabricator.wikimedia.org/T86092) [18:42:22] 10Continuous-Integration, 10Wikimedia-Fundraising-CiviCRM: Make Civi CI job run on civicrm, drupal, and vendor (DonationInterface and SmashPig) repos - https://phabricator.wikimedia.org/T91905#1132894 (10awight) [18:42:31] (03CR) 10AndyRussG: CentralNotice browser tests: even more platforms and browsers (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/193556 (https://phabricator.wikimedia.org/T86092) (owner: 10AndyRussG) [18:42:53] Krinkle: if you are thinking of deploying any CI changes today, can you bring in this one? https://gerrit.wikimedia.org/r/#/c/197226/ [18:43:02] 10Continuous-Integration, 10Wikimedia-Fundraising-CiviCRM: CI for Civi: provision and run tests under Jenkins/Zuul - https://phabricator.wikimedia.org/T86103#1132899 (10awight) [18:43:03] 10Continuous-Integration, 10Wikimedia-Fundraising-CiviCRM: Make Civi CI job run on civicrm, drupal, and vendor (DonationInterface and SmashPig) repos - https://phabricator.wikimedia.org/T91905#1132897 (10awight) 5Open>3Resolved Confirmed that the job runs on all subrepos, and the correct change is cloned i... [18:43:08] (lower priority) [18:43:23] (03CR) 10AndyRussG: "Separated out the addition of iPhone support: Ifc5e52adb16e132927d285783e4d80eb9bbf8134" [integration/config] - 10https://gerrit.wikimedia.org/r/193556 (https://phabricator.wikimedia.org/T86092) (owner: 10AndyRussG) [18:43:26] greg-g: OK. I'll roll it out in a few hours after the mysql experiment [18:44:04] RECOVERY - Puppet failure on deployment-kafka02 is OK: OK: Less than 1.00% above the threshold [0.0] [18:45:59] Krinkle: ty [18:49:33] 10Continuous-Integration, 10Wikimedia-Fundraising-CiviCRM, 3Fundraising Sprint Grandmaster Flash: Make Civi CI job run on civicrm, drupal, and vendor (DonationInterface and SmashPig) repos - https://phabricator.wikimedia.org/T91905#1132934 (10awight) [18:49:41] 10Continuous-Integration, 10Wikimedia-Fundraising-CiviCRM, 3Fundraising Sprint Grandmaster Flash: Make Civi CI job run on civicrm, drupal, and vendor (DonationInterface and SmashPig) repos - https://phabricator.wikimedia.org/T91905#1098495 (10awight) [18:50:18] 10Continuous-Integration, 10Wikimedia-Fundraising-CiviCRM: CI for Civi: provision and run tests under Jenkins/Zuul - https://phabricator.wikimedia.org/T86103#1132937 (10awight) [18:50:19] 6Release-Engineering, 10Fundraising Tech Backlog, 6Scrum-of-Scrums, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Continuous integration - CiviCRM - https://phabricator.wikimedia.org/T78100#1132938 (10awight) [18:50:20] 10Continuous-Integration, 6Release-Engineering, 10Fundraising Tech Backlog, 10Wikimedia-Fundraising-CiviCRM, and 3 others: Deploy CiviCRM integration job to WMF integration server - https://phabricator.wikimedia.org/T86374#1132936 (10awight) 5Open>3Resolved [18:52:40] (03PS1) 10Dduvall: Fallback to default environment configuration [selenium] - 10https://gerrit.wikimedia.org/r/197980 [18:54:52] Yippee, build fixed! [18:54:53] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8.1-internet_explorer-11-sauce build #380: FIXED in 47 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8.1-internet_explorer-11-sauce/380/ [18:57:00] (03CR) 10Krinkle: [C: 031] Beta timing out jobs now abort + 45 mins for db update [integration/config] - 10https://gerrit.wikimedia.org/r/197226 (https://phabricator.wikimedia.org/T92906) (owner: 10Greg Grossmeier) [19:24:44] 6Release-Engineering, 10Ops-Access-Requests, 6Phabricator, 6operations, 5Patch-For-Review: Mukunda needs sudo on iridium (phab host) - https://phabricator.wikimedia.org/T93151#1133088 (10mmodell) signed. [20:17:34] 10Deployment-Systems, 6Release-Engineering, 6operations, 5Patch-For-Review: /usr/local/bin/deploy2graphite broken on tin due to nc command syntax - https://phabricator.wikimedia.org/T1387#1133205 (10greg) [20:28:09] (03CR) 10Hashar: [C: 031] "Fine to me and an excellent idea. You might want to update the README.md doc to mention the newly introduced 'default'" [selenium] - 10https://gerrit.wikimedia.org/r/197980 (owner: 10Dduvall) [20:30:52] 10Continuous-Integration, 6translatewiki.net, 5Patch-For-Review: l10n-bot self-force-merging sometimes breaks mediawiki/core master - https://phabricator.wikimedia.org/T91707#1094080 (10hashar) @Raymond it seems the wednesday run used CR+2 and got changes merged via successful tests. Is there anything else... [20:36:19] (03PS2) 10Dduvall: Fallback to default environment configuration [selenium] - 10https://gerrit.wikimedia.org/r/197980 [20:37:33] (03CR) 10Dduvall: "Done. Also snuck in some changes to the yard config to include all of the extra documentation." [selenium] - 10https://gerrit.wikimedia.org/r/197980 (owner: 10Dduvall) [20:47:27] !log Jenkins: depooled/repooled lanthanum slave, it was no more processing any jobs. [20:55:26] (03PS1) 10Legoktm: Add more extension jobs! [integration/config] - 10https://gerrit.wikimedia.org/r/198086 [20:59:11] (03CR) 10Hashar: [C: 032] "\o/" (032 comments) [selenium] - 10https://gerrit.wikimedia.org/r/197980 (owner: 10Dduvall) [20:59:36] (03Merged) 10jenkins-bot: Fallback to default environment configuration [selenium] - 10https://gerrit.wikimedia.org/r/197980 (owner: 10Dduvall) [20:59:43] hashar: whoops. i was just going to push a change to that :) [20:59:55] oh no [21:00:10] marxarelli: sorry for being so quick [21:00:28] no worries. i missed your point about the section in README [21:00:41] since I mostly nitpicked about doc, I thought I should +2 the follow up asap :) [21:02:42] hashar: just fyi, I'm not going to install JJB/etc to deploy that timeout change, so timo said he'd do it later :) [21:04:28] hashar: fixed up that section on configuration with an example https://gerrit.wikimedia.org/r/#/c/198087/ [21:06:27] greg-g: yeah that fall under my radar sorry [21:06:46] also sorry team for not attending the health check. Net went down and I had only the shitty smartphone connections [21:07:02] good news: dsl went down because some techs were busy installing optical fiber in my building !!!! [21:08:35] (03CR) 10Hashar: [C: 032] "That is the point I reported in parent change. I have approved it too fast :) Thanks Dan!" [selenium] - 10https://gerrit.wikimedia.org/r/198087 (owner: 10Dduvall) [21:08:40] marxarelli: that looks professional ! [21:09:02] (03Merged) 10jenkins-bot: Improve README section on running with env name [selenium] - 10https://gerrit.wikimedia.org/r/198087 (owner: 10Dduvall) [21:09:41] (03PS3) 10Hashar: Beta timing out jobs now abort + 45 mins for db update [integration/config] - 10https://gerrit.wikimedia.org/r/197226 (https://phabricator.wikimedia.org/T92906) (owner: 10Greg Grossmeier) [21:10:21] hashar: thanks for the -1 on docs! it's really important they be clear [21:11:57] (03CR) 10Hashar: [C: 032] "I have refreshed the beta* jobs." [integration/config] - 10https://gerrit.wikimedia.org/r/197226 (https://phabricator.wikimedia.org/T92906) (owner: 10Greg Grossmeier) [21:12:06] greg-g: merged and deployed :) [21:12:48] marxarelli: you can also get in touch with S Page. He wrote browser tests iirc and is now the doc lead :) [21:13:32] marxarelli: talking to S is a pretty good idea [21:15:07] good idea. once we reach critical mass on porting repos to mw-selenium 1.0, we really need to go through the docs on mw.org and make sure they're up to date [21:17:20] marxarelli: I've taken a few passes through the browser test docs in recent times, they should be in pretty good shape. [21:17:27] hashar: that wasn't the health check, it was the "q4 pre-planning planning meeting with bd808 and rob.la" ;) [21:17:31] and we've sent volunteers there who came back alive [21:21:00] greg-g: oh man :-( I havent even read the etherpad yet grblblbl [21:21:07] chrismcmahon: that's good :) [21:21:20] chrismcmahon: btw, are we still pairing @ 2:30? [21:21:22] !log disable/enable gearman in jenkins [21:22:23] marxarelli: nah, I don't have anything useful to say [21:22:42] chrismcmahon: alrighty [21:23:10] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #474: FAILURE in 1 min 22 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/474/ [21:23:24] (03Merged) 10jenkins-bot: Beta timing out jobs now abort + 45 mins for db update [integration/config] - 10https://gerrit.wikimedia.org/r/197226 (https://phabricator.wikimedia.org/T92906) (owner: 10Greg Grossmeier) [21:24:29] (03PS2) 10Legoktm: Add more extension jobs! [integration/config] - 10https://gerrit.wikimedia.org/r/198086 [21:24:34] (03CR) 10Legoktm: [C: 032] Add more extension jobs! [integration/config] - 10https://gerrit.wikimedia.org/r/198086 (owner: 10Legoktm) [21:25:23] greg-g: I have added an entry: * First pass at implementing [https://phabricator.wikimedia.org/T1350 RFC: Extensions continuous integration]. [21:26:04] greg-g: which is running PHPUnit against a set of extensions (mobile ones + other) [21:27:16] hashar: yep, thanks! [21:27:30] * greg-g just added the set of 'em (at least from that one commit on the task) [21:28:43] greg-g: oh and I reached Filippo today, we have a 1/1 next Tuesday. Alexandros pushed a bunch of .deb packages today :) [21:28:49] yay! [21:29:16] (03Merged) 10jenkins-bot: Add more extension jobs! [integration/config] - 10https://gerrit.wikimedia.org/r/198086 (owner: 10Legoktm) [21:30:21] !log deployed https://gerrit.wikimedia.org/r/198086 [21:31:12] (03PS3) 10Hashar: BrowserTests: support iphone [integration/config] - 10https://gerrit.wikimedia.org/r/197967 (https://phabricator.wikimedia.org/T86092) (owner: 10AndyRussG) [21:31:53] (03CR) 10Hashar: [C: 032] "SauceLabs does support iPhone 8.1. I haven't updated the jobs since none are using the iphone yet :)" [integration/config] - 10https://gerrit.wikimedia.org/r/197967 (https://phabricator.wikimedia.org/T86092) (owner: 10AndyRussG) [21:36:37] (03Merged) 10jenkins-bot: BrowserTests: support iphone [integration/config] - 10https://gerrit.wikimedia.org/r/197967 (https://phabricator.wikimedia.org/T86092) (owner: 10AndyRussG) [21:44:15] (03PS2) 10Krinkle: Set up npm-test for mediawiki/extensions/Buggy [integration/config] - 10https://gerrit.wikimedia.org/r/197660 [21:44:28] (03CR) 10Krinkle: [C: 032] Set up npm-test for mediawiki/extensions/Buggy [integration/config] - 10https://gerrit.wikimedia.org/r/197660 (owner: 10Krinkle) [21:45:07] (03PS2) 10Krinkle: Convert MediaWiki jobs from sqlite to mysql [integration/config] - 10https://gerrit.wikimedia.org/r/197958 (https://phabricator.wikimedia.org/T57788) [21:45:27] (03PS3) 10Krinkle: Convert MediaWiki jobs from sqlite to mysql [integration/config] - 10https://gerrit.wikimedia.org/r/197958 (https://phabricator.wikimedia.org/T57788) [21:45:33] !!! [21:45:36] (03Merged) 10jenkins-bot: Set up npm-test for mediawiki/extensions/Buggy [integration/config] - 10https://gerrit.wikimedia.org/r/197660 (owner: 10Krinkle) [21:46:13] 10Beta-Cluster, 10Flow, 5Patch-For-Review: beta-update-databases-eqiad hasn't completed in 22 days because of (?) FlowUpdateRevisionContentLength:version2 - https://phabricator.wikimedia.org/T92906#1133466 (10greg) >>! In T92906#1133382, @gerritbot wrote: > Change 197226 merged by jenkins-bot: > Beta timing... [21:46:24] I am off time to sleep a little bit [21:46:43] hashar: g'night! [21:47:01] greg-g: and you can trigger https://integration.wikimedia.org/ci/view/Beta/job/beta-update-databases-eqiad/ manually [21:47:05] !log Reloading Zuul to deploy I6654b3a35818 [21:47:19] just login with your 'wmf' labs account and it rebuild :) [21:47:27] or [Build Now] [21:47:42] or yeah wait [21:48:35] I'm just going to wait it out :) [21:50:46] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenkins jobs for OAuthAuthentication - https://phabricator.wikimedia.org/T93274#1133514 (10hashar) a:5hashar>3None [21:50:59] 10Continuous-Integration, 10MediaWiki-extensions-OpenID-Connect: Add Jenkins jobs for OpenIDConnect - https://phabricator.wikimedia.org/T93275#1133518 (10hashar) a:5hashar>3None [21:51:45] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenkins jobs for VirtualKeyboard - https://phabricator.wikimedia.org/T93277#1133529 (10hashar) a:5hashar>3None [21:52:34] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenkins jobs for SemanticMetaTags - https://phabricator.wikimedia.org/T93276#1133556 (10hashar) a:5hashar>3None [21:54:25] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenskins for GitHub - https://phabricator.wikimedia.org/T93281#1133575 (10hashar) a:5hashar>3Legoktm [21:54:37] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenskins for GitHub - https://phabricator.wikimedia.org/T93281#1133579 (10hashar) 5Open>3Resolved Solved by https://gerrit.wikimedia.org/r/#/c/198086/2/jjb/mediawiki-extensions.yaml,unified [21:55:35] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenkins for DebugMode - https://phabricator.wikimedia.org/T93280#1133590 (10hashar) a:5hashar>3Legoktm [21:55:47] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenkins for DebugMode - https://phabricator.wikimedia.org/T93280#1133594 (10hashar) 5Open>3Resolved Solved via https://gerrit.wikimedia.org/r/#/c/198086/2/jjb/mediawiki-extensions.yaml,unified [21:56:44] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenkins for ContributionsList - https://phabricator.wikimedia.org/T93278#1133596 (10hashar) a:5hashar>3Legoktm [21:56:49] "off to sleep" yeah right [21:56:54] 10Continuous-Integration, 10MediaWiki-extensions-General-or-Unknown: Add Jenkins for ContributionsList - https://phabricator.wikimedia.org/T93278#1133600 (10hashar) 5Open>3Resolved Solved by https://gerrit.wikimedia.org/r/#/c/198086/2/jjb/mediawiki-extensions.yaml,unified [22:02:25] twentyafterfour: someone is adding Github support to Zuul! https://review.openstack.org/#/c/163117/ [22:02:43] in theory Zuul should then be able to act on pull requests [22:04:05] sleeep time [22:24:30] What's the over/under on l10nupdate actually working tonight? I'd really like to declare victory on that damn thing soon. [22:28:26] Hm.. GitHub for Zuul seems redundant. Might as well use Travis CI to set up anything you need. Unless using private repositories. If it's public, you wouldn't trust the input anyway and litlte advantage [22:37:21] bd808: When is the next l10n update? [22:37:28] bd808: I assume you mean l10nbot selfmerging? [22:37:30] 03:00Z [22:37:55] no, the l10nupdate cron on tin that pulls HEAD messages into the cdbs [22:38:08] oh [22:38:21] it has been broken since Decemnber [22:38:28] and we keep almost fixing it [22:38:34] * bd808 crosses fingers [22:39:38] first scap changes broke it, then core file reorgs broke it, then www-data security fixes broke it [22:40:00] the config change for the www-data change was synced this morning [22:48:18] 10Deployment-Systems, 6Release-Engineering, 6operations, 5Patch-For-Review: /usr/local/bin/deploy2graphite broken on tin due to nc command syntax - https://phabricator.wikimedia.org/T1387#1133775 (10bd808) >>! In T1387#1095974, @bd808 wrote: > I would guess that the file was renamed in Puppet and no ensure... [22:57:21] 10Beta-Cluster, 10Flow, 5Patch-For-Review: beta-update-databases-eqiad hasn't completed in 22 days because of (?) FlowUpdateRevisionContentLength:version2 - https://phabricator.wikimedia.org/T92906#1133832 (10greg) https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/8314/label=deployment-bas... [23:15:13] (03PS1) 10Krinkle: Clean up mw scripts [integration/jenkins] - 10https://gerrit.wikimedia.org/r/198137 (https://phabricator.wikimedia.org/T69163) [23:15:51] bd808: Hm.. is it being tested in beta or in prod? [23:16:00] bd808: If it's been down for that long, I wouldn't trust it running in prod directly. [23:16:06] could do anything [23:16:15] heh. it will run in prod [23:16:28] it has tried to run every night for months [23:16:42] just with various failures [23:17:05] We don't even have it setup in beta :( [23:17:35] 6Release-Engineering, 10Wikimedia-Hackathon-2015, 10Wikipedia-App-Android-App: Create end-to-end test for Wikipedia Android app - https://phabricator.wikimedia.org/T90177#1133937 (10Etonkovidova) The question came from iOS App team: Do we have the similar ticket for iOS App? Or iOS App test automation is alr... [23:17:39] although testing it in beta would require some specific test setup other than the beta servers [23:18:18] 10Continuous-Integration: Remove pywiki* and integration* from 'mediawiki' gate queue. - https://phabricator.wikimedia.org/T93304#1133946 (10Krinkle) [23:18:34] it is a process that uses the LocalisationUpdate extension to backport the latest l10n messages into the cdb files that are used on the cluster [23:18:50] bd808: Yeah, it won't do much in beta, but just having it run seems useful [23:19:20] In beta this doesn't make an sense/difference as we are always running HEAD [23:19:31] bd808: Yeah, but we also run update.php when there are no changes. [23:19:44] *nod* it would be nice to set up the job at some point [23:19:50] Aside from the convenience of auot-updating the db for when there are changes, it is also to test that the script isn't broken. [23:20:09] I assume most of these failures would happen even if the cdb was already up to date. [23:20:15] E.g. it would fail to parse json or whatever it's issue was [23:20:23] and we'd know :) and can test it there first. [23:20:33] yeah. It was like a perfect storm of brokenness [23:21:04] I hope that Nike.rabbit, T.im and I have tracked down all the bits now [23:21:46] (03CR) 10Krinkle: "Deployed mediawiki-core-qunit." [integration/config] - 10https://gerrit.wikimedia.org/r/197958 (https://phabricator.wikimedia.org/T57788) (owner: 10Krinkle) [23:22:30] 2 broken parts were caused by prod config changes, one by code being re-arranged in core. and then errors were being masked by something in the maintenance script as well [23:23:10] Plus the error in unit tests [23:23:29] What would be really nifty would be to make some way to validate the prod l10n cdbs vs translatewiki [23:23:49] LocalisationCheckUpdate [23:24:19] is that a thing? [23:24:57] No, just kidding [23:25:13] How could the checker be more reliable than the checked? [23:27:20] well, just a spot check of the messages on wiki based on a sample of the prior day's translatewiki changes would act as a canary for problems [23:27:35] that might not be too hard to rig up actually [23:28:35] * bd808 is going to make a "wouldn't it be cool" task for that [23:30:40] 10Continuous-Integration, 10OOjs-UI: OOjs UI's PHP docs should be auto-generated - https://phabricator.wikimedia.org/T74454#1134002 (10Jdforrester-WMF) [23:35:34] 6Release-Engineering, 6Language-Engineering: Spot check on-wiki messages against prior day's translatewiki updates - https://phabricator.wikimedia.org/T93308#1134012 (10bd808) 3NEW [23:37:37] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 5Patch-For-Review: the message Helppage-top-gethelp doesn't appear deployed to the Hebrew Wikipedia - https://phabricator.wikimedia.org/T92823#1134026 (10bd808) [23:37:38] 6Release-Engineering, 6Language-Engineering: Spot check on-wiki messages against prior day's translatewiki updates - https://phabricator.wikimedia.org/T93308#1134025 (10bd808) [23:55:28] (03PS1) 10Legoktm: Make some extension jobs non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/198154 [23:56:32] (03CR) 10Legoktm: [C: 032] Make some extension jobs non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/198154 (owner: 10Legoktm) [23:57:41] (03Merged) 10jenkins-bot: Make some extension jobs non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/198154 (owner: 10Legoktm) [23:58:29] (03CR) 10Krinkle: [C: 032] Clean up mw scripts [integration/jenkins] - 10https://gerrit.wikimedia.org/r/198137 (https://phabricator.wikimedia.org/T69163) (owner: 10Krinkle) [23:59:00] (03Merged) 10jenkins-bot: Clean up mw scripts [integration/jenkins] - 10https://gerrit.wikimedia.org/r/198137 (https://phabricator.wikimedia.org/T69163) (owner: 10Krinkle) [23:59:15] !log deployed https://gerrit.wikimedia.org/r/198154 [23:59:20] Logged the message, Master