[01:14:43] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10Zache) >>! Masumrezarock100 wrote: >>>! In T234743#5843628, @Xaosflux wrote: >> Note on the screen shot from C... [04:34:51] Any chance I could have the password to https://logstash-beta.wmflabs.org (I'm not a member of deployment prep group. But I do literally have access to real logstash)? [04:35:59] I mostly just want to check that CSP is working as expected on beta [05:29:16] (03PS1) 10Jdlrobson: Publish `npm run doc` for Vector [integration/config] - 10https://gerrit.wikimedia.org/r/569390 (https://phabricator.wikimedia.org/T242674) [08:06:52] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: User rights validation is sometimes malfunctioning (with FlaggedRevs only?) - https://phabricator.wikimedia.org/T234743 (10Ankit-Maity) @DannyS712 could you file a gerrit change to add the right to administrators. This is mildly annoy... [08:11:57] 10Beta-Cluster-Infrastructure, 10Browser-Support-Firefox: en.wikipedia.beta.wmflabs.org not accessible in Firefox, due to something with OCSP - https://phabricator.wikimedia.org/T243881 (10Schnark) I can confirm that that the beta site now is accessible again, and that images from upload.beta are still missing. [08:14:38] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Bawolff) >>! In T240960#5762881, @Krenair wrote: > I wonder if the CSP should contain any prod domains at... [08:17:18] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-09 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:57:13] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-09 is OK: HTTP OK: HTTP/1.1 200 OK - 95197 bytes in 1.434 second response time [08:58:26] 10Continuous-Integration-Infrastructure, 10Operations: Add python3.8 to buster-wikimedia pyall component - https://phabricator.wikimedia.org/T241195 (10Legoktm) [08:59:53] 10Continuous-Integration-Infrastructure, 10Operations: Add python3.8 to buster-wikimedia pyall component - https://phabricator.wikimedia.org/T241195 (10Legoktm) >>! In T241195#5758441, @faidon wrote: > - That said, I don't have any intentions to backport 3.8 to stretch. Seems reasonable. Retitled the task acc... [10:30:04] 10Release-Engineering-Team (Local Dev), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10MW-1.35-notes (1.35.0-wmf.18; 2020-02-04), 10Patch-For-Review, and 2 others: Provide docker-compose based development / CI environment in MediaWiki core - https://phabricator.wikimedia.org/T238224 (10kostajh... [11:23:17] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10Patch-For-Review: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Bawolff) [11:23:20] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10MediaWiki-extensions-CentralAuth, 10Security-Team, and 2 others: Beta Cluster cross-wiki login request would be blocked by CSP - https://phabricator.wikimedia.org/T211539 (10Bawolff) [12:08:12] any gerrit admin around by chance, please? [12:35:19] marxarelli: hi, you online? [13:10:46] any wikitech admins around? there’s a spammer: https://wikitech.wikimedia.org/wiki/Special:Contributions/Badkowski [13:14:46] blocked now [13:15:00] no idea who’d be responsible for cleaning it up, though [13:15:27] oh nevermind, already done as well it seems [14:40:30] (03CR) 10Niedzielski: [C: 03+1] "LGTM!" [integration/config] - 10https://gerrit.wikimedia.org/r/569390 (https://phabricator.wikimedia.org/T242674) (owner: 10Jdlrobson) [15:16:36] 10Phabricator: Remove Phabricator 2FA for awight - https://phabricator.wikimedia.org/T236765 (10Lucas_Werkmeister_WMDE) I have just talked to the real human Adam Wight in the office and can confirm that he created this Phabricator task and wants his token reset :) [15:52:18] 10Release-Engineering-Team, 10Core Platform Team, 10MediaWiki-API, 10CPT Initiatives (API Integration Tests), 10Code-Health: Expose flags for controlling API tests from the siteinfo API module - https://phabricator.wikimedia.org/T243977 (10Anomie) Rather than just one core flag, a whole `siprop` might be... [15:57:51] 10Release-Engineering-Team, 10Core Platform Team, 10MediaWiki-API, 10CPT Initiatives (API Integration Tests), 10Code-Health: Expose flags for controlling API tests from the action API - https://phabricator.wikimedia.org/T243977 (10daniel) [16:00:38] 10Release-Engineering-Team, 10Core Platform Team, 10MediaWiki-API, 10CPT Initiatives (API Integration Tests), 10Code-Health: Expose flags for controlling API tests from the action API - https://phabricator.wikimedia.org/T243977 (10daniel) [16:01:13] 10Release-Engineering-Team, 10Core Platform Team, 10MediaWiki-API, 10CPT Initiatives (API Integration Tests), 10Code-Health: Expose flags for controlling API tests from the action API - https://phabricator.wikimedia.org/T243977 (10daniel) >>! In T243977#5844996, @Anomie wrote: > Rather than just one core... [16:03:12] 10Gerrit: Fix parent project for AControlImageLink.git (gerrit admin needed) - https://phabricator.wikimedia.org/T244142 (10MarcoAurelio) [16:04:31] 10Gerrit: Fix parent project for AControlImageLink.git (gerrit admin needed) - https://phabricator.wikimedia.org/T244142 (10MarcoAurelio) p:05Triage→03Normal [16:13:03] 10Release-Engineering-Team (CI & Testing services), 10Citoid, 10Core Platform Team, 10Release Pipeline: Figure out how to test Citoid with Zotero in the pipeline - https://phabricator.wikimedia.org/T225236 (10thcipriani) I believe this should be possible with the `.pipeline/config.yaml` which allows a bit... [16:13:07] thcipriani: you around? [16:13:13] I need help [16:13:17] if possible [16:14:50] hauskatze: I am around, what's up [16:14:54] ? [16:15:15] thcipriani: would you please be able to help me in T244142 ? [16:15:16] T244142: Fix parent project for AControlImageLink.git (gerrit admin needed) - https://phabricator.wikimedia.org/T244142 [16:15:31] * thcipriani reads [16:15:54] I wrote --paernt instead of --parent when creating the repo [16:15:59] so of course it didn't worked [16:19:04] hauskatze: done, thanks for the patch :) [16:19:23] thcipriani: thanks for helping [16:19:32] * thcipriani doffs cap [16:19:42] Now I can finish with the other steps [16:19:57] (03CR) 10Thcipriani: [V: 03+2 C: 03+2] Set `mediawiki/extensions` as parent project [extensions/AControlImageLink] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/569359 (owner: 10MarcoAurelio) [16:20:18] 10Gerrit: Fix parent project for AControlImageLink.git (gerrit admin needed) - https://phabricator.wikimedia.org/T244142 (10MarcoAurelio) 05Open→03Resolved a:03thcipriani [16:25:39] thcipriani hi, wondering if you could review/merge https://gerrit.wikimedia.org/r/#/c/integration/config/+/566915/ please? :) [16:27:08] (03CR) 10Jforrester: [C: 03+2] Publish `npm run doc` for Vector [integration/config] - 10https://gerrit.wikimedia.org/r/569390 (https://phabricator.wikimedia.org/T242674) (owner: 10Jdlrobson) [16:28:11] (03Merged) 10jenkins-bot: Publish `npm run doc` for Vector [integration/config] - 10https://gerrit.wikimedia.org/r/569390 (https://phabricator.wikimedia.org/T242674) (owner: 10Jdlrobson) [16:28:55] !log Zuul: Publish `npm run doc` for Vector T242674 [16:28:58] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:28:59] T242674: Add storybook to Vector - https://phabricator.wikimedia.org/T242674 [16:43:53] !log Gerrit: replication start mediawiki/extensions/AControlImageLink --wait # new repo [16:43:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:24:04] thcipriani: oh, and if you'd like to handle T243367 and T243472 it'd be awesome; thanks! [17:24:04] T243367: +2 for Edward Chernenko in mediawiki/extensions/CreateRedirect - https://phabricator.wikimedia.org/T243367 [17:24:04] T243472: +2 for Urbanecm on mediawiki/extensions/GrowthExperiments - https://phabricator.wikimedia.org/T243472 [17:47:53] PROBLEM - Parsoid on deployment-parsoid09 is CRITICAL: connect to address 172.16.5.63 and port 8000: Connection refused [17:47:53] PROBLEM - Parsoid on deployment-mediawiki-parsoid10 is CRITICAL: connect to address 172.16.0.141 and port 8000: Connection refused [18:28:41] (03PS1) 10Jforrester: doc: Add link to Vector skin documentation [integration/docroot] - 10https://gerrit.wikimedia.org/r/569588 (https://phabricator.wikimedia.org/T242674) [18:29:01] (03CR) 10Jforrester: [C: 03+2] doc: Add link to Vector skin documentation [integration/docroot] - 10https://gerrit.wikimedia.org/r/569588 (https://phabricator.wikimedia.org/T242674) (owner: 10Jforrester) [18:29:35] (03Merged) 10jenkins-bot: doc: Add link to Vector skin documentation [integration/docroot] - 10https://gerrit.wikimedia.org/r/569588 (https://phabricator.wikimedia.org/T242674) (owner: 10Jforrester) [18:37:34] 10Beta-Cluster-Infrastructure, 10Browser-Support-Firefox: en.wikipedia.beta.wmflabs.org not accessible in Firefox, due to something with OCSP - https://phabricator.wikimedia.org/T243881 (10Kaartic) Yeah, I can confirm that the beta site is now accessible again in my desktop. The issue faced in the commons app... [18:53:52] 10Phabricator, 10Security-Team, 10Security: Make NDA task filing more obvious/prominent - https://phabricator.wikimedia.org/T244156 (10chasemp) p:05Triage→03Normal [19:10:08] Project mediawiki-core-doxygen-docker build #13378: 04FAILURE in 6 min 4 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/13378/ [19:13:57] Does phabricator have cosmetic URL support within itself for projects? Example: DC-ops project is also our landing page on how to get help [19:14:13] would be nice to have something nicer than https://phabricator.wikimedia.org/project/profile/1784/ =] [19:14:30] If it does not, then oh well. [19:18:51] robh: https://phabricator.wikimedia.org/tag/dc-ops/ [19:19:08] well shit that was easy [19:19:12] robh: (Don't ask what the difference between /tag/ and /project/ is, I think there is but…) [19:19:23] I only ask if I really wanna know [19:19:26] :-) [19:19:38] and im pretty sure its due to projects can be retagged or have multiple tags [19:19:43] so makes sense to me in a phabricator way [19:20:05] James_F: thx! [19:20:17] Any time. [19:20:21] i really didnt wanna distribute an ugly url [19:20:26] it bugged me [19:23:43] 10Beta-Cluster-Infrastructure, 10Browser-Support-Firefox: en.wikipedia.beta.wmflabs.org not accessible in Firefox, due to something with OCSP - https://phabricator.wikimedia.org/T243881 (10Krenair) Yep [19:27:47] 10Phabricator, 10Security-Team, 10Security: Make NDA task filing more obvious/prominent - https://phabricator.wikimedia.org/T244156 (10chasemp) Added to https://phabricator.wikimedia.org/project/manage/30/ [19:31:29] 10Phabricator, 10Security-Team, 10Security: Make NDA task filing more obvious/prominent - https://phabricator.wikimedia.org/T244156 (10DannyS712) >>! In T244156#5845671, @chasemp wrote: > Added to https://phabricator.wikimedia.org/project/manage/30/ The form itself is still restricted (presumably to members... [19:31:58] 10Phabricator: Phabricator no shows embed video in webm format - https://phabricator.wikimedia.org/T244162 (10Zoranzoki21) [19:32:51] 10Phabricator, 10Security-Team, 10Security: Make NDA task filing more obvious/prominent - https://phabricator.wikimedia.org/T244156 (10chasemp) >>! In T244156#5845678, @DannyS712 wrote: >>>! In T244156#5845671, @chasemp wrote: >> Added to https://phabricator.wikimedia.org/project/manage/30/ > > The form its... [19:44:17] 10Phabricator: Phabricator no shows embed video in webm format - https://phabricator.wikimedia.org/T244162 (10Aklapper) I neither see Evan as watcher or member of #Phabricator nor a Herald rule that added Evan, hence removing. Please don't subscribe folks without a reason - thanks! [19:48:39] 10Phabricator: Phabricator does not show videos in webm format as embedded - https://phabricator.wikimedia.org/T244162 (10Aklapper) [19:49:07] 10Phabricator: Phabricator does not show videos in webm format as embedded - https://phabricator.wikimedia.org/T244162 (10Zoranzoki21) >>! In T244162#5845773, @Aklapper wrote: > I neither see Evan as watcher or member of #Phabricator nor a Herald rule that added Evan, hence removing. Please don't subscribe folks... [19:49:09] 10Phabricator: Phabricator does not show videos in webm format as embedded - https://phabricator.wikimedia.org/T244162 (10Aklapper) p:05Triage→03Low Thanks for taking the time to report this! In the future, please follow https://www.mediawiki.org/wiki/How_to_report_a_bug and always provide example links. Loo... [19:50:41] 10Phabricator, 10User-Zoranzoki21: Phabricator does not show videos in webm format as embedded - https://phabricator.wikimedia.org/T244162 (10Zoranzoki21) a:03Zoranzoki21 >>! In T244162#5845800, @Aklapper wrote: > Thanks for taking the time to report this! In the future, please follow https://www.mediawiki.o... [19:54:36] 10Phabricator, 10Patch-For-Review, 10User-Zoranzoki21: Phabricator does not show videos in webm format as embedded - https://phabricator.wikimedia.org/T244162 (10Aklapper) >>! In T244162#5845799, @Zoranzoki21 wrote: > I added him as subscriber as he is one of maintainers of Phabricator, and I thinked that he... [19:57:51] 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, 10Quality-and-Test-Engineering-Team (QTE): Upgrade MW core from karma 3.x to 4.x - https://phabricator.wikimedia.org/T222293 (10Jdforrester-WMF) [19:58:18] brennen: o/ [19:58:23] ill spam in here instead of in ops :P [19:58:37] I made this https://performance.wikimedia.org/xhgui/run/compare?base=5e387ade3f3dfaac29a7c19b&head=5e387ad8bb854478657c53db [19:59:12] which is comparing a nothing special page load between mwdebug1001(base) and mwdebug1002(new) on enwiki [19:59:47] there is an execution time difference between them (of course that could be anything) [19:59:53] i'll see if i can reproduce it multiple times [20:00:09] nice [20:00:27] though if anything "new" looks... faster [20:00:54] heh, yeah, rubbish [20:02:04] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10OOUI, 10OOjs, 10Utilities-UnicodeJS, and 2 others: Upgrade karma and related packages to latest version in libraries - https://phabricator.wikimedia.org/T243791 (10Jdforrester-WMF) a:03Jdforrester-WMF [20:02:59] 2 more similar such comparisons, https://performance.wikimedia.org/xhgui/run/compare?base=5e387bd63f3dfaac29a8e350&head=5e387bcebb854478655a36e2 https://performance.wikimedia.org/xhgui/run/compare?base=5e387bdb3f3dfaa629758baf&head=5e387be5bb85447d65bb35f6 but it looks like there is too much going on to notice anything :( [20:04:26] yeah. :\ [20:08:03] TemplateParser::processTemplate is consistently called more on mwdebug1002 comapres with 1001 [20:10:07] Yippee, build fixed! [20:10:07] Project mediawiki-core-doxygen-docker build #13379: 09FIXED in 6 min 3 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/13379/ [20:10:40] like a needle in a haystack [20:12:46] does look like there were some changes to TemplateParser [20:14:35] hmm doesnt look like anything major, just that cache key thingy? [20:15:03] 821d8c8e301d73ea77093689c707af84ebd7ab71 TemplateParser: Change cache key and version cache [20:15:05] 82faff75ee9432b42ff79f2288b6bc83a6d6d491 TemplateParser: Use LightnCandy::prepare() instead eval() [20:15:07] 7c4e9f790a48bedc1c314162a5fd2068faae1cb1 Update zordius/lightncandy v0.23 to v1.2.4 [20:17:35] maybe that `$renderer = LightnCandy::prepare( $code )` call is more expensive than the eval for some reason? [20:17:57] maybe, *looks for hints about that in the profile* [20:18:40] "candy" doesnt appear at all in the profiles i grabbed [20:21:28] on https://grafana.wikimedia.org/d/RIA1lzDZk/application-servers-red-dashboard?panelId=9&fullscreen&orgId=1&from=1579651200000&to=1579823999000&var-datasource=eqiad%20prometheus%2Fops&var-cluster=appserver&var-method=GET what are the "static requests" refering to ? [20:22:18] also not brennen that switching to api you dont see a spike, smells even more like the template thing now [20:22:23] *note [20:22:32] good question. [20:22:38] (03PS1) 10Jforrester: jjb: Provide mediawiki-quibble-apitests-*-docker; drop from main [integration/config] - 10https://gerrit.wikimedia.org/r/569633 (https://phabricator.wikimedia.org/T243975) [20:22:40] (03PS1) 10Jforrester: layout: [mediawiki] Run mediawiki-quibble-apitests-vendor-docker experimentally [integration/config] - 10https://gerrit.wikimedia.org/r/569634 (https://phabricator.wikimedia.org/T243975) [20:22:42] (03PS1) 10Jforrester: layout: [mediawiki] Run mediawiki-quibble-apitests-vendor-docker fully [integration/config] - 10https://gerrit.wikimedia.org/r/569635 (https://phabricator.wikimedia.org/T243975) [20:22:54] is interesting that you see static reqs a little spiky during that window, but i don't know what they are. [20:23:25] yes [20:23:48] (03CR) 10jerkins-bot: [V: 04-1] layout: [mediawiki] Run mediawiki-quibble-apitests-vendor-docker fully [integration/config] - 10https://gerrit.wikimedia.org/r/569635 (https://phabricator.wikimedia.org/T243975) (owner: 10Jforrester) [20:23:49] (maybe just a knock-on effect of overall slowdown?) [20:24:04] I think the fact that api at https://grafana.wikimedia.org/d/RIA1lzDZk/application-servers-red-dashboard?panelId=9&fullscreen&orgId=1&from=1579651200000&to=1579823999000&var-datasource=eqiad%20prometheus%2Fops&var-cluster=api_appserver&var-method=GET&var-code=200 has no spike screams it could be this template thing [20:24:29] yes, could be [20:24:55] yeah, lacking any other leads, i'll flag the template thing on the ticket. [20:25:16] also, RoanKattouw, if you're about, commentary on the plausibility of above would be welcome. [20:25:20] aah yes, the static is just everything non php [20:26:04] Catching up [20:26:39] Yes I made changes to TemplateParser, and the cache key changed because there was a breaking change in the format of what was stored in the cache [20:27:23] Also I meant for that prepare() call to be changed back to eval() [20:27:42] But my revert of the eval->prepare patch was never merged for some reason [20:28:21] No wait it was merged, but on Wednesday [20:28:21] https://gerrit.wikimedia.org/r/c/mediawiki/core/+/565155 [20:28:27] Cherry-picking that might help [20:29:06] +1 for trying that before staring at anything too much more [20:29:14] Or just roll the train and wait for tomorrow's new train to fix it? [20:29:27] or that :P [20:29:34] Roan's original patch rode the previous train, not this one, I thought? [20:29:58] Ah, no, 82faff7 was new in wmf.16. [20:30:42] yup, all in .16 [20:31:43] OK, reasonable assumption that it's at fault. [20:31:43] if we cherry pick it and roll forward and _don't_ see the CPU spike, we know we've found a culprit, probably [20:31:51] Probably. [20:31:54] Seems worth trying. [20:32:12] yeah, i think it'd be better to have that information than not. [20:35:07] brennen: let me know if it works or not :) [20:35:26] i always love a good investigative challenge [20:35:36] will do. :) [20:49:56] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Patch-For-Review: doc1001 permission problems for doc.wikimedia.org deploy - https://phabricator.wikimedia.org/T237707 (10Dzahn) We ran into permission problems again today. The latest attempt to fix is: - stop us... [20:58:01] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Patch-For-Review: doc1001 permission problems for doc.wikimedia.org deploy - https://phabricator.wikimedia.org/T237707 (10Dzahn) So please all deploy with "`sudo -u doc-uploader git -C /srv/docroot/ pull`" and hope... [21:17:28] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10OOUI, 10OOjs, 10Utilities-UnicodeJS, and 3 others: Upgrade karma and related packages to latest version in libraries - https://phabricator.wikimedia.org/T243791 (10Jdforrester-WMF) 05Open→03Resolved [21:25:12] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, 10Google-Code-in-2019, and 3 others: Stop using jsonlint and instead use eslint-plugin-json for the linting - https://phabricator.wikimedia.org/T220036 (10Jdforrester-WMF) [21:28:26] (03CR) 10Daniel Kinzler: [C: 03+1] "would +2 if i could :)" [integration/config] - 10https://gerrit.wikimedia.org/r/569633 (https://phabricator.wikimedia.org/T243975) (owner: 10Jforrester) [21:34:23] (03PS2) 10Jforrester: jjb: Provide mediawiki-quibble-apitests-*-docker; drop from main [integration/config] - 10https://gerrit.wikimedia.org/r/569633 (https://phabricator.wikimedia.org/T242913) [21:34:33] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/569633 (https://phabricator.wikimedia.org/T242913) (owner: 10Jforrester) [21:35:04] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10CPT Initiatives (API Integration Tests), 10Code-Health, and 2 others: Enable API integration tests in CI for MediaWiki core - https://phabricator.wikimedia.org/T236680 (10Jdforrester-WMF) [21:35:39] (03Merged) 10jenkins-bot: jjb: Provide mediawiki-quibble-apitests-*-docker; drop from main [integration/config] - 10https://gerrit.wikimedia.org/r/569633 (https://phabricator.wikimedia.org/T242913) (owner: 10Jforrester) [21:40:06] (03PS2) 10Jforrester: layout: [mediawiki] Run mediawiki-quibble-apitests-vendor-docker experimentally [integration/config] - 10https://gerrit.wikimedia.org/r/569634 (https://phabricator.wikimedia.org/T243975) [21:40:09] (03CR) 10Jforrester: [C: 03+2] layout: [mediawiki] Run mediawiki-quibble-apitests-vendor-docker experimentally [integration/config] - 10https://gerrit.wikimedia.org/r/569634 (https://phabricator.wikimedia.org/T243975) (owner: 10Jforrester) [21:41:06] (03Merged) 10jenkins-bot: layout: [mediawiki] Run mediawiki-quibble-apitests-vendor-docker experimentally [integration/config] - 10https://gerrit.wikimedia.org/r/569634 (https://phabricator.wikimedia.org/T243975) (owner: 10Jforrester) [21:44:09] !log Zuul: [mediawiki] Run mediawiki-quibble-apitests-vendor-docker experimentally T243975 [21:44:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:44:11] T243975: Run API integration tests suite in CI on core repo without extensions - https://phabricator.wikimedia.org/T243975 [22:12:48] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10Patch-For-Review: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Jdforrester-WMF) >>! In T240960#5844011, @Bawolff wrote: >>>! In T240960#5762881, @... [22:12:54] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10serviceops: Add second virtual hard disk to ganeti gerrit test instance - https://phabricator.wikimedia.org/T243983 (10Dzahn) a:03Dzahn [22:13:08] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10Patch-For-Review: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Krenair) >>! In T240960#5844011, @Bawolff wrote: >>>! In T240960#5762881, @Krenair... [22:18:01] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10Patch-For-Review: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Bawolff) I meant, that is the justification for doing it on prod. I assume beta is... [22:24:07] 10Beta-Cluster-Infrastructure, 10ContentSecurityPolicy, 10Maps, 10Patch-For-Review: Beta Cluster points to maps-beta.wmflabs.org instead of maps.wikimedia.org, which CSP blocks - https://phabricator.wikimedia.org/T240960 (10Krenair) Yes, so I think my point stands that our CSP should not contain prod's dom... [22:29:20] (03PS2) 10Jforrester: New email [integration/config] - 10https://gerrit.wikimedia.org/r/569188 (owner: 10Ricordisamoa) [22:29:30] (03CR) 10Jforrester: [C: 03+2] New email [integration/config] - 10https://gerrit.wikimedia.org/r/569188 (owner: 10Ricordisamoa) [22:29:50] (03PS3) 10Jforrester: Zuul: New email address for Ricordisamoa [integration/config] - 10https://gerrit.wikimedia.org/r/569188 (owner: 10Ricordisamoa) [22:29:58] (03CR) 10Jforrester: [C: 03+2] "…" [integration/config] - 10https://gerrit.wikimedia.org/r/569188 (owner: 10Ricordisamoa) [22:31:10] (03Merged) 10jenkins-bot: Zuul: New email address for Ricordisamoa [integration/config] - 10https://gerrit.wikimedia.org/r/569188 (owner: 10Ricordisamoa) [22:32:01] 10Phabricator, 10Security-Team, 10Security: Convert #Security to acl*Security_Task_Access - https://phabricator.wikimedia.org/T244165 (10chasemp) [22:32:05] 10Phabricator, 10Security-Team, 10Privacy: Turn off #privacy workboard - https://phabricator.wikimedia.org/T244161 (10chasemp) [22:32:07] 10Phabricator, 10Security-Team, 10Privacy: Turn off #privacy workboard - https://phabricator.wikimedia.org/T244161 (10chasemp) [22:36:23] !log Zuul: New email address for Ricordisamoa [22:36:24] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:38:11] I sort of fear this #security migration is going to be a little messy :) [22:47:14] (03CR) 10Jforrester: [C: 04-1] Add labs/tools/VideoCutTool (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/569352 (https://phabricator.wikimedia.org/T244079) (owner: 10Gopavasanth) [22:50:19] (03PS3) 10Jforrester: Add labs/tools/VideoCutTool [integration/config] - 10https://gerrit.wikimedia.org/r/569352 (https://phabricator.wikimedia.org/T244079) (owner: 10Gopavasanth) [22:50:54] (03PS4) 10Jforrester: Add labs/tools/VideoCutTool [integration/config] - 10https://gerrit.wikimedia.org/r/569352 (https://phabricator.wikimedia.org/T244079) (owner: 10Gopavasanth) [22:51:36] (03CR) 10Jforrester: [C: 03+2] Add labs/tools/VideoCutTool [integration/config] - 10https://gerrit.wikimedia.org/r/569352 (https://phabricator.wikimedia.org/T244079) (owner: 10Gopavasanth) [22:52:35] (03Merged) 10jenkins-bot: Add labs/tools/VideoCutTool [integration/config] - 10https://gerrit.wikimedia.org/r/569352 (https://phabricator.wikimedia.org/T244079) (owner: 10Gopavasanth) [22:53:22] !log Zuul: Add CI for labs/tools/VideoCutTool T244079 [22:53:24] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:53:25] T244079: Set up continuous integration for VideoCutTool - https://phabricator.wikimedia.org/T244079 [23:01:25] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Operations, 10serviceops: Deploy multi-site plugin to gerrit1001 and gerrit2001 - https://phabricator.wikimedia.org/T217174 (10Dzahn) [23:17:09] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10serviceops: Add second virtual hard disk to ganeti gerrit test instance - https://phabricator.wikimedia.org/T243983 (10Dzahn) The production db in the filesystem is 2GB. ` [db1132:/sr... [23:31:42] 10Phabricator, 10Security-Team, 10Privacy: Turn off #privacy workboard - https://phabricator.wikimedia.org/T244161 (10Krinkle) Once done I'd recommend renaming it without alias to something like `#privacy-archived` and add `#privacy` has alias to .... [23:33:31] hauskatze: doesn't have to be :) [23:33:46] Krinkle: I'm always the pesimistic [23:36:07] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10MediaWiki-Core-Testing, 10Performance-Team, and 3 others: ERROR webdriver: Request failed due to Error: session not created: Chrome version must b... - https://phabricator.wikimedia.org/T234610 [23:41:19] James_F: added new disk to gerrit1002 - rebooted - can't SSH to it - [FAILED] Failed to start ferm firewall configuration. [23:41:22] :p [23:41:34] awww man [23:41:49] Oh dear. [23:41:56] That's… unfortunate. :-) [23:42:20] I guess we should also have added the task "Check we can reboot the test instance without it dying". [23:42:25] so i don't know how that happened but manual changes to ferm ? [23:42:32] indeed [23:44:24] got on it via console with root password [23:45:08] powah [23:45:12] DNS query for 'backup1001.eqiad.wmnet' faa [23:45:14] iled: Network is unreachable [23:45:20] wut [23:54:55] it's because the IP changed and what is in /etc/network/interfaces does not match DNS [23:55:20] the old IP did not get fully removed from config [23:55:56] or not .. ignore that too.. hrmm