[11:21:59] jenkins is failing basically everywhere with "This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.", even though the patches are up-to-date with master, and https://integration.wikimedia.org/zuul/ is empty [11:23:27] * Majavah files an UBN ticket [11:26:34] filed as https://phabricator.wikimedia.org/T279283, no idea why wikibugs is not here [11:30:29] ah I have just seen that and went through my commits in the chain and all of the hashes locally are identical to what's in gerrit, [12:29:24] Majavah: wikibugs disconnected, but hasn't had reason to send anything to the channel yet so hasn't joined. It looks like the phab part wikibugs needs rebooting [13:29:24] oh good. [13:32:23] thcipriani: fyi the main issue for T279283 has been resolved, im investigating a more permenent fix and will lower priority now [13:32:23] T279283: Jenkins failing on all patches, "This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository" - https://phabricator.wikimedia.org/T279283 [13:32:50] jbond42: ah! thanks. I was just watching the merger log and thinking: this looks like it's working... :) [13:33:55] :) fyi this is a tl;dr of the issue https://phabricator.wikimedia.org/T279283#6972162 (which seems like it has a bunch more history so just catching my self up) [13:38:51] jbond42: I still don't get what caused this to be a problem this morning? the remotes for all the zuul repos point to the daemon running at 29418 and we've always had 2 ssh daemons (one being openssh the other being bundled up with gerrit) -- what changed to make this fail today? [13:43:38] thcipriani: im still not 100% sure however i rolled out a change (the change just removed some white spcae) which caused sshd to be restarted, after the restart the issue started. [13:44:52] strange. [13:46:22] thcipriani: yep [14:00:21] jbond42: ha! yes, I *just* realized that the ip6 address was wrong :D [14:01:19] was just finishing my phab comment when I saw your update [14:01:31] thcipriani: :D hehe, yes we override the ipaddress and ipaddress6 facts but not the networking.ip/ip6 ones (as we can't easily if at all) [14:01:46] sending a PS now [14:02:08] <3 [14:07:15] ok, going afk because the dog will be mad if I don't walk him before morning meetings, thanks for the fixes jbond42 ! hashar is out this week so it figures CI would be down when I wake up on Monday :P [14:07:35] lol indeed and no probs [14:23:48] hey, has the issue with CI been resolved by now? I'm still getting the error when updating already existing patches on core.. [14:24:26] I see there was a workaround placed, or did that not happen yet? [14:28:03] Pchelolo: the workaround has been put in place afaik that has resolved the issues seen this morning [14:28:24] jbond42: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/676694 still getting the same error [14:29:15] * jbond42 looking [14:29:43] tried on various patches: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/674993 [14:30:01] seem like just typing recheck on any pre-existing patch causes the error [14:31:49] (03CR) 10Ahmon Dancy: Support default values in variable expressions (031 comment) [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/674689 (owner: 10Dduvall) [14:32:44] ha, seem to have worked when you did it :) [14:33:13] Pchelolo: i had only aplpied the fix to cont1001, have applied to cont2001 as well now :) [14:33:21] please ping me if you still see issues [14:33:39] magic! :) thank you, will do if I see it again [14:33:49] cool and thx [14:47:41] (03CR) 10Daimona Eaytoy: Support @phan annotation and @template in UnusedUseStatementSniff (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/676148 (owner: 10Umherirrender) [14:50:51] fyi im about to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/676933/ which should remove the need for the temporary work around put in place earlier for the zuul issues [14:54:36] \o/ [15:01:13] ok all deployed and checked please ping if you see any issues https://phabricator.wikimedia.org/T279283 [15:01:18] ^^ resolved for now [15:04:49] nice! thanks again jbond42 [15:05:12] no probs and sorry for the interuptions today :) [15:08:31] (03CR) 10Ahmon Dancy: feat! rewrite apply-patches, drop list-patches and test-patches (036 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/674871 (https://phabricator.wikimedia.org/T269153) (owner: 10Lars Wirzenius) [15:23:04] (03PS1) 10Daimona Eaytoy: Micro-optimization for UnusedUseStatementSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/676942 [15:24:05] (03PS3) 10Umherirrender: Support @phan annotation in UnusedUseStatementSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/676148 [15:24:59] (03PS4) 10Umherirrender: Support @phan annotation in UnusedUseStatementSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/676148 [15:25:09] (03CR) 10Umherirrender: "[Missed the rebase locally, redone]" (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/676148 (owner: 10Umherirrender) [15:26:02] (03CR) 10Daimona Eaytoy: [C: 03+1] Support @phan annotation in UnusedUseStatementSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/676148 (owner: 10Umherirrender) [15:29:17] (03CR) 10Umherirrender: [C: 03+1] Micro-optimization for UnusedUseStatementSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/676942 (owner: 10Daimona Eaytoy) [16:55:27] (03PS3) 10Dduvall: Support default values in variable expressions [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/674689 [16:55:52] (03CR) 10Dduvall: Support default values in variable expressions (031 comment) [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/674689 (owner: 10Dduvall) [16:57:10] (03CR) 10Ahmon Dancy: [C: 03+1] Support default values in variable expressions [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/674689 (owner: 10Dduvall) [17:45:25] !log halting gitlab-test for resize [17:45:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:20:01] !log resizing gitlab-ansible-test to g3.cores8.ram16.disk20 [18:20:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:02:36] brennen: Hello! I was wondering what might be needed to get me access to the test instance of gitlab. I'm curious about evaluating features that could be useful for the Toolforge push-to-deploy workflows. I am already in the project in cloud, but I'd rather not get in the way of your testing as well :) [19:03:57] Also, I noticed that gitlab can actually do buildpacks natively https://docs.gitlab.com/ce/topics/autodevops/ (which is basically buildpacks under the covers according to https://buildpacks.io/docs/tools/gitlab/), so I'm curious about the implications of leveraging that feature. [19:05:01] bstorm: hello! so, the quick breakdown: we're currently pretty using that WMCS project as scratch space for the contractors working on prod gitlab setup - they're developing some ansible playbooks and doing some perf testing. [19:05:08] s/pretty/pretty much/ [19:06:18] Fair enough :) [19:07:01] which means they're pointing the public IP at a box for testing ansible stuff at least some of the time, but the other gitlab test instance is still there and you're welcome to use it... if you don't mind some ssh forwarding hijinks i guess you could go that route. [19:07:17] That's all good [19:07:34] I don't plan on doing anything they cannot blow away [19:07:37] one thing we don't have right now is a job runner for that instance. [19:07:46] Good to know [19:07:54] I'm partly curious just about looking around and kicking tires [19:08:15] Also about how configs we are using affects my future planning :) [19:08:29] yeah, please feel free. i can make you an admin there if that would be helpful. [19:08:47] In gitlab itself? yes that probably would [19:09:00] Promise not to mess with things without letting people know :-D [19:09:07] some config stuff is probably still to-be-determined, but i'm happy to answer any questions you've got about what we're planning to do right now... [19:09:40] k, i'll do that once i figure out the aforementioned ssh forwarding hijinks. [19:10:06] ok thank you! [19:32:13] Is there a plan for a nice way to publish both PHP and JS coverage reports for an extension? The two jobs both write to the same path, so… [19:42:35] (03PS1) 10Jforrester: Zuul: [mediawiki/extensions/WikiLambda] Add JS coverage reporting [integration/config] - 10https://gerrit.wikimedia.org/r/677011 [19:42:37] (03PS1) 10Jforrester: jjb: Provide coverage jobs that write to / so both can be used [integration/config] - 10https://gerrit.wikimedia.org/r/677012 [19:42:39] (03PS1) 10Jforrester: Zuul: Provide extension-coverage-php-and-js for those with both and use [integration/config] - 10https://gerrit.wikimedia.org/r/677013 [19:44:09] (03CR) 10jerkins-bot: [V: 04-1] Zuul: Provide extension-coverage-php-and-js for those with both and use [integration/config] - 10https://gerrit.wikimedia.org/r/677013 (owner: 10Jforrester) [19:55:02] (03PS2) 10Jforrester: Zuul: Provide extension-coverage-php-and-js for those with both and use [integration/config] - 10https://gerrit.wikimedia.org/r/677013 [19:57:49] (03CR) 10jerkins-bot: [V: 04-1] Zuul: Provide extension-coverage-php-and-js for those with both and use [integration/config] - 10https://gerrit.wikimedia.org/r/677013 (owner: 10Jforrester) [20:06:05] (03CR) 10Jforrester: "I think this will race-condition over-write/clash with the PHP publish job (same target)…" [integration/config] - 10https://gerrit.wikimedia.org/r/677011 (owner: 10Jforrester) [20:24:32] James_F: that requires having too much foresight that extensions might have both PHP and JS codebases >.> probably renaming them to coverage-php and coverage-js and making the CoveragePage handler in docroot display that nicely [20:25:04] my coverage charter also uses those URLs so please ping me if/when those are renamed [20:38:00] 10Phabricator, 10User-Zabe: Add Zabe to #Triagers - https://phabricator.wikimedia.org/T279012 (10Aklapper) 05Open→03Resolved a:03Aklapper Done :) [21:02:03] legoktm: Subscribe to my patch and find out. :-) [21:37:25] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10SRE, 10GitLab (Initialization), 10User-brennen: SSH Access of Git data in GitLab - https://phabricator.wikimedia.org/T276148 (10Dzahn) https://gerrit.wikimedia.org/r/c/operations/puppet/+/675135 and the entire chain below limited ssh access... [21:39:15] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10SRE, 10GitLab (Initialization), 10User-brennen: SSH Access of Git data in GitLab - https://phabricator.wikimedia.org/T276148 (10Dzahn) > This ticket is to discuss proposed solutions. @thcipriani I think this happened and we know the soluti... [21:39:46] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10SRE, 10GitLab (Initialization), 10User-brennen: SSH Access of Git data in GitLab - https://phabricator.wikimedia.org/T276148 (10Dzahn) 05Stalled→03Open [21:39:54] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10SRE, 10Traffic, 10GitLab (Initialization), and 2 others: open firewall ports on gitlab1001.wikimedia.org (was: Port map of how Gitlab is accessed) - https://phabricator.wikimedia.org/T276144 (10Dzahn) [23:52:08] 10Release-Engineering-Team (Logspam), 10ExtensionDistributor, 10Wikimedia-production-error: TypeError: Cannot read property 'master' of undefined at processAPIResponse - https://phabricator.wikimedia.org/T279392 (10Jdlrobson) [23:54:36] 10Release-Engineering-Team (Logspam), 10Structured Data Engineering, 10Structured-Data-Backlog, 10UploadWizard, and 2 others: TypeError: this.request.abort is not a function at mw.FormDataTransport.prototype.abort - https://phabricator.wikimedia.org/T262471 (10Jdlrobson) [23:56:36] 10Release-Engineering-Team (Logspam), 10Structured-Data-Backlog, 10Wikimedia-production-error: Cannot use 'in' operator to search for 'filemime' in undefined at getMediaFilters - https://phabricator.wikimedia.org/T279393 (10Jdlrobson)