[00:01:32] Yay thanks! [00:02:09] I'm AFK now but I'll recheck my other patch when I'm back [00:14:03] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T206655 (10mmodell) [02:49:08] 10Project-Admins: Create an #OSM tag to identify tasks with OpenStreetMap relevance - https://phabricator.wikimedia.org/T207017 (10Yurik) Agree. [04:28:09] 10Beta-Cluster-Infrastructure: Requesting interface administrator/bureaucrat right on fa.wikipedia.beta.wmflabs.org for User:Dalba - https://phabricator.wikimedia.org/T207622 (10Hydriz) 05Open>03Resolved a:03Hydriz I went ahead to grant you both interface administrator and bureaucrat rights on fawiki. [04:46:12] 10MediaWiki-Releasing, 10Release-Engineering-Team, 10MW-1.32-release: REL1_32 branch didn't get cut for some extensions - https://phabricator.wikimedia.org/T207281 (10greg) >>! In T207281#4679385, @mmodell wrote: > @legoktm: All of those branches have now been created except for WikibaseQualityConstraints wh... [04:47:50] 10MediaWiki-Releasing, 10Release-Engineering-Team, 10MW-1.32-release: REL1_32 branch didn't get cut for some extensions - https://phabricator.wikimedia.org/T207281 (10mmodell) @greg: I don't have permission to create a branch in that repo, even after I explicitly added it in gerrit. [05:22:18] !log Beta: Updated cxserver to 9ad60d9 [05:22:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [06:05:47] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T206655 (10Smalyshev) Something may be messed up with Eventbus/Kafka timestamp generation, see {T207817}. [06:06:09] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T206655 (10Smalyshev) [06:51:22] 10Beta-Cluster-Infrastructure, 10cloud-services-team: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 (10Krenair) [06:53:35] 10Beta-Cluster-Infrastructure, 10cloud-services-team: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 (10Krenair) ```krenair@deployment-cumin:~$ sudo cumin 'name:deployment-redis3-changeprop' id 1 hosts will be targeted: deployment-redis3-changeprop.deployment-prep.eqi... [06:56:48] 10Beta-Cluster-Infrastructure, 10cloud-services-team: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 (10Krenair) Yeah looks like this instance was created with a puppet role before it had successfully run puppet for the first time: https://horizon.wikimedia.org/projec... [06:58:10] 10Beta-Cluster-Infrastructure, 10cloud-services-team: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 (10Krenair) It actually doesn't have anything individual, it gets that role from the prefix `deployment-redis*` [06:59:43] !log T207825 moved role::jobqueue_redis::master role from deployment-redis prefix to deployment-redis0[56] [06:59:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [06:59:48] T207825: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 [07:00:56] !log T207825 replacing deployment-redis3-changeprop with deployment-redis3-changeprop02 (jessie m1.small) [07:01:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:04:26] 10Beta-Cluster-Infrastructure, 10cloud-services-team: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 (10Krenair) a:03Krenair [07:26:54] 10Beta-Cluster-Infrastructure, 10cloud-services-team: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 (10Krenair) Created a new instance called deployment-redis3-changeprop02, `sudo -i`, `cd /var/lib/puppet; mv ssl ssl_old; rm /usr/local/share/ca-certificates/Puppet_In... [07:27:35] !log T207825 reapplied role::jobqueue_redis::master to deployment-redis prefix [07:27:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:27:41] T207825: Access to deployment-redis3-changeprop broken - https://phabricator.wikimedia.org/T207825 [07:30:37] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Recommendation-API, 10Research, and 2 others: Create the recommendation api DB in Beta - https://phabricator.wikimedia.org/T207795 (10Krenair) a:03Krenair [07:34:41] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Recommendation-API, 10Research, and 2 others: Create the recommendation api DB in Beta - https://phabricator.wikimedia.org/T207795 (10Krenair) passwords at deployment-db03:/root/T207795-secrets for the moment, will sort out stuff later [07:38:18] Hello everyone! New deployment blocker on the train: T207817 [07:38:19] T207817: WDQS Updater ran into issue and stopped working - https://phabricator.wikimedia.org/T207817 [07:39:38] Looks like a date format change in events posted to event bus [07:40:07] This caused fatal issues to WDQS. Incident report: https://wikitech.wikimedia.org/wiki/Incident_documentation/20181024-WDQS [07:40:16] If any one knows anything about it, ping me! [07:41:03] zeljkof: ^^ (pinging you, not sure who's up at this time) [07:43:17] gehel: thanks, train conductor twentyafterfour will see the task, as soon as he wakes up [07:43:26] Is there anything we can do? [07:43:39] zeljkof: nothing urgent, the situation is mitigated [07:43:57] but some help to understand how this happened is definitely welcomed! [07:44:17] There are going to be a ton of actions from this one! [07:44:59] I'm looking forward to that ;P [07:45:05] he he he [07:53:38] 10Beta-Cluster-Infrastructure, 10Discovery-Search, 10Beta-Cluster-reproducible, 10Patch-For-Review, 10Puppet: Elasticsearch puppet config changes broke puppet in various instances - https://phabricator.wikimedia.org/T205672 (10fgiunchedi) I'm seeing only `beta-search` cluster configured by puppet on depl... [07:54:03] 10Beta-Cluster-Infrastructure, 10Wikimedia-Logstash: Logstash in beta doesn't have any logs - https://phabricator.wikimedia.org/T205863 (10fgiunchedi) 05Open>03Resolved Resolving in favor of {T205672} as the underlying cause is ES not logstash in this case. [08:02:05] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10Recommendation-API, 10Research, and 2 others: Create the recommendation api DB in Beta - https://phabricator.wikimedia.org/T207795 (10Krenair) 05Open>03Resolved set passwords::recommendationapi::mysql recommendationapi_pass and recommendation... [08:56:30] 10Gerrit, 10Release-Engineering-Team (Kanban): Grant Gerrit administration rights to Lars Wirzenius - https://phabricator.wikimedia.org/T207830 (10hashar) [08:57:14] 10Gerrit, 10Release-Engineering-Team (Kanban): Grant Gerrit administration rights to Lars Wirzenius - https://phabricator.wikimedia.org/T207830 (10hashar) 05Open>03Resolved a:03hashar [08:57:45] !log gerrit: added Lars "liw" Wirzenius to the Administrators group | T207830 [08:57:48] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:57:49] T207830: Grant Gerrit administration rights to Lars Wirzenius - https://phabricator.wikimedia.org/T207830 [09:08:50] 10Gerrit, 10Release-Engineering-Team (Kanban): Grant Gerrit administration rights to Lars Wirzenius - https://phabricator.wikimedia.org/T207830 (10hashar) Also added to the [[ https://gerrit.wikimedia.org/r/#/admin/groups/10,members | integration ]] group. [09:26:35] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests, 10Operations, 10SRE-Access-Requests: Add Lars Wirzenius to releng LDAP groups - https://phabricator.wikimedia.org/T207833 (10hashar) [09:38:41] 10Gerrit, 10Release-Engineering-Team: Upgrade gerrit to 2.15.6 - https://phabricator.wikimedia.org/T205784 (10Paladox) [09:53:07] 10Continuous-Integration-Config, 10Release-Engineering-Team: Decide where to store jobs for releases-jenkins - https://phabricator.wikimedia.org/T207346 (10hashar) `integration/config` and a `jjb-releases` directory seems a good start. To generate the jobs we would just point `jenkins-jobs` to a different conf... [09:55:59] 10Release-Engineering-Team (Watching / External), 10DBA, 10Datasets-General-or-Unknown, 10Patch-For-Review, and 2 others: Automate the check and fix of object, schema and data drifts between mediawiki HEAD, production masters and slaves - https://phabricator.wikimedia.org/T104459 (10Marostegui) [10:31:23] 10Continuous-Integration-Config, 10Quibble: Quibble should instruct PHPUnit to generate Junit files - https://phabricator.wikimedia.org/T207841 (10hashar) [10:34:32] 10Beta-Cluster-Infrastructure, 10Patch-For-Review, 10Puppet: Puppet error on deployment-mwmaint01 - https://phabricator.wikimedia.org/T206598 (10Krenair) 05Open>03Resolved Created deployment-puppetmaster03:/etc/conftool-state/mediawiki.yaml per @joe [12:08:32] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.33-notes (1.33.0-wmf.1; 2018-10-23), 10Patch-For-Review, 10User-zeljkofilipin: Video recording for Selenium tests in Node.js - https://phabricator.wikimedia.org/T179188 (10zeljkofilipin) a:05zeljkofilipin>03None [12:09:14] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10User-zeljkofilipin, 10goodfirstbug: All repositories with Selenium tests should use wdio-mediawiki - https://phabricator.wikimedia.org/T199113 (10zeljkofilipin) a:05zeljkofilipin>03None [12:10:15] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-notes (WMF-deploy-2018-09-18 (1.32.0-wmf.22)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilipin) a:... [12:11:38] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests, 10Operations, 10SRE-Access-Requests: Add Lars Wirzenius to releng LDAP groups - https://phabricator.wikimedia.org/T207833 (10jijiki) p:05Triage>03Normal a:03jijiki [12:50:21] 10Release-Engineering-Team (Watching / External), 10DBA, 10Operations, 10cloud-services-team, and 2 others: Move some wikis to s5 - https://phabricator.wikimedia.org/T184805 (10Marostegui) a:05Marostegui>03jcrespo I have checked `revision` and `user` table for all the wikis in s5: ``` dewiki cebwiki sh... [13:09:55] gehel: it isn't obvious so far what actually caused the issue? It sounds like wdqs should be made more resiliant to bad input data [13:13:18] (03PS1) 10Hashar: PHPunit generates Junit results [integration/quibble] - 10https://gerrit.wikimedia.org/r/469426 (https://phabricator.wikimedia.org/T207841) [13:23:16] twentyafterfour: at hospital atm, will talk more later [14:07:37] 10Phabricator: Create edit forms for every subtype - https://phabricator.wikimedia.org/T207806 (10MGChecker) [14:45:13] twentyafterfour: finally back [14:45:54] so yes, there are robustness issues on the wdqs side, it should not fail as bad as it did on unexpected format changes [14:46:15] but it should still fail, dates are hard enough to get right without having to guess at the format [14:47:02] so there should be questions as why did that format changed, how we missed the problem during testing and during deployment [14:47:12] and as to how do we fix it now [14:47:20] cc SMalyshev ^^^ [14:53:25] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10Discovery-Search (Current work), 10Patch-For-Review, 10Puppet: Elasticsearch puppet config changes broke puppet in various instances - https://phabricator.wikimedia.org/T205672 (10dcausse) [14:53:27] gehel: I certainly don't know why it changed, should we be looking through mediawiki commit history to find the offending commit? [14:53:37] I'll be glad to help investigate [14:54:14] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10Discovery-Search (Current work), 10Patch-For-Review, 10Puppet: Elasticsearch puppet config changes broke puppet in various instances - https://phabricator.wikimedia.org/T205672 (10dcausse) a:03dcausse [14:55:08] twentyafterfour: that would be great ! I know mostly nothing about the Mediawiki side of things [14:55:28] SMalyshev might be able to help once he wakes up [14:57:10] gehel: ok I'll start looking at commits in mediawiki but I'm also a bit clueless as to where I would begin the search [14:57:26] twentyafterfour: do you know who might know? [14:57:35] what are the records which contain the bad date format? [14:57:53] I don't even understand fully what wdqs does [14:58:52] it consumes events from multiple kafka topics, those topics are populated by changes in mediawiki [14:59:13] from the logs, it looks like at least some revision-create events have changed format [14:59:39] ok that helps narrow it down a bit [15:01:33] I'm not sure what the mechanism is on the producer side of things [15:04:11] I see mostly errors with `revision-create` but that might be because we have way more of those than page deletion / creation [15:06:05] gehel: I don't see anything obvious in the log between 1.32.0-wmf.26 and 1.33.0-wmf.1 [15:06:48] why is it that issues are never obvious :) [15:13:42] :-/ [15:14:09] I don't see much of anything that mentions logging or date formats [15:14:43] probably was an unintended consequence from something else :/ [15:14:48] this has the words "schema" and is related to events logging: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/WikimediaEvents/+/468490/ [15:15:37] thcipriani: good find! [15:16:02] seems pretty innocuous though [15:16:08] yeah doesn't seem to touch dates [15:16:42] mostly just grepping: https://www.mediawiki.org/wiki/MediaWiki_1.33/wmf.1/Changelog [15:17:40] I'm confused by the terminology, but isnt event logging in this context about monitoring? [15:18:04] or is it the same flow used also for content change events? [15:21:45] gehel: you are likely correct, I was just searching changelog for schema and events and that was the first thing that I found. [15:22:14] thcipriani: ok, thanks for looking btw! [15:22:24] * gehel is trying to learn something in the process [15:34:47] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.32.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T191072 (10mmodell) [15:36:03] gehel: twentyafterfour oh, what about: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EventBus/+/468482 [15:36:52] Oh, that does look like something! cc SMalyshev [15:37:17] thcipriani: gehel: see the task, it just got an update from ottomata [15:37:38] and thcipriani that's the culprit [15:40:41] yeah it definitely looks like it [15:40:52] and a change in format (which probably needs some announcement) [15:44:08] 10Beta-Cluster-Infrastructure: Please grant me interface admin rights on en.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T207856 (10Arkanosis) [15:47:11] ok the revert is merging (as soon as gate-and-submit finishes) then I'll deploy it [15:47:16] gehel: ^ [15:48:29] https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/EventBus/+/469451/ [15:49:58] twentyafterfour: kool! Thanks! [15:50:02] 10Beta-Cluster-Infrastructure: Please grant me interface admin rights on en.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T207856 (10Krenair) 05Open>03Resolved a:03Krenair ok [15:51:52] 10Beta-Cluster-Infrastructure: Please grant me interface admin rights on en.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T207856 (10Arkanosis) Thanks @Krenair ! [16:18:47] (03CR) 10Hashar: Parallelize ext/skin linter (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/462512 (owner: 10Hashar) [16:19:33] (03PS4) 10Hashar: Parallelize ext/skin linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462512 [16:19:35] (03PS4) 10Hashar: Parallelize mediawiki/core linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462513 [16:19:37] (03PS2) 10Hashar: PHPunit generates Junit results [integration/quibble] - 10https://gerrit.wikimedia.org/r/469426 (https://phabricator.wikimedia.org/T207841) [16:19:54] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Quibble should instruct PHPUnit to generate Junit files - https://phabricator.wikimedia.org/T207841 (10hashar) a:03hashar [16:28:00] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Quibble, 10User-zeljkofilipin: Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests - https://phabricator.wikimedia.org/T199116 (10hashar) @phuedx poked Greg about it. The logic is in my... [16:37:26] 10Scap: Allow configurable wait / watch time on canaries for mediawiki scap sync - https://phabricator.wikimedia.org/T207864 (10Addshore) [17:55:54] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests, 10Operations, 10SRE-Access-Requests: Add Lars Wirzenius to releng LDAP groups - https://phabricator.wikimedia.org/T207833 (10jijiki) 05Open>03Resolved [17:58:50] Can someone make me ("Jdforrester (WMF)") a steward on Beta Cluster? +bureaucrat on some but not most of the wikis makes testing painful. :-) [17:59:04] k [18:00:07] James_F, done [18:00:10] Ta. [18:01:25] James_F, I gave you the global steward stuff, do you also need the local stuff on meta? [18:01:36] Krenair: I guess I can give that to myself now? [18:01:36] I just remembered they're separate [18:01:38] yep [18:01:44] think so... [18:01:49] Let's see. [18:02:10] Done. [18:02:11] yeah they're `userrights` on the global group [18:02:16] there's* [18:02:34] Krenair: Thanks again. :-) [18:02:39] np [18:12:30] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T206655 (10Smalyshev) Since the revert in https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EventBus/+/469449, I think T207817 is no longer block... [18:12:43] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T206655 (10Smalyshev) [18:16:17] 10Project-Admins, 10Analytics: Create project for SWAP - https://phabricator.wikimedia.org/T207425 (10Milimetric) @Aklapper: subprojects sound great, I didn't know about them. And they would work for most of our projects (a few exceptions). @Neil_P._Quinn_WMF, would a subproject work for you in this context? [18:54:13] I'd like to be able to view eventlogging data on the beta cluster. I'm in the researchers and restricted groups. Could someone advise me on which box I should SSH into or point me to documentation? [18:55:00] FWIW, those groups don't apply at all on beta [18:55:17] oh [18:56:59] I'm guessing it's deployment-eventlog05 [18:57:25] kostajh: What's your wikitech username? [18:57:38] `Kosta Harlan` [18:58:10] I was just reading https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging/TestingOnBetaCluster#Give_people_access, where it says to ask in #wikimedia-cloud, although I was pointed here from that channel [18:59:24] I've added you to the deployment prep project... [18:59:32] Might take a while for puppet to run [18:59:51] But you should be able to login to deployment-eventlog05.deployment-prep.eqiad.wmflabs soon [19:00:45] I don't think you should need to be a project admin, but not sure [19:00:52] Reedy: thank you! [19:06:43] Reedy: is the suggested SSH config entry for `*wmflabs` at the end of https://wikitech.wikimedia.org/wiki/Production_shell_access#Setting_up_your_SSH_config correct? [19:10:14] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T206655 (10mmodell) [19:14:25] 10Continuous-Integration-Config, 10WMCZ-Events: Enable CI support (lint at least) for wikimedia-cz/events - https://phabricator.wikimedia.org/T207879 (10Urbanecm) [19:23:21] Reedy, puppet running isn't needed for normal additions to project membership [19:23:26] just to add people to the root keys list via hiera [19:23:46] they get put into the project-deployment-prep group in ldap [19:26:50] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.33.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T206655 (10mmodell) [19:43:05] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests, 10Operations, 10SRE-Access-Requests: Add Lars Wirzenius to releng LDAP groups - https://phabricator.wikimedia.org/T207833 (10hashar) Thank you @jijiki ! @LarsWirzenius you should now have access to the various tools. Most importantly to releng:... [20:25:04] (03CR) 10Hashar: [C: 032] Parallelize ext/skin linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462512 (owner: 10Hashar) [20:25:07] (03CR) 10Hashar: [C: 032] Parallelize mediawiki/core linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462513 (owner: 10Hashar) [20:25:10] (03CR) 10Hashar: [C: 032] PHPunit generates Junit results [integration/quibble] - 10https://gerrit.wikimedia.org/r/469426 (https://phabricator.wikimedia.org/T207841) (owner: 10Hashar) [20:26:17] (03Merged) 10jenkins-bot: Parallelize ext/skin linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462512 (owner: 10Hashar) [20:26:19] (03Merged) 10jenkins-bot: Parallelize mediawiki/core linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462513 (owner: 10Hashar) [20:26:21] (03Merged) 10jenkins-bot: PHPunit generates Junit results [integration/quibble] - 10https://gerrit.wikimedia.org/r/469426 (https://phabricator.wikimedia.org/T207841) (owner: 10Hashar) [20:26:44] (03CR) 10jenkins-bot: Parallelize ext/skin linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462512 (owner: 10Hashar) [20:27:06] !log tagged Quibble 0.0.28 at 1ac8fe353a8b7bbf5b31e6094ef06ee459c553a3 [20:27:08] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:27:09] (03CR) 10jenkins-bot: Parallelize mediawiki/core linter [integration/quibble] - 10https://gerrit.wikimedia.org/r/462513 (owner: 10Hashar) [20:27:29] (03CR) 10jenkins-bot: PHPunit generates Junit results [integration/quibble] - 10https://gerrit.wikimedia.org/r/469426 (https://phabricator.wikimedia.org/T207841) (owner: 10Hashar) [20:31:26] (03PS1) 10Hashar: docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 [20:31:36] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Quibble should instruct PHPUnit to generate Junit files - https://phabricator.wikimedia.org/T207841 (10hashar) 05Open>03Resolved [20:33:13] (03CR) 10Hashar: [C: 032] docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:33:50] (03CR) 10jerkins-bot: [V: 04-1] docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:35:13] (03CR) 10jerkins-bot: [V: 04-1] docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:35:57] (03PS1) 10Hashar: Pin flake8==3.5.0 [integration/config] - 10https://gerrit.wikimedia.org/r/469508 [20:36:11] (03PS2) 10Hashar: docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 [20:36:23] (03CR) 10Hashar: [C: 032] Pin flake8==3.5.0 [integration/config] - 10https://gerrit.wikimedia.org/r/469508 (owner: 10Hashar) [20:36:28] (03CR) 10Hashar: docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:36:31] (03CR) 10Hashar: [C: 032] docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:38:27] (03CR) 10jerkins-bot: [V: 04-1] docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:39:30] 10Release-Engineering-Team (Kanban), 10Wikimedia-Technical-Conference-2018, 10User-greg: Wikimedia Technical Conference 2018 Session - How do we work together? - https://phabricator.wikimedia.org/T206064 (10Bmueller) [20:39:31] hasharDinner: thank you for fixing the junit stuff [20:39:34] (03CR) 10jerkins-bot: [V: 04-1] Pin flake8==3.5.0 [integration/config] - 10https://gerrit.wikimedia.org/r/469508 (owner: 10Hashar) [20:39:37] (03CR) 10jerkins-bot: [V: 04-1] Pin flake8==3.5.0 [integration/config] - 10https://gerrit.wikimedia.org/r/469508 (owner: 10Hashar) [20:39:39] (03CR) 10jerkins-bot: [V: 04-1] docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:41:41] (03CR) 10Hashar: [C: 032] Pin flake8==3.5.0 [integration/config] - 10https://gerrit.wikimedia.org/r/469508 (owner: 10Hashar) [20:43:30] (03Merged) 10jenkins-bot: Pin flake8==3.5.0 [integration/config] - 10https://gerrit.wikimedia.org/r/469508 (owner: 10Hashar) [20:43:32] (03Merged) 10jenkins-bot: docker: quibble 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469504 (owner: 10Hashar) [20:44:06] !log Rebuilding CI containers for Quibble 0.0.28 [20:44:08] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:51:49] (03PS1) 10Hashar: jjb: bump Quibble jobs to 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469512 [20:55:02] (03CR) 10jerkins-bot: [V: 04-1] jjb: bump Quibble jobs to 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469512 (owner: 10Hashar) [21:05:02] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/469512 (owner: 10Hashar) [21:08:15] (03CR) 10jerkins-bot: [V: 04-1] jjb: bump Quibble jobs to 0.0.28 [integration/config] - 10https://gerrit.wikimedia.org/r/469512 (owner: 10Hashar) [21:34:42] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/469512 (owner: 10Hashar) [21:42:33] 10Continuous-Integration-Config, 10WMCZ-Events: Enable CI support (lint at least) for wikimedia-cz/events - https://phabricator.wikimedia.org/T207879 (10Urbanecm) p:05Triage>03High [21:43:31] 10Continuous-Integration-Config, 10WMCZ-Events, 10User-Urbanecm: Enable CI support (lint at least) for wikimedia-cz/events - https://phabricator.wikimedia.org/T207879 (10Urbanecm) a:03Urbanecm [21:56:23] (03CR) 10Dduvall: "per IRC: we should keep an eye on the resource usage on the instances once this is deployed since the execution profile will change dramat" [integration/config] - 10https://gerrit.wikimedia.org/r/469512 (owner: 10Hashar) [22:52:14] 10Project-Admins: Project creation request: GrowthExperiments - https://phabricator.wikimedia.org/T207907 (10Catrope) [23:46:00] thcipriani, marxarelli: do you know if the Gerrit submodule auto-bumps trigger postmerge jobs in zuul? [23:46:50] hrm, I don't know off-hand [23:47:17] I can test it later then [23:47:44] I would expect not [23:47:54] Seeing as I don't think they generate change entries viewable in the web UI [23:47:57] (IIRC) [23:48:10] yeah, they don't generate changes in the Gerrit UI [23:48:13] just commits in the git history [23:48:21] my guess would also be it doesn't happen. It doesn't generate change entires, but I don't know if they generate change-merged events. [23:48:50] my guess is no because it's not a "change" [23:49:26] for the MW tarball jenkins job creation, we need to create a new tarball whenever a submodule is bumped, so it sounds like using a cron is needed since zuul won't get triggered on those [23:49:58] Nope they do not legoktm [23:50:13] i doin't think it has a stream event [23:50:19] alright [23:50:21] settled :) [23:50:23] thanks paladox [23:50:25] unless it uses patchset created event. [23:50:35] your welcome :) [23:50:44] the plan is to register gearman jobs from releases-jenkins? [23:50:51] for creating mw tarballs? [23:51:36] legoktm https://gerrit-review.googlesource.com/Documentation/cmd-stream-events.html#_ref_updated [23:51:39] that may help [23:52:34] thcipriani: no idea, I haven't thought about it fully yet. I'm just thinking about 1.32.0-rc.1 right now [23:52:57] k [23:53:08] which will be less complex since there are no private patches involved [23:53:34] and hopefully it'll trigger Cunningham's law [23:53:35] FWIW I read your thoughts on integration/config for releases-jenkins: I'm pretty ambivalent so I'd gladly defer to you. [23:53:59] heh [23:55:43] my knowledge of how jenkins works outside of the ways we currently use it is very limited [23:56:01] so I don't know if there's a better way to do this than besides using jjb and our current style