[00:17:58] 10Release-Engineering-Team (Local Dev), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Update parsoid image and helm charts for php - https://phabricator.wikimedia.org/T242259 (10Dzahn) It uses Apache's [[ http://httpd.apache.org/ | httpd ]] and [[ https://php-fpm.org/ | php-fpm ]] as installed by... [01:57:25] (03CR) 10Jeena Huneidi: [C: 03+1] "LGTM" [releng/dev-images] - 10https://gerrit.wikimedia.org/r/556798 (owner: 10Kosta Harlan) [01:58:26] 10Deployments, 10Release-Engineering-Team, 10serviceops, 10Performance-Team (Radar): Cache of wmf-config/InitialiseSettings often 1 step behind - https://phabricator.wikimedia.org/T236104 (10Catrope) I encountered this bug again today, when deploying [[https://gerrit.wikimedia.org/r/c/565398/|this config c... [03:28:29] 10Phabricator: Delete duplicate Phabricator account - https://phabricator.wikimedia.org/T243368 (10edwardspec) [03:52:17] (03PS1) 10Legoktm: Drop Python 2.7 support [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/566406 [04:17:19] (03PS1) 10Legoktm: [WIP] Add standard black configuration [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/566407 [04:20:05] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Add standard black configuration [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/566407 (owner: 10Legoktm) [04:25:42] is scap still using python2 ? [04:54:00] https://gerrit.wikimedia.org/r/q/topic:scap-py3 [05:44:59] (03CR) 10BryanDavis: "Is there a concrete reason, beyond the Python2 end of life in April, to drop py2.7 compatibility in the codebase? If this is step 1 in som" [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/566406 (owner: 10Legoktm) [06:02:22] (03CR) 10Legoktm: "> Patch Set 1:" [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/566406 (owner: 10Legoktm) [07:01:05] 10Deployments, 10Release-Engineering-Team, 10serviceops, 10Performance-Team (Radar): Cache of wmf-config/InitialiseSettings often 1 step behind - https://phabricator.wikimedia.org/T236104 (10Catrope) Thanks to Giuseppe I got dsh+keyholder to work: `SSH_AUTH_SOCK=/run/keyholder/proxy.sock dsh -r ssh -F 20 -... [07:35:55] 10MediaWiki-Codesniffer, 10Wikidata, 10Wikidata-Campsite: Release a new version of WikibaseCodeSniffer - https://phabricator.wikimedia.org/T243296 (10Addshore) [08:01:33] Hi releng! :D [08:50:04] 10Beta-Cluster-Infrastructure: Commons beta cluster: Interface Admin rights request - https://phabricator.wikimedia.org/T228725 (10DannyS712) 05Open→03Declined Marking as declined; no response to previous question after a month. If rights are still needed, please reopen or file a new request and ping me. [08:50:39] 10Beta-Cluster-Infrastructure: Request for sysop on zh.wikipedia.beta.wmflabs - https://phabricator.wikimedia.org/T199864 (10DannyS712) 05Open→03Declined Marking as declined; no response to previous question after a month. If rights are still needed, please reopen or file a new request and ping me. [09:35:04] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), 10Patch-For-Review, and 2 others: phan 1.2.6 is OOMing on MediaWiki core - https://phabricator.wikimedia.org/T219114 (10Silvan_WMDE) The progress bar was restored for no apparent reason via https://ge... [09:38:54] hi addshore :) [09:41:13] Hi zeljkof :S [09:41:14] :D [09:42:08] :) [09:56:22] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Security Concept Review, 10Security-Team, 10SecTeam Discussion: Security Concept Review For new CI - https://phabricator.wikimedia.org/T240943 (10Joe) >>! In T240943#5820996, @chasemp wrote: Some clarifications on some details: > This seems to... [10:00:24] 10Phabricator: Delete duplicate Phabricator account - https://phabricator.wikimedia.org/T243368 (10Aklapper) The account has been active (added a comment in a task) so it is not possible to delete. I have disabled the account now. [10:00:46] 10Phabricator: Delete duplicate Phabricator account - https://phabricator.wikimedia.org/T243368 (10Aklapper) (Oh well, it could also be renamed too.) [10:02:35] 10Continuous-Integration-Config, 10Operations: cergen CI fails to run on Debian Stretch because cryptography dependency cannot be built against newer openssl version - https://phabricator.wikimedia.org/T212395 (10MoritzMuehlenhoff) a:05MoritzMuehlenhoff→03None [10:25:45] (03CR) 10Mainframe98: [C: 03+1] "I think I understand it now, thanks." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/565546 (owner: 10Thiemo Kreuz (WMDE)) [10:33:13] 10Project-Admins: Create python2 -> python3 porting Phabricator tag - https://phabricator.wikimedia.org/T243378 (10Legoktm) [10:39:09] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Testing, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, and 2 others: Login to en.wikipedia.beta.wmflabs.org sometimes fails with `There seems to be a problem with your login sesion` - https://phabricator.wikimedia.org/T243123 (10zeljko... [10:40:47] 10Continuous-Integration-Infrastructure: Disable progress bar in the phan docker image - https://phabricator.wikimedia.org/T243379 (10Silvan_WMDE) [10:41:04] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Testing, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, and 2 others: Login to at least en.wikipedia.beta.wmflabs.org and commons.wikimedia.beta.wmflabs.org sometimes fails with `There seems to... - https://phabricator.wikimedia.org/T243123 [10:41:59] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Testing, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, and 2 others: Login to at least en.wikipedia.beta.wmflabs.org and commons.wikimedia.beta.wmflabs.org sometimes fails with `There seems to... - https://phabricator.wikimedia.org/T243123 [10:48:14] 10Continuous-Integration-Infrastructure: Disable progress bar in the phan docker image - https://phabricator.wikimedia.org/T243379 (10Addshore) +1 to removing this progress bar from CI runs, It just looks ugly. [10:51:06] 10Scap, 10Operations, 10serviceops: Make canary wait time configurable - https://phabricator.wikimedia.org/T217924 (10jijiki) @thcipriani ping! :) [11:03:53] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Quibble: Quibble should inject php-invoker into MediaWiki core's composer dependencies at run time - https://phabricator.wikimedia.org/T243324 (10Daimona) >>! In T243324#5821402, @Krinkle wrote: >... [11:07:27] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10MW-1.34-notes (1.34.0-wmf.6; 2019-05-21), 10Patch-For-Review, and 2 others: phan 1.2.6 is OOMing on MediaWiki core - https://phabricator.wikimedia.org/T219114 (10Daimona) >>! In T219114#5822232, @Silvan_WMDE wrote: > The progress bar was rest... [11:17:31] 10Continuous-Integration-Infrastructure, 10phan: Disable progress bar in the phan docker image - https://phabricator.wikimedia.org/T243379 (10Daimona) > Half a year later, https://gerrit.wikimedia.org/r/541001 restored it without giving a good reason. That's not correct, see T219114#5822448 (which was mention... [11:23:11] 10Phabricator: Delete duplicate Phabricator account - https://phabricator.wikimedia.org/T243368 (10edwardspec) > people were accidentally tagging it instead of the correct account, Renaming would prevent that, so please rename it. [12:26:31] 10Phabricator: Delete duplicate Phabricator account - https://phabricator.wikimedia.org/T243368 (10Aklapper) Alright. Rename to what? :) [12:42:14] 10Phabricator: Delete duplicate Phabricator account - https://phabricator.wikimedia.org/T243368 (10edwardspec) "DeletedUser123" or something. [12:42:53] 10Beta-Cluster-Infrastructure, 10Operations, 10Patch-For-Review: Upgrade puppet in deployment-prep - https://phabricator.wikimedia.org/T243226 (10jbond) hi alex, I noticed that the postgress databases was missing the uppetdb user, however a simple puppet run on the puppet master fixed the problem. i did re... [12:58:41] (03PS1) 10Zoranzoki21: parameter_functions.py: Add TextExtracts as dependency for SpellingDictionary [integration/config] - 10https://gerrit.wikimedia.org/r/566519 (https://phabricator.wikimedia.org/T242171) [14:11:57] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Tobi_WMDE_SW) Hi, can you please add @Lena_WMDE to the #acl_project-admins group? She's a new PM at WMDE and thus needs to create projects from time to time. Thanks! [14:21:50] survey results from last year https://groups.google.com/forum/#!topic/repo-discuss/y0NAoyTFm8g [14:25:08] PROBLEM - Free space - all mounts on deployment-logstash2 is CRITICAL: CRITICAL: deployment-prep.deployment-logstash2.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-logstash2.diskspace._var_lib_elasticsearch.byte_percentfree (No valid datapoints found)deployment-prep.deployment-logstash2.diskspace.root.byte_percentfree (<100.00%) [14:25:30] 10Beta-Cluster-Infrastructure, 10Operations, 10Patch-For-Review: Upgrade puppet in deployment-prep - https://phabricator.wikimedia.org/T243226 (10jbond) Hi alex, I have pushed the change to allow multiple puppetdb's with command_broadcast and updated the node meta data in horiozon (i removed some redundant... [15:30:18] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Testing, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, and 2 others: Login to at least en.wikipedia.beta.wmflabs.org and commons.wikimedia.beta.wmflabs.org sometimes fails with `There seems to... - https://phabricator.wikimedia.org/T243123 [15:30:54] (03PS2) 10Zoranzoki21: parameter_functions.py: Add TextExtracts as dependency for TwitterCards [integration/config] - 10https://gerrit.wikimedia.org/r/566519 (https://phabricator.wikimedia.org/T242171) [15:46:45] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Other / Uncategorized), 10Release-Engineering-Team-TODO, 10Cloud-Services, and 2 others: Horizon hiera UI: investigate data type handling - https://phabricator.wikimedia.org/T243422 (10Andrew) [15:47:02] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Other / Uncategorized), 10Release-Engineering-Team-TODO, 10Cloud-Services, and 2 others: Horizon hiera UI: investigate data type handling - https://phabricator.wikimedia.org/T243422 (10Andrew) a:03Andrew [16:02:20] <_joe_> marxarelli: ping :) [16:03:36] _joe_: on my way [16:03:44] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Scap, 10Performance-Team (Radar), 10User-Ladsgroup: Add Scap support for static-array format of LCStore - https://phabricator.wikimedia.org/T105683 (10thcipriani) [16:03:46] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Tag a new release of scap - https://phabricator.wikimedia.org/T243358 (10thcipriani) [16:03:53] <_joe_> take your time, I'm not in a hurry [16:10:10] 10Scap, 10Operations, 10serviceops: Make canary wait time configurable - https://phabricator.wikimedia.org/T217924 (10thcipriani) >>! In T217924#5822404, @jijiki wrote: > @thcipriani ping! :) pong! >>! In T217924#5806546, @jijiki wrote: > @thcipriani as per our discussion, we can consider merging and testi... [16:18:55] Hi Releng! Is it possible to turn on the CI building of docker files for a service with a blubber file before the service has finished its security review? [16:26:16] (03PS1) 10Thiemo Kreuz (WMDE): Rewrite MultipleEmptyLines sniff for performance [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/566552 [16:26:37] 10Project-Admins: Create python2 -> python3 porting Phabricator tag - https://phabricator.wikimedia.org/T243378 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project has been created: #python3-porting Makes sense to me, we also have #php_7.4_support tags etc. [16:43:44] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Set up an Argo instance - https://phabricator.wikimedia.org/T234542 (10LarsWirzenius) 05Open→03Resolved [16:43:49] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Testing, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, and 2 others: Login to at least en.wikipedia.beta.wmflabs.org and commons.wikimedia.beta.wmflabs.org sometimes fails with `There seems to... - https://phabricator.wikimedia.org/T243123 [16:47:10] 10Deployments, 10Release-Engineering-Team, 10serviceops, 10Performance-Team (Radar): Cache of wmf-config/InitialiseSettings often 1 step behind - https://phabricator.wikimedia.org/T236104 (10thcipriani) >>! In T236104#5821812, @Catrope wrote: > - `InitialiseSettings.php` had the correct value for the confi... [17:08:09] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Testing, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, and 2 others: Login to at least en.wikipedia.beta.wmflabs.org and commons.wikimedia.beta.wmflabs.org sometimes fails with `There seems to... - https://phabricator.wikimedia.org/T243123 [17:20:13] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Parsoid-PHP, 10Patch-For-Review: We need to run tests on the PHP code in the deploy repo - https://phabricator.wikimedia.org/T239642 (10cscott) Alternatively, could we just load monolog on-demand? I think there was an outstanding issue where we di... [17:25:40] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Testing, 10MediaWiki-User-login-and-signup, 10MediaWiki-extensions-CentralAuth, and 3 others: Login to at least en.wikipedia.beta.wmflabs.org and commons.wikimedia.beta.wmflabs.org sometimes fails with `There seems to... - https://phabricator.wikimedia.org/T243123 [17:32:29] 10Release-Engineering-Team-TODO, 10Core Platform Team Workboards (Clinic Duty Team), 10PHP 7.2 support, 10Performance-Team (Radar): Performance regression from Apcu/ExtensionRegistry::loadFromQueue on PHP7 - https://phabricator.wikimedia.org/T187154 (10Krinkle) a:03Krinkle [17:34:06] 10Continuous-Integration-Infrastructure: mwselenium-quibble-docker job fails consistently with network errors in bundler / gem install - https://phabricator.wikimedia.org/T243429 (10Lucas_Werkmeister_WMDE) [17:38:06] 10Continuous-Integration-Infrastructure: mwselenium-quibble-docker job fails consistently with network errors in bundler / gem install - https://phabricator.wikimedia.org/T243429 (10Lucas_Werkmeister_WMDE) Hm, the build history at https://integration.wikimedia.org/ci/job/mwselenium-quibble-docker/ indicates that... [17:39:11] 10Release-Engineering-Team-TODO, 10Core Platform Team Workboards (Clinic Duty Team), 10PHP 7.2 support, 10Performance-Team (Radar): Performance regression from Apcu/ExtensionRegistry::loadFromQueue on PHP7 - https://phabricator.wikimedia.org/T187154 (10Krinkle) Performing code review for T220994 and rel... [17:45:31] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10CPT Initiatives (API Integration Tests), 10Code-Health, and 2 others: Enable API integration tests in CI for MediaWiki core - https://phabricator.wikimedia.org/T236680 (10Clarakosi) So it seems we might need a lit... [17:47:52] PROBLEM - Parsoid on deployment-parsoid09 is CRITICAL: connect to address 172.16.5.63 and port 8000: Connection refused [17:47:52] PROBLEM - Parsoid on deployment-mediawiki-parsoid10 is CRITICAL: connect to address 172.16.0.141 and port 8000: Connection refused [17:51:00] no parsoid 4u [17:55:53] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Core Platform Team, 10Goal, 10Patch-For-Review: Decide timing of the automatic mediawiki branch cut - https://phabricator.wikimedia.org/T242446 (10thcipriani) >>! In T242446#5810476, @WDoranWMF... [17:55:55] 10Continuous-Integration-Infrastructure: mwselenium-quibble-docker job fails consistently with network errors in bundler / gem install - https://phabricator.wikimedia.org/T243429 (10Lucas_Werkmeister_WMDE) 05Open→03Resolved a:03Lucas_Werkmeister_WMDE Seems to have resolved itself. [18:10:41] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Refine Seakeeper proposal for Security/SRE review - https://phabricator.wikimedia.org/T243436 (10dduvall) [18:11:09] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Refine Seakeeper proposal for Security/SRE review - https://phabricator.wikimedia.org/T243436 (10dduvall) p:05Triage→03High [18:13:31] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Refine Seakeeper proposal for Security/SRE review - https://phabricator.wikimedia.org/T243436 (10dduvall) a:03dduvall [18:15:36] 10Phabricator, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Security-Team: Make ‘Protect as security issue’ add project #security-team - https://phabricator.wikimedia.org/T242018 (10mmodell) [18:16:58] 10Release-Engineering-Team, 10MediaWiki-Core-Testing, 10Readers-Web-Backlog (Tracking), 10Technical-Debt: Upgrade Sinon.JS - https://phabricator.wikimedia.org/T239271 (10Jdforrester-WMF) [18:18:40] 10Phabricator, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Security-Team: Enforce PermanentlyPrivate tag as on Security Issue type and #security tagged issues - https://phabricator.wikimedia.org/T242638 (10mmodell) [18:18:50] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10User-greg: Developer Satisfaction Survey 2020 - https://phabricator.wikimedia.org/T243439 (10greg) p:05Triage→03High [18:19:58] 10Phabricator, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Security-Team: Enforce PermanentlyPrivate tag as on Security Issue type and #security tagged issues - https://phabricator.wikimedia.org/T242638 (10mmodell) p:05Normal→03High [18:26:07] more ldap fixes in PG https://gerrit-review.googlesource.com/c/gerrit/+/251433 [18:45:14] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10User-zeljkofilipin: Arrange PGP keysigning at All Hands 2020 - https://phabricator.wikimedia.org/T242340 (10zeljkofilipin) [18:56:17] 10Release-Engineering-Team (Local Dev), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review, 10User-ArielGlenn, 10User-brennen: Provide docker-compose based development / CI environment in MediaWiki core - https://phabricator.wikimedia.org/T238224 (10thcipriani) a:03brennen [18:58:49] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10User-brennen: train-deploy-notes Jenkins job fails in conjunction with branch.py - https://phabricator.wikimedia.org/T243330 (10thcipriani) p:05Triage→03Normal a:03mmodell Assigning to @mmodel... [19:04:58] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10CPT Initiatives (API Integration Tests), 10Code-Health, and 2 others: Enable API integration tests in CI for MediaWiki core - https://phabricator.wikimedia.org/T236680 (10daniel) >>! In T236680#5812296, @Legoktm w... [19:09:18] !log Installing newer version of php-apcu on deployment-mediawiki-07, ref T236800 [19:09:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:09:21] T236800: Ensure apcu incr/decr are atomic (Upgrade php-apcu) - https://phabricator.wikimedia.org/T236800 [19:23:53] PROBLEM - Free space - all mounts on deployment-mwmaint01 is CRITICAL: CRITICAL: deployment-prep.deployment-mwmaint01.diskspace.root.byte_percentfree (<10.00%) [19:33:55] RECOVERY - Free space - all mounts on deployment-mwmaint01 is OK: OK: All targets OK [19:37:10] !log Restore php-apcu version on deployment-mediawiki-07 to …wmf1, ref T236800 [19:37:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:37:12] T236800: Ensure apcu incr/decr are atomic (Upgrade php-apcu) - https://phabricator.wikimedia.org/T236800 [20:17:27] (03CR) 10Jforrester: [C: 03+2] parameter_functions.py: Add TextExtracts as dependency for TwitterCards [integration/config] - 10https://gerrit.wikimedia.org/r/566519 (https://phabricator.wikimedia.org/T242171) (owner: 10Zoranzoki21) [20:18:19] (03Merged) 10jenkins-bot: parameter_functions.py: Add TextExtracts as dependency for TwitterCards [integration/config] - 10https://gerrit.wikimedia.org/r/566519 (https://phabricator.wikimedia.org/T242171) (owner: 10Zoranzoki21) [20:19:33] !log Zuul: Adding TextExtracts as a dependency for TwitterCards T242171 [20:19:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:19:35] T242171: invalid dependency check causes silent failure - https://phabricator.wikimedia.org/T242171 [20:30:48] 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Quibble, 10Patch-For-Review: Quibble should inject php-invoker into MediaWiki core's composer dependencies at run time - https://phabricator.wikimedia.org/T243324 (10Jdforrester-WMF) >>! In T243... [20:45:20] 10Project-Admins: Create a #Testing-Roadblocks tag - https://phabricator.wikimedia.org/T243453 (10Clarakosi) [21:26:01] why on earth am i still awake and here [21:26:41] Is anyone around to answer some deployment-pipeline / blubber questions? More leaning toward the blubber and building images in CI side of things ? :0 [21:48:07] addshore: it's possible that i may have some answers about those things [21:48:19] (i won't make any guarantees about their quality) [21:51:14] brennen: amazing! [21:51:41] 1) is it possible to have CI running and building a docker image for a service that hasn't yet finished its security review? [21:52:10] 2) I figure js is the main currently service type built via blubber. How is the python and Java support? [21:52:36] 3) is there a standard was to deploy blubberized thing to deployment-prep / beta cluster yet? [21:52:39] *way [21:53:11] 4) general thoughts about bundeling multiple services into the same build / resulting docker image? [21:55:31] ...hrm, it turns out i do not have great answers for any of these, but i will take a crack at a few. [21:55:44] #1 seems like a policy question i don't have an answer for. [21:56:25] #2 - there's some python support - see https://wikitech.wikimedia.org/wiki/Blubber/User_Guide#Special_Config and the "python" bit. to my knowledge there's no special java support. [21:57:07] #3 [uncertain] [21:57:16] AFAIK #3 is "no" [21:57:34] at least 3 months ago there was no k8s cluster in deployment-prep [21:57:49] and nobody planning to build one :( [21:58:34] #4 - i think that the cool kids may frown on it, but i'm not sure what Best Practices _really_ are. [21:58:57] running more than one proc in a Docker container is possible, but mostly subverts the point of Docker [21:59:10] But in k8s land the answer to that is multiple containers per pod [21:59:19] marxarelli may also have some useful input here. [21:59:37] (if he's not presently bogged down in meeting-land.) [22:00:06] A Kubernetes "pod" is a unit of replication but can contain multiple containers. [22:01:35] slightly bogged but not for too long [22:02:31] TL;DR there is no standard way of deploying pipeline built images into or alongside deployment-prep [22:04:46] _joe_: had a work in progress for some image deployment method about a year ago but iirc priorities changed [22:11:10] addshore: i will answer your questions in a bit after i'm done with a meeting! [22:23:51] Thanks! [22:25:45] Hmm, yes multiple containers per pod might make sense. After a chat with jo I might post this question in an RFC very soon [23:39:16] addshore: #1 not sure the exactly policy around it (IANASRE :)), but you should be able to get something building and executing tests, etc. w/o security review. it would most likely have to happen before getting a new helm chart merged and before a prod namespace is provisioned. SRE folks can qualify or correct that statement [23:41:19] addshore: #2 (what brennen said) there's somewhat tested python support and support for general build processes (via `builder: { command:, requirements: [files] }`) but nothing specific to java. i'm always down to pair on implementing whatever support you need, and i have an OKR for making blubber more general/plugable [23:42:39] #3 see my previous comment. unfortunately, not at the moment. we should probably revisit this sometime soon but for now my priority is our proposal for a new CI system (which is a lot of work!) [23:45:06] #4 (what bd808 said) multiple containers per pod is certainly possible. you'd probably want to talk more about specific requirements with sre (e.g. do you need fast IPC, or what are the needs behind multi pod tenancy?) [23:45:53] blubber is certainly flexible to get you the images you need and i'm around to help on that front [23:46:26] (03CR) 10BryanDavis: "> But I don't mind waiting until April." [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/566406 (owner: 10Legoktm)