[00:18:34] 10Continuous-Integration-Config: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10MusikAnimal) Thanks for creating this task! I guess we don't truly need it to run the tests in this case, but it's good to require it in composer.json for wherever the application is meant to live... [00:37:52] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Darwinius) I'm getting this exact problem, with a loop on account creation, right now. Firefox 67.0.4 (64-bit) [00:39:55] 10Release-Engineering-Team, 10Release-Engineering-Team-TODO, 10MediaWiki-General-or-Unknown, 10TechCom, and 2 others: Drop PHP 7.0 support from MediaWiki - https://phabricator.wikimedia.org/T216165 (10Krinkle) I'd like to try to swing this around and instead look at what the highest PHP version is that we... [00:47:15] 10Continuous-Integration-Config: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10Krinkle) In such case you'd want to run composer install with `--ignore-platform-reqs`. However, setting that for all composer jobs in general would likely also be undesirable as for prod repos we... [00:58:25] 10Continuous-Integration-Config: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10Krinkle) Also, it should be possible to install the php-mysql (client) package from Debian without installing the mysql (server) package. Adding only the bindings should be fairly light and might... [01:17:50] 10Continuous-Integration-Config: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10MusikAnimal) Thanks, I don't know the CI system very well so I'll defer to others. I will say that the most recent build suggests we're using an [[ https://integration.wikimedia.org/ci/job/compose... [01:24:53] (03PS1) 10Jforrester: layout: [labs/tools/stewardbots] Bump composer test to php72+ [integration/config] - 10https://gerrit.wikimedia.org/r/519162 (https://phabricator.wikimedia.org/T226585) [01:25:22] 10Continuous-Integration-Config, 10Patch-For-Review: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10Jdforrester-WMF) >>! In T226585#5284702, @MusikAnimal wrote: > Thanks, I don't know the CI system very well so I'll defer to others. I will say that the most recent build sug... [01:25:31] (03CR) 10Jforrester: [C: 03+2] layout: [labs/tools/stewardbots] Bump composer test to php72+ [integration/config] - 10https://gerrit.wikimedia.org/r/519162 (https://phabricator.wikimedia.org/T226585) (owner: 10Jforrester) [01:27:00] (03Merged) 10jenkins-bot: layout: [labs/tools/stewardbots] Bump composer test to php72+ [integration/config] - 10https://gerrit.wikimedia.org/r/519162 (https://phabricator.wikimedia.org/T226585) (owner: 10Jforrester) [01:29:05] !log Moving labs/tools/stewardbots's composer test to php72+ T226585 [01:29:08] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:29:08] T226585: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 [01:31:11] 10Continuous-Integration-Config, 10Patch-For-Review: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10Legoktm) >>! In T226585#5284521, @Jdforrester-WMF wrote: > Hmm. `mysqli` seems a bit heavy to add to the `composer-{flavour}-docker` images. What do you mean by heavy? Just... [01:35:07] 10Continuous-Integration-Config, 10Patch-For-Review: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10Jdforrester-WMF) >>! In T226585#5284742, @Legoktm wrote: >>>! In T226585#5284521, @Jdforrester-WMF wrote: >> Hmm. `mysqli` seems a bit heavy to add to the `composer-{flavour}... [01:36:59] 10Continuous-Integration-Config: Add `ext-mysqli` to the CI container - https://phabricator.wikimedia.org/T226585 (10Jdforrester-WMF) [02:38:18] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<33.33%) [02:41:05] I forgot how slow the packagist mirror script is [03:18:33] (03PS1) 10Kosta Harlan: Support running PHPUnit unit tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/519166 [03:21:10] (03CR) 10Kosta Harlan: Support running PHPUnit unit tests (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/519166 (owner: 10Kosta Harlan) [05:06:58] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Qgil) @Darwinius can you test Log In vs Sign Up to see whether it makes a difference, please? Also, an alternative could be to si... [05:47:03] 10Beta-Cluster-Infrastructure, 10DBA, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Drop the `wikimedia_editor_tasks_entity_description_exists` table - https://phabricator.wikimedia.org/T226326 (10Marostegui) I have dropped this table from s3 (testwikidatawiki) which wasn't w... [05:47:32] 10Beta-Cluster-Infrastructure, 10DBA, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Drop the `wikimedia_editor_tasks_entity_description_exists` table - https://phabricator.wikimedia.org/T226326 (10Marostegui) [05:47:43] 10Beta-Cluster-Infrastructure, 10DBA, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Drop the `wikimedia_editor_tasks_entity_description_exists` table - https://phabricator.wikimedia.org/T226326 (10Marostegui) [05:48:18] 10Beta-Cluster-Infrastructure, 10DBA, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Drop the `wikimedia_editor_tasks_entity_description_exists` table - https://phabricator.wikimedia.org/T226326 (10Marostegui) [05:49:09] 10Gerrit, 10Developer-Advocacy, 10Operations, 10serviceops: Remove port 29418 from cloning process - https://phabricator.wikimedia.org/T37611 (10jijiki) p:05Normal→03Low [05:56:59] 10Beta-Cluster-Infrastructure, 10DBA, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Drop the `wikimedia_editor_tasks_entity_description_exists` table - https://phabricator.wikimedia.org/T226326 (10Marostegui) Deletion process for s8 (wikidata). The table is 6GB there. Not wri... [06:09:41] 10Beta-Cluster-Infrastructure, 10DBA, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Drop the `wikimedia_editor_tasks_entity_description_exists` table - https://phabricator.wikimedia.org/T226326 (10Marostegui) [06:09:55] 10Beta-Cluster-Infrastructure, 10DBA, 10Reading-Infrastructure-Team-Backlog, 10WikimediaEditorTasks, and 2 others: Drop the `wikimedia_editor_tasks_entity_description_exists` table - https://phabricator.wikimedia.org/T226326 (10Marostegui) 05Open→03Resolved All done [06:58:12] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Alicia_Fagerving_WMSE) I get the loop with Chrome 73.0.3683.86 (Official Build) (64-bit), both with "sign up" and "log in". [06:58:17] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:04:22] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Qgil) I *think* I have good news... I had a Firefox browser open since days with plenty of tabs, including some related to Wikime... [07:13:13] 10Diffusion, 10Release-Engineering-Team (Kanban), 10Operations, 10Packaging, and 2 others: Cannot connect to vcs@git-ssh.wikimedia.org (since move from phab1001 to phab1003) - https://phabricator.wikimedia.org/T224677 (10MoritzMuehlenhoff) @mmodell Ideally we fix this in Debian so that others can also bene... [07:45:08] (03CR) 10Hashar: [C: 04-1] "I don't think the partition will be matched, since Docker images are on / they would not match DockerMount which is set to /var/lib/docker" (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/519083 (https://phabricator.wikimedia.org/T207702) (owner: 10Thcipriani) [07:53:41] (03PS1) 10Daimona Eaytoy: Restore tests for SecurityCheckPlugin branch 2.x [integration/config] - 10https://gerrit.wikimedia.org/r/519190 (https://phabricator.wikimedia.org/T216974) [08:03:39] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10serviceops: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10hashar) I had a quick chat this morning with various SRE people. Theoretically disk setup is... [08:13:34] (03CR) 10Hashar: [C: 03+2] Restore tests for SecurityCheckPlugin branch 2.x [integration/config] - 10https://gerrit.wikimedia.org/r/519190 (https://phabricator.wikimedia.org/T216974) (owner: 10Daimona Eaytoy) [08:14:29] 10Release-Engineering-Team, 10Release-Engineering-Team-TODO, 10Developer-Advocacy, 10MediaWiki-API, and 2 others: Standardise procedures for deprecating public-facing code - https://phabricator.wikimedia.org/T114384 (10Xover) Some thoughts from a dabbler in user scripts on WMF wikis... I think @MrStradiv... [08:15:08] (03Merged) 10jenkins-bot: Restore tests for SecurityCheckPlugin branch 2.x [integration/config] - 10https://gerrit.wikimedia.org/r/519190 (https://phabricator.wikimedia.org/T216974) (owner: 10Daimona Eaytoy) [08:39:40] (03CR) 10Hashar: [C: 03+2] "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/519190 (https://phabricator.wikimedia.org/T216974) (owner: 10Daimona Eaytoy) [08:40:18] (03CR) 10Daimona Eaytoy: "> Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/519190 (https://phabricator.wikimedia.org/T216974) (owner: 10Daimona Eaytoy) [08:42:42] (03CR) 10Hashar: Remove old modules already archived (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/518973 (owner: 10Elukey) [08:43:01] elukey: hi! is "operations/puppet/kafka" archived ? [08:43:20] (03Abandoned) 10Elukey: Remove old modules already archived [integration/config] - 10https://gerrit.wikimedia.org/r/518973 (owner: 10Elukey) [08:44:26] elukey: we can archive them all in one go! [08:44:29] I don't mind doing it :] [08:45:14] PROBLEM - English Wikipedia Main page on beta-cluster is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Wikipedia' not found on 'https://en.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 2693 bytes in 6.022 second response time [08:45:35] and beta has a 503 now bah [08:46:22] 10Beta-Cluster-Infrastructure: Beta cluster: 503 on English Wikipedia Main page 503 - https://phabricator.wikimedia.org/T226606 (10hashar) [08:50:10] RECOVERY - English Wikipedia Main page on beta-cluster is OK: HTTP OK: HTTP/1.1 200 OK - 47817 bytes in 3.110 second response time [08:50:41] 10Continuous-Integration-Config, 10phan-taint-check-plugin: Upgrade php-ast to 1.0.1 - https://phabricator.wikimedia.org/T218719 (10Daimona) Ah, tests for the 2.x branch were just re-enabled, but now they fail due to ast 0.1.2 being installed. See for instance https://integration.wikimedia.org/ci/job/composer-... [08:50:43] 10Beta-Cluster-Infrastructure: Beta cluster: 503 on English Wikipedia Main page 503 - https://phabricator.wikimedia.org/T226606 (10hashar) 05Open→03Resolved a:03hashar I have no idea what happened. It is back now :-\ [08:55:47] 10Beta-Cluster-Infrastructure: Beta cluster: 503 on English Wikipedia Main page 503 - https://phabricator.wikimedia.org/T226606 (10hashar) deployment-mediawiki-07 has some php warning: ` Jun 26 08:45:27 deployment-mediawiki-07 php7.2-fpm[628]: [NOTICE] fpm is running, pid 628 Jun 26 08:45:27 deployment-mediawi... [08:56:31] 10Beta-Cluster-Infrastructure: Beta cluster: 503 on English Wikipedia Main page 503 - https://phabricator.wikimedia.org/T226606 (10hashar) And the server just got rebooted. So mystery solved :] [09:08:34] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team-TODO, 10Cloud-VPS (Quota-requests), 10cloud-services-team (Kanban): Request new Flavor for integration Cloud VPS project - https://phabricator.wikimedia.org/T225025 (10hashar) Thank you! We will rebuild all the current instances with that... [09:24:21] (03CR) 10Hashar: [C: 03+2] "That is a nice one. Thank you for the examples in the commit messages which make reviewing this change very very straightforward!" [integration/config] - 10https://gerrit.wikimedia.org/r/518974 (https://phabricator.wikimedia.org/T166066) (owner: 10Jbond) [09:26:37] (03Merged) 10jenkins-bot: ppc check experimental: removing trailing comma [integration/config] - 10https://gerrit.wikimedia.org/r/518974 (https://phabricator.wikimedia.org/T166066) (owner: 10Jbond) [09:30:26] 10Release-Engineering-Team (Kanban), 10Release Pipeline, 10Core Platform Team (Extension Management (TEC13)), 10Core Platform Team Kanban (Doing), and 2 others: Determine a standard way of installing MediaWiki lib/extension dependencies within containers - https://phabricator.wikimedia.org/T193824 (10hashar... [09:32:44] 10Phabricator: Change my Phabricator username - https://phabricator.wikimedia.org/T226423 (10Aklapper) a:03Aklapper [09:32:52] 10Phabricator: Change my Phabricator username - https://phabricator.wikimedia.org/T226423 (10Aklapper) 05Open→03Resolved Done [09:37:09] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Operations, 10serviceops: Upload docker-ce 18.06.3 upstream package for Stretch - https://phabricator.wikimedia.org/T226236 (10hashar) Adding @MoritzMuehlenhoff since he seems to knows best about the `reprepro` config in `modules/aptrepo/files/upd... [10:09:43] (03CR) 10Kosta Harlan: Codehealth: Skip MW install, generate code coverage from unit tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/518714 (owner: 10Kosta Harlan) [10:28:58] hi releng, I've run into an issue on CI in relation to a missing PHP extension. Where's the best place to ask for a PHP extension to be installed on the docker image used to run tests against our civicrm codebase https://integration.wikimedia.org/ci/job/wikimedia-fundraising-crm-composer-php72-docker/78/console [10:31:41] jgleeson: Hi! I think ejegg was looking at this recently, the edits would be to this file: https://github.com/wikimedia/integration-config/blob/master/dockerfiles/civicrm/Dockerfile.template [10:32:50] jgleeson: ah yeah here's the in-progress patch, https://gerrit.wikimedia.org/r/#/c/integration/config/+/518742/ [10:33:41] IMO the job should target your production PHP version, which I believe is php 7.0? [10:34:33] 10Diffusion, 10Release-Engineering-Team (Kanban), 10Operations, 10Packaging, and 2 others: Cannot connect to vcs@git-ssh.wikimedia.org (since move from phab1001 to phab1003) - https://phabricator.wikimedia.org/T224677 (10mmodell) [10:35:01] 10Diffusion, 10Release-Engineering-Team (Kanban), 10Operations, 10Packaging, and 2 others: Cannot connect to vcs@git-ssh.wikimedia.org (since move from phab1001 to phab1003) - https://phabricator.wikimedia.org/T224677 (10mmodell) Thanks @MoritzMuehlenhoff! [10:41:58] hey awight! hope you're doin good? Thanks of the links. It looks like we're on 7.2 on CI and 7.0 on production so we can't use a version-specific install of the package from what I understand. Maybe we should be thinking about downgrading CI to 7.0 to match prod? [10:42:37] sorry, we can't use version-specific package that reflects prod* [10:49:26] Yeah I would personally downgrade the CI [11:07:10] (03CR) 10MarcoAurelio: "@hashar: It looks it is not working: - any ideas? Thank" [integration/config] - 10https://gerrit.wikimedia.org/r/519022 (https://phabricator.wikimedia.org/T226449) (owner: 10MarcoAurelio) [11:10:30] jgleeson: I just noticed something. There are multiple images involved, and the main civicrm one is already php7.0 [11:10:58] However, there is a composer-test-php72 image used for the previous build step--the one which you found is failing. [11:13:42] I don't see an clean way to add more php extensions to that image, I think you would have to add to the base image https://github.com/wikimedia/integration-config/blob/master/dockerfiles/php72/Dockerfile.template and see if people are alright with that. [11:14:54] (03CR) 10Awight: "Just noticed that these PHP (7.2) extensions will also need to be added to dockerfiles/php72/Dockerfile.template since it's the composer-t" [integration/config] - 10https://gerrit.wikimedia.org/r/518742 (owner: 10Ejegg) [11:31:16] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Scap, 10serviceops, and 3 others: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10mmodell) We could kick off a rolling restart also at the end of each SWAT window, just fo... [11:32:56] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10LucasWerkmeister) I was able to log in with Firefox 67.0.4. I can check tonight which Firefox version I used to sign up yesterday. [11:34:38] thanks awight, I'm gonna follow up on this with the rest of fr-tech when they come online to decide how best to proceed [12:17:28] 10Phabricator: Change my Phabricator username - https://phabricator.wikimedia.org/T226423 (10Majavah) Thanks! [12:48:42] 10Release-Engineering-Team, 10Release-Engineering-Team-TODO, 10Developer-Advocacy, 10MediaWiki-API, and 2 others: Standardise procedures for deprecating public-facing code - https://phabricator.wikimedia.org/T114384 (10Tgr) >>! In T114384#5285151, @Xover wrote: > If there is a good central backlog listing... [13:34:52] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Gamaliel) Having the same problem with Chrome 75.0.3770.100 [13:49:40] https://groups.google.com/forum/#!topic/repo-discuss/Tebo-74w9n8 yay! [13:51:43] what is polymer 2? [13:54:37] apergos Polymer is a google project (https://www.polymer-project.org) [13:55:28] which part of this should I be checking out? [13:55:56] i guess the "About the Polymer Project" [13:58:12] Polymer 3 is going to be interesting :P [13:58:18] as it's all JS [13:59:34] also it'll be fun to be able to use lit-elements (html) in js doing html`
` [14:26:05] hm hm [14:55:56] (03CR) 10Kosta Harlan: [C: 04-1] "-1 until approach in Ie717b0ecf4fcfd089d46248f14853c80b7ef4a76 is clarified, but initial feedback is welcome." [integration/quibble] - 10https://gerrit.wikimedia.org/r/519166 (owner: 10Kosta Harlan) [15:09:30] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Qgil) I cannot reproduce the loop anymore, in exactly the same browser where yesterday got me stuck. I really think a browser rebo... [15:18:15] James_F / RoanKattouw what was the end result of the fibers / MinervaNeue discussion? Asking because I'm attempting to backport https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/519241 to wmf.10 but it fails on fibers install [16:06:57] kostajh: I think you'll need https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/MinervaNeue/+/518822/ [16:08:00] awight: gotcha, thanks [16:08:05] np! [16:11:14] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Scap, 10serviceops, and 3 others: Enhance MediaWiki deployments for support of php7.x - https://phabricator.wikimedia.org/T224857 (10mmodell) Note: we should think about how this affects canary tests in scap. [16:11:37] awight: kostajh: I haven't done any progress on quibble reviews / patches today. I was a bit ill and did mostly mail triage [16:12:18] Take care--more coffee at the beach! [16:12:44] there is some kind of heat wave for a few days. So better stay at home -:-] [16:12:59] ugh, here too. [16:14:00] (by heat wave, I mean 34°C :] [16:15:37] 34.9°C here :) [16:15:48] I’m just cheering on the thermometer to reach 35 at this point [16:16:25] kostajh: Yup, what awight said. [16:18:58] see you later tonight [16:19:33] Lucas_WMDE heh, we're getting the mainland heatwave by the weekend :( [16:19:45] suppose to be 30c+ [16:23:11] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10CKoerner_WMF) I saw the loop when I tried to sign up with my volunteer account in a private window in Safari (Mac OS) yesterday. I... [16:47:15] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10CDanis) I am unable to create a Discourse account because of this loop. `Chromium 73.0.3683.75 (Developer Build) built on Debian... [17:01:27] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10serviceops, 10Kubernetes, 10User-fsero: add CI job into operations/deployments-charts repo that helm lint packages and perform the helm index after merge. - https://phabricator.wikimedia.org/T216049 (10Jdforrester-WMF) [17:20:58] (03PS1) 10Jforrester: dockerfiles: [helm-linter] Initial version [integration/config] - 10https://gerrit.wikimedia.org/r/519260 (https://phabricator.wikimedia.org/T216049) [17:21:00] (03PS1) 10Jforrester: jjb: Provide a helm-limt job [integration/config] - 10https://gerrit.wikimedia.org/r/519261 (https://phabricator.wikimedia.org/T216049) [17:21:02] (03PS1) 10Jforrester: layout: [{local,deployment}-charts] Provide an experimental helm linter [integration/config] - 10https://gerrit.wikimedia.org/r/519262 (https://phabricator.wikimedia.org/T216049) [17:44:08] 10Release-Engineering-Team (Kanban), 10Developer Productivity, 10local-charts: Add tests to local-charts / configure local-charts for CI - https://phabricator.wikimedia.org/T217868 (10brennen) a:05brennen→03None [17:45:04] 10Release-Engineering-Team (Kanban), 10Developer Productivity, 10local-charts: Add tests to local-charts / configure local-charts for CI - https://phabricator.wikimedia.org/T217868 (10brennen) See also: T216049 [17:46:24] (03CR) 10Jforrester: [C: 03+2] dockerfiles: [helm-linter] Initial version [integration/config] - 10https://gerrit.wikimedia.org/r/519260 (https://phabricator.wikimedia.org/T216049) (owner: 10Jforrester) [17:47:56] (03Merged) 10jenkins-bot: dockerfiles: [helm-linter] Initial version [integration/config] - 10https://gerrit.wikimedia.org/r/519260 (https://phabricator.wikimedia.org/T216049) (owner: 10Jforrester) [17:51:35] 10Release-Engineering-Team, 10Release-Engineering-Team-TODO, 10MediaWiki-General-or-Unknown, 10TechCom, and 2 others: Drop PHP 7.0 support from MediaWiki - https://phabricator.wikimedia.org/T216165 (10Jdforrester-WMF) Unfortunately, I think it's too late to drop PHP 7.0 support in 1.33; it's already in RC... [17:53:45] !log Pushing initial helm-linter docker image for T216049 [17:54:01] (03CR) 10Jforrester: [C: 03+2] "Pushed." [integration/config] - 10https://gerrit.wikimedia.org/r/519261 (https://phabricator.wikimedia.org/T216049) (owner: 10Jforrester) [17:54:05] (03CR) 10Jforrester: [C: 03+2] layout: [{local,deployment}-charts] Provide an experimental helm linter [integration/config] - 10https://gerrit.wikimedia.org/r/519262 (https://phabricator.wikimedia.org/T216049) (owner: 10Jforrester) [17:55:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:55:05] T216049: add CI job into operations/deployments-charts repo that helm lint packages and perform the helm index after merge. - https://phabricator.wikimedia.org/T216049 [17:56:23] (03Merged) 10jenkins-bot: jjb: Provide a helm-limt job [integration/config] - 10https://gerrit.wikimedia.org/r/519261 (https://phabricator.wikimedia.org/T216049) (owner: 10Jforrester) [17:56:26] (03Merged) 10jenkins-bot: layout: [{local,deployment}-charts] Provide an experimental helm linter [integration/config] - 10https://gerrit.wikimedia.org/r/519262 (https://phabricator.wikimedia.org/T216049) (owner: 10Jforrester) [17:57:18] !log Adding the experimental helm-lint job to deployment-charts T216049 [17:57:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:18:23] (03PS1) 10Jforrester: jjb: Tweaks to helm-lint to make it work [integration/config] - 10https://gerrit.wikimedia.org/r/519269 [18:19:01] (03CR) 10Jforrester: [C: 03+2] jjb: Tweaks to helm-lint to make it work [integration/config] - 10https://gerrit.wikimedia.org/r/519269 (owner: 10Jforrester) [18:21:13] (03Merged) 10jenkins-bot: jjb: Tweaks to helm-lint to make it work [integration/config] - 10https://gerrit.wikimedia.org/r/519269 (owner: 10Jforrester) [18:27:02] 10Release-Engineering-Team (Local Dev): Make helm chart template in deployment-charts support local development - https://phabricator.wikimedia.org/T226660 (10jeena) [18:37:27] 10Release-Engineering-Team (Local Dev), 10Release Pipeline: Make helm chart template in deployment-charts support local development - https://phabricator.wikimedia.org/T226660 (10greg) [19:10:55] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T220736 (10jeena) [19:13:30] 10Continuous-Integration-Config, 10phan-taint-check-plugin: Upgrade php-ast to 1.0.1 - https://phabricator.wikimedia.org/T218719 (10Legoktm) a:03Legoktm Sorry, this dropped off my radar. Will work on this today. [19:21:56] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing, 10phan-taint-check-plugin: Configure CI to run phan-taint-check-plugin for MediaWiki core - https://phabricator.wikimedia.org/T203630 (10sbassett) [19:35:33] 10Phabricator, 10Developer-Advocacy (Jul-Sep 2019): Re-evaluate our use of Phabricator Conpherence chat - https://phabricator.wikimedia.org/T127640 (10sbassett) [19:39:54] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T220736 (10Aklapper) [19:40:38] 10Continuous-Integration-Config, 10phan-taint-check-plugin: Upgrade php-ast to 1.0.1 - https://phabricator.wikimedia.org/T218719 (10Daimona) @Legoktm Thanks! Since we're here: seccheck72 jobs have been created lately as part of T226420. They'll also need ast 1.0.1 to work. And before enabling them, libraryupgr... [19:42:13] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10LibUp: LibraryUpgrader CI normalisation tasks, June 2019 - https://phabricator.wikimedia.org/T225325 (10Daimona) I guess seccheck should be bumped to 2.0 once it gets released and T226420... [19:43:49] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Qgil) > Chromium 73.0.3683.75 @CDanis Do yo have a chance to update Chromium? There are reports of 74 working. I am still not sur... [20:20:37] Hey releng, I'm running into a failing test on quibble-donationinterface-REL1_31-php70-docker that is giving me PHP Fatal error: require(): Failed opening required '/workspace/src/vendor/composer/../jetbrains/phpstorm-stubs/PhpStormStubsMap.php' [20:20:37] Any ideas what is going on here? [20:27:50] cstone: Something in FR's vendor is trying to pull in phpstorm's stubs, but they're not there? [20:28:19] For that kind of crap I normally winge at l.egoktm or R.eedy as they're the ones who use that cruft, sorry. [20:28:44] the phpstorm stubs seem to be a dev dependency of core mediawiki in this case [20:28:51] hmm, is that just our weird branch? [20:30:54] aha, they were removed as part of a phan upgrade [20:31:17] Ah. [20:31:20] It looks like they're only on the fundraising branch now [20:31:29] k, we can get rid of them too [20:31:37] Yeah, someone probably forgot to remove them. [20:31:58] rats--they're in REL1_31 also [20:33:57] the stubs used to be needed for phan [20:34:04] if you're not running phan, you don't need them [20:34:14] looking [20:35:24] yep, doesn't look like we're running those on our core branch [20:37:16] Noting for posterity - added cparle to wmf-deployment group on Gerrit (already has access to the cluster and deploy rights there, just needed to be able to merge config patches) [20:57:26] marktraceur: probably best to !log that in -operations [20:57:57] I didn't think it was necessary but can do [20:58:23] I generally do it when there's no other paper trail like a phab ticket [20:58:43] Yeah [21:12:01] hey, tomorrow I'm doing a presentation about software engineering in Wikimedia ;), quick question because I'm looking and I cannot find [21:12:29] is there a page on wikitech that specifices how many php/db/memcache/file servers we have? [21:13:01] most probably I can get that information from many pages but I want to save up some time so I'm asking here [21:13:39] I don't need an exact number, something like 'around 150 apache' will be good enough [21:25:09] raynor: It's about 280 apaches, 140 DBs, 3 parser caches, from a quick glance at config. [21:25:19] raynor: Don't know how many fileservers offhand, sorry. [21:25:19] James_F, thx [21:26:03] James_F, also, I knew this but I forgot. Do you know why do we have two varnish instances before request hits the apache? [21:26:57] someone explained me that some time ago, but I totally forgot ;/ I'm trying to find it on wikitech but honestly the wikitech is pretty out of date, lots of documentation/images is from before 2010 ;/ [21:27:15] Yeah, the "front" ones have a short RAM-only cache, the "back" ones have a longer on and talk to each other (sharded storage). The split approach means we get (fake numbers) 99% hits in the front and 99.99% cache hits in the combined front and back, roughly. [21:27:32] s/RAM-only/local-only/ [21:27:54] So very popular items are in the front caches multiple times, but the back cache only once. [21:28:49] ok, now it rings the bell - the back cache stores items only once - thx [21:30:07] I'm going to talk about MediaWiki development, I want to throw couple numbers so people gets interested [21:30:20] looking at https://github.com/wikimedia/puppet/tree/production/hieradata/hosts [21:30:20] with: [21:30:20] ls | awk '{ prefix = $1; gsub(/[0-9].*$/, "", prefix); prefixes[prefix]++} END { for (i in prefixes) { print prefixes[i], i }}' | sort -n [21:30:22] * James_F nods. [21:30:30] I will also try to convince some folks to contribute, I know that numbers "talk" to many people [21:31:21] techguru_paul: Oh, nice point. [21:31:57] raynor, James_F -> (the following, plus a few dozen singletons and pairs) [21:31:57] 3 dbstore [21:31:57] 3 ms-be [21:31:59] 3 mw [21:32:01] 3 phab [21:32:03] 3 restbase-dev [21:32:05] 4 cloudcontrol [21:32:07] 4 cloudelastic [21:32:09] 4 labvirt [21:32:11] 4 rdb [21:32:13] 5 cloudvirtan [21:32:15] 5 labstore [21:32:17] 6 aqs [21:32:19] 6 sessionstore [21:32:21] 7 analytics [21:32:23] 7 lvs [21:32:25] 8 maps [21:32:27] 8 pc [21:32:29] 11 dbproxy [21:32:31] 12 kubernetes [21:32:33] 18 es [21:32:35] 19 cp [21:32:37] 31 cloudvirt [21:32:39] 41 restbase [21:32:41] techguru_paul: pastebin please [21:32:41] 152 db [21:33:17] Oh, right, 3 cp farms of ~6 machines each and we only talk to the front-end. [21:33:30] Krenair: it's okay [21:33:43] techguru_paul, thank you, thats really helpful [21:34:07] techguru_paul, this stuff triggers the flood alerts, please use a pastebin [21:34:10] thanks [21:35:23] legoktm, Krenair -- sorry, I am using an unfamiliar IRC GUI client, thanks for the reminder -- will rectify [21:35:45] no worries [21:35:57] ^ just to be more careful next time :) [21:38:09] I guess we don't have a hieradata file on the mw* servers because their work doesn't vary between boxen. [21:44:07] check in ./common/role etc.. based on roles and profiles [21:44:09] instead of host names [21:44:27] mediawiki::appserver afair [21:46:35] 10Phabricator-Bot-Requests, 10Discourse, 10Space: Loop trying to create an account in Wikimedia Space with certain browser versions - https://phabricator.wikimedia.org/T226545 (10Darwinius) @Qgil I experimented loging in with my mobile phone, and it worked. After that Firefox (with a zillion open tabs, true)... [21:53:42] counting from the nodes in https://github.com/wikimedia/puppet/tree/production/conftool-data/node ... [21:54:51] mw = 278 [21:59:39] mw=274, cp-79, elastic=65, wtp=44, restbase=33, kubernetes=24 [22:02:12] thats a lot of servers [22:04:56] (03CR) 10Smalyshev: [C: 03+2] Use wikidata-query over wikidata-query-blazegraph [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/512980 (owner: 10Paladox) [22:05:03] (03CR) 10Smalyshev: [V: 03+2 C: 03+2] Use wikidata-query over wikidata-query-blazegraph [wikidata/query/blazegraph] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/512980 (owner: 10Paladox) [22:11:10] 10Project-Admins: Proposal for global tag: "Needs Discussion" - https://phabricator.wikimedia.org/T226671 (10MBinder_WMF) [22:43:41] 10Phabricator: Change username - https://phabricator.wikimedia.org/T226676 (10Baloch007) [23:02:28] raynor: and its nothing compared to Google/fb/Amazon, etc. [23:12:53] 10Diffusion, 10Release-Engineering-Team (Development services), 10Operations, 10Packaging, and 2 others: Cannot connect to vcs@git-ssh.wikimedia.org (since move from phab1001 to phab1003) - https://phabricator.wikimedia.org/T224677 (10greg) [23:13:40] 10Diffusion, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (201907), 10Operations, and 3 others: Cannot connect to vcs@git-ssh.wikimedia.org (since move from phab1001 to phab1003) - https://phabricator.wikimedia.org/T224677 (10greg) [23:29:22] legoktm, that's true - but still, numbers are impressive. Many people still work on 2-3 servers (web + db, done) [23:37:25] 10Scap: Automating the swat deployment workflow - https://phabricator.wikimedia.org/T226682 (10mmodell) [23:37:46] 10Scap: Automating the swat deployment workflow - https://phabricator.wikimedia.org/T226682 (10mmodell) p:05Triage→03Normal