[00:02:10] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): Deploy labsdbuser and views to new clouddb hosts - https://phabricator.wikimedia.org/T268312 (10Bstorm) >>! In T268312#6642780, @Bstorm wrote: > I should be able to make the indexes without either of those when the code is merged,... [00:06:04] Amir1: Spam complete!Tasks created! [00:06:25] mwhaha, I added it to my todo list. Will get to them one by one [00:06:32] 🗡️ [00:09:45] heh [05:25:50] 10DBA, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10Patch-For-Review, and 2 others: Slow load times for Special:Homepage on cswiki - https://phabricator.wikimedia.org/T267216 (10MMiller_WMF) @kostajh -- I noticed that @Tgr's question is still here, and I wanted to bring it back up. [05:49:26] 10DBA, 10Growth-Structured-Tasks, 10Growth-Team (Current Sprint): Add a link engineering: Determine format for accessing and storing link recommendations - https://phabricator.wikimedia.org/T261411 (10MMiller_WMF) 05Open→03Resolved Sounds like this done (though I don't totally understand the work here).... [06:39:34] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) [06:39:41] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) [06:40:34] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) [06:40:38] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) [06:42:24] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) s8 progress [] labsdb1012 [] labsdb1011 [] labsdb1010 [] labsdb1009 [x] dbstore1005 [] db1126 [] db1124 [x] db1116 [] db1114 [x] db1111 [x] db1109 [] db1104 [] db1101 [x]... [06:42:26] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) s8 progress [] labsdb1012 [] labsdb1011 [] labsdb1010 [] labsdb1009 [x] dbstore1005 [] db1126 [] db1124 [x] db1116 [] db1114 [] db1111 [x] db1109 [] db1104 [x] db1101 [x] db... [06:45:34] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) [06:45:48] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) [06:46:25] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) [06:46:30] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) [06:49:45] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) s1 eqiad progress [x] labsdb1012 [x] labsdb1011 [x] labsdb1010 [x] labsdb1009 [x] dbstore1003 [x] db1140 [x] db1139 [x] db1135 [x] db1134 [x] db1124 [x] db1119 [x] db1118... [06:49:49] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) s1 eqiad progress [x] labsdb1012 [x] labsdb1011 [x] labsdb1010 [x] labsdb1009 [x] dbstore1003 [x] db1140 [x] db1139 [x] db1135 [x] db1134 [x] db1124 [x] db1119 [x] db1118 [... [06:50:08] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) [06:50:24] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) [06:57:54] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): Deploy labsdbuser and views to new clouddb hosts - https://phabricator.wikimedia.org/T268312 (10Marostegui) @Bstorm I am going to apply all the grants that show up at: `templates/mariadb/grants/wiki-replicas.sql` (not the uX ones).... [06:58:35] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): Deploy labsdbuser and views to new clouddb hosts - https://phabricator.wikimedia.org/T268312 (10Marostegui) [06:59:22] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) [06:59:24] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) [07:18:13] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): Deploy labsdbuser and views to new clouddb hosts - https://phabricator.wikimedia.org/T268312 (10Marostegui) Created users (self note: `grants_labsdb` file) on clouddb1013:3313. Can you try again? ` GRANT SUPER, CREATE USER ON *.* T... [07:21:34] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) s3 eqiad progress [] labsdb1012 [] labsdb1011 [] labsdb1010 [] labsdb1009 [x] dbstore1004 [] db1124 [] db1123 [] db1112 [x] db1095 [] db1078 [] db1075 [] clouddb1017 [] clou... [07:21:37] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) s3 eqiad progress [] labsdb1012 [] labsdb1011 [] labsdb1010 [] labsdb1009 [x] dbstore1004 [] db1124 [] db1123 [] db1112 [x] db1095 [] db1078 [] db1075 [] clouddb1017 [] cl... [07:51:11] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) [07:51:30] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) [07:51:48] 10Blocked-on-schema-change, 10DBA: Drop default of ip_changes.ipc_rev_timestamp - https://phabricator.wikimedia.org/T267399 (10Marostegui) 05Open→03Resolved This is all done [07:51:55] 10Blocked-on-schema-change, 10DBA: Drop default of protected_titles.pt_expiry - https://phabricator.wikimedia.org/T267335 (10Marostegui) 05Open→03Resolved This is all done [08:04:17] 10DBA, 10Operations, 10Puppet, 10User-jbond: Request new database for pki.discovery.wmnet - https://phabricator.wikimedia.org/T268329 (10Marostegui) a:03Marostegui [08:41:43] 10DBA, 10Operations, 10Patch-For-Review, 10Puppet, 10User-jbond: Request new database for pki.discovery.wmnet - https://phabricator.wikimedia.org/T268329 (10Marostegui) @jbond this is done, the database name is `pki`. Please remember you have to use m1-master.eqiad.wmnet as a connection entry point. I h... [08:43:03] 10DBA, 10Operations, 10CAS-SSO, 10User-jbond: Request new database for idp.wikimedia.org - https://phabricator.wikimedia.org/T268327 (10Marostegui) a:03Marostegui [08:49:44] 10DBA, 10Operations, 10Patch-For-Review, 10Puppet, 10User-jbond: Request new database for pki.discovery.wmnet - https://phabricator.wikimedia.org/T268329 (10jcrespo) Thanks, I will keep an eye to make sure the db is backed up. [08:59:56] 10DBA, 10Operations, 10CAS-SSO, 10Patch-For-Review, 10User-jbond: Request new database for idp.wikimedia.org - https://phabricator.wikimedia.org/T268327 (10Marostegui) @jbond we already have a cas user that has access to `cas_staging` database. Do you want to re-use that user/password or use a different... [08:59:59] 10DBA, 10Operations, 10ops-eqiad: db1139 memory errors on boot (issue continues after board change) 2020-08-27 - https://phabricator.wikimedia.org/T261405 (10jcrespo) @Jclark-ctr Any updates from HP? The host is shut down for now. [09:01:29] 10DBA, 10Operations, 10Patch-For-Review, 10Security, 10User-Kormat: Reboot es1024 (es5 master) - https://phabricator.wikimedia.org/T268469 (10Marostegui) p:05Triage→03Medium [09:01:55] 10DBA, 10Orchestrator, 10User-Kormat: Explore orchestrator hooks to integrate them with dbctl, !log, irc alerts and emails - https://phabricator.wikimedia.org/T266452 (10Marostegui) [09:13:39] should we create a ticket to ping people to upgrade beta/deployment prep? [09:13:49] I think it is still on 10.1/stretch [09:15:36] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) a:03Marostegui [09:15:58] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) p:05Triage→03Medium [09:17:44] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) I haven't found anything specifically targeting this index with https://codesearch.wmcloud.org/search/?q=namespace_title&i=nope&files=&repos= (like `USE IN... [09:19:50] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) [09:20:45] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) s6 progress [] labsdb1012 [] labsdb1011 [] labsdb1010 [] labsdb1009 [] dbstore1005 [] db2141 [] db2129 [] db2124 [] db2117 [] db2114 [] db2097 [] db2095 [... [09:20:59] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) [09:36:55] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) For big wikis this alter requires depooling, as while the index isn't present some queries get full scans: ` +------+-------------+------------------+-----... [09:39:14] jynus: not knowing anything about this, my gut feeling is yes :) [09:44:33] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) Doing everything on the same transaction fixes it: `alter table watchlist drop key namespace_title, add key wl_namespace_title (wl_namespace, wl_title);` [10:02:19] We had a few hosts depooled in codfw, most likely due to maintenance and we (I) forgot to repool them - I just did [10:19:34] 10DBA, 10Operations, 10CAS-SSO, 10Patch-For-Review, 10User-jbond: Request new database for idp.wikimedia.org - https://phabricator.wikimedia.org/T268327 (10jbond) >>! In T268327#6644232, @Marostegui wrote: > @jbond we already have a cas user that has access to `cas_staging` database. Do you want to re-us... [10:21:20] 10DBA, 10Operations, 10CAS-SSO, 10Patch-For-Review, 10User-jbond: Request new database for idp.wikimedia.org - https://phabricator.wikimedia.org/T268327 (10MoritzMuehlenhoff) >>! In T268327#6644534, @jbond wrote: >>>! In T268327#6644232, @Marostegui wrote: >> @jbond we already have a cas user that has ac... [10:31:40] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) s4 situation - Transfer from db1121 (sanitarium master) to clouddb1015:3314 and clouddb1019:3314 completed successfully. - Sanitization on clouddb1015:3314 and clo... [10:32:20] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) [11:07:24] 10DBA, 10Operations, 10CAS-SSO, 10Patch-For-Review, 10User-jbond: Request new database for idp.wikimedia.org - https://phabricator.wikimedia.org/T268327 (10Marostegui) Database created named: `cas` Grants are the same as the ones created for {T256120} Which are: ` GRANT ALTER, CREATE, CREATE TEMPORARY TA... [11:11:41] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) [11:14:45] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) On-going transfers: db1125:3312 -> clouddb1014 db1125:3312 -> clouddb1018 [12:46:53] 10DBA, 10Data-Services: Prepare and check storage layer for skrwiktionary - https://phabricator.wikimedia.org/T268458 (10LSobanski) p:05Triage→03Medium Thanks, let us know when the database is created, so we can sanitize it. [12:54:33] 10DBA, 10Operations, 10CAS-SSO, 10User-jbond: Request new database for idp.wikimedia.org - https://phabricator.wikimedia.org/T268327 (10jbond) @Marostegui I had to [[ https://gerrit.wikimedia.org/r/643239 | add a firewall rule ]] but all looks good now, can be closed from my end. thanks [12:56:03] 10DBA, 10Operations, 10CAS-SSO, 10User-jbond: Request new database for idp.wikimedia.org - https://phabricator.wikimedia.org/T268327 (10Marostegui) 05Open→03Resolved Thank you! [13:16:30] do we have an approximation of production dbs in buster/10.4? 2/3rds? [13:17:20] I haven't done the math, but everything apart from: labsdb, sanitarium, sanitarium master, master, candidate masters [13:17:33] so "most" would be a fair assesment, right? [13:18:00] I believe so [13:21:17] I created https://phabricator.wikimedia.org/T268628 [13:22:20] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) [13:24:35] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) [13:25:53] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) The transfer finished on clouddb1014:3312 and clouddb1018:3312 but as soon as replication was started they both showed: ` Nov 24 13:23:57 clouddb1014 mysqld[7223]:... [13:26:17] 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) [14:06:55] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) On-going transfers: db1074 -> clouddb1014 db1074 -> clouddb1018 [14:16:30] hi all quick question, what is the best way to initialise a database i.e. run the create tables script. do you do it manually or is there something in puppet simlar to puppetlabs-mysql::db sql parameter (https://github.com/puppetlabs/puppetlabs-mysql/blob/main/REFERENCE.md#sql) [14:16:37] or do you just do it manually? [14:17:21] jbond42: we do not have anything in puppet for it, so you need to create the tables yourself (manually or via your own scripts) [14:17:46] marostegui: ack thanks [14:18:12] jbond42: yw! [14:30:38] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) [14:57:22] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) s6 is fully done, waiting for db1139 which is down at the moment, but doesn't receive user traffic. Let's give it 24h to see if we find issues (FORCE INDEX... [15:01:21] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) [15:03:18] 10DBA, 10Data-Services, 10Patch-For-Review, 10cloud-services-team (Kanban): Productionize clouddb10[13-20] - https://phabricator.wikimedia.org/T267090 (10Marostegui) [15:03:45] 10Blocked-on-schema-change, 10DBA: Schema change for renaming namespace_title index on watchlist - https://phabricator.wikimedia.org/T268004 (10Marostegui) [15:38:33] jbond42: as a more general answer (not just for WMF), using migrations on your framework/stack would be the way you want to organize it [15:39:10] mw uses its own system, but there are many solutions doing the same [15:42:39] jynus: ack thanks in this case upstream allready uses migrations so that should be dooable [15:46:24] 10DBA, 10Analytics, 10WMF-NDA: Remove 'kraken' user - https://phabricator.wikimedia.org/T268636 (10Marostegui) 05Open→03Resolved a:03Marostegui Thanks, I have dropped it: ` # ./section s4 | while read host port; do echo "$host:$port"; mysql.py -h$host:$port -e "show grants for 'kraken'@'10.64.%';";done... [15:46:27] 10DBA, 10Analytics, 10WMF-NDA: Remove 'kraken' user - https://phabricator.wikimedia.org/T268636 (10Marostegui) [15:51:25] 10DBA, 10Data-Services, 10Tracking-Neverending: Wikireplica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767 (10Marostegui) [15:51:30] 10DBA, 10Cloud-Services, 10Operations, 10Tracking-Neverending: Database replication problems - production and labs (tracking) - https://phabricator.wikimedia.org/T50930 (10Marostegui) [15:56:24] kormat: I am getting this error when I try to package wmfmariadbpy: ERROR: Invalid requirement: 'black==20.8b1 # Black requires py3.6+' [15:58:51] I think if I remove the comments, it works for me [15:59:23] on my env, it takes the comments as a literal, I think [15:59:41] 10DBA, 10Orchestrator, 10User-Kormat: Enable report_host for mariadb - https://phabricator.wikimedia.org/T266483 (10Marostegui) [15:59:56] sending you a patch, see if I may be doing something wrong [16:01:44] are you running tox when building? I don't get the connection [16:01:56] IIRC the black deps in only in tox and not in the software itself [16:02:16] yeah, I am running tox to test etc [16:02:35] let me send the error over a patch [16:02:46] maybe it is me [16:02:58] so not while building the deb, it's just running tox [16:03:15] yeah, building the "python package" not the debian one [16:03:25] whatever you want to call it [16:04:02] this works for me: https://gerrit.wikimedia.org/r/c/operations/software/wmfmariadbpy/+/643287/1/tox.ini [16:04:09] got it, was confusing :) yeah it might get the whole line as a dep, I see how that can happen, just moving the comment on a separate line should be ok [16:04:48] so I sent that as an explanation- happy to change it in any way it is preferred [16:05:09] personally I would have kept the comments on the line before the related code, they seem useful [16:05:14] yeah [16:05:21] but do .ini have # comments? [16:05:57] maybe it needs extra spaces? [16:05:59] not sure [16:06:08] I can try with 2 spaces [16:07:17] there are comments below, just on their own lines [16:07:35] still, they are gotten as a constant [16:07:39] I will try as new lines [16:08:39] yeah, as newlines, they work [16:08:42] amending [16:10:06] this works for me: https://gerrit.wikimedia.org/r/c/operations/software/wmfmariadbpy/+/643287/2/tox.ini [16:10:26] maybe on my environement the parser behaves differently? [16:11:17] oh: https://github.com/tox-dev/tox/issues/50#event-902186164 [16:11:58] I think I am not the first one to run into this: https://github.com/tox-dev/tox/issues/332 [16:13:14] hopefully we can fit that into 0.6 [16:14:40] volans: I am awarding your help by adding you as reviewer :-PPPPP [16:14:50] thank you! 0:-) [16:15:03] lol ok [16:30:25] restarting, back in a sec [16:42:58] 10DBA, 10Community-Tech, 10Expiring-Watchlist-Items: Watchlist Expiry: Release plan [rough schedule] - https://phabricator.wikimedia.org/T261005 (10ifried) @Marostegui Hello! We are still planning to release to all wikis on December 1st. Is that still okay? Any major concerns or blockers? Thanks in advance! [17:03:44] 10DBA, 10Operations, 10Puppet, 10User-jbond: Request new database for pki.discovery.wmnet - https://phabricator.wikimedia.org/T268329 (10jbond) 05Open→03Resolved This is working as expected thanks [17:04:46] 10DBA, 10Beta-Cluster-Infrastructure, 10Operations, 10serviceops, 10Patch-For-Review: Upgrade the MediaWiki servers to ICU 63 - https://phabricator.wikimedia.org/T264991 (10Trizek-WMF) [19:46:33] 10DBA, 10MediaWiki-Parser, 10Parsoid, 10serviceops, 10Platform Team Workboards (Green): CAPEX for ParserCache for Parsoid - https://phabricator.wikimedia.org/T263587 (10WDoranWMF) 05Open→03Declined This work will be handled by #parsoid team [19:54:24] 10DBA, 10MediaWiki-Parser, 10Parsoid, 10serviceops, 10Platform Team Workboards (Green): CAPEX for ParserCache for Parsoid - https://phabricator.wikimedia.org/T263587 (10ssastry) 05Declined→03Open a:05WDoranWMF→03None @WDoranWMF. I am going to reopen this and unassign you, but feel free to change... [20:07:54] 10DBA, 10MediaWiki-Parser, 10Parsoid, 10serviceops: CAPEX for ParserCache for Parsoid - https://phabricator.wikimedia.org/T263587 (10WDoranWMF) @ssastry That works for me, I didn't know if there was an existing ticket elsewhere but I was hoping that closing and tagging would at least assure that your team... [20:32:42] 10DBA, 10Community-Tech, 10Expiring-Watchlist-Items: Monitor the growth of watchlist table at wikidata and wikicommons - https://phabricator.wikimedia.org/T268096 (10Marostegui) [20:33:56] 10DBA, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10Patch-For-Review, and 2 others: Slow load times for Special:Homepage on cswiki - https://phabricator.wikimedia.org/T267216 (10kostajh) >>! In T267216#6617928, @Tgr wrote: > Not much point in monitoring if we don't fix it. IMO this should go back... [20:35:23] 10DBA, 10Community-Tech, 10Expiring-Watchlist-Items: Watchlist Expiry: Release plan [rough schedule] - https://phabricator.wikimedia.org/T261005 (10Marostegui) >>! In T261005#6645558, @ifried wrote: > @Marostegui Hello! We are still planning to release to all wikis on December 1st. Is that still okay? Any ma... [21:30:03] 10DBA, 10Community-Tech, 10Expiring-Watchlist-Items: Watchlist Expiry: Release plan [rough schedule] - https://phabricator.wikimedia.org/T261005 (10ifried) Thanks for the update, @Marostegui! Yes, if there are serious issues, we can easily disable the feature on wikis. Everything is behind a config flag that... [21:32:13] 10DBA, 10MediaWiki-Parser, 10Parsoid, 10serviceops: CAPEX for ParserCache for Parsoid - https://phabricator.wikimedia.org/T263587 (10ssastry) Okay, so I read through the ticket and from what I can tell, there are three different pieces to this in this order: 1. Parser Cache backing "storage" design questi... [22:33:40] 10DBA, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10Patch-For-Review, and 2 others: Slow load times for Special:Homepage on cswiki - https://phabricator.wikimedia.org/T267216 (10Etonkovidova) For `wmf.18` there are quite few similar (at least, they look similar to me) issues - filed {T268679} [22:48:06] 10DBA, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10Patch-For-Review, and 2 others: Slow load times for Special:Homepage on cswiki - https://phabricator.wikimedia.org/T267216 (10Etonkovidova) For `wmf.18` there are quite few similar (at least they look similar to me) issues - {T268679} filed ....