[00:49:59] 10DBA, 10MediaWiki-Database, 10TechCom-RFC: RFC: Proposal to add wl_addedtimestamp attribute to the watchlist table - https://phabricator.wikimedia.org/T209773 (10daniel) >>! In T209773#4765225, @Marostegui wrote: > Does this has something to do with {T125991}? Is that some sort of duplicate? I just talked... [03:54:49] 10DBA, 10Analytics, 10Analytics-Kanban, 10Data-Services, 10Core Platform Team Backlog (Watching / External): Create materialized views for performance - https://phabricator.wikimedia.org/T210693 (10Milimetric) p:05Triage>03High [03:55:26] 10DBA, 10Analytics, 10Analytics-Kanban, 10Data-Services, 10Core Platform Team Backlog (Watching / External): Create materialized views for performance - https://phabricator.wikimedia.org/T210693 (10Milimetric) cc @Nuria so she's in the loop that we're following up here about the materialized views work. [06:27:49] 10Blocked-on-schema-change, 10DBA, 10Patch-For-Review, 10Schema-change: Dropping page.page_counter on wmf databases - https://phabricator.wikimedia.org/T86338 (10Marostegui) [06:37:40] 10Blocked-on-schema-change, 10DBA, 10MediaWiki-Database, 10Scoring-platform-team, and 2 others: Schema change for rc_this_oldid index - https://phabricator.wikimedia.org/T202167 (10Marostegui) [08:09:06] The error about s2 backup is real (I mean no backups made becasause of errors, or we skipped those because of reasons?) [08:16:57] have you seen what is the cause? [08:22:29] not yet, I was asking this because of deciding it is worth check or not [08:22:43] what do you think? [08:22:46] (I mean if there were reasons, it's easier to ask) [08:23:41] I remember only one operation we made on s2 but it was in codfw, and that host wasn't backed up [08:24:12] we did another one this week [08:24:21] which is probably why it failed [08:25:02] db1095... [08:25:07] yep [08:32:55] https://phabricator.wikimedia.org/P7864 [08:33:23] When the backup tried to start the host was aready recloned [08:33:30] did I miss something? [08:33:34] That's why I am saying it is probably why it failed [08:35:08] Try to find what caused the failure [08:35:09] I go and check it [08:41:46] ```2018-11-27 18:31:22 [ERROR] - Error connecting to database: Server is running in --secure-auth mode, but 'dump'@'10.64.48.17' has a password in the old format; please change the password to the new format``` [08:41:57] there you go [08:42:31] that is because of the reclone [08:45:10] 10DBA, 10Analytics, 10Analytics-Kanban: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10elukey) [08:45:27] hello everybody, I tried to list some steps in --^ [08:45:59] it would be really great if we could come up with a plan before end of next week, so all the work can start [08:46:01] hm, the dump user not even exists on db1095 [08:46:43] banyek: that is the problem and that is why the recloned "caused" it [08:47:25] I got it, I just wanted to bring up that the error message we got is not correct [09:03:04] marostegui: I gonna run https://phabricator.wikimedia.org/P7865 [09:03:27] sounds good [09:03:34] centralauth isn't really needed, but ok [09:03:49] (grants extracted by pt-show-grants from es2001 but the ip is replaced for dbstore1001.eqiad.wmnet) [09:03:53] ok, I skip that [09:03:53] I think you should try to also generate a backup for s2, to 1) have backups for this week 2) make sure it is really fixed [09:04:06] 👍 [09:04:26] I'll start the backup inside a screen after the grants are fixed [09:04:32] good [09:12:42] don't skip centralauth [09:12:49] It is like that on the rest of the servers [09:13:07] it makes the grants the same on all servers [09:13:47] that way we don't lose it when centralauth is moved [09:18:51] ok [09:21:55] I created a file 'backup_s2.cnf' which is the copy of 'backups.cnf' except I removed all other sections than s2 [09:22:05] I will start the backup in a screen with [09:22:32] `/usr/local/bin/dump_section.py --config-file=/etc/mysql/backup_s2.cnf` [09:22:50] and remove the file when the backup is completed [09:25:11] https://phabricator.wikimedia.org/P7866 [09:26:38] the old ongoing directory is still there (dump.s2.2018-11-27--18-31-22) Shll I remove it, or the script will clean that out when it finishes? [09:29:31] remove it, I guess it will be empty? [09:29:36] well, the backup will finish in ~3,5 hours, I can check it after [09:29:53] yes, it is empty [09:30:06] rmdir [09:30:26] done ✅ [09:30:38] however, you are creating it as root [09:30:55] that will break the backups, as the cron it will fail to rotate [09:31:11] I forgot sudo -u dump beforehand [09:31:15] I stop it [09:31:16] clean up [09:31:18] and restart [09:31:32] much better because if not rotation will become messy [09:32:21] `sudo -u dump /usr/local/bin/dump_section.py --config-file=/etc/mysql/backup_s2.cnf` [09:32:59] what to do with the prevoius record in zarcillo? [09:33:07] just leave it [09:33:13] it will show as ongoing or failed [09:33:23] it's ongoing [09:33:35] so it will not count as successful [09:33:43] good [10:39:02] (as the backup finished I've clean up the screen on dbstore1001) [10:41:54] 10Blocked-on-schema-change, 10MediaWiki-Change-tagging, 10User-Ladsgroup: Drop change_tag.ct_tag column in production - https://phabricator.wikimedia.org/T210713 (10Ladsgroup) p:05Triage>03Normal [10:42:12] The day has finally come ^ [10:45:22] 10DBA, 10Operations, 10Patch-For-Review, 10User-Banyek: Implement parsercache service on pc[12]0(07|08|09|10) and replace leased pc[12]00[456] - https://phabricator.wikimedia.org/T208383 (10Marostegui) [11:59:33] when it is the best time to meet? [11:59:34] Tomorrow I'll have to leave around 15:30, so we should talk prior that [11:59:40] 11? [11:59:44] CET? [11:59:46] it's perfect for me [11:59:49] I juset sent an invite [11:59:49] marostegui: ? [11:59:51] 10-11 [11:59:55] feel free to move it [11:59:59] 10 is ok to me too [12:00:14] 10 is good [12:00:48] didn't get the invite yet [12:01:15] now [12:01:17] thanks [12:01:30] accepted [12:01:34] doesn't have to be 1h, BTW [12:01:41] we can leave when we are happy [12:03:00] I am good until 3:30 ;) [12:10:18] labsdb1010 is back in action [12:10:26] all servers upgraded & rebooted, yay [12:10:50] 10DBA, 10Data-Services, 10Patch-For-Review, 10User-Banyek, 10cloud-services-team (Kanban): Upgrade/reboot labsdb* servers - https://phabricator.wikimedia.org/T209517 (10Banyek) [12:12:05] 10DBA, 10Data-Services, 10Patch-For-Review, 10User-Banyek, 10cloud-services-team (Kanban): Upgrade/reboot labsdb* servers - https://phabricator.wikimedia.org/T209517 (10Banyek) All servers are rebooted & upgraded, I guess the task is able to close, but I leave this honor for others. [12:21:41] 10DBA, 10Data-Services, 10Patch-For-Review, 10User-Banyek, 10cloud-services-team (Kanban): Upgrade/reboot labsdb* servers - https://phabricator.wikimedia.org/T209517 (10Marostegui) Thanks for taking care of this! [12:36:03] 10DBA, 10Data-Services, 10Patch-For-Review, 10User-Banyek, 10cloud-services-team (Kanban): Upgrade/reboot labsdb* servers - https://phabricator.wikimedia.org/T209517 (10aborrero) 05Open>03Resolved Thanks @Banyek, @Bstorm and @Marostegui [13:20:03] one thing to remember is that there is 3 times related to parsercache: which expiration time they are given, when are those deleted, and how often that happens [13:20:27] I barely remember those, but I think it was one on mw config and 2 on puppet-mw maintenance [13:20:53] yeah, I need to look for those [13:21:08] I would dig the ticket when the issues appeared [13:25:33] 10DBA, 10MediaWiki-Database, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) [13:27:26] 10DBA, 10MediaWiki-Database, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) Not sure if to file this separately or not, but: we also purchased an extra host this time- We can make it work transparently through s... [14:01:00] I read all new tickets in the Triage column, and I am not sure if I to file them somewhere [14:28:56] 10DBA: Drop table image_comment_temp on all wikis - https://phabricator.wikimedia.org/T209591 (10Banyek) @Marostegui can I take this? [14:30:35] ^banyek, please ask us first- that ticket doesn't seem to be ready for us, it is stalled waiting for ok from core [14:41:54] 10DBA, 10Analytics, 10Analytics-Kanban, 10Data-Services, 10Core Platform Team Backlog (Watching / External): Create materialized views for performance - https://phabricator.wikimedia.org/T210693 (10Banyek) @bstorm I can assist if you need it, just talk to me [14:48:28] 10DBA, 10Analytics, 10Analytics-Kanban, 10Data-Services, 10Core Platform Team Backlog (Watching / External): Create materialized views for performance - https://phabricator.wikimedia.org/T210693 (10jcrespo) So you don't have to reuse this- but I am pasting this for reference: https://gerrit.wikimedia.or... [14:50:48] 10DBA, 10MediaWiki-Change-tagging, 10Operations, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), and 3 others: Migrate tag_summary usage to change_tag and drop the table - https://phabricator.wikimedia.org/T209525 (10Banyek) Do you need anything from our side this moment @Ladsgroup ? [14:52:11] 10DBA, 10MediaWiki-Database, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Anomie) > Those first column of IPs (10.64.0.12, 10.64.32.72, 10.64.48.128) are not really IPs but sharding keys. Ugh, that's awful. > Will tha... [14:56:13] 10DBA, 10MediaWiki-Change-tagging, 10Operations, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), and 3 others: Migrate tag_summary usage to change_tag and drop the table - https://phabricator.wikimedia.org/T209525 (10Ladsgroup) >>! In T209525#4785174, @Banyek wrote: > Do you need anything from our side this mo... [14:57:28] 10DBA, 10MediaWiki-Database, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) > Ugh, that's awful. To clarify the context- this was done in a rush with a record patch the day before the first datacenter switch, so... [14:58:57] 10DBA, 10Analytics, 10Analytics-Kanban: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Banyek) a:03Banyek [14:59:28] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Banyek) [15:06:47] 10DBA: Drop table image_comment_temp on all wikis - https://phabricator.wikimedia.org/T209591 (10Marostegui) Sure you can! Coordinate with @Anomie to make sure it is good to go. [15:07:52] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10Performance-Team-notice, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) This is not on performance, they may be able to give some ideas on how to move forwar... [15:08:09] 10DBA: Drop table image_comment_temp on all wikis - https://phabricator.wikimedia.org/T209591 (10Anomie) Not quite yet, probably next week. 1.33.0-wmf.6 is being deployed this week, but isn't everywhere yet (and there's the risk of having to rollback to wmf.4). [15:08:42] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) [15:15:17] 10DBA, 10MediaWiki-Change-tagging, 10Operations, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), and 3 others: Migrate tag_summary usage to change_tag and drop the table - https://phabricator.wikimedia.org/T209525 (10Marostegui) Which schema change? [15:17:41] 10DBA, 10MediaWiki-Change-tagging, 10Operations, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), and 3 others: Migrate tag_summary usage to change_tag and drop the table - https://phabricator.wikimedia.org/T209525 (10Ladsgroup) >>! In T209525#4785305, @Marostegui wrote: > Which schema change? `DROP TABLE tag... [15:18:44] 10DBA, 10MediaWiki-Change-tagging, 10Operations, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11), and 3 others: Migrate tag_summary usage to change_tag and drop the table - https://phabricator.wikimedia.org/T209525 (10Marostegui) >>! In T209525#4785310, @Ladsgroup wrote: >>>! In T209525#4785305, @Marostegui wro... [15:18:52] 10DBA: Drop table image_comment_temp on all wikis - https://phabricator.wikimedia.org/T209591 (10Banyek) >>! In T209591#4785289, @Anomie wrote: > Not quite yet, probably next week. 1.33.0-wmf.6 is being deployed this week, but isn't everywhere yet (and there's the risk of having to rollback to wmf.4). OK, just... [15:24:39] 10Blocked-on-schema-change, 10MediaWiki-Change-tagging, 10User-Ladsgroup: Drop change_tag.ct_tag column in production - https://phabricator.wikimedia.org/T210713 (10Marostegui) I will start with this after the code freeze. I might alter an slave in enwiki earlier to see how this goes, as `change_tag` is a c... [15:27:29] 10DBA, 10Operations, 10Patch-For-Review, 10User-Banyek: Implement parsercache service on pc[12]0(07|08|09|10) and replace leased pc[12]00[456] - https://phabricator.wikimedia.org/T208383 (10Marostegui) >>! In T208383#4784872, @Stashbot wrote: > {nav icon=file, name=Mentioned in SAL (#wikimedia-operations),... [15:27:39] 10DBA, 10Operations, 10Patch-For-Review, 10User-Banyek: Implement parsercache service on pc[12]0(07|08|09|10) and replace leased pc[12]00[456] - https://phabricator.wikimedia.org/T208383 (10Marostegui) [15:30:44] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Marostegui) So given the fact that we started with all the pc partially cold after switching back from codfw to eqiad (due... [15:32:32] 10DBA, 10MediaWiki-Special-pages, 10Datacenter-Switchover-2018: Significant (17x) increase in time spent by updateSpecialPages.php script since datacenter switch over updating commons special pages - https://phabricator.wikimedia.org/T206592 (10Marostegui) @Bawolff did you have a moment to look into the valu... [15:34:14] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Banyek) >>! In T210725#4785416, @Marostegui wrote: > So given the fact that we started with all the pc partially cold after... [15:40:38] 10DBA, 10MediaWiki-Special-pages, 10Datacenter-Switchover-2018: Significant (17x) increase in time spent by updateSpecialPages.php script since datacenter switch over updating commons special pages - https://phabricator.wikimedia.org/T206592 (10Marostegui) looks like this is back to normal values: ` root@mwm... [15:41:46] 10DBA, 10Analytics, 10Analytics-Kanban, 10Data-Services, 10Core Platform Team Backlog (Watching / External): Create materialized views for performance - https://phabricator.wikimedia.org/T210693 (10Bstorm) [15:52:24] I leave to the kindergarten today. I'll show up for a small amount of ticketing when I am back [16:08:03] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Imarlier) >>! In T210725#4785435, @Banyek wrote: >>>! In T210725#4785416, @Marostegui wrote: >> So given the fact that we s... [16:29:51] 10DBA, 10Cloud-Services, 10cloud-services-team: Prepare and check storage layer for shnwiki - https://phabricator.wikimedia.org/T206916 (10MarcoAurelio) Apparently it is not there still per https://github.com/Pathoschild/Wikimedia-contrib/issues/116#issuecomment-442883839? [16:33:31] 10DBA, 10Cloud-Services, 10cloud-services-team: Prepare and check storage layer for shnwiki - https://phabricator.wikimedia.org/T206916 (10MarcoAurelio) On my side, `sql shnwiki` on labs runs okay. Running @Pathoschild's command linked above does fail though. [16:39:34] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) The multiple keys is ok, we already do that for the External Storage, my worry is not that, as much as the migrati... [16:39:55] 10DBA, 10Analytics, 10Cloud-VPS: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Nuria) [16:43:01] 10DBA, 10Cloud-Services, 10cloud-services-team: Prepare and check storage layer for shnwiki - https://phabricator.wikimedia.org/T206916 (10jcrespo) @MarcoAurelio most likely the wikis is available but not on the meta_p- I am unsure if adding it to meta_p is a process that runs regularly from time to time (so... [16:46:07] 10DBA, 10Cloud-Services, 10cloud-services-team: Prepare and check storage layer for shnwiki - https://phabricator.wikimedia.org/T206916 (10bd808) >>! In T206916#4785646, @MarcoAurelio wrote: > On my side, `sql shnwiki` on labs runs okay. Running @Pathoschild's command linked above does fail though. The step... [16:48:14] 10DBA, 10Cloud-Services, 10cloud-services-team: Prepare and check storage layer for shnwiki - https://phabricator.wikimedia.org/T206916 (10GTirloni) I only ran that command on the first replica server (labsdb1009), that must be it. Did it work without errors on all 3 servers? I'll update the documentation t... [16:53:17] I'd like to ask your opinion about https://phabricator.wikimedia.org/T208622#4785750 [16:53:17] tomorrow [16:53:17] today I leave [16:53:17] bye [16:53:39] yes, just make sure to use a non-root account [16:53:47] and puppetize it [16:53:57] it looks good [16:57:17] 10DBA, 10Analytics, 10Cloud-VPS: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Banyek) as far as I know we don't have any spare hardware, but I am curious too [17:02:15] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10Banyek) I'll start tomorrow checking / documenting information about the dbstore1002 - I am curious if we make those similar to labsdb1009-1... [17:02:55] 👍 [17:04:09] 10DBA, 10Analytics, 10Cloud-VPS: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Nuria) We have some hardware orders in progress for db-like hosts, we might be able use those if nothing else is available. [17:07:55] 10DBA, 10Analytics, 10Analytics-Kanban, 10User-Banyek: Migrate dbstore1002 to a multi instance setup on dbstore100[3-5] - https://phabricator.wikimedia.org/T210478 (10elukey) As far as I know we have to go multi-instance, but I don't have a lot of context if multi-source can or is needed anymore (I guess n... [17:08:10] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Anomie) >>! In T210725#4785678, @jcrespo wrote: > Alternatively, we can setup 4 hosts actively, but I think the sharding fu... [17:14:46] 10DBA, 10Analytics, 10Cloud-VPS: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Marostegui) We don't have any spare host similar to the labsdb ones. Those are very specific hardware, as they need to contain all the wikis on the same host, they have lots of... [17:28:13] jynus: so you have to run that maintain-meta script one by one in all dbs? [17:28:19] looks like quite a work [17:28:54] wrong channel, Hauskatze [17:29:00] that is cloud [17:29:14] we only take care of replication + servers [17:29:26] I commented there in clinic duty capacity [17:29:29] certainly, my bad [17:29:35] too many channels [17:29:38] no harm done [17:29:46] just so you know that I personally don't do it [17:29:56] and I guess they don't either, but I am not sure [17:30:07] lol [17:38:23] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) > Alternatively, we can setup 4 hosts actively, but I think the sharding function won't work ok? Sorry, my fault,... [17:48:09] 10DBA, 10Operations, 10Patch-For-Review: Audit "misc" cluster hosts - https://phabricator.wikimedia.org/T210486 (10jcrespo) Adding DBA for the few db hosts that shouldn't be there, remove the tag when those are fixed: * New pc* hosts * New dbstore* hosts * dbmonitor (unsure of that one, that is most likely... [17:56:17] 10DBA, 10Operations, 10Patch-For-Review: Audit "misc" cluster hosts - https://phabricator.wikimedia.org/T210486 (10Marostegui) I can fix `regex.yaml` to add the new parsercache there, but the dbstore appearing on that list do not exist: dbstore1003 and dbstore1005 [18:09:50] 10DBA, 10Analytics, 10Cloud-VPS: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10elukey) >>! In T210749#4785874, @Marostegui wrote: > We don't have any spare host similar to the labsdb ones. > Those are very specific hardware, as they need to contain all the... [18:11:08] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Anomie) On the MediaWiki site the relevant code is in SqlBagOStuff. It looks like the current code will treat a failing ser... [18:12:46] 10DBA, 10Analytics, 10Cloud-VPS, 10User-Elukey: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10elukey) [18:14:15] 10DBA, 10Analytics, 10Cloud-VPS, 10User-Elukey: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Marostegui) That is up to you guys to decide :-) For context: 1 single host can have all the wikis - we have 3 in labs for redundancy and because we separate the... [18:16:13] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) > I see no logic for automatic switching That is ok, the plan B (or even plan A, based on your opinions) was to p... [18:20:04] 10DBA, 10Analytics, 10Cloud-VPS, 10User-Elukey: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Nuria) [18:24:48] 10DBA, 10Analytics, 10Cloud-VPS, 10User-Elukey: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Nuria) @Marostegui Let's have in mind these boxes are going to be used to scoop data once a month so they likely not need to be as beefy as boxes used every day... [18:29:22] 10DBA, 10Analytics, 10Cloud-VPS, 10User-Elukey: Hardware for cloud db replicas for analytics usage - https://phabricator.wikimedia.org/T210749 (10Marostegui) >>! In T210749#4786204, @Nuria wrote: > @Marostegui Let's have in mind these boxes are going to be used to scoop data once a month so they likely not... [18:31:02] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Marostegui) >>! In T210725#4785536, @Imarlier wrote: > > Something that I would suggest, if it's possible, is taking this... [18:34:47] 10DBA, 10Cloud-Services: Prepare and check storage layer for nap.wikisource - https://phabricator.wikimedia.org/T210762 (10MarcoAurelio) [18:36:22] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) > How will the disk space grow on those servers? Remember space is not capped except for expiration. The same con... [18:48:44] 10DBA, 10Cloud-Services: Prepare and check storage layer for nap.wikisource - https://phabricator.wikimedia.org/T210762 (10jcrespo) Waiting now for the actual creation at T210752 to setup the replication, as no preventive action is needed due to it being public. [18:49:31] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Marostegui) Yes, I'm fine with the overshard I just wanted to make sure disk space will remain untouched Thanks for clarify... [18:55:55] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10jcrespo) > Is my understanding correct? That is what I understood. [18:56:05] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Imarlier) @jcrespo I should have kept my answer simpler: I think it's fine to go ahead and do this. I would suggest changi... [20:04:53] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Krinkle) The above all sounds great. Two quick fly-by notes/recommendations: * Change at most one key on a given day (and... [20:10:24] 10DBA, 10wikitech.wikimedia.org, 10Wikimedia-production-error: Exception of type Wikimedia\\Rdbms\\DBConnectionError after an API query - https://phabricator.wikimedia.org/T210332 (10Krinkle) `name=exception [62a725b459d8e036f5a4e627] /w/api.php?... /srv/mediawiki/php-1.33.0-wmf.4/includes/libs/rdbms/loadbal... [20:13:10] 10DBA, 10Patch-For-Review, 10cloud-services-team (Kanban): cloudvps: dedicated openstack database - https://phabricator.wikimedia.org/T202889 (10Marostegui) [20:13:12] 10DBA, 10wikitech.wikimedia.org, 10Wikimedia-production-error: Exception of type Wikimedia\\Rdbms\\DBConnectionError after an API query - https://phabricator.wikimedia.org/T210332 (10Marostegui) [20:33:10] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Anomie) >>! In T210725#4786814, @Krinkle wrote: > * Add the additional overshard keys either before any or after all shard... [20:35:49] 10DBA, 10MediaWiki-Database, 10Performance-Team, 10User-Marostegui: Replace parsercache keys to something more meaningful on db-XXXX.php - https://phabricator.wikimedia.org/T210725 (10Marostegui) As we are not in a super rush, we don't we take small moves just to be on the safe side? * Replace the current... [20:57:23] 10DBA, 10Analytics, 10Analytics-Kanban, 10Data-Services, 10Core Platform Team Backlog (Watching / External): Create materialized views on Wiki Replica hosts for better query performance - https://phabricator.wikimedia.org/T210693 (10bd808) [21:41:30] 10DBA, 10JADE, 10Operations, 10TechCom-RFC, and 2 others: Introduce a new namespace for collaborative judgments about wiki entities - https://phabricator.wikimedia.org/T200297 (10daniel) We discussed this again in the TechCom meeting the other day. If DBAs are ok with not just the new field and indexes, bu... [21:53:52] 10DBA, 10JADE, 10Operations, 10TechCom-RFC, and 2 others: Introduce a new namespace for collaborative judgments about wiki entities - https://phabricator.wikimedia.org/T200297 (10awight) @Marostegui Hello! I've added a few summary columns and indexes to the link tables, and the resulting DDL would look li... [21:54:00] 10DBA, 10MediaWiki-Database, 10TechCom-RFC: RFC: Proposal to add wl_addedtimestamp attribute to the watchlist table - https://phabricator.wikimedia.org/T209773 (10daniel) @D3r1ck01 is there community support for this idea? Do many people find this useful? It seems pointless to discuss the technical merit of...