[01:15:24] 10DBA, 06Editing-Analysis, 06Labs, 05Security: Replicate editor_month table from analytics-store to Labs - https://phabricator.wikimedia.org/T143955#2600611 (10Neil_P._Quinn_WMF) >>! In T143955#2599417, @jcrespo wrote: > I think it would be easier if you created a public dump, then created a tool with data... [03:09:51] 10DBA, 06Editing-Analysis, 06Labs, 05Security: Replicate editor_month table from analytics-store to Labs - https://phabricator.wikimedia.org/T143955#2600665 (10Bawolff) Well gender being private would kind of defeat the point. The original use case required it to be public [06:13:17] 10DBA, 06Editing-Analysis, 06Labs, 05Security: Replicate editor_month table from analytics-store to Labs - https://phabricator.wikimedia.org/T143955#2600731 (10jcrespo) > Huh, are you saying that that Labs is no longer being developed? That's surprising to me. No, I am saying that it needs urgent maintena... [07:31:39] Hi everyone [07:31:57] not many people here, to tell the truth [07:32:17] I added here a bot for updates on DBA tickets [07:32:39] and it is logged in case offline communication is needed [07:32:48] I think it is a good way to be in touch [07:33:15] although important communications should happen on #wikimedia-operations [07:33:27] Ah, roger that [07:33:53] basically anything that affects a service has to be !log ed there [07:34:49] but here we can have offtopic conversations, like which color we should have our SQL tables [07:36:14] Ah, yes, I saw that "!log" command before, when I was sneaking for some weeks in that channel [07:37:16] good [07:37:35] that logs to https://wikitech.wikimedia.org/wiki/Server_Admin_Log [07:37:52] and twitter [07:38:07] also deployments do it automatically [07:38:34] Ah, cool. any criteria on when or what needs to be logged?, or just something that can have an impact widely? [07:38:49] anything that is "I have done an admin action" [07:39:05] I mean, not every sudo admin individually [07:39:35] but every schema change, every "deleting just a few files to make spave", every reboot [07:40:05] Ah, ok, gotcha [07:40:17] basically, anything that is done manually [07:40:36] it helps track issues if something goes wrong [07:40:42] makes sense yes [07:41:17] oh, 5xx have doubled since 9:00, lets have a look at SAL to see if any deployments or upgradeds or configs happen [07:41:40] it is an example, not happening right now [07:42:34] right right [07:42:42] makes sense, will bookmark that page then [09:11:53] 10DBA, 10MediaWiki-API, 07Performance: action=query&list=pagepropnames really slow on a big wiki, got error with ppnlimit=500 - https://phabricator.wikimedia.org/T115825#1733673 (10Tgr) On enwiki it times out even with [[ https://en.wikipedia.org/wiki/Special:ApiSandbox#action=query&format=json&list=pageprop... [15:01:19] 10DBA, 10Analytics, 10Analytics-EventLogging: Queries on PageContentSaveComplete are starting to pileup - https://phabricator.wikimedia.org/T144278#2601560 (10jcrespo) 05Resolved>03Open This is now causing cronspam, 1 email per hour sent to root@. This is not a good solution: ``` rsync: mkdir "/limn-pu... [19:15:49] 10DBA, 10Analytics, 10Analytics-EventLogging: Queries on PageContentSaveComplete are starting to pileup - https://phabricator.wikimedia.org/T144278#2602573 (10Milimetric) ping @Ottomata because he was cleaning these directories a bit, may be related [19:23:14] 10DBA, 10Analytics, 10Analytics-EventLogging: Queries on PageContentSaveComplete are starting to pileup - https://phabricator.wikimedia.org/T144278#2602603 (10Ottomata) Thanks, just merged a fix. [19:23:55] 10DBA, 10Analytics, 10Analytics-EventLogging: Queries on PageContentSaveComplete are starting to pileup - https://phabricator.wikimedia.org/T144278#2602604 (10Ottomata) 05Open>03Resolved I'm pretty sure that cronspam problem was unrelated to this ticket. Closing. [19:25:27] 10DBA, 06Operations, 06Performance-Team, 10Traffic, and 2 others: Apache <=> mariadb SSL/TLS for cross-datacenter writes - https://phabricator.wikimedia.org/T134809#2602624 (10aaron) [20:34:56] 10DBA, 06Labs, 06Operations, 07Tracking: Database replication services (tracking) - https://phabricator.wikimedia.org/T50930#2603094 (10Neil_P._Quinn_WMF) [20:35:00] 10DBA, 06Editing-Analysis, 06Labs, 05Security: Replicate editor_month table from analytics-store to Labs - https://phabricator.wikimedia.org/T143955#2603090 (10Neil_P._Quinn_WMF) 05stalled>03declined @jcrespo, thank you for the further explanation; I've [documented some of it on Wikitech](https://wikit...