[08:33:16] bacula fd is maximizing 2 cpus on contint1001, many small files maybe? [14:13:15] funny that only 1 job is running concurrently [14:13:22] 10DBA, 10Operations, 10serviceops, 10Goal, 10Patch-For-Review: Switchover backup director service from helium to backup1001 - https://phabricator.wikimedia.org/T236406 (10jcrespo) Some jobs are getting stuck (single xml backups) for some issue complaining about the sd daemon. Even cancel gets stuck (expe... [14:13:23] there should be too IIRC [14:20:11] yeah configuration says 2 per SD, 10 for the director, 1 per FD [14:20:22] there should be another job working fine right now [14:28:13] they used to be 2 [14:28:38] something was weird, but I was waiting for that 1 to finish to see what happened [14:29:19] I scheduled a restore down below [14:29:39] with prioarity 1, but it is supposedly blocked [14:30:15] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10WDoranWMF) @jcrespo Totally aware, you guys are jammed up right now, do you think we can proceed based on what we have or are there conce... [14:32:53] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) I still don't see the gerrit patch? https://gerrit.wikimedia.org/g/mediawiki/core/+/533346b24ffbd93a50f81b0534a6dd5e2f4f861f/inc... [14:36:11] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10BPirkle) https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/545590/ [14:37:19] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) Thanks, that should be the #1 thing I need, in some cases, I don't even need a ticket!, just be added to the review :-D [14:40:38] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10WDoranWMF) Thank you, @jcrespo! [14:44:19] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) The last thing I need to know from you, which will not be on the review (although it could be on the commit msg!), is the expect... [14:53:33] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) Based on testing I made, this query would bring down our production servers unless run "offline" on a cron + our vslow servers,... [14:55:40] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10WDoranWMF) pinging @eprodromou for metrics on usage of below: - only called on update/not user dependent/cached - Number of calls sim... [14:57:09] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10WDoranWMF) @BPirkle @jcrespo Are there limits or optimisation we can employ to improve this? [15:01:34] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) >>! In T235572#5619570, @WDoranWMF wrote: > @BPirkle @jcrespo Are there limits or optimisation we can employ to improve this? S... [15:04:50] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) a:05jcrespo→03eprodromou Moving temporarilly to other tasks, let me know how to proceed. [15:10:01] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10WDoranWMF) @jcrespo thanks, we'll review and loop back to you. [15:15:58] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) If you limit yourself to namespace 0, it *may* be possible with some rate limiting (but I don't like that much from a user persp... [15:19:56] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10Anomie) >>! In T235572#5619554, @jcrespo wrote: > Based on testing I made, this query would bring down our production servers unless run... [15:20:31] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10eprodromou) >>! In T235572#5619560, @WDoranWMF wrote: > pinging @eprodromou for metrics on usage of below: > - only called on update/no... [15:29:45] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) >>! In T235572#5619688, @Anomie wrote: >>>! In T235572#5619554, @jcrespo wrote: >> Based on testing I made, this query would bri... [15:41:16] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10WDoranWMF) @jcrespo What is the level of effort to test out an additional index on index on rev_page, rev_minor? [15:47:19] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) >>! In T235572#5619863, @WDoranWMF wrote: > @jcrespo What is the level of effort to test out an additional index on index on rev... [15:59:51] 10DBA: dbprov2002 slower to generate snapshots - https://phabricator.wikimedia.org/T236924 (10jcrespo) [16:40:01] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10BPirkle) I'm going to look around in our codebase for an example of doing counts with limits. But as a quick sanity check, this returns v... [16:42:49] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10jcrespo) >>! In T235572#5620151, @BPirkle wrote: > I'm going to look around in our codebase for an example of doing counts with limits. B... [16:45:49] 10DBA: dbprov2002 slower to generate snapshots - https://phabricator.wikimedia.org/T236924 (10jcrespo) It needs to finish the backups T236406#5619287 and ongoing snapshots for me to do a sanity restart. [16:45:59] 10DBA: dbprov2002 slower to generate snapshots - https://phabricator.wikimedia.org/T236924 (10jcrespo) p:05Triage→03Normal [17:05:17] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10WDoranWMF) @jcrespo @BPirkle and I spoke with @eprodromou if the limit will work and not break the DBs for now, we think we'll move forwa... [17:06:15] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10Anomie) >>! In T235572#5620151, @BPirkle wrote: > I'm going to look around in our codebase for an example of doing counts with limits. L... [19:00:13] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10eprodromou) >>! In T235572#5620305, @Anomie wrote: > @eprodromou would have to determine whether a capped count would serve. It will wor... [19:04:31] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10Pchelolo) I hoper we're going to apply the limit to all the count types right? [21:08:50] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10BPirkle) Prospective change uploaded to https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/545590/ Here's the actual query executed by... [21:12:27] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10BPirkle) >>! In T235572#5620876, @eprodromou wrote: > @bpirkle let's say the cap is 500. You should set your LIMIT to 501. If you get bac... [21:14:32] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10BPirkle) >>! In T235572#5620892, @Pchelolo wrote: > I hoper we're going to apply the limit to all the count types right? That's an @epr... [21:51:04] 10DBA, 10CPT Initiatives (Core REST API in PHP), 10Core Platform Team Workboards (Green): Compose query for minor edit count - https://phabricator.wikimedia.org/T235572 (10eprodromou) > So if the cap is 500 and there is only one minor edit, I'm returning `{"count": 1, "limit": false}`. Yes, that's right!