[01:19:33] eqiad elasticsearch dropped into red status during this rolling reboot, taking a look [01:20:20] hmm, back into yellow now [01:23:56] https://www.irccloud.com/pastebin/mnVeM3w5/some_0_rep_indices.log [01:24:22] handful of 0 replication indices. not sure if that means there's a reindex going on or if something is just borked [01:24:44] in any case I feel comfortable letting the cookbook continue [10:47:56] lunch [12:05:01] dcausse: I was not able to find a hive table named `wcqs-external.sparql-query`. All I could find was a stream with that name. [12:07:44] Am I looking for a table that’s a sink for that stream? [13:07:21] pfischer: my bad should be event.wcqs_external_sparql_query (- and . get converted to _), you can also use https://datahub.wikimedia.org to search for tables/streams [14:16:37] o/ [14:36:16] \o [14:41:48] o/ [14:49:49] proposed draft of communication to mediawiki-l (and maybe others?) about dumps: https://phabricator.wikimedia.org/P85094 [14:52:46] oh i guess i need some dates about when we will turn off the old dumps...i dunno [14:55:34] wikitech-l no ? [14:57:05] question before it's too late, we're fine with this "index_name=" prefix in all the subfolders? [14:58:04] otherwise the message lgtm [14:58:56] I made some slight edits to the message. Looks good. [14:59:12] probably mediawiki-l, wikitech-l, not sure where else [14:59:18] asked in #no-stupid-questions, maybe someone will have ideas [14:59:32] for the index_name= prefix, i was going to leave it but i guess it is a little odd [15:04:43] .o/ [16:09:20] hmm, was wondering what the road closure signs were about...apparently today is "rip out and replace the road" day :S [16:09:29] will see how loud they end up being [16:09:51] :/ [16:11:25] there are some upsides, there is a very nearby corner with tree roots that gave one side a washboard, so people often come around the corner on the other side of the road. Would be nice to fix :) [16:18:16] for timing, i dunno..this seems reasonable: We will continue producing the old dumps through november, expecting to shut them off before the end of the year. [16:18:42] sounds good to me [16:40:49] mailed wikitech-l and xmldatadumps-l. Will also poke through phab, could perhaps contact the people that contacted us when the dumps were not being produced [16:54:19] thanks! [16:54:27] heading out, have a nice week-end [17:05:43] .o/ [17:05:47] workout, back in ~30 [17:05:50] err...40 [18:47:51] curiously...trawled over wikitech and mw.org, but didn't find any docs to update about the dumps. There is some bits about cron/old dumps to clean out once we drop the jobs. [22:02:19] ryankemper you got anything for pairing? I just closed out T408919 and I'm working on my Asana update [22:02:19] T408919: OpenSearch on K8s: Create separate user for the OpenSearch operator - https://phabricator.wikimedia.org/T408919 [22:14:28] inflatador: dusting off the wdqs slo patch. also gonna kick off a codfw cirrus reboot when I’m back at my desk in 15’ (out w dog now) [22:37:09] ryankemper ACK, I'm out of time today, gotta pick up my son. See ya Monday! [22:39:10] inflatador: have a good weekend! [22:39:13] kicking off codfw reboot now [22:39:58] hmm we have a bunch of 1 replica apifeatureusage indices. i forget if there was a reason why it's not set to 2 or if that's just an oversight