[00:10:00] 10Analytics, 10Operations, 10netops: Add more dimensions in the netflow/pmacct/Druid pipeline - https://phabricator.wikimedia.org/T254332 (10faidon) To add to the above, I'm also wondering how difficult it would be to also include AS *names*, e.g. coming from the MaxMind GeoIP ASN database. I think we've use... [03:47:26] 10Analytics-Radar, 10AbuseFilter, 10Cognate, 10ConfirmEdit (CAPTCHA extension), and 28 others: Replace PageContent(Insert|Save)Complete hooks - https://phabricator.wikimedia.org/T250566 (10DannyS712) [06:21:09] 10Analytics-Radar, 10AbuseFilter, 10Cognate, 10ConfirmEdit (CAPTCHA extension), and 28 others: Replace PageContent(Insert|Save)Complete hooks - https://phabricator.wikimedia.org/T250566 (10DannyS712) [06:21:34] hello folks, I need to reboot all our ganeti instances :( [07:03:10] Hi team [07:03:28] Hi elukey - please let me know if I can help in any way [07:04:43] !log rerun failed pageview_actor_hourly [07:04:44] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [07:04:53] helloooo team europe [07:04:59] joal: an-launcher is the only one left, I am waiting for local jobs to finish before reboot thanks :) [07:05:00] Good morning fdans :) [07:05:14] do we need to do anything for all those alarms? [07:05:14] ack elukey - you're too fast [07:05:38] elukey: I need to investigate and try to find the reason for the `heisen` aspect of the bug [07:10:25] ack, let me know if I can help [07:11:56] quick check on first day of daily jobs optimized: TIme taken divided by between 2 and 3 for daily-uniques (aggregation step only), time divided by 10(wow!) for interlanguage (aggregation step only) - eager to look at monthly jobs! [07:13:21] nice!! [07:15:10] Wow - I'm really sorry for the alerts-spam - Trying to put it to na end fast [07:23:37] elukey: side note - I have cleaned as much I could yesterday on archiva-refinery - Still left to do/discuss: refinery-camus to bump in puppet before more removal from archiva, and refinery-tools: Let's push for deleting that module/code :) [07:27:00] ack yes [07:32:48] joal: https://gerrit.wikimedia.org/r/607717 [07:33:45] Thanks elukey - +1ed [07:35:34] very weird on an-launcher1001 - I was waiting for java/python jobs to finish, and the pingback RU job seemed doing somework with an hive query [07:35:44] but it started on June 4th, and there is no trace of it in yarn [07:35:58] hm [07:36:09] elukey: let's kill that manually - this is weird though [07:36:16] yes just done, rebooting [07:37:06] (03PS1) 10Joal: Remove old camus jars (up to 0.0.115) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/607718 [07:37:42] elukey: https://issues.apache.org/jira/browse/HIVE-14555 - leading to https://issues.apache.org/jira/browse/HIVE-12302 - fixed in version 2.0 [07:37:45] :( [07:37:50] also elukey - CR just above :) [07:38:18] (03CR) 10Elukey: [C: 03+1] Remove old camus jars (up to 0.0.115) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/607718 (owner: 10Joal) [07:38:54] joal: on the good side we are migrating to hive 2.3 with bigtop :) [07:39:00] (03CR) 10Joal: [V: 03+2 C: 03+2] "Merging" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/607718 (owner: 10Joal) [07:39:29] elukey: it makes my heart full of joy - the wait until then a bit less I must say :) [07:40:06] !log Dropping refinery-camus jars from archiva up to 0.0.115 [07:40:07] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [07:55:36] (03PS1) 10Joal: Correct pageview_actor_hourly bug [analytics/refinery] - 10https://gerrit.wikimedia.org/r/607719 (https://phabricator.wikimedia.org/T255467) [07:55:48] elukey: if you have a minute (just for sanity) --^ [07:57:12] (03CR) 10Elukey: [C: 03+1] Correct pageview_actor_hourly bug (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/607719 (https://phabricator.wikimedia.org/T255467) (owner: 10Joal) [07:57:21] thqanks a lot mate [07:58:31] np :) [07:58:51] so now I am trying to think about how to sync archiva1002 with 1001, since they are a bit different [07:59:01] probably I have to wipe and restart from zero [07:59:02] hm [07:59:07] pfff :( [07:59:48] will do a try [08:00:40] ack [08:00:57] elukey: I'm also doing a try of the patch I sent for apgeview_actor_hourly [08:01:10] super [08:02:43] !log Start backfilling pageview_actor_hourly job with new patch (expected to solve heisenbug) [08:02:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:03:20] We need to let it bake and see [08:09:47] ah no I think that with a copy + directory/artifacts scanning I can sync single repositories [08:09:57] seems good [08:10:03] (just synced releases) [08:10:14] 10Analytics: Check home/HDFS leftovers of nathante - https://phabricator.wikimedia.org/T256356 (10MoritzMuehlenhoff) [08:10:20] joal: when you have time can you try to build from archiva-new? [08:10:32] 10Analytics: Check home/HDFS leftovers of nathante - https://phabricator.wikimedia.org/T256356 (10MoritzMuehlenhoff) I've already removed his Kerberos principal. [08:10:40] Sure elukey [08:14:01] Test started from stat1004 elukey [08:14:16] wow super quick thanks [08:14:40] elukey: it works, but not a lot of downloads to do - shall I test after removing my repo-cache? [08:14:48] +1 [08:15:08] joal: me and Andrew thought to repurpose notebook1003/4 in the following way [08:15:25] - an-launcher1002 (a lot of cores and ram, less hassle for us) [08:15:37] (this will be the replacement for an-launcher1001) [08:15:45] - possibly an-airflow1002? [08:15:58] (if we decide to go forward) [08:16:30] works for me elukey - Maybe an-scheduler100X instead of airflow? [08:16:46] elukey: having a more powrful machine for launcher is great :) [08:16:49] thanks for that [08:16:59] sure, we already have the "an-airflow" prefix this is why I thought about it, but for me any name is good [08:17:21] in theory I could try to do it before the next sqoop run [08:18:04] as expected, there is a performance hit from removing map-join in pageview_actor (from ~6mins to ~8mins per job) - But so far no error (waiting for more time before saying it's done) [08:18:12] that would great elukey ! [08:42:26] elukey: confirmed with more downloads [08:45:07] wooow! All good? [08:45:12] yessir:) [08:48:59] elukey: Asking for permission to merge the pageview_actor fix and do a quick deploy to fix [08:49:13] +1 [08:49:18] thanks mate [08:49:57] oh actually elukey, will ad another quick change to the patch [08:50:55] (03PS2) 10Joal: Correct pageview_actor_hourly bug [analytics/refinery] - 10https://gerrit.wikimedia.org/r/607719 (https://phabricator.wikimedia.org/T255467) [08:50:58] elukey: --^ [08:51:15] elukey: other change is bumping jar version from 0.0.126 to 0.0.128 [08:51:18] should be noop [08:53:11] yep +1 feel free to go [08:53:27] ack [08:53:48] (03CR) 10Joal: [V: 03+2 C: 03+2] "Merging for quickfix deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/607719 (https://phabricator.wikimedia.org/T255467) (owner: 10Joal) [08:54:14] fdans: forgot to mention - backfilling job should be ready if you want :) [08:54:30] fdans: I can do it if you want, but will need some help about the setup :) [08:55:05] joal: oh I'll do that joseph, I want to start slowly and check the data before proceeding [08:55:11] thank you for the deploy :) [08:55:30] no prob fdans - let me know if you wish me to help :) [08:56:51] !log deploying refinery using scap to fix pageview_actor_hourly [08:56:52] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:14:46] !log Deploy refinery to HDFS [09:14:47] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:25:43] !log Kill-restart pageview_actor jobs (current+backfill) after dpeloy [09:25:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:28:57] !log Kill-restart pageview-hourly to read from pageview_actor [09:28:58] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:04:59] Yay, pageview_actor seems stabilized :) [10:06:46] nice! [10:10:14] Backfilling is still ongoing, and I need to setup data-deletion, but the heisenbug seems gone [10:10:48] 10Analytics, 10Analytics-Kanban: Setup data-drop for pageview_actor_hourly - https://phabricator.wikimedia.org/T256362 (10JAllemandou) [11:26:31] joal: what did you do to test archiva earlier on on stat1004? set archiva-new in source, then mvn build? [11:27:44] 10Analytics, 10Analytics-Cluster: Separate Report Updater Jobs to dedicated VM - https://phabricator.wikimedia.org/T255266 (10elukey) 05Open→03Declined We are going to repurpose notebook1003 (now not used anymore) to an-launcher1002, so this vm is not needed. [11:27:46] 10Analytics, 10Analytics-Kanban: Analytics Ops Technical Debt - https://phabricator.wikimedia.org/T240437 (10elukey) [11:28:21] elukey: yep - in main pom.xml, use archiva-new instead of archiva in urls, (4 places), than mvn clean package [11:28:53] elukey: if ou want to test with more downloads, you can drop parts of your repo-cache (rm -r ~/.m2/repository/org for instance) [11:30:46] 10Analytics, 10Analytics-Cluster: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10elukey) p:05Triage→03High [11:31:27] joal: super [11:31:53] joal: there are some weird things that I found with ge*hel, I can show them to you when you have time [11:37:59] (about archiva) [11:38:14] sure elukey [11:38:36] elukey: cave? [11:39:42] sure! [11:49:44] (03PS1) 10Fdans: [wip] Add filter/split component to Wikistats [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/607768 (https://phabricator.wikimedia.org/T249758) [12:13:29] 10Analytics, 10Analytics-Cluster: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts: ` ['notebook1003.eqiad.wmnet', 'notebook1004.eqiad.wmnet'] ` The log can be found in `/var/log/wmf-a... [12:13:52] !log reimage notebook1003/4 to debian buster as fresh start [12:13:53] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:34:21] 10Analytics, 10Analytics-Cluster: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['notebook1003.eqiad.wmnet', 'notebook1004.eqiad.wmnet'] ` and were **ALL** successful. [12:45:40] 10Analytics, 10Analytics-Cluster, 10Patch-For-Review: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by elukey@cumin1001 for hosts: `notebook1003.eqiad.wmnet` - notebook1003.eqiad.wmnet (**PASS**) - Downtimed host on I... [13:05:28] 10Analytics, 10Analytics-Cluster, 10Patch-For-Review: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts: ` ['an-launcher1002.eqiad.wmnet'] ` The log can be found in `/var/log/wmf-auto... [13:29:13] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform: Camus should look for multiple possible timestamp fields to use for hourly partitioining - https://phabricator.wikimedia.org/T256370 (10Ottomata) [13:30:06] (03PS1) 10Ottomata: [WIP] Overloaded methods to make working with default Refine related classes easier [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/607788 [13:30:14] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Overloaded methods to make working with default Refine related classes easier [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/607788 (owner: 10Ottomata) [14:04:41] (03PS1) 10Ottomata: Improve log messages in KafkaReader to include topic and partition [analytics/camus] (wmf) - 10https://gerrit.wikimedia.org/r/607795 [14:04:43] (03PS1) 10Ottomata: Make JsonStringMessageDecoder search for list of possible camus.message.timestamp.field [analytics/camus] (wmf) - 10https://gerrit.wikimedia.org/r/607796 (https://phabricator.wikimedia.org/T256370) [14:05:41] (03CR) 10Ottomata: "Huh, this is one I must have committed locally when I was trying to debug Camus problems a while ago. Might as well get it merged now tha" [analytics/camus] (wmf) - 10https://gerrit.wikimedia.org/r/607795 (owner: 10Ottomata) [14:09:32] 10Analytics, 10Analytics-Cluster: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['an-launcher1002.eqiad.wmnet'] ` Of which those **FAILED**: ` ['an-launcher1002.eqiad.wmnet'] ` [14:10:47] (03PS2) 10Ottomata: Make JsonStringMessageDecoder search for list of possible camus.message.timestamp.field [analytics/camus] (wmf) - 10https://gerrit.wikimedia.org/r/607796 (https://phabricator.wikimedia.org/T256370) [14:36:13] 10Analytics-Radar, 10Event-Platform, 10Core Platform Team Workboards (External Code Reviews), 10MW-1.35-notes (1.35.0-wmf.34; 2020-05-26), 10Patch-For-Review: EventBus should make better use of DI - https://phabricator.wikimedia.org/T204295 (10Pchelolo) 05Open→03Resolved [14:37:05] 10Analytics, 10Analytics-Cluster: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts: ` ['an-launcher1002.eqiad.wmnet'] ` The log can be found in `/var/log/wmf-auto-reimage/202006251437_... [14:39:49] ottomata: o/ sorry I didn't have time up to now to check code reviews, if you need any review let me know and I'll do it [14:43:55] 10Analytics: Check home/HDFS leftovers of nathante - https://phabricator.wikimedia.org/T256356 (10Halfak) I just dropped a message to @Groceryheist. Will report back. [14:44:26] no worries !i thnk i need to rework that one i added yo to [14:47:44] super [14:48:06] I am finishing the reimage from notebook1003 -> an-launcher1002 [14:57:39] 10Analytics, 10Analytics-Cluster, 10Patch-For-Review: Repurpose notebook100[3,4] - https://phabricator.wikimedia.org/T256363 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['an-launcher1002.eqiad.wmnet'] ` and were **ALL** successful. [15:01:01] a-team gonna miss standup etc. i'm having a crazy shoulder pain and am trying to figure out what to do about it [15:01:54] * RhinosF1 not team but get well soon ottomata [16:02:27] great data-viz article! https://www.nytimes.com/interactive/2020/us/coronavirus-spread.html [16:02:53] joal: I am moving camus/refine/etc.. to an-launcher1002, ok for you? [16:02:57] (all except RU for the moment) [16:02:59] yesir! [16:07:52] !log move all timers but RU from an-launcher1001 to 1002 (puppet disabled on 1001, all timers completed) [16:07:54] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:32:23] all right timers ready! [16:33:41] mforns: I may have another RU job to check :( [16:33:49] elukey: yes? [16:34:14] the /srv/reportupdater/log/reportupdater-pingback/syslog.log [16:34:30] seems doing a very big query, and in the logs I see a lot of recurrent error [16:34:40] I am wondering if it is failing and doing the retry thing [16:35:48] Just created https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Pageview_actor_hourly if anyone can review :) [16:36:03] Having diner with family, back after [16:36:25] elukey: looking [16:42:51] (03PS1) 10Elukey: Add an-launcher1002 to the targets [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/607834 [16:43:08] (03CR) 10Elukey: [V: 03+2 C: 03+2] Add an-launcher1002 to the targets [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/607834 (owner: 10Elukey) [16:43:57] joal: if you have a moment would like to merge and use this one sooner rather than later [16:43:57] https://gerrit.wikimedia.org/r/c/analytics/camus/+/607796 [16:44:07] interesting [16:44:08] Jun 25 16:40:03 an-launcher1002 camus-webrequest[29467]: Exception in thread "main" java.io.IOException: Error opening job jar: /srv/deployment/analytics/refinery/artifacts/org/wikimedia/analytics/camus-wmf/camus-wmf-0.1.0-wmf9.jar [16:45:09] mmm but the file is there, might have been the first run of camus [16:45:53] 10Analytics-Radar, 10AbuseFilter, 10Cognate, 10ConfirmEdit (CAPTCHA extension), and 28 others: Replace PageContent(Insert|Save)Complete hooks - https://phabricator.wikimedia.org/T250566 (10DannyS712) [16:46:31] ah Caused by: java.util.zip.ZipException: error in opening zip file [16:46:58] this is weird [16:47:32] ahhh of course, without scap deploy it doesn't do the git fat [16:48:51] or not [16:49:35] it doesn't do git-fat, this is strange [16:50:17] joal: are you miissing view_count field from your table schema description there? [16:52:04] elukey: do you remember when we removed the ensure => $ensure_jobs var from jobs.pp? [16:52:25] mforns: nope, I just re-added it though (for the 1002 migration) [16:52:34] was it a job to keep absented? [16:53:10] no, no, but I just saw that the logs jump from Feb27 to Jun2, there's no logs inbetween [16:53:46] strange [16:54:34] mforns: I can try to check in puppet [16:54:49] git blame does not show deleted lines [16:55:20] mforns: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/574722/ the 27th [16:59:52] 10Analytics-Radar, 10AbuseFilter, 10Cognate, 10ConfirmEdit (CAPTCHA extension), and 28 others: Replace PageContent(Insert|Save)Complete hooks - https://phabricator.wikimedia.org/T250566 (10DannyS712) [17:04:39] 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad: Renamed notebook1003 to an-launcher1002 - https://phabricator.wikimedia.org/T256397 (10elukey) [17:13:33] mforns: I am ready to move RU jobs to 1002, not sure if you are ok or not [17:13:41] (if you are debugging etc..) [17:15:01] elukey: I don't think I need access to the logs now, I think I get what's happening [17:15:41] mforns: can I kill the current pingback process running on 1001? So it will start fresh on 1002 [17:16:28] elukey: sure! [17:16:59] mforns: ack - I have rsynced the /srv/reportupdater's content from 1001 to 1002 [17:17:05] now I am going to enable timers on 1002 [17:17:08] sounds good? [17:17:09] ok [17:17:11] yes yes! [17:20:54] !log move RU jobs/timers from an-launcher1001 to an-launcher1002 [17:20:56] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:22:26] all right https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&refresh=5m&var-server=an-launcher1002&var-datasource=thanos&var-cluster=analytics looks better [17:23:22] will check in a bit! [17:23:26] * elukey afk for 10/15 mins [17:30:03] 10Analytics-Radar, 10AbuseFilter, 10Cognate, 10ConfirmEdit (CAPTCHA extension), and 28 others: Replace PageContent(Insert|Save)Complete hooks - https://phabricator.wikimedia.org/T250566 (10DannyS712) [17:50:47] 10Analytics-Radar, 10AbuseFilter, 10Cognate, 10ConfirmEdit (CAPTCHA extension), and 28 others: Replace PageContent(Insert|Save)Complete hooks - https://phabricator.wikimedia.org/T250566 (10DannyS712) [17:52:30] Hi ottomata - I will review your patch for camus [17:52:53] ottomata: The pageview_actor_hourly doesn't pre-aggregate, it only filters [17:54:42] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712) [17:59:21] joal: we should be good with sqoop next month :) [17:59:28] \o/ elukey :) [17:59:33] thanks a lot for that [17:59:35] we may also increase the processes [17:59:40] really? [18:00:01] elukey: let's just wait and see this month - increasing the processes will also put more pressure on the DB [18:00:15] ah yes yes right [18:00:30] great nonetheless elukey :) [18:01:31] (the db is only used by us and it is super beefy, in theory it should be good) [18:01:48] I'll decom 1001 tomorrow if all is good [18:02:10] ottomata: naming q - is it ok to have an-scheduler1001? (instead of say an-airflow1002?) [18:03:35] (03CR) 10Joal: "One detail on logging - rest looks good :)" (031 comment) [analytics/camus] (wmf) - 10https://gerrit.wikimedia.org/r/607796 (https://phabricator.wikimedia.org/T256370) (owner: 10Ottomata) [18:04:36] elukey: I suggest we monitor the DB and bandwidth while running sqoop next month - and possibly try to make it faster (I want to refactor the parallelization scheme of the overall thing, would be a good opportunity) [18:06:13] +1 [18:09:31] ottomata: just added a note in doc about the table not aggregating [18:18:17] gr8! [18:18:28] joal: am responding to the event ingestiont review now [18:19:09] want to help me figure out how to make EventStreamHelper better (am renaming it to *Utilities, but I don't see the point of factoring out what is there, most of the real logic is already in EventStream and EventStreamConfig) [18:19:32] joal: oh re _actor [18:19:42] if table is not aggregating, why is it called _hourly? [18:20:16] and, why is there a reference to view_count in your example query? [18:20:35] Your doc also says [18:20:36] "These are Hive partitions, and are explicit mappings to hourly aggregations in HDFS" [18:21:12] ottomata: example query is copy-paste mistake, so is the one above - We kept the hourly to keep the frequency of jobs [18:21:19] I hear thep oint though [18:21:30] hm, yeah might be really confusing to people, do we do that for any other tables? [18:21:48] all of the _hourly, _daily named ones I know of are named that to indicate the aggregation rollup level [18:22:01] webrequest is also hourly, but we don't call it webrequest_hourly [18:22:03] same for all the event tables [18:23:41] ottomata: I see - I'm nopt happy to have to update that, but I'll do if necessary [18:24:38] (03PS13) 10Ottomata: Add classes to use EventStreamConfig with EventSchemaLoader to aide in event ingestion tasks [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) [18:24:45] (03CR) 10jerkins-bot: [V: 04-1] Add classes to use EventStreamConfig with EventSchemaLoader to aide in event ingestion tasks [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [18:24:50] joal: yeah not fun, might be good to do it before folks start using it though [18:26:24] (03CR) 10Ottomata: "Ok, I resolved all the comments except for the EventStreamUtilities (previously EventStreamHelper) and the HTTP client stuff." (037 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [18:27:02] ottomata: should we aggregated (no real point), or rename the table without hourly? [18:27:15] i think rename the table, right? [18:27:24] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712) To avoid merge conflicts with all of the updates in {T250566}, pausing for now [18:27:29] it the easiest I think [18:27:45] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712) [18:27:53] I'm still not fan of the name without hourly but he [18:27:56] eh sorry [18:28:11] going off, o/ [18:28:15] Let's see with nu*ria when she comes back [18:28:22] ottomata: she had opinions on that [18:29:09] hehehe [18:29:13] ok [18:29:43] sorry joal yeah that's just my opinion i leave the decision up to you all [18:29:56] sorry I didn't notice and make a stink about naming before [18:30:30] ottomata: you made good points - let's talk :) [18:30:43] joal: got a few mins for EventStreamHelper convo? [18:30:52] sure [19:05:48] 10Analytics, 10Analytics-Kanban: Rename pageview_actor_hourly to pageview_actor - https://phabricator.wikimedia.org/T256415 (10JAllemandou) [19:06:04] ottomata: --^ [19:06:18] 10Analytics, 10Analytics-Kanban: Rename pageview_actor_hourly to pageview_actor - https://phabricator.wikimedia.org/T256415 (10JAllemandou) a:03JAllemandou [19:06:26] 10Analytics, 10Analytics-Kanban: Rename pageview_actor_hourly to pageview_actor - https://phabricator.wikimedia.org/T256415 (10Ottomata) :) [19:06:58] 10Analytics, 10Analytics-Kanban: Rename pageview_actor_hourly to pageview_actor - https://phabricator.wikimedia.org/T256415 (10JAllemandou) [19:07:09] ottomata: also, have you seen my comment on camus code? [19:19:08] Gone for tonight - see you tomorrow team [19:19:50] 10Analytics, 10Analytics-Kanban: Delete pageview_actor_hourly data after 90 days - https://phabricator.wikimedia.org/T256417 (10JAllemandou) [19:20:00] 10Analytics, 10Analytics-Kanban: Delete pageview_actor_hourly data after 90 days - https://phabricator.wikimedia.org/T256417 (10JAllemandou) a:03JAllemandou [19:29:39] joal: not yet, thank you! [19:48:23] (03PS14) 10Ottomata: Add classes to use EventStreamConfig with EventSchemaLoader to aide in event ingestion tasks [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) [19:48:30] (03CR) 10jerkins-bot: [V: 04-1] Add classes to use EventStreamConfig with EventSchemaLoader to aide in event ingestion tasks [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [19:51:18] (03CR) 10Ottomata: "Ok, I've refactored EventStreamHelper. I still need to resolve the comments about finding a new HTTP client lib." (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [20:00:36] (03PS15) 10Ottomata: Add classes to use EventStreamConfig with EventSchemaLoader to aide in event ingestion tasks [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) [20:00:42] (03CR) 10jerkins-bot: [V: 04-1] Add classes to use EventStreamConfig with EventSchemaLoader to aide in event ingestion tasks [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/603582 (https://phabricator.wikimedia.org/T251609) (owner: 10Ottomata) [20:21:11] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712) [21:03:52] 10Quarry, 10Documentation, 10User-srodlund: admin docs: quarry - https://phabricator.wikimedia.org/T206710 (10srodlund) a:05srodlund→03None [23:07:13] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712) [23:07:54] 10Analytics-Radar, 10AbuseFilter, 10Cognate, 10ConfirmEdit (CAPTCHA extension), and 28 others: Replace PageContent(Insert|Save)Complete hooks - https://phabricator.wikimedia.org/T250566 (10DannyS712) [23:17:04] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712) [23:18:09] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712) [23:50:48] 10Analytics, 10CirrusSearch, 10Cognate, 10Discovery-Search, and 18 others: Replace TitleMoveComplet(e|ing) hooks - https://phabricator.wikimedia.org/T250023 (10DannyS712)