[05:37:26] 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10Core Platform Team Backlog (Watching / External), and 3 others: Modern Event Platform: Stream Intake Service: Migrate Mediawiki Eventbus events to eventgate-main - https://phabricator.wikimedia.org/T211248 (10AndyRussG) >>! In T211248#5325606, @Ot... [06:27:29] PROBLEM - Check the last execution of mediawiki-history-drop-snapshot on an-coord1001 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki-history-drop-snapshot https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [06:50:39] !log run msck repair table mediawiki_wikitext_history in beeline [06:50:44] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [06:58:51] RECOVERY - Check the last execution of mediawiki-history-drop-snapshot on an-coord1001 is OK: OK: Status of the systemd unit mediawiki-history-drop-snapshot https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [09:37:05] (03CR) 10Hoo man: [C: 04-1] "The query seems really weird to me (and I think it at least needs an additional group by pp_propname)." (034 comments) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522537 (https://phabricator.wikimedia.org/T224129) (owner: 10Ladsgroup) [09:42:43] (03PS9) 10Fdans: Add file extension and media type classification to media files UDF [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/517641 (https://phabricator.wikimedia.org/T225911) [09:44:19] (03CR) 10Hoo man: [C: 03+2] Fix queries to follow the new actor schema (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522549 (https://phabricator.wikimedia.org/T227788) (owner: 10Ladsgroup) [09:46:08] (03CR) 10jerkins-bot: [V: 04-1] Add file extension and media type classification to media files UDF [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/517641 (https://phabricator.wikimedia.org/T225911) (owner: 10Fdans) [09:46:22] (03CR) 10Fdans: Add file extension and media type classification to media files UDF (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/517641 (https://phabricator.wikimedia.org/T225911) (owner: 10Fdans) [09:46:23] 10Analytics, 10Analytics-Kanban: LDAP ldap-ro.eqiad.wikimedia.org not reachable from Analytics VLAN - https://phabricator.wikimedia.org/T227611 (10elukey) a:03elukey [09:48:25] (03CR) 10Ladsgroup: Track number of external identifiers on wikidata alongside statements (034 comments) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522537 (https://phabricator.wikimedia.org/T224129) (owner: 10Ladsgroup) [09:49:43] (03CR) 10Hoo man: [C: 04-1] Track number of external identifiers on wikidata alongside statements (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522537 (https://phabricator.wikimedia.org/T224129) (owner: 10Ladsgroup) [10:22:47] (03CR) 10Hoo man: [C: 03+2] Use config for wdqs host name [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/520903 (https://phabricator.wikimedia.org/T218710) (owner: 10Ladsgroup) [10:23:11] (03Merged) 10jenkins-bot: Use config for wdqs host name [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/520903 (https://phabricator.wikimedia.org/T218710) (owner: 10Ladsgroup) [10:29:20] * elukey lunch! [10:45:41] (03PS1) 10Ladsgroup: Use config for wdqs host name [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523131 (https://phabricator.wikimedia.org/T218710) [10:46:37] (03CR) 10Ladsgroup: [C: 03+2] Use config for wdqs host name [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523131 (https://phabricator.wikimedia.org/T218710) (owner: 10Ladsgroup) [10:47:01] (03Merged) 10jenkins-bot: Use config for wdqs host name [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523131 (https://phabricator.wikimedia.org/T218710) (owner: 10Ladsgroup) [11:37:00] 10Analytics, 10ULS-CompactLinks, 10UniversalLanguageSelector: The Interlanguage Navigation Statistics dashboard stops at 2019-05-26 - https://phabricator.wikimedia.org/T228033 (10Amire80) [13:13:41] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Dropping data from druid takes down aqs hosts - https://phabricator.wikimedia.org/T226035 (10elukey) @Nuria probably yes, I agree! [13:40:12] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Make it possible to use $ref in JSONSchemas - https://phabricator.wikimedia.org/T206824 (10Ottomata) For posterity, this is being done in https://github.com/wikimedia/jsonschema-tools with... [13:46:56] !log stop all timers on an-coord1001 as prep step for maintenance [13:46:57] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:47:53] ottomata: o/ [13:47:54] morninggg [13:48:02] I stopped all the timers on an-coord1001 [13:48:06] Hellooo! [13:48:10] I'd say that we wait a bit then we can proceed? [13:48:19] oh for the LVM thingee? [13:48:25] yes, sounds good. [13:48:25] exactly [13:48:43] i did the resize live, it is usually harmless, but i think there is mroe posssibility for error when decreasing size [13:48:55] but i'd expect it to fail kindly :) [13:50:33] (03CR) 10Ottomata: [C: 03+2] Deploy to notebook hosts as a separate environment to avoid deploying artifacts [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/522542 (https://phabricator.wikimedia.org/T227132) (owner: 10Ottomata) [13:50:43] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Deploy to notebook hosts as a separate environment to avoid deploying artifacts [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/522542 (https://phabricator.wikimedia.org/T227132) (owner: 10Ottomata) [13:52:10] really nice!! --^ [13:53:51] (03CR) 10Ottomata: "Done https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Deploy/Refinery#Deploying_to_notebook*_hosts" [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/522542 (https://phabricator.wikimedia.org/T227132) (owner: 10Ottomata) [13:54:02] 10Analytics, 10Analytics-Kanban, 10Release-Engineering-Team, 10Patch-For-Review: issues with artifact cache in an-coord1001 - https://phabricator.wikimedia.org/T227132 (10Ottomata) Docs updated: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Deploy/Refinery#Deploying_to_notebook*_hosts [13:54:29] ottomata: enabling firewall on notebooks! (all spark sessions have the new port config) [13:54:51] great! [13:58:29] \o/ [14:01:34] ottomata: proceeding on an-coord1001 [14:01:44] ok! [14:03:34] (03PS1) 10Ottomata: Set deploy targets for notebook environment [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/523171 (https://phabricator.wikimedia.org/T227132) [14:04:15] (03PS2) 10Ottomata: Set deploy targets for notebook environment [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/523171 (https://phabricator.wikimedia.org/T227132) [14:04:31] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Set deploy targets for notebook environment [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/523171 (https://phabricator.wikimedia.org/T227132) (owner: 10Ottomata) [14:05:48] ottomata: so it seems that online shrinkng is not supported, so I need to umount /srv [14:06:55] hellooooo ottomata let's move that hadoop reportupdater job to reportupdater-queries too? [14:06:56] https://gerrit.wikimedia.org/r/#/c/analytics/reportupdater-queries/+/520432/ [14:07:06] (03PS1) 10Ottomata: Don't use canary deployment group for notebook environment [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/523173 [14:07:27] fdans: sure! [14:07:30] shoudl I merge this? [14:07:40] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Don't use canary deployment group for notebook environment [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/523173 (owner: 10Ottomata) [14:08:06] ottomata: yessss please [14:08:14] (03CR) 10Ottomata: [C: 03+2] Add interlanguage hadoop queries to queries directory [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/520432 (https://phabricator.wikimedia.org/T222739) (owner: 10Fdans) [14:08:18] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Add interlanguage hadoop queries to queries directory [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/520432 (https://phabricator.wikimedia.org/T222739) (owner: 10Fdans) [14:08:24] thank you! [14:13:00] ottomata: so there are some /srv/tmp/etc.. files held by mariadb, I am not able to clean umount /srv [14:13:10] unless I stop mariadb for a sec [14:13:22] elukey: do you have to umount? [14:13:54] root@an-coord1001:/home/elukey# resize2fs /dev/mapper/an--coord1001--vg-srv 103G [14:13:57] resize2fs 1.43.4 (31-Jan-2017) [14:14:00] Filesystem at /dev/mapper/an--coord1001--vg-srv is mounted on /srv; on-line resizing required [14:14:03] resize2fs: On-line shrinking not supported [14:14:06] hmm [14:14:10] ah ok, sso reduceing [14:14:10] hm [14:14:19] shoot i'm sorry elukey [14:14:20] ok. [14:14:29] hm [14:14:36] nono I am rubberducking, never done it before :) [14:14:40] yaya [14:14:50] no i'm just sorry because I caused this, let's see. [14:14:57] do we need to schedule a downtime then? [14:15:53] what we could do, in theory, is to change the tmp dir of mariadb to say /tmp temporarily, then restart and proceed with /srv [14:16:00] it should free us from issues [14:16:55] hm, a restart of mariadb like that will be fine you think? [14:17:01] do we need to stop oozie and hive? [14:17:08] and druid? :0 [14:18:21] they might complain yes.. druid is able to recover, oozie and hive probably will get a bit upset [14:18:37] ok then, let's schedule a proper maintenance [14:18:57] well i dunno, if we can just do it real fast. [14:18:58] yargh. [14:19:02] maybe it would be fine? [14:19:06] coudl be dangerous dunno. [14:19:22] cluster usage is pretty low atm. [14:19:25] yeah it could be, we could do it now sending an email to people explaining [14:19:28] yeah [14:19:32] elukey: let's do it now [14:19:35] better to get backups back [14:20:21] sending an email then [14:22:33] done [14:23:03] 10Analytics, 10Analytics-Kanban, 10Release-Engineering-Team: issues with artifact cache in an-coord1001 - https://phabricator.wikimedia.org/T227132 (10Ottomata) I've manually removed a bunch of old refinery artifact jar versions from the refinery deploy on notebook hosts to free up space. [14:23:13] ok elukey [14:23:23] so plan: stop puppet, set /tmp for mariadb [14:23:27] restart mariadb [14:23:28] !log temporary stop oozie/hive/mariadb for maintenance [14:23:29] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:23:33] proceed with lvm reduce [14:23:38] yep, already done the first two [14:23:43] check that all is well [14:23:51] set /srv/tmp for mariadb [14:23:55] restart mariadb [14:23:59] check that all is well. [14:24:00] ok! [14:24:01] great. [14:25:39] all right mariadb restarted [14:25:41] seems good [14:25:44] trying to umount [14:25:59] yes now it works [14:26:02] great [14:26:06] proceedign with resize ok? [14:26:32] ottomata: --^ [14:26:39] resize2fs /dev/mapper/an--coord1001--vg-srv 103G [14:27:13] yes [14:27:36] done, now lvm [14:27:44] lvreduce -L -10G /dev/mapper/an--coord1001--vg-srv [14:28:52] /dev/mapper/an--coord1001--vg-srv 102G 24G 78G 24% /srv [14:29:59] gr8 [14:29:59] ottomata: now restarting mariadb again with prev settings [14:30:03] gr8 [14:31:14] AndyRussG: lemme know when you have some time and we can migrate the campaign events [14:31:31] all done [14:31:42] thank you lucaaa [14:31:45] !log restart hive/oozie/mariadb on an-coord1001 after mainteance [14:31:47] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:32:02] !log resize /srv on an-coord1001 to 103G (-10G) to allow lvm backups [14:32:04] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:33:14] running manually the mylvmbackup [14:33:38] oh AndyRussG just saw your email, replying [14:41:05] lvm snapshot taken! [14:42:22] awesome [14:43:00] ottomata: one thing - there is a analytics-search job, I didn't notice (sigh) that it was using hive, I think that it might be stuck [14:43:03] should we kill? [14:43:24] uh oh, why do you thnk it is stuck? [14:43:57] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Dropping data from druid takes down aqs hosts - https://phabricator.wikimedia.org/T226035 (10Nuria) 05Open→03Resolved [14:44:37] ottomata: I think it may be, it has been very close to finish for a while.. it was inserting and I stopped hive [14:44:50] hm [14:45:00] lemm essee.. [14:46:44] hm [14:46:46] dunno [14:46:59] elukey: maybe let it go a little bit longer, 10 or 20 minutes [14:47:11] if still going, let's ping search folks and ask them to re-run it [14:47:14] +1 [14:47:42] 10Analytics, 10LDAP-Access-Requests, 10Operations: Add Jan Dittrich to the ldap/wmde and ldap/nda groups - https://phabricator.wikimedia.org/T227774 (10akosiaris) 05Open→03Resolved a:03akosiaris WMDE-jand is already part of `wmde` ldap group. To be added to the `nda` ldap group, having signed the NDA i... [14:54:10] 10Analytics, 10Analytics-Kanban: mylvmbackup on an-coord1001 not working - https://phabricator.wikimedia.org/T227941 (10elukey) To keep archives happy: * /srv needed to be umounted, but mariadb was holding inodes (/srv/tmp is its tmp directory) * mariadb was stopped, the tmp dir switched to /tmp temporarily,... [14:54:12] 10Analytics, 10Analytics-Kanban: mylvmbackup on an-coord1001 not working - https://phabricator.wikimedia.org/T227941 (10elukey) [14:54:18] 10Analytics, 10Analytics-Kanban: mylvmbackup on an-coord1001 not working - https://phabricator.wikimedia.org/T227941 (10elukey) a:03elukey [14:55:20] (03CR) 10Nuria: Add file extension and media type classification to media files UDF (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/517641 (https://phabricator.wikimedia.org/T225911) (owner: 10Fdans) [14:57:43] 10Analytics, 10Analytics-Cluster, 10Analytics-Kanban, 10User-Elukey: Enable base::firewall on stat boxes after restricting Spark REPL ports. - https://phabricator.wikimedia.org/T170826 (10elukey) [14:59:43] ping fdans hola! standduppp [15:05:23] 10Analytics, 10LDAP-Access-Requests, 10Operations: Add Jan Dittrich to the ldap/wmde and ldap/nda groups - https://phabricator.wikimedia.org/T227774 (10Jan_Dittrich) thanks, that worked. [15:06:10] (03PS4) 10Ladsgroup: Track number of external identifiers on wikidata alongside statements [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522537 (https://phabricator.wikimedia.org/T224129) [15:06:12] (03PS2) 10Ladsgroup: Fix queries to follow the new actor schema [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522549 (https://phabricator.wikimedia.org/T227788) [15:07:29] ebernhar1son: o/ I had to stop hive for an emergency maintenance ~1h ago, and I missed application_1561367702623_82144 and application_1561367702623_82130.. they seem to be stuck (I suppose that loosing the connection with hive left them in a limbo until they timeout) [15:07:48] really sorry for the problem, I am wondering if we could kill/restart them [15:13:07] 10Analytics, 10Analytics-Kanban: Bug: geoeditors (editors per country data) 2019-06 snapshot broken - https://phabricator.wikimedia.org/T227812 (10Milimetric) p:05Triage→03High [15:13:09] (03CR) 10Hoo man: [C: 03+2] Track number of external identifiers on wikidata alongside statements [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522537 (https://phabricator.wikimedia.org/T224129) (owner: 10Ladsgroup) [15:13:34] (03Merged) 10jenkins-bot: Track number of external identifiers on wikidata alongside statements [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522537 (https://phabricator.wikimedia.org/T224129) (owner: 10Ladsgroup) [15:13:37] (03Merged) 10jenkins-bot: Fix queries to follow the new actor schema [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/522549 (https://phabricator.wikimedia.org/T227788) (owner: 10Ladsgroup) [15:14:47] (03PS1) 10Ladsgroup: Track number of external identifiers on wikidata alongside statements [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523195 (https://phabricator.wikimedia.org/T224129) [15:16:15] (03CR) 10Ladsgroup: [C: 03+2] Track number of external identifiers on wikidata alongside statements [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523195 (https://phabricator.wikimedia.org/T224129) (owner: 10Ladsgroup) [15:16:37] (03Merged) 10jenkins-bot: Track number of external identifiers on wikidata alongside statements [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523195 (https://phabricator.wikimedia.org/T224129) (owner: 10Ladsgroup) [15:16:53] (03PS1) 10Ladsgroup: Fix queries to follow the new actor schema [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523196 (https://phabricator.wikimedia.org/T227788) [15:16:57] elukey: i'll check, thanks [15:17:00] (03CR) 10Ladsgroup: [C: 03+2] Fix queries to follow the new actor schema [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523196 (https://phabricator.wikimedia.org/T227788) (owner: 10Ladsgroup) [15:17:22] (03Merged) 10jenkins-bot: Fix queries to follow the new actor schema [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/523196 (https://phabricator.wikimedia.org/T227788) (owner: 10Ladsgroup) [15:20:43] elukey: and yea it's a simple hive action that does read/write, think i can just re-run it. trying [15:20:56] ebernhar1son: thanks a lot! [15:22:49] (03PS1) 10Elukey: pageview: move the oozie coordinator to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/523200 (https://phabricator.wikimedia.org/T227257) [15:30:09] (03CR) 10EBernhardson: [C: 03+1] oozie swift/upload - add support for X-Delete-After header [analytics/refinery] - 10https://gerrit.wikimedia.org/r/522503 (https://phabricator.wikimedia.org/T213976) (owner: 10Ottomata) [15:35:19] ebernhardson: one thing that I wanted to ask you is if I can send a code review for wikimedia/discovery/analytics to move oozie's hive actions to hive2 [15:35:35] (I am doing it in https://phabricator.wikimedia.org/T227257) [15:35:49] basically the action needed would be to review and then merge/restart the oozie jobs [15:35:52] to pick up the new settings [15:39:51] (03CR) 10Ottomata: [V: 03+2 C: 03+2] oozie swift/upload - add support for X-Delete-After header [analytics/refinery] - 10https://gerrit.wikimedia.org/r/522503 (https://phabricator.wikimedia.org/T213976) (owner: 10Ottomata) [15:41:49] (03CR) 10Milimetric: [C: 03+2] Add zeroes to truncated values and UI about truncation [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/519382 (https://phabricator.wikimedia.org/T220098) (owner: 10Fdans) [15:44:55] elukey: sure [15:46:21] nuria: I can take care of opening tasks for remaining mediacounts stuff, you can just patch the current change for media types and i'll CR [16:26:50] fdans: sounds good, parent task is this one: https://phabricator.wikimedia.org/T210313 and there is 1 aqs task filed, we probably need one for js changes and another one for reloading [16:26:57] fdans: rather "loading" [16:29:44] fdans: would you like to fill in for me tomorrow at manager's meeting? [16:30:26] nuria: sure! can you send me the invite? [16:43:02] ottomata: I am merging https://gerrit.wikimedia.org/r/#/c/operations/dns/+/520767/ (DNS ipv6 records for the an-worker nodes) [16:46:42] !log add ipv6 aaaa/ptr records for an-worker* hosts (still didn't have them) [16:46:44] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:46:46] 10Analytics, 10Discovery, 10Operations, 10Research-Backlog: Make oozie swift upload emit event to Kafka about swift object upload complete - https://phabricator.wikimedia.org/T227896 (10EBernhardson) I currently have three use cases for this functionality: 1) Export bulk data updates for all wikis from an... [17:02:04] hip: yt? [17:02:41] ottomata: yep, what's up [17:03:14] got some thoughtts about stream config service stuff, got a few mins to brain bounce in a hangout? [17:03:19] yeah for sure [17:04:17] come on down to teh batcave [17:04:17] https://meet.google.com/rxb-bjxn-nip [17:04:50] 10Analytics, 10EventBus: [WIP] RFC: Stream Configuration Service - https://phabricator.wikimedia.org/T227906 (10Ottomata) [17:04:55] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 3 others: Modern Event Platform: Stream Configuration Service - https://phabricator.wikimedia.org/T205319 (10Ottomata) [17:16:06] milimetric: yt? [17:16:18] yep [17:16:25] cave? [17:16:27] sure [17:22:25] * elukey off! [17:32:31] 10Analytics, 10Operations, 10ops-eqiad: Broken disk on analytics1072 - https://phabricator.wikimedia.org/T226467 (10Cmjohnson) Disks is on it's way [17:51:50] milimetric: one more thing [17:51:55] if this is the arch we go with [17:52:01] i think we don't need an RFC, eh? [17:52:07] pretty simple stuff! [17:52:10] agreed [17:58:28] hey a-team, Deb Zierten in Comms wants to set up tracking for https://wikimediafoundation.org/ and link it with behavior through https://donate.wikimedia.org/. Do you know if we're tracking either of those right now? (the Foundation site loads JS for piwik, but I'm not seeing that on Donate) [18:17:11] milimetric: https://www.mediawiki.org/wiki/Manual:Interface/JavaScript#mw.config [18:20:03] ottomata: right, but I don’t think everything from mediawiki-config is available through mw.config, right? [18:25:42] no, but it can be made available [18:25:43] iiuc [18:26:13] milimetric: like [18:26:13] https://github.com/wikimedia/mediawiki-extensions-EventLogging/blob/master/includes/EventLoggingHooks.php#L62-L70 [18:27:30] right, but rather than make them globally available, I thought the pageModules or whatever that was called would bundle them up into a separate RL module [18:29:36] right we need them separate, i think that is possible too [18:29:39] there seem to be a lot of ways... [18:29:42] hm [18:35:34] ottomata: let me know if this makes sense: https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/523252/ [18:46:22] ottomata: not sure if the host is specified this way or we need some kind of alias [18:46:52] ottomata: will superset need a restart once this is deployed? [18:46:52] that should work [18:46:53] yeah [18:46:55] hmm [18:46:58] i think so [18:47:02] not sure [18:47:25] whaat is wikishared nuria ? [18:48:07] actually milimetric i think what we want is [18:48:08] https://www.mediawiki.org/wiki/ResourceLoader/Package_modules#Module_definition [18:48:17] [ 'name' => 'blah.json', 'config' => [ 'LegalTitleChars', 'IllegalFileChars' ] ] defines a dynamic file whose contents are {"LegalTitleChars": "...", "IllegalFileChars": "..."} [18:49:59] wow that works milimetric ! [18:52:38] ottomata: some database we use for ahem SOMETHING [18:52:46] ottomata: translations mostly i think [19:03:41] nuria: applied on analytics-tool1004 (superset host) [19:03:43] try in UI [19:26:42] 10Analytics, 10Operations, 10hardware-requests, 10netops, and 2 others: Upgrade kafka-jumbo100[1-6] to 10G NICs (if possible) - https://phabricator.wikimedia.org/T220700 (10wiki_willy) a:03Cmjohnson [20:02:21] kzeta: we don't track pageview stats for donate.wikimedia as far as I can tell, the only data we have is raw webrequests [20:24:17] milimetric: thanks! [20:39:41] 10Analytics, 10MobileFrontend, 10Readers-Web-Backlog (Readers-Web-Kanbanana-2019-20-Q1): Having trouble setting up MobileFrontend for development - https://phabricator.wikimedia.org/T226071 (10Jdlrobson) p:05High→03Low [22:59:19] kzeta: donatewiki is excluded from our pageview counting on purpose: https://github.com/wikimedia/analytics-refinery-source/blob/master/refinery-core/src/main/java/org/wikimedia/analytics/refinery/core/PageviewDefinition.java#L91 [23:00:31] kzeta: that does not mean it cannot be counted, it means that pageview counting is done as a proxy to measure (however imperfectly) "content consumption" [23:01:02] cc milimetric regarding donate wiki [23:04:47] nuria: thanks! at some point there may be a need to track WMF-specific pages separately. right now I'm in information-gathering mode, though :) [23:05:07] kzeta: sounds good [23:06:48] kzeta: here you can see hits to donatewiki https://bit.ly/2XLitqQ (sampled 1/128) for the last week [23:07:43] kzeta: upper bound seems to be less than 1 million pageviews per day [23:09:23] thanks!! [23:10:44] kzeta: I LIED, upper bound is higher [23:11:58] nuria: those are webrequests though, not pageviews [23:14:27] milimetric: ah yes, very true, the site does not have js though, so counts might not differ hugely , one sec [23:15:20] milimetric: ya, 1 order of maginitude less [23:19:12] kzeta, milimetric : superset dashboard with these requests (filtered by content_type matches html) [23:19:15] https://bit.ly/2NYp3WB