[02:00:27] RECOVERY - Disk space on Hadoop worker on an-worker1087 is OK: DISK OK https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [02:02:19] RECOVERY - Disk space on Hadoop worker on an-worker1090 is OK: DISK OK https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [07:43:43] 10Analytics: Superset + Turnilo access for Verena Lindner + Raja Gumienny (WMDE) - https://phabricator.wikimedia.org/T231677 (10Nuria) What are the wikitech users for each? (wikitech user and LDAP is the same one) [08:05:33] AndyRussG: eventlogging is included in all pages [08:05:55] AndyRussG: do you mean whether it has finished loading? [08:13:00] (03CR) 10Nuria: "Not sure it intent is to remove wikidata job, it is still there. I am fine leaving it provided we have test it and document it." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/533169 (https://phabricator.wikimedia.org/T215655) (owner: 10Joal) [08:21:03] 10Analytics: Superset throwing up performance errors - https://phabricator.wikimedia.org/T231614 (10Nuria) I I see that chart is trying to access pageview_hourly for 4 years split by browser, reducing the time range would help. [08:26:35] PROBLEM - Disk space on Hadoop worker on an-worker1078 is CRITICAL: DISK CRITICAL - free space: /var/lib/hadoop/data/e 16 GB (0% inode=99%): /var/lib/hadoop/data/m 30 GB (0% inode=99%): /var/lib/hadoop/data/l 27 GB (0% inode=99%): /var/lib/hadoop/data/g 26 GB (0% inode=99%): https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [08:34:25] RECOVERY - Disk space on Hadoop worker on an-worker1078 is OK: DISK OK https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [10:05:05] 10Analytics, 10Analytics-Kanban: third party domain data is getting refined - https://phabricator.wikimedia.org/T228557 (10Nuria) Issue was camel case "webHost" (spark) versus column name ("webhost") in hive [12:11:21] (03PS1) 10Nuria: Correcting column name as spark is case sensitive [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/533629 (https://phabricator.wikimedia.org/T228557) [12:12:23] (03PS2) 10Nuria: Correcting column name as spark is case sensitive [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/533629 (https://phabricator.wikimedia.org/T228557) [12:13:31] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: third party domain data is getting refined - https://phabricator.wikimedia.org/T228557 (10Nuria) [13:34:07] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: third party domain data is getting refined - https://phabricator.wikimedia.org/T228557 (10Nuria) Corrected, code will be deployed with next refinery >select webhost, count(*) from virtualpageview where year=2019 and month=07 and day=19 and hour=20 and w...