[00:45:28] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 1044 MB (5% inode=91%); [02:15:32] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 1007 MB (5% inode=91%); [03:45:36] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 971 MB (5% inode=91%); [05:15:40] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 935 MB (5% inode=91%); [06:27:21] RECOVERY - check disk on ORES-web02.Experimental is OK: DISK OK [11:31:25] o/ [11:31:49] I should check what's wrong with web02 [12:53:54] 10ORES, 10Scoring-platform-team (Current), 10User-Ladsgroup: Fix statsd config handing in ores - https://phabricator.wikimedia.org/T218567 (10Ladsgroup) [13:56:32] Hey folks. [13:56:34] I'm OOO today but I'm popping in to deploy a maintenance notice for Wikilabels. [14:00:18] halfak: your not allowed to be ooo :P [14:01:46] :P [14:02:12] I missed a Holiday last week. I had to work. I was hoping to make it up today but there's always work that needs doing and no one else to do it on a small team. :| [14:02:51] outsource it :P [14:02:57] akosiaris: hey, the hiera for statsd instance is like "statsd.eqiad.wmnet:#port" (the general config that is been used in a million places). Is it okay if we split it to two config vars, one for host and one for port? [14:04:26] OK maintenance notice looks good on staging. [14:05:18] Amir1: sure [14:05:27] if it brings value, just do it [14:06:18] akosiaris: It's basically impossible to pass it around to statsd client library in python like this. That's the biggest reason [14:06:44] I can split the config value like config.split(':') but ewww [14:07:10] sounds like a good enough reason [14:07:27] 10Scoring-platform-team (Current), 10Cloud-VPS, 10Wikilabels: Migrate Wikilabels from labsdb1004 to clouddb1002 - https://phabricator.wikimedia.org/T217922 (10Halfak) @Shilad ^ any opinions on this database? [14:07:30] Thanks [14:08:05] 10Scoring-platform-team (Current), 10Cloud-VPS, 10Wikilabels: Migrate Wikilabels from labsdb1004 to clouddb1002 - https://phabricator.wikimedia.org/T217922 (10Halfak) I've just pushed the maintenance notice out to Wikilabels. @Harej posted a bunch of announcements. We're ready to try the migration at 1400... [14:14:44] 10Scoring-platform-team (Current), 10Cloud-VPS, 10Wikilabels: Migrate Wikilabels from labsdb1004 to clouddb1002 - https://phabricator.wikimedia.org/T217922 (10Shilad) >>! In T217922#5032775, @Halfak wrote: > @Shilad ^ any opinions on this database? Wipe it! I no longer need it, but thanks for checking in! [14:22:04] I just posted our proposed goals for Q4. See https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/FY2019/TEC5:_Scoring_Platform/Goals#Q4_Goals [14:22:56] And with that I'm back to OOO. [14:22:59] Take care, folks. [14:34:50] akosiaris: the monitoring bit is in the Q4 goals now ^ [14:35:03] Amir1: thanks ! [15:12:18] I'm going to eat lunch, will be back soon [16:19:15] I need some time off now, no one is in the meeting [16:22:04] I'm OOO today. Did you ping harej? [16:22:09] Amir1, ^ [23:21:21] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 1080 MB (5% inode=91%);