[00:00:07] ah, thanks bd808 ! yeah then I guess the talk page from there? [00:00:27] paladox: no idea, where did you get it from? [00:00:32] looking at https://tools.wmflabs.org/contact/, I think G is https://phabricator.wikimedia.org/p/Gradzeichen/ [00:01:10] and the other maintainer is https://phabricator.wikimedia.org/p/Ireas/ [00:03:11] fantastic, thanks bd808 ! [00:04:04] I want to make this easier in https://toolsadmin.wikimedia.org/ but of course that's one of N things on the list [00:05:05] 06Labs, 10Tool-Labs-tools-Other, 10DBA: High replication activity filled up labsdb1004 with binlogs - https://phabricator.wikimedia.org/T150553#2789626 (10fgiunchedi) With help from @bd808 I found @Ireas and @Gradzeichen as points of contact for `isbn` (via https://tools.wmflabs.org/?tool=isbn and subsequen... [00:05:59] looks really cool [00:21:05] 06Labs, 10Tool-Labs-tools-Other, 10DBA: High replication activity filled up labsdb1004 with binlogs - https://phabricator.wikimedia.org/T150553#2789635 (10Volans) I already added all 7 of them listed there in a previous post ;) [01:36:57] 06Labs, 10Tool-Labs-tools-Other, 10DBA: High replication activity filled up labsdb1004 with binlogs - https://phabricator.wikimedia.org/T150553#2789685 (10jcrespo) I have already some banned tools from replication (meaning they are not guaranteed redundancy) due to high import/updater rates. If this happens... [02:25:01] PROBLEM - Puppet run on tools-services-02 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [03:00:01] RECOVERY - Puppet run on tools-services-02 is OK: OK: Less than 1.00% above the threshold [0.0] [06:02:50] 06Labs, 10Tool-Labs: Update Labslogbot to authenticate to wikitech using bot password or OAuth - https://phabricator.wikimedia.org/T150569#2789802 (10bd808) [07:50:13] PROBLEM - Puppet staleness on tools-services-01 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [43200.0] [10:06:16] Hi. Do I need a .forward file so mail sent to tools. works? [10:06:31] if yes, which chmod settings [11:49:09] 06Labs, 10Tool-Labs-tools-Other, 10DBA: High replication activity filled up labsdb1004 with binlogs - https://phabricator.wikimedia.org/T150553#2790007 (10Gradzeichen) I have stopped the jobs, that cause this and will not run them again before investigating the cause. Ireas has not been active for some ti... [12:02:57] 06Labs, 10Tool-Labs-tools-Other, 10DBA: High replication activity filled up labsdb1004 with binlogs - https://phabricator.wikimedia.org/T150553#2790015 (10Volans) Thanks for cooperation @Gradzeichen [13:18:20] 06Labs, 10DBA: Make watchlist table available as curated foo_p.watchlist_count on labsdb - https://phabricator.wikimedia.org/T59617#2790049 (10AlexMonk-WMF) [13:18:57] 06Labs, 10DBA: Make watchlist table available as curated foo_p.watchlist_count on labsdb - https://phabricator.wikimedia.org/T59617#609515 (10AlexMonk-WMF) [13:18:59] 06Labs, 10DBA: Reduce watchlist_count threshold - https://phabricator.wikimedia.org/T150548#2790050 (10AlexMonk-WMF) [13:20:04] 06Labs, 10DBA: Add visitingwatchers to watchlist_count - https://phabricator.wikimedia.org/T150547#2790054 (10AlexMonk-WMF) [14:31:20] 06Labs, 10Tool-Labs: C# MONO bot runs OK but not with jsub - https://phabricator.wikimedia.org/T150099#2790075 (10Kotz) {meme, src="kitten-stare", above="Help? ", below="Someone?"} [14:32:54] 06Labs, 10Tool-Labs: C# MONO bot runs OK but not with jsub - https://phabricator.wikimedia.org/T150099#2790076 (10Kotz) @Aklapper ? [14:56:08] PROBLEM - Host tools-secgroup-test-102 is DOWN: CRITICAL - Host Unreachable (10.68.21.170) [15:14:42] 06Labs, 10Tool-Labs: C# MONO bot runs OK but not with jsub - https://phabricator.wikimedia.org/T150099#2773990 (10valhallasw) It seems unlikely that the server has no network access, so this is likely an issue in your code or the .net mediawiki library you're using. You can test manually on the server by sshin... [15:54:07] PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22) [16:06:28] PROBLEM - Host secgroup-lag-102 is DOWN: CRITICAL - Host Unreachable (10.68.17.218) [17:04:30] 06Labs, 06Operations, 13Patch-For-Review, 07Tracking: Migrate tools to secondary labstore HA cluster (Scheduled on 11/14) [tracking] - https://phabricator.wikimedia.org/T146154#2790205 (10madhuvishy) [17:26:24] Hey, another maintainer started a task and I do not have permission to stop it. Could someone with root access do it? [17:47:50] DatGuy: which task? [17:48:11] I believe one is called afreporterdebug and the other afreporter [17:49:17] never mind. One is afreporterdebug and the other afreportergood [17:49:36] jobs 423784 and 424441 [17:54:47] 06Labs, 06Operations, 13Patch-For-Review, 07Tracking: Migrate tools to secondary labstore HA cluster (Scheduled on 11/14) [tracking] - https://phabricator.wikimedia.org/T146154#2790246 (10madhuvishy) [17:55:23] DatGuy: sure I can kill them [17:56:53] done [18:39:54] 10Tool-Labs-tools-Pageviews: Created "Userviews" tool (probably can come up with a better name) - https://phabricator.wikimedia.org/T150585#2790288 (10MusikAnimal) [20:40:52] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Hedwig in Washington was created, changed by Hedwig in Washington link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Hedwig_in_Washington edit summary: Created page with "{{Tools Access Request |Justification=Running some bot taks for Commons using YacBot. |Completed=false |User Name=Hedwig in Washington }}" [20:42:27] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Hedwig in Washington was modified, changed by Hedwig in Washington link https://wikitech.wikimedia.org/w/index.php?diff=970706 edit summary: i [20:59:51] 10Tool-Labs-tools-Pageviews: Pageviews Analysis 2.0 - https://phabricator.wikimedia.org/T147966#2790360 (10MusikAnimal) 05Open>03Resolved a:03MusikAnimal Deployed! [21:00:12] 10Tool-Labs-tools-Pageviews: Pageviews Analysis 2.0 - https://phabricator.wikimedia.org/T147966#2790368 (10MusikAnimal) [21:00:14] 10Tool-Labs-tools-Pageviews: Make automatically selecting chart type work without refreshing - https://phabricator.wikimedia.org/T145129#2790364 (10MusikAnimal) 05Open>03Resolved a:03MusikAnimal Deployed with the 2.0 overhaul