[00:50:18] PROBLEM - Puppet errors on tools-exec-1432 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [01:30:15] RECOVERY - Puppet errors on tools-exec-1432 is OK: OK: Less than 1.00% above the threshold [0.0] [03:33:31] PROBLEM - Puppet errors on tools-exec-1436 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [04:13:32] RECOVERY - Puppet errors on tools-exec-1436 is OK: OK: Less than 1.00% above the threshold [0.0] [06:10:08] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Create XTools API with namespace endpoint, using JS to update to namespace selector - https://phabricator.wikimedia.org/T162754#3204787 (10Samwilson) [06:10:09] 10Tool-Labs-tools-Xtools, 06Community-Tech: XTools: Top edits - 'All' namespaces option - https://phabricator.wikimedia.org/T160721#3204786 (10Samwilson) [06:57:40] 06Labs, 10Tool-Labs, 10Mail: Spam messages to cvn.maintainers@ - https://phabricator.wikimedia.org/T163656#3204834 (10Nemo_bis) [07:52:37] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Cabayi was created, changed by Cabayi link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Cabayi edit summary: Created page with "{{Tools Access Request |Justification=To start with, take a look at the tool producing [[:en:Wikipedia:Database reports/Editors eligible for Autopatrol privilege]] & see what..." [08:10:20] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: XTools: Top edits - 'All' namespaces option - https://phabricator.wikimedia.org/T160721#3204932 (10Samwilson) WiP: https://github.com/x-tools/xtools-rebirth/compare/all-namespaces-T160721 [08:28:36] 06Labs, 10Tool-Labs, 15User-bd808: Temporary Tool Labs projectadmin right for Tgr - https://phabricator.wikimedia.org/T163611#3204987 (10Tgr) Thanks! I did not get to use it in the end (the event ended up being mostly discussion and not much actual development) but it was nice to know we have that option. [09:26:20] Hi there [09:26:54] I am working as a Data Analyst for WMDE; my Q: when I need to ask for a lab VM instance on https://phabricator.wikimedia.org/T76375, do I need to assign to anyone in particular? Thanks a lot. [10:09:32] GoranSM: just file your ticket. the labs admins will take care of them [10:09:57] zhuyifei1999_: Thanks a lot! [10:10:13] (IIRC they have meetings where they discuss/approve them) [10:17:33] 06Labs: Request creation of Wikidata Concepts labs project - https://phabricator.wikimedia.org/T163672#3205326 (10GoranSMilovanovic) [12:49:56] 06Labs, 10Horizon: Stop requiring two-factor authentication for horizon.wikimedia.org - https://phabricator.wikimedia.org/T161473#3132659 (10chasemp) We have always required some level of administrators to use 2fa, and have defaulted to it in the Phabricator admin case and a few others. I'm not sure if @cstei... [12:56:20] (03PS1) 10Elukey: Piwik fake passwords [labs/private] - 10https://gerrit.wikimedia.org/r/349950 (https://phabricator.wikimedia.org/T159136) [12:57:05] (03PS2) 10Elukey: Piwik fake passwords [labs/private] - 10https://gerrit.wikimedia.org/r/349950 (https://phabricator.wikimedia.org/T159136) [12:57:41] (03CR) 10Elukey: [V: 032 C: 032] Piwik fake passwords [labs/private] - 10https://gerrit.wikimedia.org/r/349950 (https://phabricator.wikimedia.org/T159136) (owner: 10Elukey) [13:10:48] (03PS1) 10Elukey: Correct hiera path for piwik role [labs/private] - 10https://gerrit.wikimedia.org/r/349954 (https://phabricator.wikimedia.org/T159136) [13:11:41] (03CR) 10Elukey: [V: 032 C: 032] Correct hiera path for piwik role [labs/private] - 10https://gerrit.wikimedia.org/r/349954 (https://phabricator.wikimedia.org/T159136) (owner: 10Elukey) [13:23:41] PROBLEM - Puppet errors on tools-exec-1437 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [13:46:20] 06Labs, 10Labs-Infrastructure, 10DBA: ug_expiry column of the user_groups table is not present on Labs - https://phabricator.wikimedia.org/T160686#3206005 (10Marostegui) Better to be tracked here: T155605 [14:03:41] RECOVERY - Puppet errors on tools-exec-1437 is OK: OK: Less than 1.00% above the threshold [0.0] [14:22:39] 06Labs, 06Release-Engineering-Team: Get labtestwikitech/californium on the deployment train - https://phabricator.wikimedia.org/T163694#3206154 (10Andrew) [14:34:42] 06Labs, 06Release-Engineering-Team: Get labtestwikitech/labtestweb2001 on the deployment train - https://phabricator.wikimedia.org/T163694#3206179 (10Andrew) [15:03:43] bd808 hi im wondering could you help me with adding flood protection to https://github.com/wikimedia/puppet/blob/64a94a86acb6e31672b40f2be34be951974422ed/modules/ircecho/files/ircecho please? [15:04:18] Im using the bot but it seems that it generates so many messages if you do for example downtime on mutiple hosts it causes it to get kicked [15:06:34] 06Labs, 10Labs-Infrastructure, 10Tool-Labs-tools-Other, 13Patch-For-Review, 15User-bd808: Automatically updated list of all configured domains - https://phabricator.wikimedia.org/T45580#3206301 (10Andrew) The result of bd808's work is https://tools.wmflabs.org/openstack-browser/proxy/ [15:08:30] 06Labs: Something should clean up dangling dynamicproxy records - https://phabricator.wikimedia.org/T163651#3204662 (10Paladox) gerrit-log.wmflabs.org is me. I've now deleted it. [15:16:04] 06Labs: Something should clean up dangling dynamicproxy records - https://phabricator.wikimedia.org/T163651#3204662 (10zhuyifei1999) There are also a few that points to instances in the wrong project (which I assume is broken records after IP reallocation on instance recreation), eg: ``` video v2cdev.wmflabs.or... [15:28:21] paladox: I don't have time to work on that right now, but you should make a bug to track the problem for sure [15:28:29] ok [15:29:55] Done here https://phabricator.wikimedia.org/T163698 :) [15:33:56] !log tools Removed Gergő Tisza as a projectadmin for T163611; event done [15:34:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:34:01] T163611: Temporary Tool Labs projectadmin right for Tgr - https://phabricator.wikimedia.org/T163611 [15:34:29] 10Tool-Labs-tools-Xtools: Unable to login to X!'s Tools - https://phabricator.wikimedia.org/T132855#3206473 (10Matthewrbowker) a:05Matthewrbowker>03None @MusikAnimal @Samwilson One of you put oauth into the new xtools. Could you verify that it's set up OK (AKA the callback url will work even if we wind up un... [15:56:08] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10Tool-Labs: The future of service groups and service users on Labs - https://phabricator.wikimedia.org/T162945#3206715 (10Andrew) Email sent to labs-announce, subject "Does anyone care about service groups?" > Back when we created tools, we implemented t... [17:10:54] 06Labs, 10Labs-Infrastructure, 06Community-Tech-Tool-Labs, 13Patch-For-Review, 15User-bd808: invisible-unicorn (dynamicproxy) should provide an easy way to see where a host routes without knowing the project - https://phabricator.wikimedia.org/T115752#3207036 (10bd808) 05Open>03Resolved a:03bd808 W... [17:29:16] 10Tool-Labs-tools-Attribution-Generator, 06TCB-Team: Apply German quotation marks - https://phabricator.wikimedia.org/T123739#3207096 (10jhsoby) a:03jhsoby I have fixed this in [#239](https://github.com/wmde/Lizenzhinweisgenerator/pull/239), waiting for merge. [17:44:18] What are german quotation marks? [17:47:25] Zppix: https://en.wikipedia.org/wiki/Quotation_mark#German [17:51:47] I see thanks bd808 [17:52:50] 06Labs, 06Release-Engineering-Team, 15User-bd808: Get labtestwikitech/labtestweb2001 on the deployment train - https://phabricator.wikimedia.org/T163694#3207222 (10bd808) 05Open>03Resolved a:03bd808 It was already on the train, but now it is in `group0` so it will get new MediaWiki changes before wikit... [17:53:30] (03CR) 10jenkins-bot: Localisation updates from https://translatewiki.net. [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/349992 (owner: 10L10n-bot) [19:30:41] 10Tool-Labs-tools-Attribution-Generator, 06TCB-Team: Make it possible to use Esc key to close modal windows - https://phabricator.wikimedia.org/T163731#3207570 (10jhsoby) [20:28:57] 06Labs: List of leaked dns precords for Andrew to clean up - https://phabricator.wikimedia.org/T163737#3207810 (10Andrew) [20:30:05] 06Labs: List of leaked dns precords for Andrew to clean up - https://phabricator.wikimedia.org/T163737#3207810 (10bd808) * 10.68.20.115 * 10.68.20.50 * 10.68.21.145 * 10.68.18.55 * 10.68.17.219 [23:16:10] wikibugs down? [23:19:52] cc twentyafterfour [23:27:31] Zppix: I don't know anything about it... [23:27:54] i've updated many tasks not a single one did wikibugs notify on twentyafterfour [23:28:08] T163754 [23:28:08] T163754: Wikibugs bot for Phabricator currently down? - https://phabricator.wikimedia.org/T163754 [23:38:23] there are socket errors in wikibugs log... [23:52:07] wikibugs just posted in #wikimedia-operations so it's working [23:52:12] well, wikibugs__