[00:40:07] 06Labs, 10Labs-Infrastructure, 10Tool-Labs-tools-Other: Automatically updated list of all configured domains - https://phabricator.wikimedia.org/T45580#486909 (10Krinkle) 05Open>03Resolved a:03Krinkle [00:40:15] 06Labs, 10Labs-Infrastructure, 10Tool-Labs-tools-Other, 15User-bd808: Automatically updated list of all configured domains - https://phabricator.wikimedia.org/T45580#3212687 (10Krinkle) a:05Krinkle>03bd808 [00:52:50] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Optimize edit count queries in XTools - https://phabricator.wikimedia.org/T163284#3192230 (10Krinkle) There have been reasons from users against the CentralAuth data due to inaccuracy. I don't recall exactly what however. Anyway, regardless of whether we shou... [00:53:59] PROBLEM - Puppet errors on tools-exec-1434 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [01:33:46] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: XTools: Top edits - 'All' namespaces option - https://phabricator.wikimedia.org/T160721#3212754 (10Samwilson) See https://github.com/x-tools/xtools-rebirth/pull/23 [01:51:46] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: XTools: Top edits - 'All' namespaces option - https://phabricator.wikimedia.org/T160721#3108804 (10Samwilson) [01:51:46] 10Tool-Labs-tools-Xtools, 06Community-Tech: Epic: Rewriting XTools - https://phabricator.wikimedia.org/T153112#3212776 (10Samwilson) [01:51:50] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Create XTools API with namespace endpoint, using JS to update to namespace selector - https://phabricator.wikimedia.org/T162754#3212771 (10Samwilson) 05Open>03Resolved This works in my testing. I've made one slight change for T160721 that should take care... [01:58:58] RECOVERY - Puppet errors on tools-exec-1434 is OK: OK: Less than 1.00% above the threshold [0.0] [03:26:55] 10Labs-project-Wikistats: wikistats: add new wikipedias: kbp, khw, dty - https://phabricator.wikimedia.org/T160947#3212839 (10Dzahn) added "dty" since it exists now (the other 2 are still incubator redirects as of today) https://dty.wikipedia.org/wiki/%E0%A4%AE%E0%A5%81%E0%A4%96%E0%A5%8D%E0%A4%AF_%E0%A4%AA%E0%... [03:27:46] !log wikistats added new Wikipedia "dty" - Doteli (T160947) [03:27:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikistats/SAL [03:27:50] T160947: wikistats: add new wikipedias: kbp, khw, dty - https://phabricator.wikimedia.org/T160947 [03:30:22] 10Labs-project-Wikistats: wikistats: add new wikipedias: kbp, khw, dty - https://phabricator.wikimedia.org/T160947#3212842 (10Dzahn) http://wikistats.wmflabs.org/display.php?t=wp http://wikistats.wmflabs.org/detail.php?t=wp&id=317 [04:34:04] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 07Documentation: Create a "my first Pywikibot bot" tutorial for Tool Labs - https://phabricator.wikimedia.org/T134495#3212928 (10Xephyr826) a:03Xephyr826 [04:35:40] 06Labs, 10Tool-Labs, 15User-bd808: webservice stop says service not running but service.manifest not cleared - https://phabricator.wikimedia.org/T163355#3212935 (10bd808) p:05Triage>03Normal a:03bd808 [04:59:31] 06Labs, 10Tool-Labs, 07Documentation: Write documentation on new webservice code - https://phabricator.wikimedia.org/T132987#3212938 (10bd808) [05:01:18] 06Labs, 10Tool-Labs: Create developer environment using Docker images from Tool Labs Kubernetes - https://phabricator.wikimedia.org/T157733#3212942 (10bd808) [05:01:20] 06Labs, 10Tool-Labs, 13Patch-For-Review: deb.tools.wmflabs.org is not accessible from outside Tool Labs - https://phabricator.wikimedia.org/T158383#3212940 (10bd808) 05Open>03Resolved a:03scfc [05:11:21] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 07Documentation: Create a "my first Pywikibot bot" tutorial for Tool Labs - https://phabricator.wikimedia.org/T134495#3212955 (10Xephyr826) @bd808 or anyone, Two questions: - Should this tutorial use PAWS to introduce Pywikibot as suggested above? - Where w... [05:11:24] 06Labs, 10Tool-Labs, 10Tools-Kubernetes: k8s webservice restart failure with `ValueError: get() more than one object; use filter` - https://phabricator.wikimedia.org/T156626#3212956 (10bd808) [05:44:00] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 07Documentation: Create a "my first Pywikibot bot" tutorial for Tool Labs - https://phabricator.wikimedia.org/T134495#3212975 (10zhuyifei1999) >>! In T134495#3212955, @Xephyr826 wrote: > @bd808 or anyone, Two questions: > - Should this tutorial use PAWS to i... [08:22:37] 06Labs: Request creation of Wikidata Concepts labs project - https://phabricator.wikimedia.org/T163672#3213056 (10GoranSMilovanovic) @Andrew @Addshore (1) As of Hadoop, I do not know whether there is a public interface, but I can ask. Let me check and I will get back to you. (2) As of the following: "//Are you... [08:40:50] If I run a kubernetes contained nodejs webservice it seems like no log (of STDERR/STDOUT) files are written. Is this deliberate? You do get them if you run the job through the gridengine (because qsub writes all output to ~/error.log) [09:05:39] 06Labs: Request creation of Wikidata Concepts labs project - https://phabricator.wikimedia.org/T163672#3213120 (10Addshore) >>! In T163672#3213056, @GoranSMilovanovic wrote: > (2) As of the following: "//Are you sure you want a scratch start for this and not use existing Analytics infrastructure? Have you discus... [09:47:33] !log migrating s5 eqiad replicas under db1063 [09:47:35] jynus: Unknown project "migrating" [09:48:16] wrong channel [10:19:10] 06Labs: Request creation of Wikidata Concepts labs project - https://phabricator.wikimedia.org/T163672#3213258 (10GoranSMilovanovic) @Addshore Ok. Thanks. Let me talk to Analytics then and we will decide what is the best option when I learn about exporting data from the Analytics Cluster. @Andrew Thanks for sup... [11:34:49] (03PS1) 10Alexandros Kosiaris: Rename ores::redis::password [labs/private] - 10https://gerrit.wikimedia.org/r/350399 [11:37:22] (03CR) 10Alexandros Kosiaris: [V: 032 C: 032] Rename ores::redis::password [labs/private] - 10https://gerrit.wikimedia.org/r/350399 (owner: 10Alexandros Kosiaris) [12:29:00] andrewbogott: Job 4179382 is stuck in the dr state [12:29:25] Nvm. It just disappeared. I guess it only took 5 minutes. [12:53:38] !log mobile removed testing/prototyping instances readinglists and mobile-puppetmaster (no longer needed) [12:53:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Mobile/SAL [13:25:22] Cyberpower678: ok :) [15:21:35] 06Labs: Request creation of Wikidata Concepts labs project - https://phabricator.wikimedia.org/T163672#3205312 (10madhuvishy) @GoranSMilovanovic It might also be worth talking to the Analysts on Discovery (Mikhail and Chelsy) - they use R extensively. One thing we do have on our Hadoop Cluster is Jupyter Noteboo... [15:38:33] !log toolsbeta add Madhuvishy as projectadmin [15:38:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [15:40:51] 06Labs, 06Operations: During labservices1001 failover fqdn changed from foo.project.eqiad.wmflabs to foo.eqiad.wmflabs - https://phabricator.wikimedia.org/T163823#3214418 (10Andrew) I still can't reproduce this, even creating the exact set of breakages that were present when the issue appeared in prod. My gue... [15:52:04] 06Labs, 06Operations: During labservices1001 failover fqdn changed from foo.project.eqiad.wmflabs to foo.eqiad.wmflabs - https://phabricator.wikimedia.org/T163823#3214432 (10Andrew) a:05Andrew>03None [15:54:22] 06Labs, 06Operations, 10wikitech.wikimedia.org: Update wikitech-static and develop procedures to keep it maintained - https://phabricator.wikimedia.org/T163721#3214444 (10Andrew) [15:55:16] 06Labs, 06Operations, 10wikitech.wikimedia.org: Update wikitech-static and develop procedures to keep it maintained - https://phabricator.wikimedia.org/T163721#3207227 (10Andrew) [16:34:14] 06Labs, 06Operations, 10wikitech.wikimedia.org: Update wikitech-static and develop procedures to keep it maintained - https://phabricator.wikimedia.org/T163721#3214674 (10Andrew) Maintenance tasks are just: - Keep packages up to date - Keep MW up to date [16:40:57] !log git upgrading gerrit from 2.13.4 to 2.14.0 to test [16:40:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [16:59:50] !log git forgot to mention im doing this on gerrit-test3 [16:59:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [17:01:21] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Optimize edit count queries in XTools - https://phabricator.wikimedia.org/T163284#3214771 (10kaldari) Why do we not want to use the `user_editcount` field in the user table? [17:05:00] 06Labs, 10Labs-Infrastructure: Audit disk usage on labvirts - https://phabricator.wikimedia.org/T163796#3214807 (10Andrew) In our config, we have disk_allocation_ratio=1.5 I'm reading the 'disk filter' section of https://docs.openstack.org/liberty/config-reference/content/section_compute-scheduler.html, and h... [17:06:11] 06Labs, 06Operations, 10wikitech.wikimedia.org: Update wikitech-static and develop procedures to keep it maintained - https://phabricator.wikimedia.org/T163721#3214809 (10Andrew) The root password to this host no longer works. Either someone fancied it up to use keys, or we need to do a rescue as per https... [17:08:36] !log git upgrade complete and works. [17:08:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL [18:02:29] Hello, Amitie 10g here, I need some help [18:11:01] Is there an Labs sysop there? [18:14:37] Amitie_10g: I'm about but a bit distracted, what's up? (It's easier to ask your questiion and see who can respond as it may not be limited to labs admins) [18:15:41] I'm unable to access to the Wikitech wiki due I don't have the two-factor auth app configured in my device [18:16:15] And another more trivial question, how can I enable HHVM for the Webserver? [18:16:24] instead of php5 [18:24:24] Amitie_10g: on the first item, did you make a ticket about this? I suspect you lost your second factor that was your phoen? [18:24:38] and on the second question it's dependent on what webserver and various other components [18:25:36] Nope,I'll post that at Phabricator [18:26:05] And for the second, I'm using the default settings for the Webserver: lighttpd and php5 [18:27:07] Amitie_10g: if you make a ticket usually we assume folks still have access to their SSH key for Labs and can verify their identity that way working with an admin [18:27:20] Amitie_10g: do you mean in Tool Labs then for HHVM? [18:27:41] Yes, I'm still have acces to my shell account [18:27:44] via SSH [18:28:02] Amitie_10g: ok should be workable to reset fyi [18:28:24] Is there a way to send a non-public ticket at Phabricator? [18:29:17] Or in what sectionb can I request exactly my issue? [18:31:23] Hi, it seems i carn't add roles to instance through horizion [18:31:44] Amitie_10g: it doesn't need to be a non public ticket [18:32:13] OK [18:32:35] 10Tool-Labs-tools-Xtools, 06Community-Tech: Epic: Rewriting XTools - https://phabricator.wikimedia.org/T153112#3215116 (10Matthewrbowker) [18:32:36] 10Tool-Labs-tools-Xtools: Add new semi-automated tools - https://phabricator.wikimedia.org/T97647#3215114 (10Matthewrbowker) 05Open>03Resolved Fixed in the above commit, will be deployed as part of the rebirth. [18:35:19] I'll create the ticket [18:38:30] 06Labs, 06Operations: During labservices1001 failover fqdn changed from foo.project.eqiad.wmflabs to foo.eqiad.wmflabs - https://phabricator.wikimedia.org/T163823#3215139 (10chasemp) @Andrew looking at this from another angle let's say we don't know the conditions that caused all FQDN to suddenly omit project,... [18:56:20] Well, the ticket is now attended [18:56:35] But I'm still finding a way to use HHVM for my Webserver [18:57:10] I configured my local .lighttpd.conf, but when calling phpinfo() I still see php5 [19:02:30] chasemp hi, im wondering could you this role::deployment::server puppet role from the phabricator.phabricator.eqiad.wmflabs instance please? [19:02:39] I applied it to the wrong host and now puppet is failing [19:03:07] opps [19:03:17] i meant i applied it globally on the phabricator project [19:03:25] so all instances are affected. [19:07:12] paladox: your original request is missing a verb, can't tell what you're asking [19:07:21] in any case, if you can add a role why can't you remove it? [19:07:33] (assuming that 'remove' was the missing verb which maybe not) [19:10:25] Interesting. "IrishGovEdits <~nodebot@anonymous.user> “nodeJS IRC client”" [19:11:18] andrewbogott it seems adding and remove puppet classes is disabled [19:11:32] i had to workaround it by clicking edit other class [19:11:36] also sorry [19:11:54] hm, ok, I'll look in a bit [19:12:04] Thanks [19:16:21] Amitie_10g: I'm not sure that we have a documented way to run hhvm in our tool labs webservices. It would be good to open up a phabricator ticket where we can try to figure out what it would take. I'm going to randomly guess that it will be easier for us to figure out on Kubernetes than on the job grid [19:16:53] Do someone attemped to create a Tool with Webserver using HHVM instead of PHP5? [19:38:32] Good idea [19:39:27] Yes, it is not clearly documented at Wikitech Wiki, then, I followed the documentation at several websites and I replaced the php-fpm binary with hhvm [19:54:41] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Rockroland was created, changed by Rockroland link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Rockroland edit summary: Created page with "{{Tools Access Request |Justification=to create statistical summaries for use in augmenting public datasets relating to people; for example, what is the most common gender ass..." [20:13:40] paladox: I don't see any evidence that puppet management is disabled in horizon. do you not have big 'Remove Class' buttons in the green-hilighted classes? [20:13:54] I have an image [20:14:33] andrewbogott https://phabricator.wikimedia.org/F7782575 [20:14:53] andhttps://phabricator.wikimedia.org/F7782576 [20:14:56] and v [20:15:06] huh [20:15:12] and https://phabricator.wikimedia.org/F7782576 [20:15:15] oh, maybe that's a side-effect of... [20:15:17] ok, seems possible [20:15:30] oh [20:15:32] in any case, looks like /I/ can remove classes no problem :) You want that class removed project-wide? [20:16:09] yes please [20:16:31] as i only wanted it to be applied to one instance, but i went to the wrong url and managed to apply it everywhere [20:16:54] i've got 100+ icinga messages in #wikimedia-bots-testing :) [20:17:35] PROBLEM - puppet on puppet-phabricator is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [20:29:57] 06Labs, 06Operations, 10wikitech.wikimedia.org: Update wikitech-static and develop procedures to keep it maintained - https://phabricator.wikimedia.org/T163721#3215576 (10Andrew) I've updated https://wikitech.wikimedia.org/wiki/Wikitech-static with some vague maintenance instructions. The root password now... [20:30:59] paladox: better? [20:31:09] andrewbogott yep, thankyou :) [20:35:44] (03Abandoned) 10Krinkle: Remove $wgCopyrightIcon [labs/incubator] - 10https://gerrit.wikimedia.org/r/261997 (https://phabricator.wikimedia.org/T122754) (owner: 10Florianschmidtwelzow) [20:35:51] (03CR) 10Krinkle: "(last commit: 2012)" [labs/incubator] - 10https://gerrit.wikimedia.org/r/261997 (https://phabricator.wikimedia.org/T122754) (owner: 10Florianschmidtwelzow) [21:41:39] 06Labs, 06Operations, 13Patch-For-Review: Ensure we can survive a loss of labservices1001 - https://phabricator.wikimedia.org/T163402#3215840 (10Andrew) The answer to the question: Loss of a labvirt does not seem to cause any dns outages. New instances are unable to launch properly, though, because firstbo... [22:10:35] 10Tool-Labs-tools-Xtools, 10Addwiki, 03Community-Tech-Sprint: MediawikiApi::newFromPage() fails on non-XML HTML - https://phabricator.wikimedia.org/T163527#3216010 (10kaldari) 05Open>03Resolved a:03kaldari [22:17:09] 10Tool-Labs-tools-Xtools, 10Addwiki, 03Community-Tech-Sprint: MediawikiApi::newFromPage() fails on non-XML HTML - https://phabricator.wikimedia.org/T163527#3216021 (10kaldari) Now we just need to wait for Addshore to cut a new version. [22:45:11] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Optimize edit count queries in XTools - https://phabricator.wikimedia.org/T163284#3216160 (10Krinkle) >>! In T163284#3214771, @kaldari wrote: > Why do we not want to use the `user_editcount` field in the user table? Not sure, I guess it's fine. That's what Sp... [23:01:41] 06Labs, 10Tool-Labs, 10Internet-Archive, 07Documentation: Document how to install Python modules in a tool's home directory/virtual environment - https://phabricator.wikimedia.org/T63824#675945 (10bd808) There are some instructions on setting up a virtualenv related to a webservice at: * https://wikitech.w... [23:02:06] 06Labs, 10Tool-Labs, 07Documentation: Document how to install Python modules in a tool's home directory/virtual environment - https://phabricator.wikimedia.org/T63824#3216201 (10bd808) [23:03:18] 06Labs, 10Tool-Labs, 07Documentation, 07Epic: Cleanup https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools - https://phabricator.wikimedia.org/T101690#3216203 (10bd808) [23:05:32] 06Labs, 10Tool-Labs, 07Documentation: Document how to install Python modules in a tool's home directory/virtual environment - https://phabricator.wikimedia.org/T63824#3216207 (10bd808) [23:05:36] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 2 others: Run a documentation sprint for Labs - https://phabricator.wikimedia.org/T101659#3216206 (10bd808) [23:06:34] 06Labs, 10Striker, 10Horizon, 10wikitech.wikimedia.org, 07Documentation: Wikitech/horizon/striker 2fa documentation - https://phabricator.wikimedia.org/T155108#3216212 (10bd808) [23:06:39] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 2 others: Run a documentation sprint for Labs - https://phabricator.wikimedia.org/T101659#1344508 (10bd808) [23:07:43] 06Labs, 10Tool-Labs, 07Documentation, 07Epic: Re-organize Tool Labs documentation - https://phabricator.wikimedia.org/T91509#3216216 (10bd808) [23:08:07] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 2 others: Run a documentation sprint for Labs - https://phabricator.wikimedia.org/T101659#3216221 (10bd808) [23:26:50] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Optimize edit count queries in XTools - https://phabricator.wikimedia.org/T163284#3192230 (10Samwilson) It's currently using the CentralAuth API to get the edit count. However, it's the getting of "recent edits across all wikis" that's slow; it's currently sel... [23:39:15] 10Tool-Labs-tools-Other, 10Wikidata: Add interstitial to wikidata-externalid-url - https://phabricator.wikimedia.org/T160205#3216335 (10Dispenser) Reviewing [[https://wikimediafoundation.org/wiki/File:WikipediaZeroPartnerOverview-1-2-5.pdf|File:WikipediaZeroPartnerOverview-1-2-5.pdf]] I see Wikipedia #Zero use... [23:56:09] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Optimize edit count queries in XTools - https://phabricator.wikimedia.org/T163284#3216387 (10Krinkle) @Samwilson Not really. But querying revision on all wikis shouldn't have to be too slow though. It should be possible to have it be pretty fast in most cases....