[02:29:34] (03PS1) 10Ori.livneh: add passwords::grafana, for catalog compiler [labs/private] - 10https://gerrit.wikimedia.org/r/246138 [02:30:00] (03CR) 10Ori.livneh: [C: 032 V: 032] add passwords::grafana, for catalog compiler [labs/private] - 10https://gerrit.wikimedia.org/r/246138 (owner: 10Ori.livneh) [02:32:15] (03PS1) 10Ori.livneh: Fix-up for Idf57f839 [labs/private] - 10https://gerrit.wikimedia.org/r/246139 [02:32:28] (03CR) 10Ori.livneh: [C: 032 V: 032] Fix-up for Idf57f839 [labs/private] - 10https://gerrit.wikimedia.org/r/246139 (owner: 10Ori.livneh) [09:45:48] 6Labs, 10MediaWiki-Vagrant: MediaWiki-Vagrant fails due to dpkg post-installation script of hhvm - https://phabricator.wikimedia.org/T115450#1724622 (10zhuyifei1999) 3NEW [09:46:38] PROBLEM - Puppet staleness on tools-k8s-bastion-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [43200.0] [09:47:01] 6Labs, 10MediaWiki-Vagrant: MediaWiki-Vagrant fails due to dpkg post-installation script of hhvm - https://phabricator.wikimedia.org/T115450#1724630 (10zhuyifei1999) [10:18:32] (03CR) 10Ricordisamoa: "Please add copyright&license headers to nuclides.py and units.py (copy from chemistry.py) and to nuclides.css (copy from table.css), with " [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 [10:21:39] (03CR) 10Ricordisamoa: "Then I can start deduplication and cleanup in this same patch, if you don't object." [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 [11:39:24] 6Labs, 10MediaWiki-Vagrant: MediaWiki-Vagrant fails due to dpkg post-installation script of hhvm - https://phabricator.wikimedia.org/T115450#1724789 (10zhuyifei1999) Running vagrant provision again seems to fix the issue: {P2195} There's probably some sort of order issues in vagrant up provisioning. [11:56:29] 6Labs, 6operations, 10wikitech.wikimedia.org: Nutcracker having issues on wikitech - https://phabricator.wikimedia.org/T115457#1724804 (10Krenair) 3NEW [13:08:18] 6Labs, 10Wikimedia-Mailing-lists: expand labs listinfo pages and link them to eachother - https://phabricator.wikimedia.org/T97480#1724954 (10Dzahn) [13:11:15] 6Labs, 10Tool-Labs, 7Mail: Mails from tools are being marked as 'spam' by gmail - https://phabricator.wikimedia.org/T104871#1724984 (10coren) The headers are okay - and passed SPF so that's not it. Gmail uses strange heuristics to decide what to think of as spam, at least part of which includes how many peo... [13:13:55] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1724991 (10Andrew) This will need some misc database support as well -- adding Jaime to the ticket. We could potentially have the dbs all run on the c... [13:16:41] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1725004 (10coren) Have you coordinated with @papaul about the currently unknown-function Cisco servers that used to be Labs and that currently live in D... [13:44:50] Coren: hey! do you have an answer to '@yuvipanda: what group owns the export?' for our NFS project exports? [13:44:52] root? [13:45:05] (relaying a question from kubernetes slack) [13:45:37] yuvipanda: Missing moar context. Where is this? [13:45:58] we are discussing what a process running with gid 0 can do [13:46:11] but a non 0 uid [13:46:48] in terms of being able to access other user's files [13:46:58] and I think it basically has free reign [13:47:11] and am talking to this other guy and so explaining our setup [14:16:09] No; gid 0 has exactly no powers. [14:16:37] (Well, unless there are files owned by thet group with permissions - but they are not magical permissions like fsuid 0 is) [14:16:49] oh [14:16:51] I see [14:16:54] I'm going to test that now [14:17:48] since it's also passsing through a docker image [14:29:30] yuvipanda: This isn't to say that running processes under gid 0 isn't an issue at all - it's not magical but there may be things writable to that gid that might be issues in a default image. [14:30:12] 10Wikibugs: Wikibugs should not say ", and 0 others" - https://phabricator.wikimedia.org/T90324#1725196 (10Dzahn) bla bla bla (testing wikibugs) [14:30:15] yeah but they can't do much damage by doing things inside the image. it's NFS I'm primarily worried about [14:32:15] That shouldn't be an issue either - nobody should be putting files owned by gid 0 on there and if they do then they deserve what they got. [14:37:14] right [14:37:21] I wasn't aware that gid 0 had no privs [14:37:43] 6Labs, 10Tool-Labs: Move tools-master and tools-shadow to trusty - https://phabricator.wikimedia.org/T94791#1725201 (10Dzahn) [14:37:44] 6Labs, 10Tool-Labs, 3Labs-Sprint-103, 3Labs-Sprint-115: Labs: Move tools-shadow off the same host as tool-master - https://phabricator.wikimedia.org/T103390#1725199 (10Dzahn) 5Resolved>3Open we are seeing these again in Icinga and a comment there from last time linked to this ticket: https://icinga.wi... [14:38:32] is labstore1001 still in maintenance period? [14:41:08] 6Labs, 10Tool-Labs, 3Labs-Sprint-103, 3Labs-Sprint-115: Labs: Move tools-shadow off the same host as tool-master - https://phabricator.wikimedia.org/T103390#1725204 (10coren) I've just checked and tools-shadow is on labvirt1008 and tools-master is on labvirt1004. @yuvipanda: It's not clear to me why the t... [14:41:51] mutante|1way: labstore1001 is stills crewed, yes [14:42:12] yuvipanda: ok, tx [14:57:43] 10Wikibugs, 6operations: wikibugs test bug - https://phabricator.wikimedia.org/T1152#1725253 (10Legoktm) [14:58:09] 10Wikibugs: wikibugs test bug - https://phabricator.wikimedia.org/T1152#1725257 (10Legoktm) [15:10:26] 6Labs: Provide a simple way to backup arbitrary files from instances - https://phabricator.wikimedia.org/T104206#1725288 (10akosiaris) a:3akosiaris Let's start by evaluating a central bacula server as we have in production that will be able to backup files from labs VMs. That way we will build on established k... [15:32:22] 6Labs: Provide a simple way to backup arbitrary files from instances - https://phabricator.wikimedia.org/T104206#1725377 (10yuvipanda) So ideally the workflow I'd like people to have: # Specify filesets in hiera (so can do it per host or per-project) # Specify retention strategy (from a few options we give them... [16:04:24] 6Labs, 10MediaWiki-Vagrant, 5Patch-For-Review: MediaWiki-Vagrant fails due to dpkg post-installation script of hhvm - https://phabricator.wikimedia.org/T115450#1725531 (10bd808) Thanks for the great bug report @zhuyifei1999. I thought I had actually already fixed this (I saw the same thing in some testing o... [16:04:36] 6Labs, 10MediaWiki-Vagrant, 5Patch-For-Review: MediaWiki-Vagrant fails due to dpkg post-installation script of hhvm - https://phabricator.wikimedia.org/T115450#1725532 (10bd808) a:3bd808 [16:04:49] 6Labs, 10MediaWiki-Vagrant, 5Patch-For-Review: MediaWiki-Vagrant fails due to dpkg post-installation script of hhvm - https://phabricator.wikimedia.org/T115450#1724622 (10bd808) p:5Triage>3High [16:14:25] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Allocate labs subnet in dallas - https://phabricator.wikimedia.org/T115491#1725570 (10Andrew) 3NEW a:3mark [16:17:11] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Allocate subnet for labs test cluster instances - https://phabricator.wikimedia.org/T115492#1725583 (10Andrew) 3NEW a:3mark [16:21:02] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Allocate subnet for labs test cluster instances - https://phabricator.wikimedia.org/T115492#1725608 (10coren) Given that we are looking to do vlan config with Neutron, I think it'd be wise to allocate a very large subnet fo... [16:25:57] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1725615 (10Andrew) [16:26:04] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1725616 (10RobH) Ok, allocations for this: * WMF3763 (previously named ssl2002) - 8GB System * WMF3810 (previously named ssl2003) - 8GB System * WMF58... [16:32:42] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1725645 (10Andrew) Please cable up two nics for: wmf5850 (labtestvirt2001) WMF5835 (labtestnet2001) The second nic will be on the instance vlan. The... [17:30:39] (03PS3) 10: Added a wikidata-based "chart of the nuclides" under the periodic table app (link to /nuclides) (updated with pep8 fixes and license) [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 [17:32:54] (03CR) 10ArthurPSmith: "I put in the license changes. Go ahead and do the refactoring you feel would help! The table "Cell" classes definitely would be good to se" [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/245591 (owner: 10ArthurPSmith) [18:01:47] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1725921 (10RobH) @Andrew: Chatting with @Mark @ lunch, we need to clear the allocation of the 32GB misc machine with him. (It was a passing comment, s... [18:10:26] 6Labs, 10Labs-Infrastructure, 10hardware-requests, 6operations, 3labs-sprint-117: Labs test cluster in codfw - https://phabricator.wikimedia.org/T114435#1725949 (10Andrew) Naming! wmf5850 (32G): labtestvirt2001 WMF5835 (16G): labtestnet2001 WMF3763 (8GB): labtestneutron2001 WMF3810 (8GB): labtestmetal20... [18:23:18] 6Labs, 10Tool-Labs, 5Patch-For-Review: Add python3 equivalent packages for existing python packages - https://phabricator.wikimedia.org/T101646#1725999 (10valhallasw) 5Open>3Resolved a:3valhallasw [18:47:20] 6Labs, 10Tool-Labs: Document and make it easy for people to request new packages in toollabs - https://phabricator.wikimedia.org/T1101#1726049 (10valhallasw) 5Open>3Resolved a:3valhallasw https://wikitech.wikimedia.org/w/index.php?title=Help%3ATool_Labs&type=revision&diff=193070&oldid=192392 [19:17:52] Hi everybody [19:19:40] I have a question, Andrew created the wikitolearn-dev project upon my request (see ) [19:20:00] If I go under Manage instances and filter by project [19:20:05] there are no instances [19:20:24] However if I click on "Add an instance" it seems that I am able to add instances to the project [19:20:25] have you created any? [19:20:32] Not yet [19:20:38] well [19:20:38] and that was exactly my question [19:20:59] for my other project (Wikidata-LDF), I asked for a single instance [19:21:06] projects aren't prepopulated with instances, you jut create what you need [19:21:08] and it was created in advance (IIRC) [19:21:18] I was surprised that this time I am able to add instances [19:21:30] and my question is: is this something I am supposed to be allowed to be doing? [19:21:43] yes, you're a project admin [19:21:45] yes [19:22:26] ok Krenair , MaxSem thanks! [19:22:33] I asked in advance... [19:39:09] 6Labs, 10wikitech.wikimedia.org: "Shell Access Request/Edit" form on Wikitech Labs lacks a "watch this page" checkbox - https://phabricator.wikimedia.org/T63104#1726128 (10Krenair) [19:39:50] 6Labs, 10wikitech.wikimedia.org: Update Semantic Forms - https://phabricator.wikimedia.org/T63104#1726132 (10Krenair) [19:45:06] 6Labs, 10Labs-Infrastructure, 10wikitech.wikimedia.org: Update Semantic Forms - https://phabricator.wikimedia.org/T63104#1726141 (10Dzahn) [19:54:11] !log design Added violetto as Project member [19:54:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Design/SAL, Master [20:03:37] 6Labs, 7Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#1726182 (10CristianCantoro) [20:03:39] 6Labs: Two small instances: for WikiToLearn development - https://phabricator.wikimedia.org/T115282#1726180 (10CristianCantoro) 5Resolved>3Open Sorry for re-opening but I wanted to keep track of requests here. I have talked with the developer (User:Ruphy and User:Toma.luca95) and they have asked if they can... [20:08:12] 6Labs, 10Tool-Labs, 7Tracking: Packages to be added to toollabs puppet - https://phabricator.wikimedia.org/T55704#1726202 (10valhallasw) [20:08:13] 6Labs, 10Tool-Labs, 5Patch-For-Review: Install composer on tools-login - https://phabricator.wikimedia.org/T104789#1726199 (10valhallasw) 5Open>3Resolved a:3valhallasw ``` Notice: /Stage[main]/Toollabs::Composer/File[/srv/composer]/ensure: created Notice: /Stage[main]/Toollabs::Composer/Git::Clone[comp... [20:47:14] 6Labs: Data missing from June 11/12 on s3.labsdb - https://phabricator.wikimedia.org/T115517#1726338 (10dungodung) 3NEW [20:49:46] 6Labs, 7Database: Data missing from June 11/12 on s3.labsdb - https://phabricator.wikimedia.org/T115517#1726361 (10Krenair) [22:11:50] 6Labs, 10Tool-Labs: Add ability to choose Node.js version in webservice2 - https://phabricator.wikimedia.org/T106961#1726656 (10Ricordisamoa) Would something like this work? ```lang=diff -os.execv('/usr/bin/npm', ['/usr/bin/npm', 'start']) +os.execv('npm', ['npm', 'start']) ```