[00:24:01] здарова пидарки [00:24:02] че [00:24:02] как [00:24:04] дела [00:29:19] ?теперь язык планеты земля это русский это сказал вз [03:07:18] 6Labs, 10Tool-Labs, 10Labs-Infrastructure: Can't delete rule in default security group for the Tools project - https://phabricator.wikimedia.org/T112492#1636116 (10scfc) 3NEW [03:46:48] would someone please tell me the path to "pip", I cannot find it [03:51:55] sDrewth: use a virtualenv? [03:52:11] 'virtualenv .' and then there's ./bin/pip and ./bin/python [03:52:26] just need to install mwlib to rin patrol.py [03:52:29] run [03:53:05] should i run a virtualenv? was reading that on the help page [03:55:15] * YuviPanda isn't sure what patrol.py is [03:55:23] but in general if you want to use pip you should be using virtualenv [03:56:03] k [04:03:22] hmm it tells me that it cannot install --user mwlib due to user site packages not visible in virtualenv [04:05:04] sDrewth: the virtualenv is isolated within itself so you don't need to use --user [04:05:13] it installs inside itself and is available only inside itself... [04:05:54] okay, the user pages omit that [04:06:02] which pages? [04:06:55] there isn't really anything toollabs specific about virtualenv so just the generic virtualenv documentation should work [04:07:04] help:tools labs and its link to subpage python application stub [04:07:23] ugh, what is that? [04:07:36] can you give me a link? [04:07:59] it is probably me misreading [04:08:19] if it's specifying --user in any form it should be corrected [04:09:06] [[Help:Tool Labs]] then go to My tool requires ... header [04:09:07] if you're trying to run pywikibot there's probably also more speciailzed pages for that (not sure) [04:09:08] ok [04:09:17] I'll try take a look tomorrow, gotta go now [04:09:21] has link to subpage [04:09:24] k thx [05:04:55] when submitting a cronjob to run on the grid, one needs to set the virtualenv too ? [05:05:31] when the command requires a virtualenv, that is [05:05:31] sDrewth: if you specify the full path it should just be ok ($VIRTUALENV/bin/python). also remember to pass -l release=trusty so it runs on trusty rather than precise [05:05:50] ok, thx [05:10:32] yuvipanda I am getting a insecureplatformewarning and have added the detail to T71980 [05:11:02] not sure how scary that is, or should be [06:43:28] 10Tool-Labs-tools-Other, 7I18n: [[Intuition:Raun-more entries/ksh]] i18n issue - https://phabricator.wikimedia.org/T112467#1636277 (10Liuxinyu970226) [07:08:34] 6Labs, 10Tool-Labs: Add support to dynamicproxy for kubernetes based web services - https://phabricator.wikimedia.org/T111916#1636310 (10yuvipanda) [11:19:23] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations, 5Patch-For-Review: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1636779 (10Krenair) [11:19:46] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1636375 (10Krenair) [11:26:52] 6Labs, 10Salt, 6operations: salt does not run reliably for toollabs / labs generally - https://phabricator.wikimedia.org/T99213#1636790 (10ArielGlenn) These changes are now live on labstore1001. Check of instances that don't reply to test.ping now. **The following have 'no route to host' so presumably they... [11:30:09] 6Labs, 10Salt, 6operations: salt does not run reliably for toollabs / labs generally - https://phabricator.wikimedia.org/T99213#1636794 (10ArielGlenn) response fast, all ten hosts, no timeout needed: ``` root@labcontrol1001:~# salt -G 'fqdn:tools-webgrid-lighttpd-12*' cmd.run hostname tools-webgrid-lightt... [11:30:55] 6Labs, 10Salt, 6operations: salt does not run reliably for toollabs / labs generally - https://phabricator.wikimedia.org/T99213#1636802 (10ArielGlenn) 5Open>3Resolved a:3ArielGlenn closing this, opening another ticket specific to the instances that owners must fix. [11:32:32] 6Labs, 10Salt: lab instances with broken salt which need to be fixed by instance owners - https://phabricator.wikimedia.org/T112512#1636810 (10ArielGlenn) 3NEW [11:38:22] santhosh : I have been stuck with this error : parsoidserver-http: HTTP 404 [11:38:37] I have setup mediawiki inside vagrant in labs [11:38:49] I have visualeditor role enabled [11:38:58] But whenever I try to enter edit mode [11:39:02] I get this error [11:40:21] This is the web proxy for my instance : http://languagetool_testaccount.wmflabs.org/ [11:40:32] So you can check it out [11:41:01] I can't see anything in the logs either [11:58:53] 6Labs, 10Salt: clean up old ec2id-based salt keys on labs - https://phabricator.wikimedia.org/T103089#1636898 (10ArielGlenn) the marathon instances have broken puppet which turns into broken salt configs. because their puppet is marathon-master, a project owner ought to look at those. I've opened T112512 for... [12:01:13] !log restarting elasticsearch (deployment-elastic0[5-8]) to deploy new plugins [12:01:14] restarting is not a valid project. [12:03:15] !log search restarting elasticsearch (deployment-elastic0[5-8]) to deploy new plugins [12:03:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Search/SAL, Master [12:04:56] !log deployment-prep restarting elasticsearch (deployment-elastic0[5-8]) to deploy new plugins [12:04:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL, Master [12:54:29] 6Labs, 10Salt: check that puppet certs/salt keys are deleted when they should be - https://phabricator.wikimedia.org/T112524#1637120 (10ArielGlenn) 3NEW [13:46:23] 6Labs, 3Labs-sprint-112: Restore some files from /home/gwicke - https://phabricator.wikimedia.org/T110698#1637245 (10ssastry) @Andrew, pinging again as per your previous request. :) [14:08:27] 6Labs, 10Continuous-Integration-Infrastructure, 10Labs-Infrastructure: mediawiki-core-phplint clone the whole repo from Zuul and times out - https://phabricator.wikimedia.org/T110512#1637305 (10hashar) 5Open>3Resolved I have manually cloned the mediawiki/core repo on that slave for that job. That has le... [14:08:28] 6Labs, 10Continuous-Integration-Infrastructure, 10Labs-Infrastructure: integration-slave-trusty-1014 and integration-slave-trusty-1017 instances can't boot anymore, ended up corrupted. Need rebuild - https://phabricator.wikimedia.org/T110052#1637307 (10hashar) [14:11:26] 6Labs, 10Tool-Labs, 10Continuous-Integration-Config: Job labs-toollabs-debian-glue is failing for labs/toollabs repository - https://phabricator.wikimedia.org/T110939#1637318 (10hashar) a:3hashar Assigning to myself since I am probably the only one going/willing to fix this. [14:28:34] 6Labs, 10Tool-Labs, 10Continuous-Integration-Config: Don't know what to put in setup.py/requirements.txt to satisfy both dpkg-buildpackage and tox-flake8 - https://phabricator.wikimedia.org/T110445#1637368 (10hashar) 5Open>3Resolved a:3hashar Seems that is a work in progress on https://gerrit.wikimedia... [14:55:10] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1637443 (10Andrew) I see this problem and can reproduce it on another instance. No idea as to the cause yet. [15:00:45] 6Labs, 10Salt: check that puppet certs/salt keys are deleted when they should be - https://phabricator.wikimedia.org/T112524#1637462 (10scfc) Regarding the latter question, I assume that there are scripts out there that rely on `$hostname.eqiad.wmflabs` resolving, so, //if//, I would be more comfortable with n... [15:05:47] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1637501 (10Andrew) This appears to be yet another issue with the nova rolling-upgrade process. The new instance, deployment-puppetmaster, was run... [15:06:14] 6Labs, 10Labs-Infrastructure, 3Labs-sprint-112, 5Patch-For-Review, 3labs-sprint-113: Update remaining virt nodes to kilo - https://phabricator.wikimedia.org/T112200#1637503 (10Andrew) [15:06:19] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1637502 (10Andrew) [15:09:57] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1637526 (10Krenair) Signed and puppet successfully ran on deployment-poolcounter01.deployment-prep.eqiad.wmflabs [15:14:47] 6Labs, 3Labs-sprint-112: Restore some files from /home/gwicke - https://phabricator.wikimedia.org/T110698#1637541 (10GWicke) In the meantime, I pushed 0.4 to releases.wikimedia.org, but before we can switch to that {T111225} will need to be resolved. [15:37:24] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1637622 (10Andrew) [15:37:27] 6Labs, 10Labs-Infrastructure, 3Labs-sprint-112, 5Patch-For-Review, 3labs-sprint-113: Update Labs to OpenStack Kilo - https://phabricator.wikimedia.org/T110045#1637623 (10Andrew) [15:37:36] 6Labs, 10Beta-Cluster, 10MediaWiki-General-or-Unknown, 6operations: Create a poolcounter instance in deployment-prep - https://phabricator.wikimedia.org/T112501#1637624 (10Andrew) 5Open>3Resolved [16:10:21] (03CR) 10Hashar: "recheck" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/234934 (https://phabricator.wikimedia.org/T91231) (owner: 10Tim Landscheidt) [16:13:58] 6Labs, 10Tool-Labs, 10Continuous-Integration-Config, 5Patch-For-Review: Job labs-toollabs-debian-glue is failing for labs/toollabs repository - https://phabricator.wikimedia.org/T110939#1637822 (10hashar) Fixed as can be seen on https://gerrit.wikimedia.org/r/#/c/234934/ The new `debian-glue` jobs takes... [16:14:06] (03CR) 10Hashar: "recheck" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/204013 (https://phabricator.wikimedia.org/T93197) (owner: 10Yuvipanda) [16:14:08] (03CR) 10jenkins-bot: [V: 04-1] Do not depend on portgranter [labs/toollabs] - 10https://gerrit.wikimedia.org/r/204013 (https://phabricator.wikimedia.org/T93197) (owner: 10Yuvipanda) [16:14:13] 6Labs, 10Tool-Labs, 10Continuous-Integration-Config, 5Patch-For-Review: Job labs-toollabs-debian-glue is failing for labs/toollabs repository - https://phabricator.wikimedia.org/T110939#1637823 (10hashar) 5Open>3Resolved [16:14:15] 6Labs, 10Tool-Labs, 5Patch-For-Review: Create a utility that dumps all databases of a user - https://phabricator.wikimedia.org/T91231#1637824 (10hashar) [16:37:48] 6Labs: Measure capacity and utilization of labs services (Tracking) - https://phabricator.wikimedia.org/T107066#1637917 (10coren) [16:37:50] 6Labs: Labs team reliability goal for Q1 2015/16 - https://phabricator.wikimedia.org/T105720#1637918 (10coren) [16:37:51] 6Labs, 3Labs-Sprint-107, 3Labs-Sprint-108, 3Labs-Sprint-109, 3labs-sprint-113: Setup monitoring and reporting for disk space usage of each project on NFS - https://phabricator.wikimedia.org/T106476#1637915 (10coren) 5Open>3declined After consideration, the occurrence of a project using a large fracti... [16:42:20] hello valhallasw`cloud [16:42:29] hmm [16:42:35] the entire line is highlighted here? [16:42:49] valhallasw`cloud: yeah but the grey is ETOOGREY [16:42:59] the color doesn't change at all [16:43:05] valhallasw`cloud: compared to all the other colors going around [16:43:06] ? [16:43:13] valhallasw`cloud: it isn't very visible [16:43:58] hm. Dunno, it's clear enough for me, but I can see how gray vs gray can be a bit unclear [16:44:09] YuviPanda: compare this line to the previous one [16:44:28] valhallasw`cloud: yeah - but still, not as clear as it used to be [16:45:01] mm. [17:04:49] 6Labs, 3Labs-Sprint-108, 3Labs-Sprint-109, 3Labs-Sprint-114, 3labs-sprint-113: Have catchpoint checks for all labs services (Tracking) - https://phabricator.wikimedia.org/T107058#1638059 (10Andrew) [17:05:32] YuviPanda: also redis redis redis [17:05:49] you should make http://shinken.wmflabs.org/dashboard your start page =p [17:06:05] 6Labs, 10Tool-Labs, 3Labs-Sprint-114: Add support to dynamicproxy for kubernetes based web services - https://phabricator.wikimedia.org/T111916#1638066 (10yuvipanda) [17:06:15] 6Labs, 10Tool-Labs, 3Labs-Sprint-114: Setup and verify authentication for Kubernetes - https://phabricator.wikimedia.org/T111904#1638067 (10yuvipanda) [17:06:26] 6Labs, 10Tool-Labs, 3Labs-Sprint-114: Make sure that docker0 bridge comes up after flannel network is established - https://phabricator.wikimedia.org/T111893#1638069 (10yuvipanda) [17:06:57] 6Labs, 10Tool-Labs, 3Labs-Sprint-114: Move toollabs off labsdebrepo into aptly - https://phabricator.wikimedia.org/T111708#1638073 (10yuvipanda) [17:12:05] 6Labs, 6operations, 10ops-eqiad, 3Labs-Sprint-114, 3ToolLabs-Goals-Q4: Make certain ports and cables between the labstores and shelves are numbered/named and labeled, and make sure that the diagram(s) reflect that. - https://phabricator.wikimedia.org/T112549#1638094 (10coren) 3NEW a:3coren [17:16:36] 6Labs, 3Labs-sprint-112, 3ToolLabs-Goals-Q4, 3labs-sprint-113: Fix documentation & puppetization for labs NFS - https://phabricator.wikimedia.org/T88723#1638131 (10coren) This is pending only the port labeling/numbering. [17:16:41] 6Labs, 3Labs-Sprint-114, 3Labs-sprint-112, 3ToolLabs-Goals-Q4, 3labs-sprint-113: Fix documentation & puppetization for labs NFS - https://phabricator.wikimedia.org/T88723#1638132 (10coren) [17:16:59] 6Labs, 3Labs-Sprint-114, 3labs-sprint-113: Evaluate gridengine's use of NFS and (possibly) move it to a different volume - https://phabricator.wikimedia.org/T111797#1638133 (10coren) [17:18:29] 6Labs, 10Labs-Infrastructure, 3Labs-Sprint-114: Ironic on Labs - https://phabricator.wikimedia.org/T110556#1638156 (10Andrew) [17:19:20] 6Labs, 3Labs-Q4-Sprint-2, 3Labs-Sprint-114, 3ToolLabs-Goals-Q4: Remove dependencies on LDAP from labstore100[12] - https://phabricator.wikimedia.org/T95558#1638163 (10coren) [17:20:52] 6Labs, 3Labs-Sprint-114: Make a flowchart for locating and halting misbehaving NFS clients - https://phabricator.wikimedia.org/T101744#1638182 (10coren) [17:58:38] YuviPanda: it would also be good if someone does a triage round [17:58:55] YuviPanda: and maybe close bugs as WONTFIX if that is what the answer is (e.g. the composer one) [17:59:15] valhallasw`cloud: I don't think that one is WONTFIX as much as a 'oh, so we need to import that package' [18:00:58] YuviPanda: eh, okay. I thought the conclusion last time was 'but we don't want local packages', but either is fine with me [18:01:27] valhallasw`cloud: hmm, good question. I don't know the answer to one. But it definitely isn't a WONTFIX as much as a 'needs to be done...' [18:38:49] 6Labs, 10Tool-Labs, 10Wiki-Loves-Monuments-Database: Consider using spatial indexes for faster geographical searches - https://phabricator.wikimedia.org/T112563#1638516 (10jcrespo) [18:40:56] 6Labs, 10Tool-Labs, 10Wiki-Loves-Monuments-Database: Consider using spatial indexes for faster geographical searches - https://phabricator.wikimedia.org/T112563#1638500 (10Multichill) +1. The int hack will get us through September, this is a better long term solution. [18:44:55] 6Labs, 10Tool-Labs, 5Patch-For-Review: Labs_lvm::Volume[separate-tmp] is noisy on execution hosts - https://phabricator.wikimedia.org/T109933#1638572 (10scfc) 5Open>3Resolved Removed. [18:45:54] jynus : Whats the toolsdb performance bug in phab? [18:48:25] 6Labs, 10Tool-Labs, 5Patch-For-Review: Make tools-mail route mail for @tools-*.pmtpa.wmflabs correctly - https://phabricator.wikimedia.org/T63484#1638605 (10scfc) 5Open>3Resolved Tested this by `qsub -m e -b y sleep 60` on `tools-bastion-01` and while: ``` scfc@tools-bastion-01:~$ qstat -j 408481 […] ma... [18:48:28] I added this: https://phabricator.wikimedia.org/T112563#1638500 [18:48:35] but that is not the current issue [18:49:41] I was just to send Emilio the link with the example code, see what he thinks [18:51:19] I have, BTW, code examples on how to use the spatial indexing [18:51:23] let me seach [18:52:11] just in case they are helpful: http://www.slideshare.net/jynus/query-optimization-with-mysql-57-and-mariadb-10-even-newer-tricks/76 [18:53:56] 10 doesn't have the json improvements, but it does the others [19:03:36] 6Labs: Create a catchpoint check for labs LDAP - https://phabricator.wikimedia.org/T107454#1638643 (10Andrew) [19:08:03] jynus: Oh, that's nice. Can you throw the links in the bug too? [19:08:24] sure, multichill [19:08:46] And I would just file a bug for the performance problems. That makes it easier to track [19:09:36] 6Labs, 10Tool-Labs, 10Wiki-Loves-Monuments-Database: Consider using spatial indexes for faster geographical searches - https://phabricator.wikimedia.org/T112563#1638655 (10jcrespo) This is something that I wrote some time ago that may be useful. http://www.slideshare.net/jynus/query-optimization-with-mysql-5... [19:13:51] 6Labs, 10Labs-Infrastructure, 6operations: move labs role classes to role/labs/foo structure - https://phabricator.wikimedia.org/T112570#1638664 (10Dzahn) 3NEW [19:17:43] Hi, I have a mediawiki installation inside vagrant with visualeditor role enabled. [19:18:19] Everytime I make changes to the localsettings.js file under parsoid, it gets overwritten upon running vagrant provision [19:18:20] !log deployment-prep updated OCG to version 5811056e28f2bc6408b6da96095352ab381bb11f [19:18:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL, Master [19:18:27] How do I avoid that? [19:23:48] 6Labs, 7Puppet: Move all labs-only puppet roles to manifests/role/labs - https://phabricator.wikimedia.org/T107167#1638699 (10Dzahn) [19:23:49] 6Labs, 10Labs-Infrastructure, 6operations: move labs role classes to role/labs/foo structure - https://phabricator.wikimedia.org/T112570#1638698 (10Dzahn) [19:37:37] 6Labs, 3Labs-Sprint-108, 3Labs-Sprint-109, 3Labs-Sprint-114, 3labs-sprint-113: Have catchpoint checks for all labs services (Tracking) - https://phabricator.wikimedia.org/T107058#1638781 (10Andrew) [19:37:38] 6Labs, 5Patch-For-Review: Create a catchpoint check for labs LDAP - https://phabricator.wikimedia.org/T107454#1638778 (10Andrew) 5Open>3Resolved a:3Andrew http://tools-checker.wmflabs.org/ldap [19:37:46] YuviPanda : could you help? [19:38:01] I don't know much about vagrant these days, sorry ankita-ks [19:38:14] Can you point me to someone who does? [19:38:23] I can't seem to catch bd808 :/ [19:38:42] ankita-ks: _808db [19:38:49] is bd808 but he might not be around atm [19:38:54] I do not know who else knows, sorry [19:38:58] you can try emailing wikitech-l [19:39:20] okay, I will do that. Thanks :) [19:51:33] 6Labs: Enable NFS at own project - https://phabricator.wikimedia.org/T112465#1638843 (10Luke081515) I guess 10-15 Tasks. But I need a shared storage between the instances, and a kind of job queue. Can you help me with installing that? [19:55:51] 6Labs: Enable NFS at own project - https://phabricator.wikimedia.org/T112465#1638868 (10yuvipanda) 10-15 can very easily be handled without gridengine. I personally prefer using Celery + Redis for job queues (That is what Quarry runs on) http://celery.readthedocs.org/en/latest/getting-started/brokers/redis.html.... [20:00:02] 6Labs, 7Puppet: Move all labs-only puppet roles to manifests/role/labs - https://phabricator.wikimedia.org/T107167#1638882 (10scfc) In https://gerrit.wikimedia.org/r/#/c/230928/1/manifests/role/labsvagrantlxc.pp, @akosiaris wrote that roles should move to `modules/role/manifests/` in the long term, so ideally... [20:07:39] YuviPanda: regarding https://phabricator.wikimedia.org/T107449, do you have any sample code that hits one of our internal db servers? [20:08:16] andrewbogott: hmm, I might have some in the labsdb auditor... [20:09:14] andrewbogott: nope, but it is just standard mysql from python [20:09:42] yeah, not hard, just wondered if there was a preferred pattern [20:09:46] use pymysql, read creds from ~/replica.my.cnf, connect to labsdb1001, 2, 3, 5, do a 'select * from page limit 1' and see if there is any result [20:21:26] YuviPanda: can you tell what’s up with puppet on tools-webgrid-lighttpd-1403? [20:21:34] Error: Could not get latest version: Cannot allocate memory - fork(2) [20:21:38] And yet… looks ok to me [20:22:41] 6Labs, 3Labs-Sprint-114, 3labs-sprint-113: Evaluate gridengine's use of NFS and (possibly) move it to a different volume - https://phabricator.wikimedia.org/T111797#1638994 (10coren) Currently, `/var/lib/gridengine` is a bind mount of `/data/project/.system/gridengine` on all nodes, which itself is just a su... [20:24:06] andrewbogott: looking [20:42:26] andrewbogott: not sure what's going on there [20:42:36] Lemme take a peek [20:43:03] YuviPanda: I assume it’s something so obvious that neither of us can see it [20:43:06] Coren: thanks [20:43:41] YuviPanda: so, those db checkers… we’re talking about labsdb1001.eqiad.wmnet, labsdb1002.eqiad.wmnet, etc right? [20:43:49] Are there aliases I should use from within labs? [20:44:14] andrewbogott: yah but just hit them directly [20:44:23] since the aliases can change if we wanted to rebalance [20:44:28] ok [20:44:47] I can’t hit them, at least not using andrew’s config [20:46:01] Dafu? Puppet behaves like oom, but there is definitely no oom in progress. [20:46:09] Hm. The actual VM is very ill. [20:47:13] dmesg is full of segfaults; to php-cgi, perl, and other sundry things. [20:47:34] I can't see any instances on https://wikitech.wikimedia.org/wiki/Special:NovaInstance, all sections are empty. [20:47:45] Is that the wiki-session vs openstack session bug still? [20:48:00] Krinkle: maybe! [20:48:35] I assume log-out/log-in will fix it but if there's any data you can look at I'll leave my session as-is and do something else [20:48:57] it's a complete productivity killer. [20:50:08] YuviPanda: any obvious issues with https://phabricator.wikimedia.org/P2042 ? [20:50:25] It tells me [20:50:26] pymysql.err.OperationalError: (2003, 'Can\'t connect to MySQL server on \'labsdb1002.eqiad.wmnet\' ((1045, u"Access denied for user \'u2093\'@\'10.68.16.17\' (using password: YES)"))') [20:50:56] andrewbogott: don't need configparser - you can pass it in directly as 'defaults_file' or something to connect [20:51:05] andrewbogott: try getting rid of the quotes in the replica.my.cnf [20:51:06] h, ok [20:51:31] YuviPanda: wait, in the file itself? [20:51:44] andrewbogott: yes, I vaguely remember something like that [20:51:55] …where did replica.my.cnf come from in the first place? [20:51:55] I think the newer mysql creds generator doesn't put the quotes in but the old one does [20:52:00] ah [20:52:04] there is a script running on labstore [20:52:22] YuviPanda: that was it! [20:54:13] hah [20:54:14] :) [20:54:22] andrewbogott: ok :) [20:54:29] configparser is also not needed tho [20:54:45] I’d love it if pymysql had, like, a reference guide [20:54:49] to tell me things like that [20:54:54] But I guess I’ll read the source [20:55:10] YuviPanda; andrewbogott: the instance was definitely very ill. I evacuated it and rebooted it and now puppet runs. [20:55:29] Coren: ok… I can’t guess why that happened :( [20:55:54] andrewbogott: Nor can I, but with dmesg being (literally) full of random crap segfaulting... there isn't much to help [20:57:11] * andrewbogott hopes that doesn’t start happening [20:58:40] I'll keep an eye out for it; but I wouldn't fear a virtualization bug on an isolated instance. [20:58:49] I don't think I've seen that before. [20:58:50] andrewbogott: Is there somethign worth investigating or should I just workaround it ? [20:59:00] Krinkle, just work around please [20:59:09] Is there a bug I can track? [20:59:16] The previous ones were closed it seems. [20:59:20] Krinkle: horizon also works for a lot of things. [20:59:29] * YuviPanda has been using it for everything except applying puppet roles [20:59:42] horizon.wikimedia.org [21:00:41] hi yuvipanda. [21:00:51] hi leila [21:00:59] should we chat for 15 min now to finish up the survey, yuvipanda [21:01:08] I can join remotely. [21:01:16] leila: sure! I'm not in the office yet either [21:01:29] cool cool. okay, let's use the calender Hangout link [21:01:35] YuviPanda: I don’t know what "select * from page limit 1” is but it seems not to work without specifying a db [21:03:31] andrewbogott: You can use meta_p [21:03:39] "select * from meta_p.page limit 1" [21:03:46] andrewbogott: ah yes, enwiki_p. or meta_p [21:03:55] Ah, not page in meta_p though. :-) [21:04:03] "select * from meta_p.wiki limit 1" [21:04:04] :-) [21:04:05] yuvipanda, if it helps, here is the link: https://plus.google.com/hangouts/_/wikimedia.org/leila-yuvipanda?authuser=1 [21:04:10] leila: yeah moment am setting up [21:04:15] enwiki_p may not be the best idea; even its indices are huge. [21:04:16] ooki, np. [21:05:06] yuvipanda https://etherpad.wikimedia.org/p/ToolLabs_Survey_feedback [21:11:44] leila: \o/ [21:12:01] seriously, YuviPanda! if we can get this out of the door, I feel good. :-) [21:12:27] leila: yeah sorry it's dragged on so long :( [21:12:40] np, YuviPanda. half of it was my fault. ;-) [21:22:00] YuviPanda: when you have a moment can you update https://phabricator.wikimedia.org/T97748 with what you think is or isn’t already done? [21:22:13] YuviPanda, for the question of how often have you used each of the following services, what are th reasonable responses we should provide? I'm assuming we want to offer buckets like: NA, 1, between 2 and 10, more than 20 (numbers are made up here). [21:23:01] leila: not sure numbers make sense there [21:23:14] maybe just /'never' to 'very often'? [21:23:30] ah! got it, yuvipanda. good. [21:24:39] 6Labs, 10Tool-Labs, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Setup a tools checker service that can check all internal services for availability - https://phabricator.wikimedia.org/T97748#1639265 (10yuvipanda) [21:24:42] andrewbogott: ^ [21:24:46] not that much it looks like >_> [21:27:04] YuviPanda, is that question about the past year? shall we ask it as "in the past year, how often have you used the following services?" I think it should be like that, so when we repeat the survey it stays consistent. [21:27:29] leila: +1 [21:28:19] YuviPanda: thanks!