[00:11:47] (03PS2) 10Zppix: Adding help command to grrrit-wm [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 [00:11:59] (03CR) 10Paladox: "Fixed spacing." [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 (owner: 10Zppix) [00:13:28] (03PS3) 10Zppix: Adding help command to grrrit-wm [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 [00:29:41] (03PS4) 10Zppix: Adding help command to grrrit-wm [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 [00:39:47] (03PS5) 10Zppix: Adding help command to grrrit-wm [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 [00:42:03] (03PS6) 10Zppix: Adding help command to grrrit-wm [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 [00:43:39] (03CR) 10Paladox: [C: 031] "Tested on test bot." [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 (owner: 10Zppix) [00:47:00] (03CR) 10Zppix: "recheck" [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 (owner: 10Zppix) [01:04:24] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 15User-bd808: 2016 Tool Labs user survey - https://phabricator.wikimedia.org/T147336#2781718 (10leila) @bd808 I used the data right from the survey, no normalization or anything fancy had been done. Feel free to apply the analysis you had from last year to t... [01:16:10] (03CR) 10Paladox: "recheck" [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 (owner: 10Zppix) [01:29:54] (03CR) 10Paladox: [C: 032] Adding help command to grrrit-wm [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 (owner: 10Zppix) [01:38:59] (03CR) 10Zppix: [V: 032] Adding help command to grrrit-wm [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320541 (owner: 10Zppix) [03:46:16] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Jarallah was modified, changed by Jarallah link https://wikitech.wikimedia.org/w/index.php?diff=964417 edit summary: [06:44:52] PROBLEM - Puppet run on tools-exec-gift is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [06:59:32] 10Wikibugs: Post #wikisource bugs to #wikisource channel - https://phabricator.wikimedia.org/T150319#2781901 (10Samwilson) [07:15:46] 10Wikibugs, 06Wikisource: Post #wikisource bugs to #wikisource channel - https://phabricator.wikimedia.org/T150319#2781914 (10Samwilson) [07:24:54] RECOVERY - Puppet run on tools-exec-gift is OK: OK: Less than 1.00% above the threshold [0.0] [10:43:24] RECOVERY - Host tools-secgroup-test-102 is UP: PING OK - Packet loss = 0%, RTA = 4.29 ms [10:48:23] PROBLEM - Host tools-secgroup-test-102 is DOWN: CRITICAL - Host Unreachable (10.68.21.170) [11:47:47] RECOVERY - Host tools-secgroup-test-103 is UP: PING OK - Packet loss = 0%, RTA = 0.94 ms [12:02:08] PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22) [12:03:17] RECOVERY - Host secgroup-lag-102 is UP: PING OK - Packet loss = 0%, RTA = 1.41 ms [12:05:36] PROBLEM - Host secgroup-lag-102 is DOWN: CRITICAL - Host Unreachable (10.68.17.218) [13:48:41] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, and 3 others: Move dbproxy1010 and dbproxy1011 to labs-support network, rename them to labsdbproxy1001 and labsdbproxy1002 - https://phabricator.wikimedia.org/T149170#2782298 (10mark) [13:58:18] (03PS2) 10Jean-Frédéric: Set-up Raven client for error reporting via Sentry [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/320363 (https://phabricator.wikimedia.org/T137882) [13:58:36] (03CR) 10Jean-Frédéric: Set-up Raven client for error reporting via Sentry (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/320363 (https://phabricator.wikimedia.org/T137882) (owner: 10Jean-Frédéric) [15:56:47] 06Labs, 10Labs-Infrastructure, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 10Shinken: Purge old instances from wmflabs Shinken - https://phabricator.wikimedia.org/T150339#2782648 (10hashar) [16:38:22] 10Labs-project-other, 06Developer-Relations: move WikiApiary to Labs - https://phabricator.wikimedia.org/T149874#2767311 (10madhuvishy) +1 [16:41:06] 10Labs-project-other, 06Developer-Relations: move WikiApiary to Labs - https://phabricator.wikimedia.org/T149874#2782754 (10Andrew) 05Open>03Resolved a:03Andrew Done. @MarkAHershberger, you're project admin and can add other users or admins as you like. [16:47:39] hry, doctaxon I showed you https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Database [16:47:59] buy you may need extra gidance with the mysql command line client [16:48:15] if someone can help, that would be great [16:48:25] (I do not know all the ins and outs of the tools env) [16:48:57] but there are other tools users, maybe someone knows more than I do [16:49:02] *here [16:49:34] He is trying to create a database, which I saw here how it is done: https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Database#User_databases [16:49:59] sql local [16:50:15] CREATE DATABASE __DBNAME; [16:50:17] jynus: mysqlexec/db server: Can't create database 's51837__MerlBot'; database exists [16:50:26] oh, well, that is good [16:50:30] okay [16:50:37] now just connect to that database [16:50:48] and you should be able to create tables there [16:50:48] let me think how [16:50:55] andrewbogott: quick q: i have a new role/module that i cherry-picked on deployment-puppetmaster02 and now i want to apply it to a host in betacluster, but don't see it in the puppet config in horizon [16:51:08] you can use the keyword use to change the current db [16:51:11] do i still need to enable it in wikitech? [16:51:17] use s51837__MerlBot [16:51:51] those are questions that I do not even undestand, that is why I am redirecting you here [16:51:51] mobrovac: the list of classes on horizon come directly from the main puppet branch, so they won't be present. To add local classes you need to include them in the hiera block instead. [16:52:07] Which I don't immediately know the syntax for… yuvipanda, can you help? [16:53:40] jynus: I think I am connected but not sure [16:54:57] so I assume you have become your tool, right? [16:55:08] doctaxon? [16:55:36] i don't know yet [16:56:12] then you are asking the only person that doesn't know how that part works :-) [16:56:25] I can help you with mysql, not with labs [16:57:01] okay, how it is possible to find out, whether I am connected right [16:57:28] what do you seen on your screen? [16:57:41] the return was '0' [16:57:54] of what command? [16:58:05] % mysqlexec $db "use s51837__MerlBot" [16:58:06] 0 [16:58:18] ok, that I assume execs things [16:58:23] but then exits [16:59:10] add a ";create table X...." within the string [16:59:33] otherwise the use gets reset [17:00:23] % mysqlexec $db "use s51837__MerlBot; create table WORKLIST (page_id INT page_name CHAR page_fullname CHAR subjects CHAR);" [17:00:26] mysqlexec/db server: You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'create table WORKLIST (page_id INT page_name CHAR page_fullname CHAR subjects CH' at line 1 [17:01:32] jynus: ^ [17:02:52] where is bigbrotherrc located? [17:02:56] I do not know what mysqlexec does [17:03:03] but the create table is wrong [17:03:49] hm, mysqlsel gives the same: [17:03:50] % mysqlsel $db "use s51837__MerlBot; create table WORKLIST (page_id INT page_name CHAR page_fullname CHAR subjects CHAR);" [17:03:53] mysqlsel/db server: You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'create table WORKLIST (page_id INT page_name CHAR page_fullname CHAR subjects CH' at line 1 [17:05:01] I havent ever use mysqlexec / mysqlsel, I do not know what those are [17:05:24] tcl/mysql interface command [17:05:39] should I try it from bash? [17:05:53] ok, then go to the manual for those and see how they work, I sincerely do not know [17:06:08] it works this way [17:06:17] according to manuals [17:06:44] how does it work from bash? [17:07:38] run "sql local" [17:07:49] andrewbogott: is there a manual or sonthing that can tell me that? i've gone through all of the hiera configs i could find, but have seen no "role activation" parts [17:07:51] yuvipanda: ^ ? [17:07:53] use s51837__MerlBot [17:08:08] CREATE TABLE whatever; [17:08:41] MariaDB [(none)]> use s51837__MerlBot [17:08:41] ERROR 1049 (42000): Unknown database 's51837__MerlBot' [17:08:51] it said before it was created [17:08:53] so create it [17:09:01] CREATE DATABASE s51837__MerlBot [17:09:03] ; [17:09:25] okay, database changed [17:09:36] now run the create table [17:09:55] (which the original one had syntax errors, but that is up to you) [17:10:21] ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near 'CHAR page_fullname CHAR subjects CHAR)' at line 1 [17:10:24] yep [17:10:30] that is better than before [17:10:39] check your commas [17:11:04] the commas, ah [17:11:27] if sql is difficult, there are good guis that can be used [17:11:54] e.g. https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Database#MySQL_Workbench [17:13:06] jynus: how can I simply check, that the table exists? [17:13:22] without entries yet [17:13:26] SHOW TABLES; [17:13:44] or SHOW TABLE STATUS like 'table_name'; [17:14:03] anyone here uses bigbrother? [17:18:51] jynus: how can I get out of the trap: -> [17:19:25] \c [17:20:06] no, it ends the whole sql local [17:20:23] I am back in the bash now [17:20:28] :( [17:20:37] it shouldn't [17:20:44] it only cancels current statement [17:21:15] you sure you didn't write CTRL-d or CTRL-c? [17:21:37] normally, you would write a .sql file [17:21:40] yes, I got it [17:21:50] and run it on the stdrd output of that command [18:54:08] jynus: what is the path to this database? [18:56:53] path? [18:57:06] path of a database makes no sense [18:57:25] okay, where is the table [18:57:44] or the database [18:57:50] in a server called labsdb1005 [18:58:02] it is a file, isn't it? [18:58:05] no [18:58:42] remote accessed db are not like sqlite [18:58:42] what else? [18:58:53] it is not a file, [18:59:16] if you go there (that you could not), and copy it, you would not obtain a database [18:59:31] if you want to transfer db data [18:59:50] think of it as apache [19:00:07] if you copy the php files you do not get the html [19:00:23] you need to use some client if you want to transfer of backup your data [19:00:47] mysqldump is the more standard: http://dev.mysql.com/doc/refman/5.7/en/mysqldump.html [19:01:00] maybe that is what you are looking for? [19:02:46] ya okay, thx [19:02:56] yw [19:03:14] databases are not easy, sorry :-( [19:07:27] jynus: what is the max cell content length of undefined VARCHAR column [19:08:09] sorry, there was a long time that I studied for the mysql certification [19:08:12] :-) [19:08:29] the manual is very good, though http://dev.mysql.com/doc/refman/5.7/en/char.html [19:10:18] first of all, varchar without size is not accepted on my mysql version [19:10:56] "A table can contain a maximum of 1017 columns" [19:11:42] he maximum row length, except for variable-length columns (VARBINARY, VARCHAR, BLOB and TEXT), is slightly less than half of a page (16K) [19:12:08] "including BLOB and TEXT columns, must be less than 4GB." [19:18:11] (03PS1) 10Paladox: Make the whitelist regex based [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320632 (https://phabricator.wikimedia.org/T149689) [19:19:11] (03CR) 10jenkins-bot: [V: 04-1] Make the whitelist regex based [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320632 (https://phabricator.wikimedia.org/T149689) (owner: 10Paladox) [19:21:47] 10Labs-project-other, 06Developer-Relations: move WikiApiary to Labs - https://phabricator.wikimedia.org/T149874#2783204 (10Dzahn) 05Resolved>03Open Thank you! but this was actually subtask T150065 for the creation of the labs project [19:21:53] (03PS2) 10Paladox: Make the whitelist regex based [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320632 (https://phabricator.wikimedia.org/T149689) [19:23:22] 06Labs: Request creation of WikiApiary labs project - https://phabricator.wikimedia.org/T150065#2783209 (10Dzahn) copied from parent task ---- Andrew added a subscriber: Andrew. Mon, Nov 7, 7:52 AM Comment Actions This is probably fine, but can you please provide a summary of what this project is, what it will... [19:24:43] 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#2783214 (10Dzahn) [19:24:45] 06Labs: Request creation of WikiApiary labs project - https://phabricator.wikimedia.org/T150065#2783211 (10Dzahn) 05Open>03Resolved a:03Andrew [19:25:16] 10Labs-project-other, 06Developer-Relations: move WikiApiary to Labs - https://phabricator.wikimedia.org/T149874#2767311 (10Dzahn) [19:28:08] (03PS6) 10Paladox: Replacing swig with swig-templates [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320294 [19:48:43] 06Labs, 10Labs-Infrastructure, 06Release-Engineering-Team, 07Beta-Cluster-reproducible, 07LDAP: Purge old instances from wmflabs Shinken - https://phabricator.wikimedia.org/T150339#2783311 (10Krenair) Shinken gets the data from LDAP. Most of these are wrong though, the instances still exist. [19:49:36] 06Labs, 10Labs-Infrastructure, 06Release-Engineering-Team, 07Beta-Cluster-reproducible, 07LDAP: Purge old instances from wmflabs Shinken - https://phabricator.wikimedia.org/T150339#2783315 (10Krenair) 05Open>03Invalid Actually all of them are wrong, all of these exist [19:50:27] 10PAWS: Create custom login page - https://phabricator.wikimedia.org/T150355#2783317 (10Framawiki) [20:11:41] hiya, quote on wikitech Help:Security_groups page [20:11:42] "Important: Consider your security scheme before you create an instance, you cannot remove or add security groups to an instance once it has been created. [20:11:42] " [20:11:47] is this true anymore with horizon? [20:12:24] andrewbogott: ^maybe knows? [20:14:10] no [20:14:42] Krenair: its not true anymore? [20:14:58] correct [20:15:01] I'll clean the page up [20:15:08] i'm trying to open up my now fully puppetized and deployed service in deployment-prep [20:15:21] its deployed to sca0[123] on port 8092 [20:15:30] mobrovac: did you find what you were looking for? [20:15:31] i've created an 'eventstreams' security group for that port [20:15:32] it's hiera_classes [20:15:37] and added it to those instances [20:15:42] put a list of roles in there and it'll work [20:15:49] ottomata, define open up [20:15:54] i've also created a dns webproxy to sca01 port 8082 from eventstreams-beta.wmflabs.org [20:16:40] 8092 vs. 8082? [20:16:56] 8092 (did i make i 8082?) [20:17:03] 18<ottomata18> its deployed to sca0[123] on port 8092 [20:17:07] i've also created a dns webproxy to sca01 port 8082 from eventstreams-beta.wmflabs.org [20:17:21] sorry, [20:17:23] 8092 [20:18:11] yuvipanda: hiera_classes? where? [20:18:46] ottomata, looking [20:19:29] sqlite> select backend.url from backend, route where backend.route_id = route.id and route.domain = 'eventstreams-beta.wmflabs.org'; [20:19:29] http://10.68.20.183:8092 [20:19:42] mobrovac: in the hiera yaml for that particular instance [20:19:43] which is deployment-sca01.deployment-prep.eqiad.wmflabs:8092 [20:20:10] correct [20:20:21] yuvipanda: in ops/puppet? and if i just cherry-pick it on deployment-puppetmaster02 it'll automatigacally work? [20:20:38] ottomata, this is the 'eventstreams' security group? [20:20:45] mobrovac: if you put that in hiera and cherry-pick on deployment-puppetmaster02 it'll work [20:20:46] yes [20:21:10] and curl -v 10.68.20.183:8092/v1/stream/revision-create from within deployment-prep project works fine [20:21:38] ottomata, https://horizon.wikimedia.org/project/access_and_security/security_groups/813/ doesn't appear to have much :) [20:21:45] yuvipanda: thnx! [20:21:52] * Krenair adds 8092 access to all of labs [20:21:56] mobrovac: yw [20:22:20] ottomata, not it works [20:22:45] OH, is it the cidr range? [20:22:54] i thought it defaulted to everything [20:22:55] hmMM [20:23:00] you just didn't add the port at all [20:23:03] the security group was empty [20:23:11] it didn't do anything [20:23:15] HmMm i did! hm strange ok. [20:23:30] well, maybe nova lies [20:24:17] ok cool! the domain from within labs works! guess i jsut gotta wait for dns to get to me [20:24:18] YES [20:24:19] curl -v -H 'Host: eventstreams-beta.wmflabs.org' 208.80.155.156/v1/stream/revision-create [20:24:21] works from my local [20:24:23] yeehaw [20:25:55] yeah dns may be cached somewhere :/ [20:27:19] !log deployment-prep removed default SSH access from production host 208.80.154.135, the old gallium IP [20:27:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [20:29:46] Krenair: thank you! [20:42:10] ottomata, I think this page you found also has the old pmtpa.wmflabs CIDR [20:42:23] 10.4.0.0/21 [20:43:49] the wikitech security groups one? [20:44:41] yes [21:21:43] o/ [21:22:09] I wonder why the machines behind wmflabs are soooo sloooow ? [21:23:11] every command I run (either on bastion, or directly on a node via qlogin) takes ages to do even trivial tasks [21:23:37] for instance, starting a python interpreter in a shell takes a few seconds [21:24:45] I think you'll find that problem is largely limited to tools.eqiad.wmflabs these days [21:26:24] Krenair: is there a way to ask for a better machine when submitting jobs via SGE? [21:28:05] (03CR) 10Zppix: [C: 032] "Tested by both me and paladox independently (due to cloak restrictions)" [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320632 (https://phabricator.wikimedia.org/T149689) (owner: 10Paladox) [21:28:33] (03Merged) 10jenkins-bot: Make the whitelist regex based [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320632 (https://phabricator.wikimedia.org/T149689) (owner: 10Paladox) [21:32:46] (03PS7) 10Paladox: Replacing swig with swig-templates [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320294 [21:43:43] this is really frustrating :-( [21:45:44] pintoch: maybe the problem is really slow communication instead of machine resources? [21:49:41] Platonides: see by yourself: http://pintoch.ulminfo.fr/7284417663/log.txt [21:50:05] creating a virtualenv involves no network communication as far as I know [21:50:45] the same command takes 0.87s on my (shitty) laptop [21:50:52] :( [21:51:06] versus 55s on wmflabs… I really don't get it [22:00:41] pintoch, yes, it does [22:00:55] pretty much anything you can touch as a normal user involves NFS [22:01:11] on tools [22:02:24] that's how your files are present on both the bastion and grid engine hosts [22:03:36] 06Labs, 10Labs-Infrastructure, 06Operations, 13Patch-For-Review, 07Wikimedia-Incident: Some labs instances IP have multiple PTR entries in DNS - https://phabricator.wikimedia.org/T115194#2784008 (10Andrew) 05Open>03Resolved we've gone > a week without leaks. Seems unrealistic to close this, but ther... [22:04:42] 10Labs-project-other, 06Developer-Relations: move WikiApiary to Labs - https://phabricator.wikimedia.org/T149874#2784016 (10Andrew) a:05Andrew>03MarkAHershberger (oops) [22:04:49] yuvipanda, got any suggestions for pintoch? [22:05:00] ah [22:05:03] pintoch: try running [22:05:12] 'webservice --backend=kubernetes python2 shell' [22:05:17] and doing your stuff in there [22:05:21] virtualenvs should be much faster [22:05:26] assuming you are using webservice [22:05:30] oh right, python2 shell [22:05:31] ok [22:05:32] not necessarily [22:05:32] sorry [22:05:39] you can also use kubectl directly [22:05:54] webservice shell is the easiest way to access it rn [22:12:13] yuvipanda: thanks a lot, that seems to work! [22:12:37] pintoch: yw. virtualenvs in particular (or anything that does a lot of stat calls) is going to be very painful [22:14:19] (03PS1) 10Paladox: Modify the regex to do \/ instead of \\ [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320695 [22:16:36] (03CR) 10Zppix: [C: 032] Modify the regex to do \/ instead of \\ [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320695 (owner: 10Paladox) [22:17:04] (03Merged) 10jenkins-bot: Modify the regex to do \/ instead of \\ [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/320695 (owner: 10Paladox) [22:21:22] 06Labs, 10Labs-Infrastructure, 06Operations, 13Patch-For-Review, 07Wikimedia-Incident: Some labs instances IP have multiple PTR entries in DNS - https://phabricator.wikimedia.org/T115194#2784034 (10hashar) Good news @Andrew thank you. [22:33:39] 10Tool-Labs-tools-Pageviews: Add Mediaviews to Pageviews suite - https://phabricator.wikimedia.org/T149642#2784075 (10MusikAnimal) @harej-NIOSH So are we only supporting media that is on Commons? Or is it even possible to generate data on a per-project basis, such as files only available under fair use? [22:46:38] 10Tool-Labs-tools-Pageviews: Add Mediaviews to Pageviews suite - https://phabricator.wikimedia.org/T149642#2784089 (10MusikAnimal) @harej-NIOSH Also, I need either JSONP or CORS support so I can work on this locally :) [23:45:42] Krinkle: When you're around, can you poke me about intuition? I'm having problems getting Intuition to only display languages that there is an actual loaded translation for. The docs say use "getAvailableLanguages()" but that shows all of them. If there's a better place to ask please let me know.