[07:24:09] 3Tool-Labs-tools-Database-Queries: Add my query - https://phabricator.wikimedia.org/T76125 (10Yamaha5) 3NEW p:3Triage [07:29:39] 3Tool-Labs-tools-Database-Queries: Query tool's CVS download is not unicode - https://phabricator.wikimedia.org/T76126 (10Yamaha5) 3NEW p:3Triage [07:33:42] 3Tool-Labs-tools-Database-Queries: Categorizing the queries - https://phabricator.wikimedia.org/T76127 (10Yamaha5) 3NEW p:3Triage [07:44:57] Coren you there? [07:51:19] Steinsplitter: Isn't it like 3AM in Corenland? [07:52:18] a930913: i tought coren = france [07:52:46] Steinsplitter: Is he on holiday? [07:53:37] Wait, now you're making me doubt myself. [07:53:55] sanfranciso time, so he will be here later :P [08:05:42] 3Wikimedia-Labs-General: replication for s5 source wikis (dewiki/wikidata) stopped on labs1002 (dewiki.labsdb) - https://phabricator.wikimedia.org/T76070#790634 (10Merl) [08:08:17] 3Wikimedia-Labs-General: replication for s5 source wikis (dewiki/wikidata) stopped on labs1002 (dewiki.labsdb) - https://phabricator.wikimedia.org/T76070#790635 (10Merl) 5Open>3Resolved a:3Merl database is up to date again: ``` $ mysql -hdewiki.labsdb -e "select rc_timestamp, now(), now()-rc_timestamp as l... [08:12:49] 3Wikimedia-Labs-Other: (Tracking) Database replication services - https://phabricator.wikimedia.org/T50930#790669 (10Merl) [08:12:50] 3Wikimedia-Labs-tools: Missing Toolserver features in Tools (tracking) - https://phabricator.wikimedia.org/T60791#790667 (10Merl) [08:12:52] 3Wikimedia-Labs-tools: Performance problem on database server s5 using commonswiki - https://phabricator.wikimedia.org/T69602#790665 (10Merl) [08:12:53] 3Tool-Labs-tools-Other: merl tools (tracking) - https://phabricator.wikimedia.org/T69556#790668 (10Merl) [10:41:49] a930913: coren is based on the east coast of canada afaik. Possibly even in that part where they speak something which resembles French ;-) [10:59:02] 3Tool-Labs-tools-Other: [tracking] toolserver.org tools that have not been migrated - https://phabricator.wikimedia.org/T60865#790880 (10Magnus) [10:59:03] 3Tool-Labs-tools-Other: Migrate https://toolserver.org/~magnus/flickr_mass.php - https://phabricator.wikimedia.org/T63174#790878 (10Magnus) 5Open>3declined Superseded by https://tools.wmflabs.org/flickr2commons/ [11:11:59] 3Wikimedia-Labs-Infrastructure: wikidata (federated?) database not available for many wikis - https://phabricator.wikimedia.org/T75511#790883 (10zhuyifei1999) [11:21:58] apt.wikimedia.org repo has been added recently in sources.list? [11:22:07] (for Labs instances) [12:24:16] 3Wikimedia-Labs-Infrastructure: Labs: Enable "Puppet freshness" checks in shinken for cvn project - https://phabricator.wikimedia.org/T68573#791034 (10yuvipanda) Is this still wanted, @Krinkle? if so I can set this up with shinken. [12:58:57] 3Wikimedia-Labs-extdist: /var is running out of space on extdist2 - https://phabricator.wikimedia.org/T72952#791099 (10yuvipanda) p:5High>3Normal Use rotatinglogfilehandler in python, and set its parameters accordingly? [14:02:24] !paste [14:02:24] http://tools.wmflabs.org/paste/ [14:02:42] !paste is https://phabricator.wikimedia.org/paste/ [14:02:42] Key was added [14:02:45] !paste [14:02:45] https://phabricator.wikimedia.org/paste/ [14:03:39] YuviPanda: any idea why I would be getting https://tools.wmflabs.org/paste/view/09cf6e00 [14:03:48] * YuviPanda loks [14:04:00] Betacommand: hmm, is this happening locally? [14:04:03] looks like DNS failure [14:04:06] can you try again? [14:04:18] YuviPanda: its on my local webserver [14:04:26] did you try again? [14:04:31] Yeah [14:05:34] Betacommand: hmm, probably transient - works for me. Perhaps DNS caching on the way to you... [14:06:14] Betacommand: can you try 'dig gerrit.wikimedia.org' and paste output? [14:08:56] YuviPanda: https://tools.wmflabs.org/paste/view/5cf16947 [14:09:28] Betacommand: definitely looks like a local issue. can you access gerrit.wikimedia.org on your browser? [14:11:08] YuviPanda: looks like Ive screwed up my DNS settings. thanks for the help troubleshooting [14:11:16] :) [14:12:10] YuviPanda: first time setting up an NX server, growing pains [14:12:30] I am migrating an old windows webserver to trusty [14:12:50] aaaah [14:12:53] that... sounds like fun. [14:12:55] (or not) [14:13:14] good luck, Betacommand [14:13:51] YuviPanda: this is the only remaining issue [14:13:57] ah, nice [14:14:13] sites up, configured, and running noticeably faster [14:14:21] :D [14:14:22] nice [14:14:55] YuviPanda: the windows server was a hack, Win 7, with a server on a stick config [14:15:04] oh [14:15:06] WAMP? [14:15:11] XAMMP [14:15:59] wasnt bad, but wanted to make things a little easier for myself [14:16:32] :) [14:17:32] tended to be a little slow is all [16:37:41] 3Wikimedia-Labs-General: Some files of the dewiki-20141111 dump missing - https://phabricator.wikimedia.org/T75721#792039 (10Giftpflanze) 5Open>3Resolved a:3ArielGlenn [19:00:33] (03PS1) 10Yuvipanda: Replace webservice bash script with python script [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176293 [19:00:36] legoktm: ^ wanna review? python!!!!!1 [19:13:39] YuviPanda: y no python3? [19:13:45] legoktm: has to run on precise [19:13:52] precise has 3.2 [19:14:07] yeah, but 3.2 [19:14:10] I don't want to deal with 3.2 :P [19:14:44] use print_function so it'll be easier to migrate in the future? :P [19:16:02] :P [19:16:11] legoktm: in the glorious future, where only trusty nodes exist on toollabs :) [19:16:13] I think that's it [19:16:16] legoktm: I bet print will be the least of the problems [19:31:29] YuviPanda: I don't think we'll resonable ever not have Precise nodes while it still has LTS. It'll not be the default, for sure, and we'll adjust the ratio, but I don't plan on removing Precise entirely anytime soon. [19:31:44] well, 'glorious future' :) [19:33:01] By that time, you'll be pining for the glorious future of yodeling yack or whichever debian stable. :-) [19:33:53] heh :) [19:33:59] but yeah, majority on trusty would be nice [19:34:33] Coren: wanna CR https://gerrit.wikimedia.org/r/#/c/176293/? [19:34:43] works fine when tested locally [19:35:00] * Coren looks [19:35:04] I probably need to handle a bunch of edge cases... [19:35:08] oooh, and add checking for the publicdir [19:35:26] Coren: doesn't add release=trusty yet, but with this in place that should be trivial [19:37:29] You may also want to implement status. I don't know how many people use it, but I'd rather not axe functionality. [19:37:38] ah, hmm. ok [19:38:02] Coren: also, I can't find 'state' in the xml output :| [19:39:42] (03CR) 10coren: [C: 031] "Reasonable WIP, but I'd rather it be named something else for some time so that they can both live side-by-side until we are fully confide" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176293 (owner: 10Yuvipanda) [19:43:21] Coren: ah, hmm. makes sense. I'll make tye python version 'webservice2', add the release, and be ok? [19:43:42] wmf [19:43:45] wfm, even [19:57:46] (03PS2) 10Yuvipanda: Add webservice2 script [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176293 [20:15:32] (03PS3) 10Yuvipanda: Add webservice2 script [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176293 [20:25:16] Coren: ^ wanna +1/merge? I'll email list, and add status later on [20:26:12] (03CR) 10coren: [C: 031] "This is safe, since the old webservice remains available in case issues are noticed." [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176293 (owner: 10Yuvipanda) [20:26:34] Coren: hmm, also, why is this in a package instead of just in puppet? [20:26:43] take makes more sense, but this I'm not sure. [20:26:51] (03CR) 10Yuvipanda: [C: 032] Add webservice2 script [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176293 (owner: 10Yuvipanda) [20:28:07] YuviPanda: That seemed reasonable at the time, though I'm not opposed either way. Given that it's experimental, and does not replace anything, I would normally push it manually on the bastions (in /usr/local/bin) for testing and, once all the bugs and feature requests have been worked out, update the package, bump the version and let puppet do its thing. [20:28:41] Coren: hmm, can I just move it to the puppet repo? [20:28:52] Coren: both of them [20:29:53] If you do, then you have to make sure there exists no version in /usr/bin/ anymore. I'm not sure it's worth the trouble since we do need a package anyways. [20:30:53] yeah, I think that'll be fine. I'd like to keep it in puppet repo if that's ok with you. no need to update package each time there's a fix, and I don't like manually hackign it in [20:31:45] Either approaches are reasonable and I'm not opposed. You'll still have to update the package to remove them though. [20:31:50] yeah, I'll do that. [20:32:01] thanks [20:32:10] Hm. [20:32:19] Wait, there's an extra issue. [20:33:09] enduser scripts may well rely on them (as well as the j* family) living in /usr/bin; and /usr/local/bin isn't in the default paths of many things. You'll need to account for that as well. [20:34:02] hmm [20:34:06] actually, yeah. [20:34:06] that and manpages [20:34:25] don't think we can do manpages when we want to without the package, at least not as easily [20:34:28] I'll abandon local commits. [20:34:40] Also. I'm not sure I like the idea of pushing manpages through puppet. yeah, that. [20:34:44] Heh. GMTA [20:34:50] GMTA? [20:35:00] Great Minds Think Alike. :-) [20:35:08] :D [20:36:12] So yeah; if you really really want to handle the hassle, I'm not going to oppose moving this into puppet but there are advantages to maintaining the package too. [20:36:28] yeah [20:36:32] I agree, I think. [20:36:40] I'll just bump package version and build it now. [20:36:43] kk [20:36:45] guess it's in the local repo [20:36:59] It is, since it's pretty much worthless outside of tools. [20:37:28] OTOH, it means that once you update the repo with the newer version, puppet takes care of all the rest because we ensure => latest [20:37:41] yeah [20:38:21] bah, have to edit changelog manually [20:38:22] OS S [20:38:22] X [20:39:13] I usually build on -dev; it's easier that way and makes it simpler to then add to the repo. [20:40:38] Also, I'm pretty sure that doing the debbuild on OSX is going to make an... "interesting" take executable. :-) [20:41:10] (03PS1) 10Yuvipanda: Package fixes for webservice2 [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176299 [20:41:17] Coren: heh, nah, I just wanted to edit changelog. [20:41:21] Coren: ^ is... that right? [20:41:31] * YuviPanda has very little experience building packages, mostly restricted to python ones [20:42:35] (03CR) 10coren: [C: 031] "That works." [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176299 (owner: 10Yuvipanda) [20:42:48] Also, you have an odd timezone, you Indian you. :-) [20:42:50] (03CR) 10Yuvipanda: [C: 032] Package fixes for webservice2 [labs/toollabs] - 10https://gerrit.wikimedia.org/r/176299 (owner: 10Yuvipanda) [20:43:02] Coren: hehe :) Nepal is +0545 :) [20:43:17] that must make for crazier math [20:43:28] Ha! I didn't know there were quarter-hour timezones! [20:43:42] I didn't either until last month. Spent some time with nice mozilla folks from Nepal. [20:43:55] Want me to build and put in repo? [20:44:03] Coren: nah, I should learn this anyway. [20:44:08] Coren: I'll just poke if stuck :) [20:46:06] kk. There's a tiny script in /data/project/.system/deb that does the needful dpkg-scanpackages you can use. [20:47:48] We should probably start considering reprepro soon; when I started this we had, like, four total packages to manage on exactly one release. A file local repo is not going to be sufficient for very much longer. [20:50:16] Coren: yeah, maybe one just for all of labs even [20:50:16] . [20:50:26] Coren: cool, built and uploaded. doing an update now [20:51:08] Coren: that was surprisingly easy :) some day I should spend like a day or two doing nothing but building packages from scratch. [20:51:19] YuviPanda: I'm pretty sure tools{,beta} will always need its own repo because we sometimes need to use bleeding edge versions of things we wouldn't want to put elsewhere. [20:51:44] Things like oursql, or tcl libraries. [20:52:45] Coren: hmm, updatescripts doesn't actually seem to work. I see packages.gz and packages, and only .gz is updated, but I've a feeling apt is using the non gz version [20:53:13] * YuviPanda extracts manually [20:53:32] Oh, crap. Yeah - that's a change of behaviour in apt-get that was manually worked around earlier. The script should be updated. [20:53:49] yeah, I can do that. [21:16:24] ok, emailed! [21:17:24] 3Wikimedia-Labs-tools: Set up a trusty web host on tools - https://phabricator.wikimedia.org/T76055#792230 (10yuvipanda) 5Open>3Resolved a:3yuvipanda Aaand done :) Use the `webservice2` command instead of `webservice`, and pass it --release=trusty to start your tools on trusty! [21:17:31] Coren: I'm thinking we should rename ^ project to just 'Tool Labs' [21:17:37] well, Tool-Labs at least [21:17:46] objections? [21:19:49] well, done :) [21:20:27] YuviPanda: does it work with bigbrother? [21:20:41] valhallasw`cloud: should, bigbrother doesn't care how it was started [21:21:08] YuviPanda: are you sure? how does bigbrother know the job name then? :/ [21:21:09] valhallasw`cloud: wikibugs is already running on the trusty exec node, right? [21:21:16] aye [21:21:19] valhallasw`cloud: the job name is always lighttpd- [21:21:39] when started with webservice [21:21:44] and with webservice2 too [21:22:00] YuviPanda: you're missing my point. Bigbrother 1) needs to know how to start a task, and 2) needs to know how to check a task is running [21:22:12] let me look at the bigbrother code [21:22:14] YuviPanda: I don't get how it can know that magically for any task [21:22:26] (maybe it fiddles with paths or something? could work, I guess) [21:22:42] but my guess was that it checks for '-N bla' or 'webservice start' [21:22:46] Coren: where's bigbrother code? [21:23:12] aha [21:23:13] in puppet [21:23:24] oh man, perl :( [21:23:55] valhallasw`cloud: bam, you're right. it detects them properly, but then uses webservice to restart. [21:24:11] valhallasw`cloud: so even if you launch it with webservice2, it will restart them with webservice [21:24:15] auch. [21:24:42] also, eeeugh, perl [21:26:34] YuviPanda: That's trivial to add. [21:26:56] Coren: hmm, as a part of the rc itself? [21:27:21] Coren: can you do that? Perl... [21:28:51] Coren: https://phabricator.wikimedia.org/T76162?workflow=create [21:29:24] I would, but for some reason gerrit no longer likes my SSH key. [21:29:27] dafu? [22:01:09] 3Labs-Team, Wikimedia-Labs-Infrastructure: Have shinken check for basic labs infrastructure - https://phabricator.wikimedia.org/T75865#792311 (10yuvipanda) [22:01:23] Coren: heh, might be a very old bug resurfacing [22:02:50] 3Wikimedia-Labs-Infrastructure: Change I9238a052 broke ircecho on labs - https://phabricator.wikimedia.org/T64407#792316 (10yuvipanda) 5Open>3Invalid a:3yuvipanda I don't fully understand what the bug is / how to fix it. Plus it's pretty old, so closing for now. Do re-open if you've more info! [22:04:34] 3Wikimedia-Labs-Infrastructure: Set up ulimits on bastion - https://phabricator.wikimedia.org/T56719#792323 (10yuvipanda) [22:04:55] 3Wikimedia-Labs-Infrastructure: Set up ulimits on bastion - https://phabricator.wikimedia.org/T56719#611594 (10yuvipanda) p:5Triage>3Volunteer? I don't know if this is strictly required - but would definitely be nice to have! [22:28:06] Coren: hmm, interesting. tools-webgrid-05 is dead. [22:28:25] * YuviPanda restarts [22:28:59] Coren: huh, it's in 'SHUTOFF' state. can't restart [22:35:07] Coren: I'm going to head to sleep, would be grateful if you could look at what happened to tools-webgrid-05 [22:35:50] * YuviPanda goes [22:36:45] YuviPanda|zzzz: thanks for the info, I was AfK with the email question :) [23:46:08] I'm having issue with the top edits function of Xtools.