[01:59:07] I'm trying to configure my error logging in Python to send email notifications of errors for a script that will be running on labs. What mailhost should I use? [01:59:31] or should I just send errors to stderr and get emails from cron? [03:12:03] since wmf has like $60m, can they fix the labs now? :/ [03:25:24] No, but they can order us all pizza and beer. :) [06:23:02] comets: what’s broken in labs? [06:37:50] PROBLEM - Puppet failure on tools-uwsgi-01 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [06:48:43] PROBLEM - Puppet failure on tools-exec-cyberbot is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [06:52:45] RECOVERY - Puppet failure on tools-uwsgi-01 is OK: OK: Less than 1.00% above the threshold [0.0] [06:55:51] PROBLEM - Puppet failure on tools-exec-wmt is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [07:13:46] RECOVERY - Puppet failure on tools-exec-cyberbot is OK: OK: Less than 1.00% above the threshold [0.0] [07:20:50] RECOVERY - Puppet failure on tools-exec-wmt is OK: OK: Less than 1.00% above the threshold [0.0] [08:07:09] 3Labs-Team: Investigate multiarch differences between precise / trusty - https://phabricator.wikimedia.org/T86294#965343 (10yuvipanda) 3NEW [08:07:47] 3Labs-Team: Investigate multiarch differences between precise / trusty - https://phabricator.wikimedia.org/T86294#965343 (10yuvipanda) p:5Triage>3Low [08:19:51] 3Labs-Team: Investigate multiarch differences between precise / trusty - https://phabricator.wikimedia.org/T86294#965357 (10yuvipanda) It's probably an artifact of how the glance images were built. [08:22:33] YuviPanda: I tried uWSGI yesterday, but was not very succesful. See https://merlijn.vandeen.nl/drafts/flask-mwoauth-on-tools.html for some details [08:22:50] YuviPanda: basically uWSGI randomly stopped working at some point [08:23:08] YuviPanda: and uWSGI error logs SUCK BALLS [08:23:17] excusez le mot [08:24:38] YuviPanda: "cannot read file OR application function not found", or something like that. :| [08:25:03] valhallasw`cloud: uh. which tool is this? [08:25:03] oh [08:25:09] outofband [08:27:30] which I hacked up for Coren (and now don't have access to anymore =p) [08:27:30] valhallasw`cloud: am trying now [08:27:31] YuviPanda: basically, uwsgi stopped loading my app at some point, and I have no clue why [08:27:31] and no clue how to debug [08:27:54] YuviPanda: it's definitely broken now in outofbound because I've reused the venv for fcgi [08:27:59] which is on 12.04 instead of 14.04 [08:28:15] valhallasw`cloud: works when I delete the uwsgi.ini file [08:28:19] wat. [08:28:40] valhallasw`cloud: uwsgi chdirs to www/python/src before doing anything [08:28:48] so it was looking for www/python/src/src/app.py [08:28:52] valhallasw`cloud: and app.py is the default anyway [08:28:56] YuviPanda: I had app.py before [08:29:18] and then it didnt work, so I tried random stuff to try to get it to work again [08:29:46] http://stream1.gifsoup.com/view/257866/keyboard-smash-o.gif <-- me, yesterday [08:30:00] valhallasw`cloud: https://tools.wmflabs.org/outofband doesn’t work because of the fact that it’s looking for URLs ‘/' [08:30:04] and not /outofband [08:30:13] YuviPanda: noooo [08:30:19] that was not the issue [08:30:24] that was *also* an issue [08:30:26] valhallasw`cloud: it is now. [08:30:35] but while I tried fixing that, uwsgi completely decided to stop loading app.py [08:30:41] see uwsgi.log! [08:35:24] YuviPanda: :( It's even more depressing it's magically working again [08:35:54] valhallasw`cloud: hmm, I’m trying to spot the time when it stopped working [08:37:00] valhallasw`cloud: first failure I see is [08:37:02] > failed to open python file patchuploader.py [08:37:13] YuviPanda: right, then I changed it to app.py and it worked [08:37:26] right [08:37:27] YuviPanda: then I tried to add logging in app.py and stuff broke [08:37:37] YuviPanda: even though I could just execute app.py directly [08:37:52] hmm [08:37:56] how did you add logging? [08:38:01] YuviPanda: I'm also super confused because the uWSGI docs say the wsgi app should be called 'application'? [08:38:18] YuviPanda: from flask import Flask, request, then in the 404 handler returned repr(request.headers) [08:40:12] YuviPanda: well, I'm going to try again soon(TM) so I can write flask-in-a-box for tools [08:40:25] valhallasw`cloud: I think we need to fix the prefix issue somehow [08:40:28] yeah [08:40:31] tell flask about it in some form [08:40:32] maybe [08:40:34] yeah [08:40:41] that should be in UWSGI_APP or something like that [08:40:43] some header [08:40:53] because it magically works over fcgi [08:40:59] so flask clearly can understand prefixes [08:41:10] valhallasw`cloud: right. [08:41:30] valhallasw`cloud: perhaps one of the params nginx could set differently [08:41:40] valhallasw`cloud: also, we aren’t using uwsgi over uwsgi protocol, but over http protocol [08:41:53] hmm, or not [08:41:55] I think i fixedd that [08:42:40] I don't know what that means [08:43:12] you mean nginx just forwards the http request (and uwsgi acts as web server) instead of nginx embedding uwsgi somehow? [08:43:22] valhallasw`cloud: the nginx -> uwsgi proxying is done over a binary protocol called uwsgi [08:43:24] that both support [08:43:27] rather than as http [08:43:30] I see [08:43:35] that’s the reccomended way to do this [08:43:48] why use different names for different things if you can call ALL the things the same? :P [08:44:32] but that shouldn't really matter, I think [08:44:46] there are some hints in the uwsgi docs on how to configure the prefix in nginx [08:45:11] valhallasw`cloud: yeah, I’ll take a look [08:45:17] <3 [08:45:29] valhallasw`cloud: I added it because faster, plus if we do hhvm we have to support fastcgi directly [08:49:45] YuviPanda: lighttpd does fcgi? I don't get it :P [08:50:10] valhallasw`cloud: ah, trying to get nginx -> hhvm rather than nginx -> lighty -> hhvm [08:50:22] Ohhhhhh. [08:58:06] valhallasw`cloud: hmm, http://uwsgi-docs.readthedocs.org/en/latest/Vars.html [08:58:12] valhallasw`cloud: don’t see anything that could be of use to us [08:59:25] APPLICATION_ROOT [08:59:48] not sure if that's an env var though or a flask config one :/ [09:00:58] oh I get what's happening [09:01:05] or not :/ [09:01:43] what? [09:02:04] oh, hmm [09:02:08] maybe we should set APPLICATION_ROOT [09:02:09] and rewrite? [09:02:14] I think it's SCRIPT_NAME vs REQUEST_URI [09:02:22] or something like that, I'm not really sure [09:02:58] http://flask.pocoo.org/docs/0.10/deploying/uwsgi/ [09:03:01] SCRIPT_NAME, yeah [09:03:27] > uwsgi_modifier1 30; [09:03:41] I don't even. [09:04:14] oh [09:04:19] apparently that's the magic trick?!?! [09:04:22] The uwsgi_modifier1 30 option sets the uWSGI modifier UWSGI_MODIFIER_MANAGE_PATH_INFO. This per-request modifier instructs the uWSGI server to rewrite the PATH_INFO value removing the SCRIPT_NAME from it. [09:04:34] https://stackoverflow.com/questions/22642124/the-uwsgi-modifier1-30-directive-is-not-removing-the-script-name-from-path-inf [09:04:41] I'm going to do some work now [09:05:31] thanks for looking into it [09:06:44] valhallasw`cloud: I’m just setting modifier-manage-path-info directly [09:06:57] but alas [09:06:58] https://tools.wmflabs.org/outofband/ [09:08:10] valhallasw`cloud: I’ll keep poking [09:12:39] valhallasw`cloud: AND BAM https://tools.wmflabs.org/outofband/ [09:13:22] YuviPanda: seems to work, but oob doesn't use flask to generate urls [09:13:34] valhallasw`cloud: yup. let me try with g-p-u [09:13:40] (y) [09:13:54] YuviPanda: in any case it's further than I was yesterday, thanks [09:18:07] valhallasw`cloud: BAM https://tools.wmflabs.org/gerrit-patch-uploader/ [09:19:34] now to puppetize [09:24:39] 3Labs-Team: Replace custom ec2id fact with facter's ec2 - https://phabricator.wikimedia.org/T86297#965409 (10yuvipanda) 3NEW a:3yuvipanda [09:40:22] valhallasw`cloud: ok, g-p-u running on uwsgi again. I renamed patchuploader.py to app.py tho [09:50:51] YuviPanda: ok! [09:50:58] can you commit that? [09:51:21] you have commit rights on the repo [09:51:39] valhallasw`cloud: I shall in an hour or so, I’d probably have to modify fcgi etc as well ( want to still keep that ) [09:51:44] valhallasw`cloud: but now I’m off to get more tests done [09:51:46] so brb [09:51:47] cool, thanks [09:51:50] good luck! [09:57:08] (03PS1) 10Merlijn van Deen: Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 [09:57:10] (03CR) 10jenkins-bot: [V: 04-1] Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 (owner: 10Merlijn van Deen) [09:57:29] :< [09:57:56] (03PS2) 10Merlijn van Deen: Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 [09:57:58] (03CR) 10jenkins-bot: [V: 04-1] Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 (owner: 10Merlijn van Deen) [09:59:21] (03PS3) 10Merlijn van Deen: Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 [09:59:26] hashar: what's your opinion on https://gerrit.wikimedia.org/r/#/c/183636/ ? [09:59:45] hashar: if you have time, that is [10:01:43] (03PS2) 10Merlijn van Deen: Duplicate -qa notifcations to -releng [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183371 (https://phabricator.wikimedia.org/T86053) (owner: 10Hashar) [10:02:58] valhallasw`cloud: in my review backlog :-D [10:03:20] ok! [11:51:17] the question is dear panda, whats working? :P [12:08:52] comets: uh, everything, afaik [12:08:56] valhallasw`cloud: poke when you are around [12:09:29] 24/7? [12:11:23] comets: hmm? [12:11:36] I’m not aware of any significant breakage in the recent past. [12:15:02] YuviPanda: I'm around, but won't always respond quickly [12:17:24] valhallasw`cloud: ok. [12:19:12] 3Wikimedia-Labs-Infrastructure, Labs-Team: Make /tmp an lvm partition too for new labs instances - https://phabricator.wikimedia.org/T85471#965550 (10yuvipanda) @Coren @andrew can we make this happen for the new debian images to start with? [12:24:33] 3Tool-Labs: static references broken with flask via uwsgi - https://phabricator.wikimedia.org/T85360#965554 (10yuvipanda) [12:24:36] 3Tool-Labs: Uwsgi breaks flask project-relative URLs - https://phabricator.wikimedia.org/T85362#965555 (10yuvipanda) [12:50:49] 3Tool-Labs: Make DynamicProxy be able to proxy back to non-http protocols - https://phabricator.wikimedia.org/T84983#965589 (10yuvipanda) 5Resolved>3Open Boo! nginx requires uwsgi_pass, fastcgi_pass, proxy_pass depending on what protocol the origin server is listening on. This is terrible. [12:50:50] 3Tool-Labs: Make HHVM based webservices available on toollabs - https://phabricator.wikimedia.org/T78783#965591 (10yuvipanda) [12:57:04] 3Wikimedia-Labs-Infrastructure: Automatically updated list of all configured domains - https://phabricator.wikimedia.org/T45580#965599 (10yuvipanda) p:5High>3Volunteer? [12:57:39] 3Wikimedia-Labs-Infrastructure: new security rule not applied - https://phabricator.wikimedia.org/T42526#965601 (10yuvipanda) p:5High>3Normal 2ish years later, is this still the case? [12:57:56] 3Wikimedia-Labs-Infrastructure: Commons replica DB excessively out-of-date - https://phabricator.wikimedia.org/T75980#965606 (10yuvipanda) Is this still the case? [12:58:24] 3Wikimedia-Labs-Infrastructure: Input/Output errors in a /home directory - https://phabricator.wikimedia.org/T47609#965608 (10yuvipanda) p:5High>3Triage I suppose this can be closed now? [13:00:44] 3Wikimedia-Labs-Infrastructure: When uploading files to web, in network activity is twice of out - https://phabricator.wikimedia.org/T45060#965611 (10yuvipanda) 5Open>3Invalid a:3yuvipanda Cleaning up as invalid now, because we don't have gluster nor ganglia anymore :) [13:43:45] 3Wikimedia-Labs-Infrastructure, Labs-Team: Make /tmp an lvm partition too for new labs instances - https://phabricator.wikimedia.org/T85471#965640 (10coren) Not the way it currently works, no; but /tmp is thankfully one of the easiest filesystem to just replace (provided there is unallocated space to begin with) [13:54:05] YuviPanda: soooooo poke? [13:54:31] valhallasw`cloud: oh, was going to ask you to review a patch, but gerrit seems dead... [13:54:36] oh :< [13:54:41] works for me [13:54:46] valhallasw`cloud: https://gerrit.wikimedia.org/r/#/c/182848/ [13:54:48] valhallasw`cloud: works in chrome [13:55:16] YuviPanda: oh that's a bit too complicated for now. I'll poke at it tonight. [13:55:27] valhallasw`cloud: \o/ ty [13:55:35] valhallasw`cloud: your previous review was very thorough and quite helpful :) [13:55:50] I shall commit the changes for g-p-u now [13:56:41] valhallasw`cloud: and uwsgi seems finish now :3 [13:56:51] \o/ [13:57:43] valhallasw`cloud: need to figure out python3 support tho [13:57:57] YuviPanda: py3 venv probably just works(TM)? [13:58:23] valhallasw`cloud: no. uwsgi has a python plugin and a python3 plugin [13:58:27] this requires latter [13:58:30] oh :< [13:58:41] I might add a uwsgi-python3 thing [14:05:37] Coren: YuviPanda congrats on fixing the DNS issue :] [14:06:21] hashar: dnsmasq still remains ridiculously oversensitive to even light load; we just managed to slash the load down. [14:07:15] yeah, but should buy us enough room for the foreseeable future, I think [14:07:23] hashar: betalabs still has failures, they’re just not dns related :) [14:07:38] hashar: need to figure out who exactly is responsible for fixing betalabs puppet failures [14:07:42] feels a bit diffuse atm [14:08:10] Coren: +1? https://gerrit.wikimedia.org/r/#/c/183833/ [14:08:28] YuviPanda: anyone [14:08:32] everyone [14:08:36] noone? [14:08:37] :) [14:08:44] yeah that ends up being none :( [14:09:00] hashar: something to discuss in SF in a few weeks, I think [14:09:34] Coren: thanks! https://gerrit.wikimedia.org/r/#/c/183209/? I’m testing it on betalabs now [14:09:40] YuviPanda: I should held a session about what is beta, how to interact with it and most importantly get folks to help maintained the setup [14:09:58] hashar: you should! [14:10:07] seems most devs think it is a service provided by some team and that they have no commitment to it [14:10:12] meanwhile [14:10:20] I got a job passing! https://integration.wikimedia.org/ci/job/mediawiki-phpunit-integration-hhvm/16/console [14:10:26] hashar: yup. ‘beta is broken, I hope the beta team fixes it' [14:11:17] we even had someone who asked to freeze auto deploy and make it 99,99% available so it can be used for end user testing .... [14:11:33] :) [14:11:43] hashar: what did you tell them? [14:15:40] NO [14:15:53] rephrased to be politically correct [14:16:38] !log wdq-mm importing new dump into binary file, process running on wdq-mm-02 [14:16:41] hashar: heh :) [14:16:42] Logged the message, Master [14:16:48] hashar: either way, a session on it sounds good [14:16:54] something like "that is a very nice idea, but given the current situation of beta lacking allocated staff resources and it being used as a continuous integration platform, there is little chance we can meet those criteria. Would it be wiser to setup a dedicated labs instance for your high priority experimentation? We could help on that front" [14:17:42] YuviPanda: yeah will look at the mw summit sessions and register a few [14:18:00] I just hate preparing such sessions [14:18:31] in French, I would just show up with a few paper notes and improve the talk [14:40:37] Coren: +1 this as well? https://gerrit.wikimedia.org/r/#/c/183209/ [14:50:23] YuviPanda: ... that's already merged. [14:50:40] Coren: just merged, thought you were away :) [14:50:45] tested on betalabs though, so should be ok [14:50:59] What Could Go Wrong?tm [14:51:06] What Could Go Wrong?™ [14:51:23] :D [14:52:08] YuviPanda: g-p-u dead again, this time because of git 1.7 vs 1.9 >_< [14:53:02] valhallasw`cloud: :( [14:53:21] valhallasw`cloud: I suppose re-cloning everything on 1.9 should fix the issue? [14:53:37] YuviPanda: everything is cloned on the fily [14:53:43] oh [14:53:46] valhallasw`cloud: shallow clones? [14:53:50] ya [14:54:00] hmm, unshallow them? :D [14:54:01] which I apaprently should not be able to push from in 1.7 [14:54:02] but still works [14:54:12] you want me to make a non-shallow mediawiki clone? how about no :P [14:54:59] ah "If your shallow repository's history does not extend long enough and the other repository forked before your truncated history, wyou cannot compute the common ancestor and you cannot push out." was the old rule [14:55:09] which was fine because it was a fresh clone [14:55:48] 1.9 has real support, but gerrit doesn't get what git 1.9 asks it to do [14:58:09] valhallasw`cloud: eugh, sigh. [14:58:18] valhallasw`cloud: one option is to give you a local 1.7git [14:58:33] I can compile that for you if you would like. is fairly trivial [14:58:40] and you can just use that in your tool [14:59:31] I’m doing that anyway [15:07:17] YuviPanda: meh. [15:07:25] YuviPanda: maybe I should use pygit or something ;-D [15:07:32] * valhallasw`cloud shudders [15:08:02] valhallasw`cloud: ~/git/bin/git :) [15:08:08] is 1.7 [15:13:14] 3Wikimedia-Labs-Infrastructure: new security rule not applied - https://phabricator.wikimedia.org/T42526#965752 (10hashar) Yup, I verified it a few weeks ago :( [15:27:09] YuviPanda: tx [15:27:11] thx* [15:41:45] PROBLEM - Puppet failure on tools-exec-catscan is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [16:01:49] RECOVERY - Puppet failure on tools-exec-catscan is OK: OK: Less than 1.00% above the threshold [0.0] [16:50:04] Coren: https://gerrit.wikimedia.org/r/#/c/183871/ [16:50:10] but I suppose we’ll have to manually kill that view [16:51:18] Yeah, the script has no provision for removing views entirely (since it simply no longer knows about it) [16:51:22] yeah [16:51:34] Heh. Puppet redux. :-) [16:52:38] Coren: :D I suppose we can just wait a bit and write a remover script in one go [16:52:45] auditor will point out the missing ones [16:52:53] Works for me. [16:54:21] Coren: I think I’ll drop povwatch and pif_edits too [17:23:58] !log wdq-mm re-seed complete [17:24:02] Logged the message, Master [17:24:07] * YuviPanda waves, goes to sleep [17:24:43] valhallasw`cloud: take a look at https://gerrit.wikimedia.org/r/#/c/182848/ if you can :) [17:24:51] YuviPanda: will do! [17:24:55] thanks! [17:46:08] [13nagf] 15Krinkle pushed 2 new commits to 06master: 02https://github.com/wikimedia/nagf/compare/6b821bc9f321...d4e58fdee62e [17:46:09] 13nagf/06master 147989ac6 15Timo Tijhof: NagfView: Catch runtime exceptions and provide error page [17:46:09] 13nagf/06master 14d4e58fd 15Timo Tijhof: WebCache: Detect unwritable cache directory... [17:47:32] wikimedia/nagf#21 (master - d4e58fd: Timo Tijhof) The build was broken. - http://travis-ci.org/wikimedia/nagf/builds/46472224 [17:49:30] [13nagf] 15Krinkle 04force-pushed 06master from 14d4e58fd to 14fd9ac62: 02https://github.com/wikimedia/nagf/commits/master [17:49:30] 13nagf/06master 14ae31a75 15Timo Tijhof: NagfView: Catch runtime exceptions and provide error page [17:49:31] 13nagf/06master 14fd9ac62 15Timo Tijhof: WebCache: Detect unwritable cache directory... [17:50:37] wikimedia/nagf#22 (master - fd9ac62: Timo Tijhof) The build was fixed. - http://travis-ci.org/wikimedia/nagf/builds/46472554 [17:53:56] (03PS3) 10Legoktm: Duplicate -qa notifcations to -releng [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183371 (https://phabricator.wikimedia.org/T86053) (owner: 10Hashar) [17:54:23] (03CR) 10Legoktm: [C: 032] Duplicate -qa notifcations to -releng [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183371 (https://phabricator.wikimedia.org/T86053) (owner: 10Hashar) [17:54:43] (03Merged) 10jenkins-bot: Duplicate -qa notifcations to -releng [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183371 (https://phabricator.wikimedia.org/T86053) (owner: 10Hashar) [17:57:07] * legoktm pokes wikibugs [17:57:25] !log tools.wikibugs Updated channels.yaml to: fcda5c7e60e46b0097552f0e1328c5a669dde363 Duplicate -qa notifcations to -releng [17:57:25] 3Release-Engineering, Wikibugs: Unify RelEng related IRC channels to #wikimedia-releng - https://phabricator.wikimedia.org/T86053#966187 (10Legoktm) [18:22:05] legoktm: there's more patches :> https://gerrit.wikimedia.org/r/#/projects/labs/tools/wikibugs2,dashboards/default [18:22:26] wwhat is this github magic! [18:23:22] github? [18:23:29] 18:49 nagf/master fd9ac62 Timo Tijhof: WebCache: Detect unwritable cache directory... [18:23:29] (03CR) 10Legoktm: [C: 032] + taxonomy script [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/181583 (owner: 10Merlijn van Deen) [18:23:50] (03Merged) 10jenkins-bot: + taxonomy script [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/181583 (owner: 10Merlijn van Deen) [18:23:57] apparently it's built-in at github these days [18:23:59] valhallasw`cloud: GitHub has built-in WebHooks for various services like Travis and IRC. [18:24:01] (03PS4) 10Legoktm: Add config-fetcher to fab [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/182234 (owner: 10Merlijn van Deen) [18:24:06] (03CR) 10Legoktm: [C: 032] Add config-fetcher to fab [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/182234 (owner: 10Merlijn van Deen) [18:24:17] (03Merged) 10jenkins-bot: Add config-fetcher to fab [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/182234 (owner: 10Merlijn van Deen) [18:24:22] (03CR) 10Legoktm: [C: 032] Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 (owner: 10Merlijn van Deen) [18:24:26] (03PS4) 10Legoktm: Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 (owner: 10Merlijn van Deen) [18:24:32] (03CR) 10Legoktm: Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 (owner: 10Merlijn van Deen) [18:24:39] (03CR) 10Legoktm: [C: 032] Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 (owner: 10Merlijn van Deen) [18:24:51] (03PS2) 10Legoktm: Make sure to reset to origin/master, and show current sha1 before doing so [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/181584 (owner: 10Merlijn van Deen) [18:24:53] (03Merged) 10jenkins-bot: Gerrit-Patch-Uploader to -labs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183804 (owner: 10Merlijn van Deen) [18:24:57] (03PS3) 10Legoktm: Make sure to reset to origin/master, and show current sha1 before doing so [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/181584 (owner: 10Merlijn van Deen) [18:25:11] valhallasw`cloud: http://i.imgur.com/317LavU.png [18:25:12] [13gerrit-patch-uploader] 15yuvipanda pushed 1 new commit to 06master: 02http://git.io/2D0d0Q [18:25:12] 13gerrit-patch-uploader/06master 149c7c528 15YuviPanda: Use tools-static for static files [18:25:13] (03CR) 10Legoktm: [C: 032] Make sure to reset to origin/master, and show current sha1 before doing so [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/181584 (owner: 10Merlijn van Deen) [18:25:21] yep, works [18:25:26] (03Merged) 10jenkins-bot: Make sure to reset to origin/master, and show current sha1 before doing so [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/181584 (owner: 10Merlijn van Deen) [18:25:53] Use SSL, no short url, join channel, colors :) [18:26:00] that's what I use anyway [18:26:17] [tools-login.wmflabs.org] out: error: The following untracked working tree files would be overwritten by merge: [18:26:17] [tools-login.wmflabs.org] out: taxonomy.py [18:26:18] [tools-login.wmflabs.org] out: Please move or remove them before you can merge. [18:26:18] [tools-login.wmflabs.org] out: Aborting [18:26:35] * legoktm fixes [18:26:39] legoktm: sorry :< [18:26:41] valhallasw`cloud: topic "(detached" - https://gerrit.wikimedia.org/r/#/c/181584/3 [18:27:21] Krinkle: yeah, noticed it before. git-review doesn't like detached branches [18:27:29] valhallasw`cloud: if you use https://github.com/legoktm/grr that won't happen!! [18:27:40] Krinkle: this is from a 'git co origin/master && git cherry-pick && git-review' workflow [18:28:02] !log tools.wikibugs Updated channels.yaml to: 4c4fc344a850a36ef47a7c9965c853a27863baac Make sure to reset to origin/master, and show current sha1 before doing so [18:28:56] valhallasw`cloud: git-review takes a custom topic as parameter if you like [18:29:08] Krinkle: yeah, I know, but I don't really care about topics tbh [18:29:13] :) [18:29:46] It basically... copies what's already in the commit message, but shorter? [18:30:12] topics are useful for filtering [18:30:21] LOL, from the IRC hook docs: "Notice: Enables sending IRC notices instead of regular messages. -- Recommended, as it decreases channel noise." [18:30:34] in every irc client ever channel notices result in highlights [18:30:42] like https://gerrit.wikimedia.org/r/#/q/status:open+topic:normal,n,z for example [18:31:09] legoktm: I still don't understand what 'normal' tells me in that case [18:31:49] all the patches I linked are related to core's utfnormal classes + functions [18:32:17] sure, but other people then use 'utfnormal' or 'normalize' or ... [18:32:36] it's includes/normal/ in core :p [18:32:56] it's just useful to use to link multiple patches at once [18:32:56] legoktm: I understand you can filter on them, I don't understand the workflow where one would use that filter [18:33:20] when I want to tell someone to review those specific patches without sending them 4 links [18:34:06] I see, yes, that works. [18:35:59] what is the taxonomy script for btw? [18:36:53] legoktm: updating https://www.mediawiki.org/wiki/Phabricator/Projects/Test = https://phabricator.wikimedia.org/T85096 [18:37:54] WTF [18:38:11] why does setting status to 'stalled' not change assigned to [19:03:01] Where did test/mediawiki/extensions/examples go :| [19:52:02] 3Tool-Labs, Wikimedia-Labs-Infrastructure: Make (redacted) log_search table available on ToolLabs - https://phabricator.wikimedia.org/T85756#966522 (10Umherirrender) Another solution is to skip the rows where the log_id is log_type = 'suppress' in the logging table. [20:57:18] 3Wikimedia-Labs-wikistats: completely remove or globally add the "views" column in stats tables - https://phabricator.wikimedia.org/T38293#966772 (10Dzahn) there have been recent changes that remove hit counters from mw core https://gerrit.wikimedia.org/r/183902 also confirmed by demon that they should be 0 o... [20:58:20] 3Wikimedia-Git-or-Gerrit, Gerrit-Patch-Uploader: Gerrit-patch-uploader fails under git 1.9 - https://phabricator.wikimedia.org/T86304#966776 (10valhallasw) This is an issue with JGit, and has been solved: https://github.com/eclipse/jgit/commit/199dd4a9a938e5c6ee7a06d0e0610e47b47ff050 @chad / @qchris, would it... [21:02:34] 3Gerrit-Patch-Uploader: .orig added in some cases - https://phabricator.wikimedia.org/T86349#966805 (10valhallasw) 3NEW [21:03:02] 3Gerrit-Patch-Uploader: Only add explanatory comment once per patchset - https://phabricator.wikimedia.org/T86350#966811 (10valhallasw) 3NEW [21:03:46] 3Gerrit-Patch-Uploader: Remember last used project - https://phabricator.wikimedia.org/T86352#966829 (10valhallasw) 3NEW [21:04:19] 3Gerrit-Patch-Uploader: Check author field using JS - https://phabricator.wikimedia.org/T86353#966837 (10valhallasw) 3NEW [21:05:37] 3Gerrit-Patch-Uploader: Serve static resources from //tools-static.wmflabs.org or /static/ project - https://phabricator.wikimedia.org/T86354#966847 (10valhallasw) 3NEW [21:05:58] 3Gerrit-Patch-Uploader: Edit existing patch - https://phabricator.wikimedia.org/T86355#966853 (10valhallasw) 3NEW [21:06:15] 3Gerrit-Patch-Uploader: Remove Bugzilla integration - https://phabricator.wikimedia.org/T86356#966860 (10valhallasw) 3NEW [21:07:47] 3Gerrit-Patch-Uploader: Accept "new file version" uploads - https://phabricator.wikimedia.org/T86358#966884 (10valhallasw) 3NEW [21:08:29] 3Gerrit-Patch-Uploader: git submodules are broken - https://phabricator.wikimedia.org/T86360#966900 (10valhallasw) 3NEW [21:09:25] 3Gerrit-Patch-Uploader: Write docs on developing/contributing/deploying - https://phabricator.wikimedia.org/T86361#966909 (10valhallasw) 3NEW [21:09:58] 3Gerrit-Patch-Uploader: Allow selection of branch - https://phabricator.wikimedia.org/T86362#966917 (10valhallasw) 3NEW [21:34:31] 3Wikimedia-Labs-wikistats: completely remove or globally add the "views" column in stats tables - https://phabricator.wikimedia.org/T38293#967010 (10Nemo_bis) This feature is very useful for most wikis, so it should be expected that most wikis will reinstate it. (If not, is there a bug?) [21:50:01] 3Multimedia, Wikibugs: Wikibugs not reporting tasks that are only in #multimedia in the multimedia IRC channel - https://phabricator.wikimedia.org/T77947#967061 (10valhallasw) 5Open>3Resolved [21:51:26] 3Wikibugs: Add 'team' (purple) to output on IRC - https://phabricator.wikimedia.org/T1209#967064 (10valhallasw) 5Open>3Resolved a:3valhallasw I think, in the current usage of 'team' projects, it's good to always list them, even if more specific projects are available. [21:57:17] PROBLEM - Free space - all mounts on tools-webproxy is CRITICAL: CRITICAL: tools.tools-webproxy.diskspace._var.byte_percentfree.value (<11.11%) [22:07:18] RECOVERY - Free space - all mounts on tools-webproxy is OK: OK: All targets OK [22:26:58] what mailserver should I use when configuring a script on labs to send email notifications? [22:33:14] (03PS1) 10Greg Grossmeier: Cleanup the projects announced in -releng [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183994 [22:46:39] (03CR) 10Merlijn van Deen: [C: 04-1] "Could you clarify why Phabricator.org and Gitblit-Deprecate should go? All other projects are archived and can safely be removed (except f" (032 comments) [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183994 (owner: 10Greg Grossmeier) [22:59:38] 3Gerrit-Patch-Uploader: Author with non-ascii name crashes uploader - https://phabricator.wikimedia.org/T86376#967402 (10valhallasw) 3NEW [23:23:21] 3Wikimedia-Labs-wikistats: completely remove or globally add the "views" column in stats tables - https://phabricator.wikimedia.org/T38293#967476 (10Dzahn) I don't know if there is a bug, we should ask ^demon. [23:36:55] (03CR) 10Greg Grossmeier: "Because they are not things owned, inherently, by the Release Engineering team at WMF and only create noise." [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183994 (owner: 10Greg Grossmeier) [23:40:35] (03CR) 10Greg Grossmeier: "(Additionally)" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/183994 (owner: 10Greg Grossmeier)