[00:05:45] 10Tool-Labs-tools-Other: Requesting installation of mpl_toolkits.basemap, icu for tool.spiarticleanalyzer - https://phabricator.wikimedia.org/T157744#3018663 (10JustBerry) Although Wikimedia Maps is not a direct replacement, I'll look into leafletjs for now. Regarding icu, is it installed on kubernetes and/or g... [00:06:17] hey bd808 o/ [00:24:42] RECOVERY - Puppet run on tools-bastion-02 is OK: OK: Less than 1.00% above the threshold [0.0] [00:27:10] Do I need to jsub a webservice --backend=gridengine call? [00:37:19] 06Labs, 10Striker, 10Tool-Labs, 10community-labs-monitoring: Preperation for api for CLM - https://phabricator.wikimedia.org/T157847#3018687 (10Matthewrbowker) [00:38:18] 06Labs, 10Tool-Labs, 10community-labs-monitoring: Implement a system to monitor tools on tool-labs - https://phabricator.wikimedia.org/T53434#572676 (10Matthewrbowker) >>! In T53434#3018651, @bd808 wrote: >>>! In T53434#2951500, @Matthewrbowker wrote: >> @bd808 if I provided some sort of CRUD API, could we u... [00:38:51] 06Labs, 10Tool-Labs, 10community-labs-monitoring: Implement a system to monitor tools on tool-labs - https://phabricator.wikimedia.org/T53434#3018706 (10bd808) [00:38:53] 06Labs, 10Striker, 10Tool-Labs, 10community-labs-monitoring: Preperation for api for community-labs-monitoring - https://phabricator.wikimedia.org/T157847#3018705 (10bd808) [00:38:55] 06Labs, 10Striker, 10Tool-Labs, 10community-labs-monitoring: Preperation for api for community-labs-monitoring - https://phabricator.wikimedia.org/T157847#3018707 (10Matthewrbowker) [00:45:18] 06Labs, 10Striker, 10Tool-Labs, 10community-labs-monitoring: Preperation for api for community-labs-monitoring - https://phabricator.wikimedia.org/T157847#3018687 (10bd808) > To secure, would a manually generated API key work? Or would something more secure be necessary? A shared secret and HTTPS are prob... [00:48:26] 06Labs, 10Striker, 10Tool-Labs, 10community-labs-monitoring: Preperation for api for community-labs-monitoring - https://phabricator.wikimedia.org/T157847#3018743 (10Matthewrbowker) >>! In T157847#3018722, @bd808 wrote: >> To secure, would a manually generated API key work? Or would something more secure b... [01:02:17] JustBerry: ping? [01:02:21] zhuyifei1999_: yes [01:02:38] zhuyifei1999_: from above: Do I need to jsub a webservice --backend=gridengine call? [01:03:19] no, think of webservice as a jsub call itself [01:06:42] zhuyifei1999_: that's what I thought [01:07:00] zhuyifei1999_: okay... also... any ideas if pyicu and icu are installed on the grid [01:07:07] I'll check the ticket [01:07:11] you linked some stuff I think [01:07:41] anyways, since I don't think my attempts to guide you through the virtualenv building and package installation process has been fruitful, I can try to fix this myself if you give my access to the tool; however, I do not guarantee that I will be successful, in which case you may just have to switch to either a pure-python module or javascript [01:07:47] no icu here (https://github.com/wikimedia/operations-puppet/blob/c0f7677797227a8dad1351bedcca2018eddd94aa/modules/toollabs/manifests/dev_environ.pp#L48) or here (https://github.com/wikimedia/operations-puppet/blob/c0f7677797227a8dad1351bedcca2018eddd94aa/modules/toollabs/manifests/exec_environ.pp#L24) @ zhuyifei1999_ [01:08:16] zhuyifei1999_: well that's why I wanted to use basemap... [01:08:26] but it can't be scaled on the grid [01:08:31] it'll be doing the same thing locally [01:12:34] zhuyifei1999_: yes no? [01:13:10] ? [01:14:37] JustBerry: so do you accept that or not? [01:16:33] zhuyifei1999_: a lot has gotten solved with our discussions... [01:16:53] I'm manipulating a few things, so I'm not sure that sshing simultaneously might be the best idea [01:17:04] zhuyifei1999_: if there's something in particular you have in mind, let me know? [01:17:16] I think what you're saying is install basemap locally in venv, correct? [01:17:28] correct [01:17:39] well, when I do webserivce --backend=grid and whatnot [01:17:41] gridengine [01:17:49] I mean, you seem really confused about different environments [01:17:52] it's going to display errors in uwsgi.log [01:18:03] zhuyifei1999_: well, labs isn't all that straightforward ;p [01:18:09] haven't been around for a while, so [01:18:11] did read the docs [01:21:46] actually, I thought of something more fun: I'll beat you to successfully building the venv with the two mentioned modules, elsewhere [01:22:06] JustBerry: ^ [01:24:27] zhuyifei1999_: oy [01:24:44] I made the venv [01:24:46] I'm in venv [01:24:51] and I followed the build instructions [01:24:58] which require makes in c [01:25:02] make installs and whatnot [01:25:07] I think those aren't being built correctly tbh [01:26:37] zhuyifei1999_: ^^ [01:26:59] exactly [01:28:52] building one under tools.video2commons-test in /data/project/video2commons-test/testvenv [01:30:13] zhuyifei1999_: oy [01:30:24] if you do... [01:30:25] then [01:43:05] JustBerry: basemap last release = 2013-08-20 [01:43:15] zhuyifei1999_: it worked? [01:43:17] what about that [01:43:19] 3+ years ago [01:43:27] not yet, downloading [01:43:51] zhuyifei1999_: see you in another few months then [01:43:55] that file takes a while ;p [01:57:01] JustBerry: compiling [02:05:32] zhuyifei1999_: git.ready.it.might.not.work. [02:25:29] zhuyifei1999_: bastion having issues? [02:25:37] sorry I'm having a phone call [02:29:41] 06Labs, 10Tool-Labs: elastic2001 disk space: Possibly related to immense lag on Tool Labs? - https://phabricator.wikimedia.org/T157855#3018911 (10JustBerry) [02:30:36] bd808: ^^ [02:32:21] 06Labs, 10Tool-Labs: elastic2001 disk space: Possibly related to immense lag on Tool Labs? - https://phabricator.wikimedia.org/T157855#3018924 (10JustBerry) [02:34:47] 06Labs: Create Phabricator tag for tasks that require extended permissions - https://phabricator.wikimedia.org/T157856#3018925 (10scfc) [02:35:22] 06Labs, 10Tool-Labs: Create Phabricator tag for tasks that require extended permissions - https://phabricator.wikimedia.org/T157856#3018938 (10scfc) [02:39:16] 06Labs, 10Tool-Labs: elastic2001 disk space: Possibly related to immense lag on Tool Labs? 11-02-2017 (~2:22-2:30) - https://phabricator.wikimedia.org/T157855#3018940 (10JustBerry) [03:09:05] https://www.irccloud.com/pastebin/EsWYqqoB/ [03:09:10] JustBerry: ^ [03:09:17] sorry long phone call [03:09:25] zhuyifei1999_: naw [03:09:38] wa.t [03:09:40] wat. [03:09:48] zhuyifei1999_: what happened to bastion tho [03:09:52] see ticket above i filed [03:10:04] I installed on k8s [03:10:07] not bastion [03:10:56] bastion-03? [03:11:50] 06Labs, 10Tool-Labs: elastic2001 disk space: Possibly related to immense lag on Tool Labs? 11-02-2017 (~2:22-2:30) - https://phabricator.wikimedia.org/T157855#3018964 (10JustBerry) FYI, extreme lag continues. After entering `cd ..` for example, waiting for about 15-20 seconds (even longer earlier). Commands l... [03:11:53] JustBerry: "zhuyifei1999_: what happened to bastion tho" <= bastion-0 [03:11:57] *3? [03:12:13] @tools-bastion-03 [03:12:26] * zhuyifei1999_ looks [03:12:32] 06Labs, 10Tool-Labs: elastic2001 disk space: Possibly related to immense lag on Tool Labs? 11-02-2017 (~2:22-2:30) - https://phabricator.wikimedia.org/T157855#3018965 (10JustBerry) To note, I'm on @tools-bastion-03 `tools.spiarticleanalyzer@tools-bastion-03:~$` [03:14:17] 06Labs, 10Tool-Labs: elastic2001 disk space: Possibly related to immense lag on Tool Labs? 11-02-2017 (~2:22-2:30) - https://phabricator.wikimedia.org/T157855#3018978 (10JustBerry) p:05Triage>03High Worth looking into. Won't triage any higher until critical errors or widespread effect of this issue is demo... [03:15:06] zhuyifei1999_: could you build locally for grid? [03:15:17] similar to how you did for k8s [03:15:20] * zhuyifei1999_ like k8s [03:15:28] once you build and activate grid? [03:15:33] zhuyifei1999_: it won't scale for k8s [03:15:33] basemap [03:15:46] k8s = lightweight, no? [03:15:50] what do you mean by it won't scale? [03:15:53] no [03:16:06] containers are lightweight [03:16:14] *k8s containers [03:23:27] 06Labs, 10Tool-Labs: Massive NFS IO on tools-bastion-03 (tools-login) - https://phabricator.wikimedia.org/T157855#3018981 (10zhuyifei1999) [03:24:12] zhuyifei1999_: ?? [03:25:05] ? [03:25:31] zhuyifei1999_: where's the I/O info [03:25:50] you know what D state means? [03:25:54] zhuyifei1999_: and I know they're lightweight, that's why heavier weight packages like basemap aren't quite suitable probs [03:26:16] and the grey color in CPU usage [03:26:48] no, containers are lightweight, you're mixing things up [03:27:07] just think of containers as VMs [03:27:30] if every single VM is heavy weight, it's not gonna work for the host machine [03:27:37] .. [03:27:42] I meant basemap being heavy weight [03:27:46] not k8s [03:27:49] containers [03:27:55] it's fine [03:28:01] zhuyifei1999_: and d state if when a process is waiting reading/writing [03:28:09] basemap lives on NFS [03:28:10] can't be interfered with and such [03:28:24] container data doesn't [03:28:56] yep, 6 d state = something is really wrong [03:31:16] Less Ds now zhuyifei1999_ [03:31:22] 06Labs, 10Tool-Labs: Massive NFS IO on tools-bastion-03 (tools-login) - https://phabricator.wikimedia.org/T157855#3018984 (10zhuyifei1999) a:03scfc ``` root 27936 0.0 0.0 120924 4692 ? SNs Feb10 0:00 \_ sshd: scfc [priv] scfc 27986 0.0 0.0 121056 2184 ? SN Feb10 0:02 |... [03:33:06] JustBerry: how long has it been like this? [03:33:54] 06Labs, 10Tool-Labs: Massive NFS IO on tools-bastion-03 (tools-login) - https://phabricator.wikimedia.org/T157855#3018986 (10JustBerry) Adding back in snippet of #wikimedia-operations IRC chat logs from earlier (may be related): **11-02-2017** ``` 2:22 icinga-wm: PROBLEM - Disk space on elastic2001 is CRITIC... [03:34:00] zhuyifei1999_: let's say about 1 hour [03:34:51] 06Labs, 10Tool-Labs: Massive NFS IO on tools-bastion-03 (tools-login) - https://phabricator.wikimedia.org/T157855#3018987 (10zhuyifei1999) FWIW: ``` 03:25:47 0 ✓ zhuyifei1999@tools-bastion-03: /$ time stat /data/project File: ‘/data/project’ -> ‘/mnt/nfs/labstore-secondary-tools-project’ Size: 41... [03:35:13] JustBerry: 99% sure unrelated [03:35:29] zhuyifei1999_: the logs? [03:35:38] yeah [03:35:38] the elastic? [03:35:39] ok [03:36:57] zhuyifei1999_: list of people that have access to labs? [03:37:02] labs admins or such [03:37:39] ? [03:38:06] zhuyifei1999_: which group of people can resolve that issue [03:38:08] generally speaking [03:38:57] zhuyifei1999_: https://wikimediafoundation.org/wiki/Staff_and_contractors#Release_Engineering? [03:38:57] scfc is a tool labs admin [03:39:01] no [03:39:14] the admin list is https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools [03:45:25] zhuyifei1999_: familiar with url encoding? [03:45:34] kind of, why? [03:45:44] https://paste.pound-python.org/show/5QIW9dltKts6JerLmbJU/ [03:45:49] https://paste.pound-python.org/show/b428ggGPCJEb45XNUOfy/ [03:45:50] both rip [03:49:45] zhuyifei1999_: ^^ [03:49:52] also, mind if I triage that ticket higher? [03:49:59] I guess high is fine [03:50:02] but definitely concerning... [03:50:09] ls takes about 20 seconds [03:50:10] heh [03:51:26] zhuyifei1999_: 89.9MB/s [03:51:27] wat [03:51:59] JustBerry: https://docs.python.org/2/library/urllib.html#urllib.urlencode [03:52:45] zhuyifei1999_: yeah, but what WOULD the second tuple be though [03:52:50] combining the two "parts"? [03:52:56] separated by the special character? [03:53:17] key value [03:53:31] that's two elements [03:54:19] btw, why don't you google? [03:54:21] 06Labs, 10Tool-Labs: Massive NFS IO on tools-bastion-03 (tools-login) - https://phabricator.wikimedia.org/T157855#3018990 (10JustBerry) Related? ``` 22:45 icinga-wm: PROBLEM - Host cp1052 is DOWN: PING CRITICAL - Packet loss = 100% 22:51 icinga-wm: PROBLEM - IPsec on cp2023 is CRITICAL: Strongswan CRITICAL -... [03:54:38] zhuyifei1999_: I did... hence the two attempts and errors [03:54:51] "Related?" <= again, no [03:55:17] most of the time whatever you see from -operations is unrelated [03:56:37] JustBerry: have you seen https://stackoverflow.com/questions/5607551/how-to-urlencode-a-querystring-in-python ? [03:57:14] now you should know what key and values are [03:57:21] zhuyifei1999_: yeah I already saw that [03:57:25] I know WHAT they are [03:57:27] isn't useful here [03:57:33] dealing with path --> url [03:57:38] trying path2url one now [03:57:47] what are you trying to do? [04:46:09] zhuyifei1999_: familiar with pywikibot? [04:46:15] trying to get revisions of a page with it [04:46:16] or diffs [04:46:27] https://www.mediawiki.org/wiki/Manual:Pywikibot/Scripts ;c [04:46:55] yes, but you seem to be poking random modules all the time... [04:47:54] that page is definitely not where you want to look [04:48:17] they are kind of like example scripts [04:49:02] if you want to integrate with pywikibot, you need its api [04:49:56] (and true, pywikibot's docs are sub-optimal on mw.org) [04:50:48] JustBerry: https://doc.wikimedia.org/pywikibot/ [04:51:10] zhuyifei1999_: not really random... someone had recommended it a while ago [04:51:14] instead of mediawiki api [04:51:18] that isn't cleaned up [04:51:23] or I'll be parsing html lol [04:53:39] why would you want to parse html? [04:54:21] zhuyifei1999_: that's how the enwiki api returns diffs and such [04:54:23] html mess [04:54:34] tasks have been filed to fix but rip [04:55:07] I think I told you. you can create your own diff engine [04:55:53] https://gist.github.com/zhuyifei1999/49af65a7f07fa950a381171ea037135e#file-signbot-py-L96 [04:56:01] line 96 [05:43:11] 06Labs, 10Tool-Labs: Massive NFS IO on tools-bastion-03 (tools-login) - https://phabricator.wikimedia.org/T157855#3019009 (10zhuyifei1999) 05Open>03Resolved a:05scfc>03None Idk what @scfc was doing, but the script terminated and it seems resolved now. The IRC logs are unrelated. [06:54:13] PROBLEM - Puppet run on tools-exec-1420 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [07:29:16] RECOVERY - Puppet run on tools-exec-1420 is OK: OK: Less than 1.00% above the threshold [0.0] [08:45:51] 06Labs, 10Tool-Labs: Massive NFS IO on tools-bastion-03 (tools-login) - https://phabricator.wikimedia.org/T157855#3019053 (10scfc) Sorry for any inconvenience. [09:13:22] (03PS1) 10Ricordisamoa: Merge stable nuclides query into general nuclides query [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/337219 [09:55:27] Change on 12www.mediawiki.org a page Wikimedia Labs/Tool Labs/List of Toolserver Tools was modified, changed by Shirayuki link https://www.mediawiki.org/w/index.php?diff=2393275 edit summary: typo [11:56:14] (03CR) 10Tim Landscheidt: "(AFAICS) alternatives (https://www.debian.org/doc/debian-policy/ap-pkg-alternatives.html) require that all packages collaborate and do not" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/336998 (https://phabricator.wikimedia.org/T156174) (owner: 10Zhuyifei1999) [11:57:43] (03CR) 10Tim Landscheidt: "@zhuyifei1999: Sorry, I misread topic vs. branch and didn't notice that you *are* developing on branch crontab. In that case, I meant to " [labs/toollabs] - 10https://gerrit.wikimedia.org/r/336998 (https://phabricator.wikimedia.org/T156174) (owner: 10Zhuyifei1999) [12:03:27] (03CR) 10Zhuyifei1999: "$ git checkout master && git pull --rebase && git rebase master crontab" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/336998 (https://phabricator.wikimedia.org/T156174) (owner: 10Zhuyifei1999) [12:05:52] (03CR) 10Zhuyifei1999: "Btw, regarding oge-crontab, this script was used to be called xcrontab, fwiw" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/336998 (https://phabricator.wikimedia.org/T156174) (owner: 10Zhuyifei1999) [13:03:34] 10Tool-Labs-tools-Other: Requesting installation of mpl_toolkits.basemap, icu for tool.spiarticleanalyzer - https://phabricator.wikimedia.org/T157744#3019219 (10scfc) @JustBerry: Sorry, I thought that when I asked you to test on `tools-bastion-03` you understood that I meant write a small Python script that does... [14:51:41] (03CR) 10ArthurPSmith: "looks good to me!" [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/316049 (owner: 10Ricordisamoa) [14:53:07] zhuyifei1999_: lol [14:53:39] ? [14:55:40] (03CR) 10ArthurPSmith: [C: 031] "Thanks! I remember wondering how to do that when I was first looking into this - the BIND(EXISTS...) syntax is a good solution." [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/337219 (owner: 10Ricordisamoa) [15:06:05] 10Tool-Labs-tools-Other: Requesting installation of mpl_toolkits.basemap, icu for tool.spiarticleanalyzer - https://phabricator.wikimedia.org/T157744#3019359 (10JustBerry) @scfc Ah, okay. Let me clarify a few things. - You cloned the repository after https://github.com/JustBerry/SPIArticleAnalyzer/commit/6934... [15:09:35] 10Tool-Labs-tools-Other, 07Tracking: Issues related to tool.spiarticleanalyzer - https://phabricator.wikimedia.org/T157767#3019362 (10JustBerry) [15:09:40] 10Tool-Labs-tools-Other: webservice for tool.spiarticleanalyzer: 404 Error - https://phabricator.wikimedia.org/T157766#3019360 (10JustBerry) 05stalled>03Resolved a:03JustBerry [15:19:54] (03CR) 10Ricordisamoa: [C: 032] Merge stable nuclides query into general nuclides query [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/337219 (owner: 10Ricordisamoa) [15:20:16] (03Merged) 10jenkins-bot: Merge stable nuclides query into general nuclides query [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/337219 (owner: 10Ricordisamoa) [15:44:11] PROBLEM - ToolLabs Home Page on toollabs is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:49:02] RECOVERY - ToolLabs Home Page on toollabs is OK: HTTP OK: HTTP/1.1 200 OK - 3670 bytes in 0.065 second response time [16:24:33] valhallasw`cloud: Did you see my note in here about tsreports on precise? [16:26:34] No, but I vaguely remember that I have to fix it [16:26:55] I literally haven't touched tsreports in over two years, so I'm a bit scared to poke it :P [16:27:43] Heh, all right. [16:27:54] I've been getting the e-mails as well. I thought maybe it was time to let it die. [16:28:55] If it doesn't magically work on trusty that's exactly what's going to happen =p [16:46:33] (03CR) 10Lokal Profil: [C: 031] "Minor question but looks good" (031 comment) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335364 (owner: 10Jean-Frédéric) [16:57:05] (03PS2) 10Jean-Frédéric: Harvest whether an image is geolocated in the image table [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335364 [17:14:04] (03CR) 10Lokal Profil: [C: 032] Add unit test for populate_image_table.getSources [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335935 (owner: 10Jean-Frédéric) [17:15:28] (03Merged) 10jenkins-bot: Add unit test for populate_image_table.getSources [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335935 (owner: 10Jean-Frédéric) [17:15:30] (03CR) 10Lokal Profil: [C: 032] Harvest whether an image is geolocated in the image table [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335364 (owner: 10Jean-Frédéric) [17:16:45] (03Merged) 10jenkins-bot: Harvest whether an image is geolocated in the image table [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335364 (owner: 10Jean-Frédéric) [17:17:00] (03CR) 10jenkins-bot: Add unit test for populate_image_table.getSources [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335935 (owner: 10Jean-Frédéric) [17:17:59] (03CR) 10jenkins-bot: Harvest whether an image is geolocated in the image table [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/335364 (owner: 10Jean-Frédéric) [17:26:38] Yvette: tsreport is fixed [17:26:44] [13tsreports] 15valhallasw pushed 4 new commits to 06master: 02https://git.io/vDwk7 [17:26:44] 13tsreports/06master 145d742a2 15Merlijn van Deen: +lighttpd config file [17:26:45] 13tsreports/06master 14874ac25 15Merlijn van Deen: Merge branch 'master' of https://github.com/valhallasw/tsreports [17:26:45] 13tsreports/06master 143db23b5 15Merlijn van Deen: Fixes, works on Trusty now. [17:26:46] insofar things were not already broken, at least [17:38:49] halfak: yes, that is a pattern I'm worried about -- it's a pattern I regularly encounter (although not in wmf space) and it annoys me like hell. email, click link, archive, next email, click, archive, then if I try to read what was linked, I can't read what 'A' was and have to dig through my email archive to find it again [17:39:41] valhallasw`cloud, OK. This can be done. Will look into it. [17:39:48] This PR is turning into a monster. :/ [17:46:27] bd808: thanks :) [18:07:51] 06Labs: Request creation of labs project - https://phabricator.wikimedia.org/T157879#3019463 (10Petrb) [18:08:00] 06Labs: Request creation of wm-bot labs project - https://phabricator.wikimedia.org/T157879#3019477 (10Petrb) [18:08:21] 06Labs, 10WM-Bot: Move wm-bot instance to Trusty - https://phabricator.wikimedia.org/T157838#3019479 (10Petrb) T157879 [18:08:42] 06Labs: Request creation of wm-bot labs project - https://phabricator.wikimedia.org/T157879#3019463 (10Petrb) [18:08:44] 06Labs, 10WM-Bot: Move wm-bot instance to Trusty - https://phabricator.wikimedia.org/T157838#3019481 (10Petrb) [18:09:10] 06Labs: Request creation of wm-bot labs project - https://phabricator.wikimedia.org/T157879#3019463 (10Petrb) [18:09:12] 06Labs, 10WM-Bot: Move wm-bot instance to Trusty - https://phabricator.wikimedia.org/T157838#3018288 (10Petrb) [18:09:19] !log ores staged ores-wmflabs-deploy:f58d3fd [18:09:19] 06Labs: Request creation of wm-bot labs project - https://phabricator.wikimedia.org/T157879#3019463 (10Petrb) [18:09:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [18:09:22] 06Labs, 10WM-Bot: Move wm-bot instance to Trusty - https://phabricator.wikimedia.org/T157838#3018288 (10Petrb) [18:12:41] !log ores deployed ores-wmflabs-deploy:f58d3fd [18:12:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [18:20:19] victory! [18:44:42] halfak: I'll try to review this PR, with or without that change. At some point it's better to merge changes rather than trying to perfect them :-) [18:45:04] valhallasw`cloud, I'll have a change in a little bit that should address your concerns. [18:45:12] Testing it now [18:48:11] OK confirmed that two separate "next"s now work and don't race [18:52:11] https://github.com/valhallasw/flask-mwoauth/pull/18#issuecomment-279167296 [18:54:28] halfak: cool! [20:29:05] [13flask-mwoauth] 15valhallasw closed pull request #18: Switches library to use mwoauth and requests-oauthlib (06master...06master) 02https://git.io/vDcCM [20:35:29] halfak: and it's on pypi! :-) [20:35:36] [13flask-mwoauth] 15valhallasw pushed 3 new commits to 06master: 02https://git.io/vDwGi [20:35:36] 13flask-mwoauth/06master 147b04a6c 15Merlijn van Deen: fix release script [20:35:37] 13flask-mwoauth/06master 14801238c 15Merlijn van Deen: Bump to 0.3.x [20:35:37] 13flask-mwoauth/06master 148be3ddc 15Merlijn van Deen: Bump version to 0.3.61 [20:35:56] valhallasw`cloud, \o/ [20:36:05] also, THANK YOU [20:36:12] Happy to contribute :) [21:16:18] 10Tool-Labs-tools-Erwin's-tools: Migrate https://toolserver.org/~erwin85/xwiki.php to Tool Labs - https://phabricator.wikimedia.org/T62878#3019564 (10Akoopal) I made the link blue again in public_html/inc/footer.inc.php [22:58:41] halfak: which web server does labs use