[01:50:05] !log tools.precise-tools All better now and prettier too [01:50:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [02:21:28] (03CR) 10Tim Landscheidt: [V: 031 C: 032] jsub: Change IOError string substitution conversion from '%e' to '%s' [labs/toollabs] - 10https://gerrit.wikimedia.org/r/333232 (https://phabricator.wikimedia.org/T155787) (owner: 10Zhuyifei1999) [02:22:08] (03Merged) 10jenkins-bot: jsub: Change IOError string substitution conversion from '%e' to '%s' [labs/toollabs] - 10https://gerrit.wikimedia.org/r/333232 (https://phabricator.wikimedia.org/T155787) (owner: 10Zhuyifei1999) [02:24:53] 06Labs, 10Tool-Labs: Mail from cron regarding a failure of jsub - https://phabricator.wikimedia.org/T155787#2988674 (10scfc) [02:26:35] 06Labs, 10Tool-Labs, 13Patch-For-Review: Please install mktorrent on tool labs - https://phabricator.wikimedia.org/T155470#2988677 (10scfc) a:03Legoktm [03:05:09] PROBLEM - Free space - all mounts on tools-exec-1221 is CRITICAL: CRITICAL: tools.tools-exec-1221.diskspace._public_dumps.byte_percentfree (No valid datapoints found)tools.tools-exec-1221.diskspace.root.byte_percentfree (<22.22%) [03:41:51] PROBLEM - Free space - all mounts on tools-exec-gift is CRITICAL: CRITICAL: tools.tools-exec-gift.diskspace._public_dumps.byte_percentfree (No valid datapoints found)tools.tools-exec-gift.diskspace.root.byte_percentfree (<20.00%) [04:04:55] !log tools.precise-tools Deploying 7d5f610. Might need to change redis key for a cache refresh as well. [04:04:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [04:20:55] !log tools.precise-tools Deploying b753c7f [04:20:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [04:26:24] !log tools.precise-tools I broke it. Deploying fix a757fd9 [04:26:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [04:39:34] 06Labs, 10Tool-Labs, 10Tool-Labs-tools-Other: osm4wiki fills error.log with warnings about uninitialized variables - https://phabricator.wikimedia.org/T151568#2988825 (10scfc) 05Open>03Resolved a:03scfc "Tomorrow", "two months after" – what's the difference? :-) I left a note at https://de.wikipedia.o... [05:15:01] !log tools.precise-tools Deploying revert 6adacba [05:15:05] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [05:20:44] 06Labs, 10Tool-Labs: Develop on separate branches for each target of Debian packages - https://phabricator.wikimedia.org/T156886#2988894 (10scfc) [05:22:13] 06Labs, 10Tool-Labs: Develop on separate branches for each target of Debian packages - https://phabricator.wikimedia.org/T156886#2988908 (10scfc) [05:25:01] zhuyifei1999_: I see what you were going for there. I think we can make it work but it will take a bit of tweaking how the master list is compiled. It will make legoktm happy too to see legobot drop off the list. :) [05:29:00] one other thing we should probably add is a 'last updated' timestamp showing the cached data's time [05:47:38] oh yeah right [05:47:45] k [05:49:31] bd808: how about a master cache? 'last updated' timestamp doesn't really make if there are multiple timestamps from multiple caches :P [05:50:43] I think to make it work with deletes we need to merge the two data sources together and just cache the final dict [05:53:30] The way I'm thinking that would work is to change the accounting collection to return the dict it builds up and then add+delete from it using the live data before caching the whole dict [05:53:59] hmm sure [05:55:10] but what we've got now is a lot better than the nothing we had a couple of days ago :) [05:56:13] yep [05:56:19] thx :) [06:40:09] RECOVERY - Free space - all mounts on tools-exec-1221 is OK: OK: tools.tools-exec-1221.diskspace._public_dumps.byte_percentfree (No valid datapoints found) [07:16:22] 06Labs, 10DBA: Add and sanitize s2, s4, s5, s6 and s7 to sanitarium2 and new labsdb hosts - https://phabricator.wikimedia.org/T153743#2989039 (10Marostegui) I would like to start importing s4 soon, so for that we need a host to be its master. I originally thought about db1063 and db1067, but maybe that is not... [07:27:09] 10Tool-Labs-tools-Other: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2989044 (10Legoktm) [07:47:13] 10Tool-Labs-tools-Other: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2989044 (10zhuyifei1999) 20 mins later: ``` 15:30 ⇐ stashbot quit (~stashbot@wikimedia/bot/stashbot) Remote host closed the connection 15:30 stashbot________ → stashbot ``` [08:00:17] 10Tool-Labs-tools-Other: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2989081 (10zhuyifei1999) [[https://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-operations/20170201.txt|`#wikimedia-operations`]]: ``` [07:13:30] !log restart thumbor process on thumbo... [09:53:15] 06Labs, 10Tool-Labs, 06Tool-Labs-standards-committee: Create a wall for tools migration to trusty - https://phabricator.wikimedia.org/T156386#2973168 (10Legoktm) It would be nice if the wall could include all the maintainers names too so I could just ctrl+f instead of trying to remember all the tools I'm res... [10:00:20] 10Tool-Labs-tools-LTA-Knowledgebase: Finish editing method - https://phabricator.wikimedia.org/T155338#2989306 (10Samtar) [10:47:53] PROBLEM - Puppet run on tools-exec-gift is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [10:51:33] !log tools.precise-tools Deploying 1f3e78d [10:51:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [10:56:54] RECOVERY - Free space - all mounts on tools-exec-gift is OK: OK: tools.tools-exec-gift.diskspace._public_dumps.byte_percentfree (No valid datapoints found) [11:27:54] RECOVERY - Puppet run on tools-exec-gift is OK: OK: Less than 1.00% above the threshold [0.0] [11:28:12] !log precise-tools Deploying 10b6331 & 793d894 [11:28:12] Unknown project "precise-tools" [11:28:13] Did you mean to say "tools.precise-tools" instead? [11:28:20] !log tools.precise-tools Deploying 10b6331 & 793d894 [11:28:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [11:39:22] !log tools.precise-tools Deploying f225a2b -- another optimization attempt [11:39:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [11:44:11] 10Tool-Labs-tools-Other: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2989464 (10akosiaris) Nope, not really, I did notice the quit and proper renaming and let it be. [12:36:08] PROBLEM - Free space - all mounts on tools-exec-1221 is CRITICAL: CRITICAL: tools.tools-exec-1221.diskspace._public_dumps.byte_percentfree (No valid datapoints found)tools.tools-exec-1221.diskspace.root.byte_percentfree (<55.56%) [13:26:38] 06Tool-Labs-standards-committee: Create mailing list for Tool-Labs-standards-committee - https://phabricator.wikimedia.org/T156218#2989617 (10zhuyifei1999) It's been a week. I personally don't object to what's proposed above. Anyone object or want some changes? Or shall we move this forward? [14:10:19] 06Labs: Request creation of labs project - https://phabricator.wikimedia.org/T156915#2989689 (10Xaxa) [14:14:17] 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#2989710 (10MarcoAurelio) [14:14:20] 06Labs, 14Trash: Request creation of labs project - https://phabricator.wikimedia.org/T156915#2989706 (10MarcoAurelio) 05Open>03Invalid p:05Triage>03Lowest a:05Xaxa>03None [14:22:17] 06Labs, 14Trash: Request creation of labs project - https://phabricator.wikimedia.org/T156915#2989689 (10MarcoAurelio) @Xaxa Please test on https://phab-01.wmflabs.org. This platform is designed to track bugs for MediaWiki, its extensions and other software using MediaWiki. Abusing this project wi... [14:37:17] 06Labs, 05Security: webiron batched abuse reports 1/23/2017 - https://phabricator.wikimedia.org/T156074#2989810 (10chasemp) [14:38:47] 06Labs, 05Security: webiron batched abuse reports 1/23/2017 - https://phabricator.wikimedia.org/T156074#2963364 (10chasemp) 05Open>03Invalid >>! In T156074#2989654, @Beetstra wrote: >>>! In T156074#2965196, @chasemp wrote: >> @Beetstra thank you for your proactive response. FWIW I don't see and I don't c... [14:46:08] 06Labs, 05Security: webiron batched abuse reports 1/23/2017 for coibot and linkwatcher - https://phabricator.wikimedia.org/T156074#2989851 (10chasemp) [14:46:14] 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#2989853 (10MarcoAurelio) [14:58:49] 06Labs: (Re-)Create Gitblit->Phabricator testing instance on Labs - https://phabricator.wikimedia.org/T142186#2989878 (10Aklapper) Any news? Is this still wanted? [15:35:48] 06Labs, 10Labs-Infrastructure: Creating new instance failed - https://phabricator.wikimedia.org/T136656#2989976 (10Dzahn) [15:35:51] 06Labs: (Re-)Create Gitblit->Phabricator testing instance on Labs - https://phabricator.wikimedia.org/T142186#2989975 (10Dzahn) 05stalled>03Open [16:50:39] 06Tool-Labs-standards-committee: Create mailing list for Tool-Labs-standards-committee - https://phabricator.wikimedia.org/T156218#2990177 (10Matanya) move ahead [16:57:11] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Investigation: Plan for rewriting XTools - https://phabricator.wikimedia.org/T154551#2915501 (10MusikAnimal) a:03MusikAnimal [16:58:33] 10Tool-Labs-tools-Other, 15User-bd808: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2990188 (10bd808) a:03bd808 Ugh. I thought I had fixed the infinite `_` bug. It happens when auth to freenode isn't working and sometimes is related to k8s deciding to run two p... [17:09:01] 10Tool-Labs-tools-Other, 15User-bd808: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2990280 (10bd808) I opened {T156929} to figure out a phab project for @Stashbot [17:12:50] 10Tool-Labs-tools-Other, 15User-bd808: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2990305 (10akosiaris) >>! In T156895#2990188, @bd808 wrote: > Ugh. I thought I had fixed the infinite `_` bug. It happens when auth to freenode isn't working and sometimes is rela... [17:22:28] 10PAWS: Functionality to share & view PAWS internal notebooks - https://phabricator.wikimedia.org/T156934#2990369 (10Zareenf) [17:27:58] 10Tool-Labs-tools-Other, 06Wikispeech-WMSE, 15User-LokalProfil, 10Wikispeech (Sprint 2017-01-25): New toollabs project not found in SAL - https://phabricator.wikimedia.org/T156127#2990396 (10Lokal_Profil) >>! In T156127#2987662, @scfc wrote: > In which channel did you try `!log wikispeech`? `#wikimedia-la... [17:29:39] 10Tool-Labs-tools-Other, 15User-bd808: stashbot_______ is now known as stashbot________ - https://phabricator.wikimedia.org/T156895#2990435 (10bd808) Things to fix in stashbot's python code: * Check to see if the current nick is `stashbot_` and do not add another `_`. If both `stashbot` and `stashbot_` are tak... [17:31:56] !log tools.precise-tools Deploying 8241a04 and clearing cache [17:31:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [17:32:20] zhuyifei1999_: I do heart your diligent use of the log mechanism [17:32:50] lol getting used to it [17:34:33] https://tools.wmflabs.org/sal/tools.precise-tools -- I guess I should figure out how to link to differential instead of gerrit [17:35:42] holy cow I didn' tknow that tool existed bd808 [17:35:45] wut [17:35:46] nice [17:36:04] chasemp: dude! its the only way to check SAL [17:36:17] full elasticsearch searches :) [17:36:21] every week I learn about some new tool and I practically live here [17:36:31] !log tools.precise-tools Pulling to e5f09b2 and pip installing yaml -- I didn't know it's not a default package... [17:36:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [17:36:38] yeah there are a ton of cool ones [17:37:10] My Q4 resolution is to start doing a 'featured tool' thing somewhere at least once a week [17:37:21] I've been trying to accomplish that for a year [17:37:38] it's sorely needed [17:38:19] the super ideal thing would be to do it by making sure the tool has a Tool:* page on wikitech [17:38:28] that may be a bridge too far though [17:39:39] hmmm... maybe I can just build the guts for that into Striker... [17:39:49] 10Tool-Labs-tools-Other, 06Wikispeech-WMSE, 15User-LokalProfil, 10Wikispeech (Sprint 2017-01-25): New toollabs project not found in SAL - https://phabricator.wikimedia.org/T156127#2990443 (10chasemp) @Lokal_Profil shouldn't be. Most likely culprit is the bot responsible for listening was down at the time. [17:45:17] uh, k8s doesn't have /etc/ldap.yaml? [17:45:39] probably not :/ [17:45:54] the pods wouldn't need it normally [17:46:30] uh then I'll just copy it to home dir... [17:46:54] You should be able to do all the queries you need as an anon ldap user [17:47:07] so you really just need the hostnames [17:47:57] hmm okay [17:48:14] so just ldap3.Connection without user= & pssword=? [17:49:53] yeah, I think that works fine for read-only stuff [17:50:06] let me find the code in stashbot that does it [17:50:26] zhuyifei1999_: https://github.com/wikimedia/labs-tools-stashbot/blob/master/stashbot/ldap.py [17:51:36] * zhuyifei1999_ simply stole the code from P4805 [17:55:41] bd808: just wondering, what's the difference between https://github.com/wikimedia/labs-tools-stashbot/blob/master/stashbot/ldap.py#L47 and setting retriable=True the the function args, as a default arg? [17:56:14] !log tools.precise-tools Deploying 8deef39 [17:56:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [17:57:08] zhuyifei1999_: hmmm... probably nothing actually. That code I wrote looks a lot like how one would handle the splat args in PHP or C. ;) [17:57:48] oh ok [17:59:07] my python tends to get more pythonic based on the number of hours I've written in python that week. If I'm switching languages quickly it all reverts to some hybrid of C and the target language. :) [17:59:43] I have to like reset my brain to write idiomatic php [18:01:44] lol [18:08:57] !log tools.precise-tools Deploying 8b99b16 [18:08:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [18:11:21] phew.. finally up again https://tools.wmflabs.org/precise-tools/ [18:14:48] bd808: I'm bad ad doing designs. do you have any idea where I should put the list of maintainers? [18:14:57] for each tool [18:15:01] *at [18:16:22] zhuyifei1999_: I think I would start by sticking them in the 'tool' column and see how that works [18:16:42] we can do some css magic to style a list there and make it pretty [18:18:09] so on the html side just put the maintainers as a
    in that [18:18:23] don't worry about pretty at first, just make it work [18:18:50] if you are on that tool's list, is that a bad thing? … [18:19:22] annika: it means that something will break for you on 2017-03-06 if you don't make a change [18:19:28] um could you do this? I'm probably gonna screw up [18:19:35] (my tools certainly can and do run on both images, but i haven't checked the latter) [18:19:35] https://wikitech.wikimedia.org/wiki/Tools_Precise_deprecation [18:19:53] does sge only use precise if not specified otherwise? [18:20:10] zhuyifei1999_: can you get the list into the data structure that is passed to the template layer? [18:20:14] annika: trusty is the default now [18:20:22] bd808: yes [18:20:33] zhuyifei1999_: cool. I can take it from there :) [18:20:38] ok then this sounds more alarming than i thought [18:20:46] thx [18:20:53] it's in the 'members' of the tool dict value [18:21:32] annika: if most of the things you are seeing there are webservices, doing `webservice stop; webservice start` will switch you from precise to trusty [18:21:39] https://phabricator.wikimedia.org/source/tool-precise-tools/browse/master/app.py;8aca9035339627d7589b3785198a7790819b4eb7$36 [18:22:06] zhuyifei1999_: in a meeting. I can look in about 40 minutes [18:22:41] annika: if you have a lot of time to play with webservices, try migrating to k8s [18:22:55] i already did :) [18:22:56] much faster in filesystem accessing [18:23:03] bd808: k [18:23:11] annika: nice :) [18:24:15] hey madhuvishy. i have a follow up question about sharing paws internal notebooks. is it possible to copy the ipynb files on the server or make them read accessible to other users? [18:25:20] zareen: no, you wouldn't have the permissions to [18:26:34] madhuvishy: fyi https://tools.wmflabs.org/precise-tools/ we are improving on the algorithms :) [18:32:33] !log tools.precise-tools Deploying faa6427 [18:32:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [18:57:05] zhuyifei1999_: that's pretty cool :) I saw some of the changes [18:57:20] :) [19:30:12] 06Labs, 10Tool-Labs, 10DBA: labsdb1001 and labsdb1003 short on available space - https://phabricator.wikimedia.org/T132431#2990891 (10Matthewrbowker) [19:30:15] 06Labs, 10Tool-Labs, 10Tool-Labs-tools-Xtools, 10DBA: `s51187__xtools_tmp` database using 272G on labsdb1001 - https://phabricator.wikimedia.org/T133321#2990888 (10Matthewrbowker) 05Open>03Resolved I am going to call this task resolved as of now. There are currently 95 tables, and only 6 are older tha... [19:30:29] !log tools.precise-tools Deploying 6eb9c04 [19:30:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [19:31:05] 06Labs, 10Tool-Labs, 10Tool-Labs-tools-Xtools, 10DBA: `s51187__xtools_tmp` database using 272G on labsdb1001 - https://phabricator.wikimedia.org/T133321#2990893 (10jcrespo) Thank you, again! [20:11:15] PROBLEM - Puppet run on tools-redis-1002 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [20:26:15] RECOVERY - Puppet run on tools-redis-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [20:26:30] 10Tool-Labs-tools-LTA-Knowledgebase: Add continuous integration - https://phabricator.wikimedia.org/T155944#2991161 (10Samtar) 05Open>03Resolved a:03Samtar [20:43:59] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: keystone admin api occasionally refuses connection - https://phabricator.wikimedia.org/T156337#2991258 (10Andrew) So far I only ever see this in one situation, in a 'novastats' report I've been running. The python novaclient invokes keystoneclient to author... [20:45:52] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: keystone admin api occasionally refuses connection - https://phabricator.wikimedia.org/T156337#2991261 (10Andrew) It's possible that the uwsgi changes fixed most issues and I'm just hunting one weird corner case. It might be worth hanging out and seeing if... [20:46:03] !log tools.precise-tools Deploying e5282fb [20:46:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [20:47:21] !log tools.precise-tools Poop. I broke it [20:47:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [20:48:08] !log tools.precise-tools Rolled back to 6eb9c04; will examine error log [20:48:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [20:49:13] bd808: probably a 'generated' tool :P [20:49:57] close. UndefinedError: 'tools' is undefined [20:50:10] I didn't make my dict like I meant to [20:51:05] oh I see [20:54:47] !log tools.precise-tools Deploying eabef48 [20:54:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [20:55:52] well... almost [20:56:25] members list not showing so I the template still isn't quite right [20:57:45] weird [20:59:02] 10Striker, 06Project-Admins: Allow self-service creation of Maniphest projects for Tools - https://phabricator.wikimedia.org/T144111#2991299 (10Legoktm) OK, let's go with "Tool-{toolname}", for consistency with the Diffusion setup, e.g. . It's also... [20:59:08] it seems empty inside redis [20:59:42] was tools_members working before? [20:59:50] I think so [21:00:47] yeah I scrolled up in my terminal and it's there [21:00:50] * zhuyifei1999_ looks [21:02:01] hmmm... I'm not quite sure how I would have messed that bit up [21:07:28] I'll do some have to live hack this one [21:07:33] *no some [21:14:36] zhuyifei1999_: thanks. I think the view will work if the members list gets filled in. Sorry if I did something dumb to break it [21:15:04] I think it's probably my fault [21:15:25] but I still can't find the cause o.o [21:16:18] hmmm... something funky. Let me paste [21:16:39] oh nvm I think I know now [21:16:49] https://phabricator.wikimedia.org/P4864 [21:17:07] conn.response has multiple responses [21:19:36] yeah. maybe make tool_to_members a defaultdict(set) and just keep appending [21:19:45] !log tools.precise-tools Deploying fix b705bdc [21:19:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [21:22:08] it's showing now :) [21:22:20] w00t [21:22:28] I'll fix the css up some more in a bit [21:22:41] ecept that for some places where there are a lot of maintainers it looks not so cool [21:22:45] thx :) [21:25:42] 06Labs, 10Tool-Labs, 06Tool-Labs-standards-committee: Create a wall for tools migration to trusty - https://phabricator.wikimedia.org/T156386#2991360 (10zhuyifei1999) >>! In T156386#2989281, @Legoktm wrote: > It would be nice if the wall could include all the maintainers names too so I could just ctrl+f inst... [21:29:20] pretty sweet https://tools.wmflabs.org/precise-tools/ [21:29:39] even a view source link that works to diffusion [21:29:42] * chasemp passes out [21:31:58] except idk if other people can submit patches / pull requests [21:34:41] bd808 matanya: do you think adding a link to https://tools.wmflabs.org/contact/ for each maintainer is a good idea? [21:36:16] It would be easy to add I suppose [21:36:31] k [21:36:56] hmmm actually it wouldn't [21:37:08] contact only cares about POST I guess [21:37:30] oh /search/foo works maybe? [21:38:00] sort of works anyway [21:38:10] it fills in the form and you have to hit submit [21:40:13] yeah [21:40:38] !log tools.precise-tools Deploying c96cab7 [21:40:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [21:43:55] I think it's looking petty good, except some css to make that first col not too wide [21:45:12] !log tools.precise-tools Deploying 4530d5c [21:45:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [21:45:41] almost what I wanted. rogue commas there [21:46:14] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Investigation: Plan for rewriting XTools - https://phabricator.wikimedia.org/T154551#2991438 (10MusikAnimal) [21:46:31] lol [21:47:15] bah I forgot some padding too [21:48:58] !log tools.precise-tools Deploying cf01934 [21:49:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [21:49:03] ok done piddling [21:49:51] wow [21:50:06] css is magic! [21:50:34] * zhuyifei1999_ wouldn't think of indenting [21:50:52] really makes it much better [21:52:26] !log tools.precise-tools Deploying f32e68f [21:52:29] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.precise-tools/SAL [21:52:38] last one I promise :) [21:54:13] 06Labs, 10Tool-Labs, 06Tool-Labs-standards-committee: Create a wall for tools migration to trusty - https://phabricator.wikimedia.org/T156386#2991453 (10Huji) @Ladsgroup, @Matanya, @eranroz, @zhuyifei1999: You all have been listed on that wall! Let us start this by moving //our own// projects to Trusty befor... [21:57:22] 06Labs, 10Tool-Labs, 06Tool-Labs-standards-committee: Create a wall for tools migration to trusty - https://phabricator.wikimedia.org/T156386#2991462 (10zhuyifei1999) Ah yeah, I migrated all mine. But that's not a week ago yet. :P I'm considering whether grid status should be able to veto accounting status.... [21:58:12] @seen Huji [21:58:12] zhuyifei1999_: Last time I saw huji they were quitting the network with reason: Remote host closed the connection N/A at 12/7/2016 8:53:29 PM (56d1h4m42s ago) [21:58:35] heh [21:58:51] 06Labs, 10Labs-Infrastructure: Deprecate precise instances in Labs by 03/31/2017 - https://phabricator.wikimedia.org/T143349#2991466 (10stwalkerster) [22:08:24] PROBLEM - Puppet run on tools-bastion-03 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [22:28:21] 06Labs, 10Tool-Labs, 06Tool-Labs-standards-committee: Create a wall for tools migration to trusty - https://phabricator.wikimedia.org/T156386#2991565 (10eranroz) >>! In T156386#2991453, @Huji wrote: > @Ladsgroup, @Matanya, @eranroz, @zhuyifei1999: You all have been listed on that wall! Let us start this by m... [22:28:22] RECOVERY - Puppet run on tools-bastion-03 is OK: OK: Less than 1.00% above the threshold [0.0] [22:28:53] zhuyifei1999: did you get a precise reminder email? [22:37:41] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 13Patch-For-Review, 15User-bd808: Modernize the admin tool's codebase - https://phabricator.wikimedia.org/T140254#2991612 (10bd808) Note to my future self: ``` [22:35] bd808: the way to test these would be to test this on tools-proxy-02 by han... [22:53:46] madhuvishy: i was talking with zareen about T156934 and was wondering if we could just make user folders readable to other users by default? (so that one could copy over notebooks and other files directly on the notebooks server) [22:53:47] T156934: Functionality to share & view PAWS internal notebooks - https://phabricator.wikimedia.org/T156934 [22:53:56] ..that's the setting on stat1002/4 [22:57:37] 06Labs, 10Tool-Labs, 06Stewards-and-global-tools: For Tool Labs admins: Notice of heavy use of tool in the next month - https://phabricator.wikimedia.org/T156845#2991709 (10MarcoAurelio) @chasemp Thanks. I wasn't even sure if I had to tell you here or in labs-l. In any case, it was just so you're informed th... [22:57:42] HaeB: isn't that already readable by default? [22:57:57] HaeB: you can't see it from notebook tho, you need to use 'new -> terminal' and use commandline [22:58:13] ah ok, i tried it out by changing the URL [22:58:17] and it didnt work [22:59:06] HaeB: yeah, the notebook itself is limited to only your homedir. can you file a separate ticket about that if you want? To allow notebook UI to be used to browse everywhere [23:00:13] (this would basically mirror the public notebook mirrors on public PAWS) [23:00:44] HaeB: yup doesn't work that one [23:12:06] madhuvishy: ~/service.manifest does not exist for us... [23:12:20] following: https://wikitech.wikimedia.org/wiki/Tools_Precise_deprecation#What_should_I_do.3F [23:13:08] wait I found the webservice which tells me [23:13:36] that still might want to be updated tho [23:13:43] 06Labs, 10Tool-Labs, 06Tool-Labs-standards-committee: Create a wall for tools migration to trusty - https://phabricator.wikimedia.org/T156386#2991731 (10scfc) Don't know if it belongs here: If tools are using Precise "only" for webservice, this might be a good opportunity to try restarting them first with th... [23:16:18] Is there a way to figure out what tools are still on precise? [23:16:31] avicennasis: all listed here I believe https://tools.wmflabs.org/precise-tools/ [23:17:12] avicennasis: you should also have an email if you maintain any precise tools [23:17:51] I just got an email about it, and thought I had migrated everything. But apparently I missed one [23:18:22] avicennasis: that list is /within the last week/ so if it was very recent it could be wrong [23:18:23] tools-exec-gift is still trusty afais. will anyone replace that instance sometime? [23:18:26] chasemp: thanks for the link, that tells me exactly what I missed [23:18:50] *precise [23:19:14] (those names are confusing …) [23:20:14] annika: I think only the maintainers could really answer that, I"m not sure what the dependencies are [23:20:26] 10PAWS: Functionality to share & view PAWS internal notebooks - https://phabricator.wikimedia.org/T156934#2991738 (10Tbayer) @yuvipanda pointed out that it is already possible to copy over notebooks and auxiliary files directly on the server using cp on the command line (use 'New' -> 'Terminal' while in the root... [23:20:50] chasemp: maintainers? [23:21:10] annika: https://tools.wmflabs.org/?tool=giftbot [23:21:18] the developers who are responsible for and maintain the tool [23:21:22] that would be me … but i have no clue [23:21:48] the instance was not created by me but for me (or rather the tool) [23:21:52] I see, are you asking if we are going to build a dedicated trusty node in lieu of the dedicated precise one? [23:22:03] yes [23:22:03] right [23:23:06] 10PAWS: Ability to view other user's notebooks - https://phabricator.wikimedia.org/T156980#2991754 (10Tbayer) [23:23:16] annika: just a sec I'm verifying a few things [23:23:32] 10PAWS: Ability to view other users' notebooks - https://phabricator.wikimedia.org/T156980#2991741 (10Tbayer) [23:26:52] annika: I created https://phabricator.wikimedia.org/T156981 [23:26:52] 06Labs, 10Tool-Labs, 07Epic: Find a solution for tools-exec-gift on Trusty - https://phabricator.wikimedia.org/T156981#2991757 (10chasemp) [23:27:10] is there a time we can try to shift over to the standard grid scheduler for Trusty? [23:32:30] annika: is this you? https://phabricator.wikimedia.org/p/annikamoeller/ [23:32:45] no [23:33:17] Not sure what your phab username is then, cc yourself there? [23:33:21] we'll have to work it out [23:33:48] fun /s [23:35:10] there are already some jobs running under that tool user on trusty [23:35:15] spread over teh grid [23:35:23] 38462 0.37846 gvm tools.giftbo r 11/17/2016 23:12:40 continuous@tools-exec-1419.too 1 [23:35:23] 362927 0.30558 gva tools.giftbo r 01/27/2017 13:45:25 continuous@tools-exec-1419.too 1 [23:35:24] 362939 0.30558 mg tools.giftbo r 01/27/2017 13:45:34 continuous@tools-exec-1411.too 1 [23:35:32] 620427 0.30001 vm tools.giftbo r 02/01/2017 23:17:21 continuous@tools-exec-1407.eqi 1 [23:35:33] 620428 0.30001 sga tools.giftbo r 02/01/2017 23:17:22 continuous@tools-exec-1401.eqi 1 [23:35:59] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 13Patch-For-Review: Make a nag system to email maintainers of tools still running on precise grid hosts - https://phabricator.wikimedia.org/T149214#2991780 (10madhuvishy) This is done, emails were sent out day, and will be sent out weekly. The cron is applie... [23:36:10] those are the normal jobs, the giftbot queue is for an array job with 200 subtasks (and related tasks) [23:37:59] which doesn't have its normal capacity anyway (only 54 are running) [23:38:15] but that's just btw [23:38:47] and now i really have to go to bed [23:39:07] ok thanks for bringing it up annika we'll try to coordinate on task a plan [23:39:14] !log ores deployed ores-wmflabs-deploy:ce8861d [23:39:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [23:39:31] thanks stashbot <3