[01:37:20] 6Labs, 10Labs-Other-Projects: Create Cyberbot Project on Labs - https://phabricator.wikimedia.org/T112881#1652181 (10scfc) If DeadLinksBot indeed checks dead web links, then we already have several (?) bots running for that purpose, including AFAIR @Giftpflanze's bot for which there is also a Labs project Dwl... [03:08:37] (03PS1) 10Legoktm: OTRS → #wikimedia-otrs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239311 [03:09:00] (03CR) 10Legoktm: [C: 032] "Per request of RD" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239311 (owner: 10Legoktm) [03:09:16] (03Merged) 10jenkins-bot: OTRS → #wikimedia-otrs [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239311 (owner: 10Legoktm) [03:11:13] !log tools.wikibugs Updated channels.yaml to: f9dab0c9be84689bc24046982ef22e22d45402b7 OTRS → #wikimedia-otrs [03:11:14] 10Wikibugs, 10OTRS: wikibugs test bug - https://phabricator.wikimedia.org/T1152#1652267 (10Legoktm) [03:11:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL, Master [03:11:27] 10Wikibugs: wikibugs test bug - https://phabricator.wikimedia.org/T1152#1652269 (10Legoktm) [04:30:19] 6Labs, 10Labs-Other-Projects: Create Cyberbot Project on Labs - https://phabricator.wikimedia.org/T112881#1652348 (10Giftpflanze) https://en.wikipedia.org/wiki/Wikipedia:Bots/Requests_for_approval/Cyberbot_II_5: "Future feature requests, such as detecting unmarked dead links, should be made under a subsequent... [04:35:45] 6Labs, 6operations, 5Patch-For-Review: audit labs versus production ssh keys - https://phabricator.wikimedia.org/T108078#1652356 (10Krenair) Looks like https://gerrit.wikimedia.org/r/#/c/175442/ did something like this [04:37:33] (03PS3) 10Yuvipanda: Unreviewed changes to rmtool [labs/toollabs] - 10https://gerrit.wikimedia.org/r/104397 (owner: 10Tim Landscheidt) [04:37:50] (03CR) 10Yuvipanda: "Do we still even use rmtool? I just assumed we don't really support deleting tools." [labs/toollabs] - 10https://gerrit.wikimedia.org/r/104397 (owner: 10Tim Landscheidt) [06:05:56] hey! anybody knows why I get "no route to host" trying to access some of my hosts? e.g. db01.eqiad.wmflabs/10.68.16.196 [06:07:15] SMalyshev: where are you trying to access it from? [06:07:38] well, from my local machine, via bastion [06:07:50] but direct ssh from bastion gives the same [06:08:19] 10.68.16.86 works though... [06:08:20] which project are these instances in? [06:08:23] oh [06:08:33] wikidata-query [06:09:00] but same happens for me with hhvm-build1.hhvm.eqiad.wmflabs for example. no route to host too [06:09:20] hmm [06:09:59] can you verify that the instances with those names still exist? [06:10:02] the ip might be re-used [06:10:06] * yuvipanda is on the phone [06:10:16] as in, from the phone so can't really wikitech [06:10:16] yuvipanda: I see them in the instance list on wikitech [06:10:42] Ok [06:10:45] Then I'm.not sure :(/ [06:10:53] Can you dig them and see if you get the same ip? [06:11:59] db01.wikidata-query.eqiad.wmflabs. 60 IN A 10.68.16.196 [06:12:08] seems to be the same [06:12:55] looks like some kind of networking issue [06:12:56] And you can ssh to the ip? [06:13:00] That's very strange [06:13:04] yuvipanda: no, no route to host [06:13:39] Oh hmm [06:13:41] yuvipanda: I can't ssh there, that's the problem. I can ssh to other hosts within same project, but not to this one. some hosts have this problem, some don't [06:13:46] I just for ofd a train [06:13:53] I'll take a look when I reach home? [06:13:59] Going to be 20mins [06:14:00] yuvipanda: sure, thanks! [06:14:07] SMalyshev: can you open a bug [06:17:11] 6Labs: no route to host trying to reach labs instances - https://phabricator.wikimedia.org/T113025#1652462 (10Smalyshev) 3NEW a:3yuvipanda [06:17:21] yuvipanda: https://phabricator.wikimedia.org/T113025 [06:24:01] 6Labs, 10Tool-Labs: Decide on Docker image policies for Tool Labs Kubernetes - https://phabricator.wikimedia.org/T112855#1652473 (10Joe) I think having our docker registry publicly consultable for at least the base images (which don't have to host passwords or such) would be a good thing(TM), but it requires c... [07:28:42] 6Labs, 10Tool-Labs: Decide on Docker image policies for Tool Labs Kubernetes - https://phabricator.wikimedia.org/T112855#1652561 (10valhallasw) > We'll also then rebuild all the other images, ensuring those too get the security patches. What do we do if this rebuild fails for some reason? > the base images (w... [07:38:26] 6Labs, 10Tool-Labs: Decide on Docker image policies for Tool Labs Kubernetes - https://phabricator.wikimedia.org/T112855#1652566 (10yuvipanda) Kubernetes has built in support for secrets (https://github.com/kubernetes/kubernetes/blob/master/docs/design/secrets.md) and those are per-namespace (so in our context... [07:39:03] 6Labs: no route to host trying to reach labs instances - https://phabricator.wikimedia.org/T113025#1652567 (10yuvipanda) a:5yuvipanda>3None [07:43:13] 6Labs: no route to host trying to reach labs instances - https://phabricator.wikimedia.org/T113025#1652571 (10yuvipanda) They're both on labvirt1007, but hhvm-build1 was in 'paused' state. I've just rebooted it, let's see how that goes. [07:45:33] 6Labs: no route to host trying to reach labs instances - https://phabricator.wikimedia.org/T113025#1652573 (10yuvipanda) hhvm-build1 works for me now. [07:49:38] SMalyshev: ^ would you like me to reboot db01 as well? [07:49:46] SMalyshev: or should I preserve it for andrewbogott to look at later? [08:08:07] 6Labs: no route to host trying to reach labs instances - https://phabricator.wikimedia.org/T113025#1652591 (10yuvipanda) I'm going to try to leave it be for @andrew to investigate tomorrow - but in the meantime if you need it do reboot the instance? [08:08:13] SMalyshev: ^ I'm heading to sleep now [08:27:38] (03PS1) 10Greg Grossmeier: releng is now Release-Engineering-Team [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239328 [08:27:55] (03CR) 10jenkins-bot: [V: 04-1] releng is now Release-Engineering-Team [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239328 (owner: 10Greg Grossmeier) [08:35:50] (03CR) 10Legoktm: [C: 04-1] "Release-Engineering was the example used in our tests :P so they'll need updating" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239328 (owner: 10Greg Grossmeier) [09:17:26] (03PS2) 10Greg Grossmeier: releng is now Release-Engineering-Team [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239328 [09:18:17] (03CR) 10Greg Grossmeier: "fixed, maybe I'll run the tests next time? :P" [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239328 (owner: 10Greg Grossmeier) [09:18:22] (03CR) 10Legoktm: [C: 032] releng is now Release-Engineering-Team [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239328 (owner: 10Greg Grossmeier) [09:18:35] (03Merged) 10jenkins-bot: releng is now Release-Engineering-Team [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/239328 (owner: 10Greg Grossmeier) [09:18:58] legoktm: thanks :) [09:20:06] !log tools.wikibugs Updated channels.yaml to: 6a3566594f734c84b9e7d85600ae39b33ab366de releng is now Release-Engineering-Team [09:20:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL, Master [11:07:36] Change on 12www.mediawiki.org a page Developer access was modified, changed by Shirayuki link https://www.mediawiki.org/w/index.php?diff=1887038 edit summary: [+0] [11:09:09] Change on 12www.mediawiki.org a page Developer access was modified, changed by Shirayuki link https://www.mediawiki.org/w/index.php?diff=1887039 edit summary: [-1] dummy edit to update translation pages [12:28:32] 6Labs, 5Continuous-Integration-Scaling: Nodepool can't SSH to spawn instances due to wmflabs provided instances due ssh algorithms - https://phabricator.wikimedia.org/T102459#1652887 (10hashar) 5Open>3declined a:3hashar We are using our own images with DIB. They are based on stock Jessie and hence do not... [12:29:19] (03Abandoned) 10Tim Landscheidt: Unreviewed changes to rmtool [labs/toollabs] - 10https://gerrit.wikimedia.org/r/104397 (owner: 10Tim Landscheidt) [13:30:10] 6Labs, 10Labs-Other-Projects: Create Cyberbot Project on Labs - https://phabricator.wikimedia.org/T112881#1653128 (10Cyberpower678) 5Open>3stalled [13:32:19] 6Labs, 10Labs-Other-Projects: Create Cyberbot Project on Labs - https://phabricator.wikimedia.org/T112881#1653130 (10Cyberpower678) Hey, guys, I appreciate all the input. It's very useful. Per a discussion I've had with Earwig last night, I'm temporarily suspending this request. I'm going to attempt some ch... [13:48:45] (03PS1) 10Jean-Frédéric: Move conversion methods to own module [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239373 [13:48:47] (03PS1) 10Jean-Frédéric: Set up unit testing infrastucture [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239374 (https://phabricator.wikimedia.org/T113038) [13:50:04] (03CR) 10Jean-Frédéric: [C: 032] Move conversion methods to own module [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239373 (owner: 10Jean-Frédéric) [13:50:32] (03CR) 10jenkins-bot: [V: 04-1] Move conversion methods to own module [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239373 (owner: 10Jean-Frédéric) [13:50:46] (03CR) 10Jean-Frédéric: [C: 032] Set up unit testing infrastucture [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239374 (https://phabricator.wikimedia.org/T113038) (owner: 10Jean-Frédéric) [13:50:52] (03CR) 10jenkins-bot: [V: 04-1] Move conversion methods to own module [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239373 (owner: 10Jean-Frédéric) [13:50:54] (03CR) 10jenkins-bot: [V: 04-1] Set up unit testing infrastucture [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239374 (https://phabricator.wikimedia.org/T113038) (owner: 10Jean-Frédéric) [13:51:11] Coren, did you see I stalled the request. [13:53:20] (03PS2) 10Jean-Frédéric: Set up unit testing infrastucture [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239374 (https://phabricator.wikimedia.org/T113038) [13:53:23] (03PS2) 10Jean-Frédéric: Move conversion methods to own module [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239373 [13:53:38] (03CR) 10Jean-Frédéric: [C: 032] Move conversion methods to own module [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239373 (owner: 10Jean-Frédéric) [13:53:45] (03Merged) 10jenkins-bot: Move conversion methods to own module [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239373 (owner: 10Jean-Frédéric) [13:53:48] (03Merged) 10jenkins-bot: Set up unit testing infrastucture [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/239374 (https://phabricator.wikimedia.org/T113038) (owner: 10Jean-Frédéric) [14:55:38] 6Labs: no route to host trying to reach labs instances - https://phabricator.wikimedia.org/T113025#1653318 (10Andrew) The log for db01 says 'rcu_sched self-detected stall on CPU' which seems telling. I'm going to try a reboot. [14:57:34] 6Labs, 10Labs-Other-Projects, 10The-Wikipedia-Library: Create Cyberbot Project on Labs - https://phabricator.wikimedia.org/T112881#1653319 (10Sadads) [14:59:21] 6Labs: no route to host trying to reach labs instances - https://phabricator.wikimedia.org/T113025#1653321 (10Andrew) The instance is responsive again, post-reboot. I don't know why it died :( [15:33:15] 6Labs, 10Tool-Labs: Permission issues and/or failure to load Ruby environment on trusty - https://phabricator.wikimedia.org/T106170#1653444 (10MusikAnimal) Thanks @coren! The issue is happening again. How would I go about using the `stat` command? It appears to just provide file system information. [15:34:13] ^ anyone know how to use `stat` for this purpose? [15:34:24] look like I'm trying to track the same bug [15:34:42] or could a tool labs sysadmin please remount the NFS with `sudo mount -o remount /data/project` [15:35:02] file on nfs give me "permission denied" on trusty in a random way, works-fail-works [15:35:50] yep, same issue here. Coren is finding a solution but told me I could use `stat` as a workaround in the meantime, not sure how that works tho [15:35:56] 6Labs, 10Tool-Labs: Permission issues and/or failure to load Ruby environment on trusty - https://phabricator.wikimedia.org/T106170#1653447 (10coren) >>! In T106170#1653444, @MusikAnimal wrote: > Thanks @coren! The issue is happening again. How would I go about using the `stat` command? It appears to just prov... [15:36:52] phe: It's a known issue with the attribute cache in Trusty. I'm trying to find a workable solution as we speak. [15:37:39] MusikAnimal: http://ruby-doc.org/core-1.9.3/File/Stat.html [15:37:50] never saw that trouble before yesterday, but since I got nearly 100% failure [15:38:13] I just used a backtick with `stat perm_clerk.log` [15:38:17] about to find out if that worked [15:38:20] and obviously if I strace cat xxx, it'll fix the problem for a few minutes [15:38:48] MusikAnimal, it'll work for a bit, then it'll restart to fail [15:39:03] phe: It's per-node [15:39:35] and no, a forcible stat before the open() makes it work all the time - it's just an horrid workaround though. [15:40:48] worked! [15:40:54] thank you! [15:41:53] MusikAnimal: It's probably rather crappily inneficient if you shell out every time with a backtick though. :-) [15:45:09] yeah haha, now I just have to implement some workarounds for the maxlag errors [15:45:13] which has been happening a lot today [15:46:16] currently my bot just aborts entirely [15:50:59] annoying it can even fail when importing the script implementing stat [15:52:29] phe: What causes it is a file being replaced on one node and then opened on another without an intervening stat call. I'm still trying to figure out whether it's a kernel issue, or a tuning issue. Both are possible because that only happens with trusty. [15:55:51] s/replaced /replaced or added / [16:09:29] Coren: looks like the `stat` trick didn't work the next time around. Maybe it was coincidence that the script successfully ran on the first try? [16:10:39] as far as I know the File::Stat Ruby class is a wrapper to interact with output given by the command, where you can simply run any bash command with backticks, so `stat perm_clerk.log` should do the trick [16:33:23] is it a lot to ask to have to have the NFS remounted? that worked last time [16:35:59] MusikAnimal: It's a coincidence. Remounting an NFS mountpoint has no real effect unless you are doing a whole-vfs change (like rw->ro) because the actual NFS mount code never gets invoked. [16:36:28] MusikAnimal: In fact, part of the issue I'm running into is that testing nfs options is very hard because of that. [16:40:41] ah, rats. So any ideas what I could do, then? stat doesn't appear to do the trick anymore :( [16:46:52] Can you tell me which node it last failed on? [16:47:10] not sure how to tell [16:47:21] but actually I have to step out for lunch, I'll be back in about an hour [16:47:29] Allright, ping me then? [16:47:32] as always, thanks for all of your help! [16:47:34] yes will do [16:47:35] :) [17:03:10] yuvipanda: Once you're around, https://gerrit.wikimedia.org/r/#/c/239377/ makes webservicemonitor a bit less brute-force and fixes two issues. [17:03:37] Ok Coren [17:03:44] I'll take a look after breakfast! [17:03:58] * Coren attempts to parse your timezone and fails. [17:04:27] "Somewhere in the Pacific"? :-) [17:04:59] I guess so [17:05:09] I've given up a long time agp [17:05:10] Ago [17:05:39] I seem to be doing noon to 8pm on average local time now [17:10:49] yuvipanda: A few easy questions for you on https://phabricator.wikimedia.org/T97748 as well [17:12:12] andrewbogott: OK! The cron one is probably the toughest... [17:12:44] andrewbogott: we can maybe test it by having a cron setup to run every 30mins and write out a timestamp [17:12:59] error triggers if timestamp is more than an hour old? [17:13:04] yuvipanda: as long as you just want to test that crons are running, not the creation/editing of them... [17:13:09] seems trivial, yeah, just check a timestamp [17:13:37] Can I just create the job with crontab -e or is there something arcane and toollabs-specific? [17:13:40] Yeah that's good enough [17:13:50] Could some root move my tables from u2815_p to u2815__p? [17:14:09] It is arcane and tools specific but you can create it with crontab -e on tools-login.wmflabs.org [17:18:22] yuvipanda: cool [17:18:22] 6Labs, 3Labs-sprint-112: Restore some files from /home/gwicke - https://phabricator.wikimedia.org/T110698#1653800 (10GWicke) 5Open>3declined @cscott: No, now that we have the other repo ready we can just shut down this one. Actually, I think this means that we can delete parsoid.wmflabs.org. [17:24:44] 6Labs, 3Labs-sprint-112: Restore some files from /home/gwicke - https://phabricator.wikimedia.org/T110698#1653826 (10Andrew) Sorry I never got to this. Our NFS install is still hanging by a thread :( [17:29:10] 6Labs, 10Tool-Labs, 6Design Research Backlog, 6Learning-and-Evaluation, and 2 others: Organize a (annual?) toollabs survey - https://phabricator.wikimedia.org/T95155#1653868 (10leila) [17:31:58] 6Labs, 10Tool-Labs, 6Design Research Backlog, 6Learning-and-Evaluation, and 2 others: Organize a (annual?) toollabs survey - https://phabricator.wikimedia.org/T95155#1653873 (10leila) @yuvipanda, if you send me the number of users we will contact, I'll make the meta page today. If there is a special place... [17:53:10] 6Labs, 6Discovery, 7Elasticsearch: Replicate production elasticsearch indices to labs - https://phabricator.wikimedia.org/T109715#1654039 (10yuvipanda) Ok, so we have a machine approved to test for 6 weeks! Should be racked next week, I think. Things I'd like to get out of this test: # Working replication... [17:53:29] ebernhardson: ^ [17:56:35] yuvipanda: heh, i created a ticket too :P will merge [17:56:49] * ebernhardson is getting used to creating new tickets for everything [17:57:11] ebernhardson: :D [17:58:11] 6Labs, 6Discovery, 7Elasticsearch: Replicate production elasticsearch indices to labs - https://phabricator.wikimedia.org/T109715#1654047 (10EBernhardson) [18:01:30] ebernhardson: yeah, we have 4 3TB disks, can't we actually just do raid1? [18:03:42] ebernhardson: also are our elastic clusters trusty or jessie? [18:08:40] yuvipanda: Survey time? :-) [18:08:52] multichill: yup :) we'll probably send it out monday [18:09:08] I guess you're just going to invite all users how have a (tool)labs account? [18:11:37] multichill: thinking of all users who are members of a tool [18:13:28] Yes, that makes sense. How many people would that be? [18:13:51] And we should have some sort of silly prize yuvipanda :P [18:14:26] multichill: haha. 'root on toollabs for 1 day'? [18:14:27] :) [18:14:32] multichill: going to calculate that soon [18:18:07] yuvipanda: trusty [18:18:33] aaah so I guess that's what we'll want this one to be too [18:52:00] 6Labs, 10Labs-Infrastructure, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Move LabsDB aliases to DNS - https://phabricator.wikimedia.org/T63897#1654282 (10scfc) On a host where `/etc/hosts` does not contain the aliases: ``` scfc@toolsbeta-vmbuilder-precise:~$ cat /etc/hosts 127.0.0.1 localhost 127.0.1.1 ubuntu... [18:54:12] 6Labs, 10Labs-Infrastructure, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Move LabsDB aliases to DNS - https://phabricator.wikimedia.org/T63897#1654287 (10scfc) I retract that; the template for `/etc/hosts` for #Tool-Labs instances contains a dynamic mapping for `tools-redis`, so this would need testing first i... [18:58:16] 6Labs, 10Tool-Labs, 3Labs-Sprint-114, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Setup a tools checker service that can check all internal services for availability - https://phabricator.wikimedia.org/T97748#1654303 (10Andrew) [19:00:27] yuvipanda: I’m still hoping for a snippet of webserver code. [19:01:37] andrewbogott: I have a test one already, I'm in a meeting now for 30mins I'll ping you with it right after? [19:01:45] (sorry!) [19:01:56] yep, no problem [19:38:23] (03PS1) 10Jforrester: build: Test with flake8 too, and make pass [labs/tools/forrestbot] - 10https://gerrit.wikimedia.org/r/239446 [19:46:50] 6Labs, 10Tool-Labs, 3Labs-Sprint-114, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Setup a tools checker service that can check all internal services for availability - https://phabricator.wikimedia.org/T97748#1654410 (10Andrew) a:3Andrew [19:47:15] 6Labs, 3Labs-Sprint-114, 5Patch-For-Review: Setup an availability checker for all labsdb hosts - https://phabricator.wikimedia.org/T107449#1654411 (10Andrew) a:3Andrew [19:49:07] 6Labs, 10Labs-Infrastructure, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Move LabsDB aliases to DNS - https://phabricator.wikimedia.org/T63897#1654413 (10Krenair) We still have to keep an /etc/hosts because of `tools-db`, `tools-redis` and `tools-redis.eqiad.wmflabs`. The *.labsdb entries can go though. [19:49:10] 6Labs, 10Labs-Infrastructure, 3Labs-Sprint-114: Ironic on Labs - https://phabricator.wikimedia.org/T110556#1654415 (10Andrew) """ Excerpts from Andrew Bogott's message of 2015-09-16 10:03:48 -0700: > My users are mostly happy with VMs, but I get occasional requests for > physical hardware in ord... [19:52:20] andrewbogott, what's "Ironic on Labs"? [19:52:24] https://phabricator.wikimedia.org/T110556 [19:52:34] Maybe you subscribed the wrong Aaron? [19:52:53] Oh! I see. In the copy-paste comment [19:52:57] This is about bare-metal [19:54:49] halfak: yeah, it’s the bare-metal management project [19:55:21] Cool. Thanks for CCing me. [19:56:04] I've got a use case that would use bare metal ASAP. We've been trying to make due with 160GB disks by partitioning a service. [19:56:31] Not sure how soon Ironic might see the light of day, but I think I can speak better to the what and why of what I want better than before. [19:56:36] :) [19:57:25] on that note, if you have any protips for hosting very large memory-mapped files on labs, please let me know. [20:00:48] halfak: It’s going to take a while, but supporting bare metal is on our goal list for the next quarter. [20:04:25] legoktm: It'd be great to get https://gerrit.wikimedia.org/r/#/c/238542/ merged so that RelEng aren't disrupted in switching to wmf.0 for the branch after next week (i.e., we want to start using this code in production from Tuesday afternoon). [20:07:18] 6Labs, 10Tool-Labs, 15User-Bd808-Test: Create template PHP application for use on Tool Labs based on Slim, Twig and Wikimedia libraries - https://phabricator.wikimedia.org/T90092#1654502 (10Spage) (Minor drive-by comment) Why Twig? MediaWiki core [[ https://www.mediawiki.org/wiki/Requests_for_comment/HTML_te... [20:15:17] andrewbogott: I had gone from one meeting into another.... [20:22:49] 6Labs, 10Labs-Infrastructure, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Move LabsDB aliases to DNS - https://phabricator.wikimedia.org/T63897#1654538 (10yuvipanda) I think that cleans it out? [20:25:05] Coren, you there. [20:25:13] Hmm? [20:25:24] andrewbogott: so test-webservice-generic tool has a generic webservice code (in ~/www/) and test-lighttpd-precise / test-lighttpd-trusty for php webservice checks [20:25:32] So I'm going to attempt a minor rewrite of my script, to multithread it properly. [20:25:34] 6Labs, 10Labs-Infrastructure, 5Patch-For-Review, 3ToolLabs-Goals-Q4: Move LabsDB aliases to DNS - https://phabricator.wikimedia.org/T63897#1654555 (10scfc) 5Open>3Resolved Yes. [20:25:38] Coren, ^^ [20:25:59] If it works, my demands for resources should go down considerably. [20:26:08] Makes it easier to get them. [20:26:10] yuvipanda: ok — I will look. thanks [20:26:23] andrewbogott: for the php webservice ones it'll be in ~/public_html [20:26:33] Coren, But I don't know anyone who's ever multithreaded a PHP script before. [20:27:02] Coren, and it is somewhat beyond my scope of experience at current, but we all have to start somewhere. [20:27:09] Coren, so wish me luck. :p [20:27:15] Learn-by-doing. :-) [20:28:07] Coren, gotta go for now. [20:34:55] yuvipanda: None of that is currently puppetized, right? [20:35:03] andrewbogott: yup [20:36:11] I like that there is a test-webservice-generic and also a test-generic-webservice tool [20:36:33] oh, I don't know about the latter (or former?) [20:37:29] they’re both yours [20:37:36] maybe you could delete whichever one of them is.. nothing [20:38:00] ... [20:38:06] I'll check with them once *this* meeting is done :) [20:39:41] neither has anything in public_html [20:39:50] andrewbogott: yeah, generic will have them in ~/www [20:54:08] 6Labs, 10Tool-Labs, 10Labs-Infrastructure, 3Labs-Sprint-115: Can't delete rule in default security group - https://phabricator.wikimedia.org/T112492#1654734 (10Andrew) [21:02:17] (03CR) 10Niedzielski: "@Yuvipanda, please review when you can." [labs/tools/wikipedia-android-builds] - 10https://gerrit.wikimedia.org/r/231697 (https://phabricator.wikimedia.org/T99115) (owner: 10Niedzielski) [21:42:13] James_F|Away: ooh yay. Will review [21:49:06] yuvipanda: for you, when you have time… https://gerrit.wikimedia.org/r/#/c/239504/ [21:50:09] andrewbogott: hmm so that's going to be interesting because the commands aren't idempotent. [21:50:25] And our supported model is one webservice per tool [21:50:27] yeah, but is anything else going to run inside that tool? [21:50:55] No but these are two right. So if we start one and then don't successfully stop it idk what will exactly happen [21:50:58] Or is the framework going to run the two functions in a way that overlaps? [21:51:07] It might. [21:51:13] bah [21:51:17] so we need a lock, at least. [21:51:19] We can force uwsgi to have only one process [21:51:34] Then it won't run them both simultaneously but that can cause other problems [21:51:42] Like a stuck worker causing all alerts to fail [21:52:21] andrewbogott: we could have two different tools to test these as, and just use sudo? [21:52:22] oh, I guess I can’t use a lock because this isn’t a threading issue really [21:52:26] Yeah [21:52:45] Well... [21:53:00] We can just have one test that tests both things. And if either one fails we get an alert. That’s the easiest :) [21:53:09] Yeah that's OK too [21:53:13] We can just do the php test [21:53:15] I think I’ll do that, it’s simpler. [21:53:27] And not bother with the generic one [21:53:31] Oh yeah or that. [21:53:36] We don’t really have a way to provide info from these tests other than worked vs. didn’t work do we> [21:53:43] No [21:53:47] ok then :) [21:59:15] yuvipanda: ok, resubmitted [22:19:53] why isn't logmsgbot in -releng? [22:22:02] I can't find anything obvious here: https://phabricator.wikimedia.org/diffusion/OPUP/history/production/modules/tcpircbot/ [22:42:09] why was grrrit-wm changed to krrrit-wm? [22:45:27] Negative24: ask yuvipanda :) [22:45:45] 17:53 < greg-g> yuvipanda: why "krrrit", btw? [22:45:46] 17:53 < yuvipanda> greg-g: it's running on kubernetes! [22:46:03] oh! congrats yuvipanda! [23:14:03] Change on 12www.mediawiki.org a page OAuth (obsolete info) was modified, changed by Shirayuki link https://www.mediawiki.org/w/index.php?diff=1888456 edit summary: [23:14:23] Change on 12www.mediawiki.org a page OAuth (obsolete info)/en-gb was modified, changed by FuzzyBot link https://www.mediawiki.org/w/index.php?diff=1888457 edit summary: Updating to match new version of source page [23:14:23] Change on 12www.mediawiki.org a page OAuth (obsolete info)/ja was modified, changed by FuzzyBot link https://www.mediawiki.org/w/index.php?diff=1888458 edit summary: Updating to match new version of source page [23:14:23] Change on 12www.mediawiki.org a page OAuth (obsolete info)/zh was modified, changed by FuzzyBot link https://www.mediawiki.org/w/index.php?diff=1888459 edit summary: Updating to match new version of source page [23:15:42] Change on 12www.mediawiki.org a page OAuth (obsolete info) was modified, changed by Shirayuki link https://www.mediawiki.org/w/index.php?diff=1888460 edit summary: dummy edit to update translation pages [23:15:59] Change on 12www.mediawiki.org a page OAuth (obsolete info)/en was modified, changed by FuzzyBot link https://www.mediawiki.org/w/index.php?diff=1888461 edit summary: Updating to match new version of source page [23:15:59] Change on 12www.mediawiki.org a page OAuth (obsolete info)/en-gb was modified, changed by FuzzyBot link https://www.mediawiki.org/w/index.php?diff=1888464 edit summary: Updating to match new version of source page [23:15:59] Change on 12www.mediawiki.org a page OAuth (obsolete info)/ja was modified, changed by FuzzyBot link https://www.mediawiki.org/w/index.php?diff=1888465 edit summary: Updating to match new version of source page [23:15:59] Change on 12www.mediawiki.org a page OAuth (obsolete info)/zh was modified, changed by FuzzyBot link https://www.mediawiki.org/w/index.php?diff=1888469 edit summary: Updating to match new version of source page [23:24:27] Hey guys, is there a tutorial on how to get pywikibot working on Labs? [23:36:09] ResMar: https://wikitech.wikimedia.org/wiki/User:Legoktm/pywikibot_on_tools_lab [23:36:25] that may be outdated though [23:36:28] I haven't done that in a year [23:37:30] Thanks. [23:37:51] Sigh. [23:38:02] I wish there was a WMF team dedicated to documentation. [23:40:07] hehe, that would be nice, just add #needdocs to any task and somebody else can figure it out *g*' [23:40:33] I've been doing some work with Bluemix lately [23:40:47] And you know there's something wrong when your organization's documentation is worse than IBM's. [23:42:23] I feel like tech needs a nice site like this: https://policy.wikimedia.org/ [23:45:56] legoktm: Can you tell me a little bit about job submissions? [23:46:32] I'd like to route wikicode outputted by a script through a bot that edits a page. [23:46:53] ResMar: https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Grid is very detailed [23:48:09] the topic of this channel is outdated [23:48:50] Hmm. For starters I suppose it'd be better to avoid pywikibot entirely and just route it to output that can be copy-pasted by the user.