[02:17:06] 6Labs: Ensure that Terms of Use document restrictions on third-party web interactions - https://phabricator.wikimedia.org/T129936#2120419 (10coren) I'm not sure why you never received a reply, but it's very clear-cut. Indeed, there was at least one user whose access to labs was suspended because of that very re... [02:24:37] kaldari, ping [02:24:48] howdy [02:24:49] Niharika, ping [02:25:04] kaldari, oh good you're still awake. :p [02:25:19] So the checkIfDead class. How will it handle site timeouts. [02:25:42] I forget if curl times out by default. [02:26:37] I believe curl does timeout, but I don't think we're handling for that currently [02:27:24] Maybe we could put in some exception handling for that [02:28:06] Cyberpower678: Do you have any example pages that we could test against? [02:28:15] I see it handles redirects to the root domain, but what if the site redirects to the main page without changing the URL. [02:28:24] not really [02:28:40] I typically don't make it a habit of documenting bad websites. ;P [02:31:30] Cyberpower678: There's no way for us to reliably detect loading the main page without an actual URL change [02:31:38] Ok [02:32:58] We've been talking with the IA about detecting soft 404s (other than just redirects to root), since we would need their data to help with that, so that's still a possibility for the future [02:34:02] Cyberpower678: Did you get a chance to look at the logging API any? [02:34:53] Not yet [02:34:56] Exam tomorrow [02:38:36] NP [02:38:44] good luck with the exam! [02:39:00] thanks. [02:39:33] kaldari, but a repeat of every single math theorem out there isn't my idea of good or fun. [02:39:38] :/ [02:43:35] kaldari, I merged the pull request. [02:47:22] yay [03:42:28] 10Tool-Labs-tools-Other, 6Community-Tech, 7Community-Wishlist-Survey, 7Milestone: Pageview Stats tool - https://phabricator.wikimedia.org/T120497#2121292 (10Shizhao) [03:51:38] 6Labs: New project: Petscan - https://phabricator.wikimedia.org/T129749#2121301 (10jkroll) The CatGraph project is running and in use by several tools we developed at WMDE. A graph exists for every wiki available on Labs, including Commons. Carrying the page IDs for each wiki takes a sizable amount of RAM; our t... [08:16:39] (03CR) 10Ricordisamoa: "Yes, nice indeed." (032 comments) [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/277072 (owner: 10Tobias47n9e) [08:34:53] PROBLEM - Host tools-bastion-01 is DOWN: CRITICAL - Host Unreachable (10.68.17.228) [09:09:47] (03PS1) 10Ricordisamoa: Credit ArthurPSmith in toolinfo.json [labs/tools/ptable] - 10https://gerrit.wikimedia.org/r/277479 [09:30:31] 6Labs, 10Datasets-General-or-Unknown, 6Operations, 10wikitech.wikimedia.org: copy wikitech dumps to dumps server ? - https://phabricator.wikimedia.org/T128680#2082710 (10ArielGlenn) [09:34:56] 6Labs, 10Tool-Labs, 10Datasets-General-or-Unknown, 6Operations: enwiki database dumps missing - https://phabricator.wikimedia.org/T89537#2121741 (10ArielGlenn) [11:03:34] 10MediaWiki-extensions-OpenStackManager: Missing message parameter to openstackmanager-deletedinstance - https://phabricator.wikimedia.org/T129994#2122074 (10Nikerabbit) [11:10:36] 6Labs, 6Operations, 10wikitech.wikimedia.org, 13Patch-For-Review: Wikitechwiki has 4xx responses to requests for some static assets inc. poweredby_mediawiki_88x31.png and WikiEditor's button-sprite.svg - https://phabricator.wikimedia.org/T128747#2084612 (10Nikerabbit) Broken again (still?). GET https://wi... [11:12:58] is there a way to cahnage the replica pw? [11:19:43] hashar *_* [11:20:46] Steinsplitter: mind to elaborate ? What do you mean by replica password? [11:21:20] the passwort to connect to the dababases (for example enwiki_p via s1) [11:22:49] oh for the labs db [11:23:05] I have no idea how that is setup. You might want to ask on labs list or task fill it :D [11:23:09] sorry :( [11:23:22] ok :) [11:30:52] looks like SET PASSWORD = PASSWORD('newpass'); works :) [13:52:22] 6Labs: OS-EXT-SRV-ATTR:instance_name not set for some instances - https://phabricator.wikimedia.org/T123162#2122394 (10scfc) [13:52:24] 10MediaWiki-extensions-OpenStackManager: Missing message parameter to openstackmanager-deletedinstance - https://phabricator.wikimedia.org/T129994#2122393 (10scfc) [14:15:02] o/ hey folks. [14:15:25] I know we have graphite.wmflabs.org. Do we have grafana installed somewhere too? [14:15:54] halfak: in production on krypton.eqiad.wmnet [14:16:32] thanks moritzm. [14:29:02] 6Labs, 10Tool-Labs, 6Discovery, 10Maps: Move users of maps-related tools to production services where possible - https://phabricator.wikimedia.org/T130013#2122501 (10scfc) [14:59:48] mobrovac: Do you know anything about http://math.beta.wmflabs.org/ ? [14:59:52] It appears to be broken [15:00:10] But also, it’s a ‘math’ IP but bound to the ‘beta.wmflabs.org’ domain, which seems wrong [15:00:23] ah interesting [15:00:51] given that it’s broken anyway, I want to just delete it [15:01:07] but not sure if I should ask physikerwelt first [15:10:14] andrewbogott: delete the proxy ip? [15:10:59] mobrovac: just the address [15:11:07] I sent an email [15:11:13] the dns address, I mean [15:11:19] kk [15:11:22] thnx [15:11:45] but imho, it can be deleted, there are a bunch of web proxies all pointing to the same instance [15:12:00] andrewbogott: any further idea why *.beta.wmflabs.org is known to Special:NovaAddress but wikidata.beta.wmflabs.org doesn't resolve? [15:12:56] jzerebecki: I don’t know, specifically. But the wikidata.beta.wmflabs.org domain is also defined and, I believe, has records on it. So there’s probably a conflict of some sort there [15:16:58] andrewbogott: good idea. it was not but m.wikidata.beta.wmflabs.org was, so I just added wikidata.beta.wmflabs.org perhaps that will fix it... [15:34:36] Kelson: If you are here, can we talk about dns names in mwoffliner? [15:47:24] (03PS1) 10MarcoAurelio: Bring back requests.php [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/277521 [15:49:29] * andrewbogott writes a hundred emails [15:50:16] 6Labs, 6Operations, 10ops-codfw: Figure out what labstore hardware is viable in codfw - https://phabricator.wikimedia.org/T128083#2063474 (10RobH) Interface Admin Link Description ge-1/0/0 up up labstore2001 ge-1/0/1 up down labstore2002 So labstore2002 is enabled and on the rig... [15:50:18] (03PS2) 10MarcoAurelio: Bring back requests.php [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/277521 [15:53:53] (03CR) 10MarcoAurelio: [C: 032] Bring back requests.php [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/277521 (owner: 10MarcoAurelio) [15:58:49] (03Merged) 10jenkins-bot: Bring back requests.php [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/277521 (owner: 10MarcoAurelio) [16:00:06] gwicke: the ‘visualeditor’ labs project is your thing, right? I’d like to move lintbridge.wmflabs.org and parsoid.wmflabs.org — either to web proxies or to subdomains of visualeditor.wmflabs.org [16:00:18] do you have thoughts about that, or suggestions about who I should coordinate with? [16:00:43] andrewbogott: They're not VE-specific; I'd rather the instance wasn't called visualeditor.wmflabs.org if possible. [16:01:06] James_F: it would be lintbridge.visualeditor.wmflabs.org [16:01:20] But, it could be any other subdomain too. Just not top-level wmflabs.org [16:01:26] Yeah. lintbridge.parsoid.wmflabs.org would be good. [16:01:45] that’s easy [16:01:58] James_F: can I just move them? Or does it need to be staged somehow? [16:03:59] 6Labs, 6Operations, 10wikitech.wikimedia.org, 13Patch-For-Review: Wikitechwiki has 4xx responses to requests for some static assets inc. poweredby_mediawiki_88x31.png and WikiEditor's button-sprite.svg - https://phabricator.wikimedia.org/T128747#2122852 (10Krenair) WFM too [16:08:29] matanya: is conf.wmflabs.org doing anything? Can I delete it, or move it to conf.jitsi.wmflabs.org? [16:26:47] andrewbogott: I've never been involved in them so I can't really judge, sorry. [16:27:24] James_F: do you know who might know? [16:27:52] andrewbogott: cscott probably. [16:28:37] cscott: here? [16:29:44] mobrovac: what’s involved in testing the mathosphere thing? Want me to move it to a proxy so you can see if it still works? [16:30:42] andrewbogott: it involves some concentration which i currently don't have because i'm sick today :/ [16:30:48] ok [16:30:59] hence the quesiton about the deadline [16:31:19] Oh, I thought you meant, how much time did I have available to work on it [16:31:26] mobrovac: a few days is ok. [16:31:41] heh, you see, i can't even properly convey my thoughts :) [16:31:43] kk cool [16:31:47] thnx andrewbogott [16:38:05] (03PS1) 10MarcoAurelio: Delete requests.php stuff not working [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/277537 [16:38:45] (03CR) 10MarcoAurelio: [C: 032] Delete requests.php stuff not working [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/277537 (owner: 10MarcoAurelio) [16:41:35] (03CR) 10MarcoAurelio: [V: 032] Delete requests.php stuff not working [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/277537 (owner: 10MarcoAurelio) [16:43:53] valhallasw`cloud: do you know how relic.wmflabs.org works? Does anyone actually hit that address directly? [16:44:03] Coren, same question :) [16:45:25] 6Labs: Ensure that Terms of Use document restrictions on third-party web interactions - https://phabricator.wikimedia.org/T129936#2123041 (10tom29739) I've seen some tools use Google Analytics too, and there is nothing in the Terms of Use at the moment that say not to. It would make sense to have it in the Terms... [16:49:29] 10Tool-Labs-tools-stewardbots, 6Stewards-and-global-tools: Bring back requests.php - https://phabricator.wikimedia.org/T130028#2123055 (10MarcoAurelio) [16:55:41] !log tools.stewardbots Merged {{gerrit|277521}}, but reverted everything on {{gerrit|277537}}. Created {{phabT|130028}} [16:56:30] no labslogbot ... [16:56:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL, Master [16:56:40] :) [16:58:48] mafk: try now? [16:59:23] andrewbogott: the bot replied at 17:56 [16:59:30] it took a bit [16:59:32] thanks [16:59:33] ah, so it did [16:59:35] ok then [17:02:51] 10Tool-Labs-tools-stewardbots, 6Stewards-and-global-tools: Unified and centralized CSS and JS for all tools in the project - https://phabricator.wikimedia.org/T130030#2123121 (10MarcoAurelio) [17:04:45] 10Tool-Labs-tools-stewardbots, 6Stewards-and-global-tools: Cleanup of the project - https://phabricator.wikimedia.org/T130031#2123138 (10MarcoAurelio) [17:05:08] 10Tool-Labs-tools-stewardbots, 6Stewards-and-global-tools: Cleanup of the project - https://phabricator.wikimedia.org/T130031#2123150 (10MarcoAurelio) [17:05:41] (03PS4) 10MarcoAurelio: Continuous Integration Python config for labs/tools/stewardbots [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/275190 (https://phabricator.wikimedia.org/T128503) [17:07:00] (03CR) 10MarcoAurelio: "Scheduling for review by the "integration" team. I'm sure it still lacks stuff and/or some of the file contents I submitted are wrong." [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/275190 (https://phabricator.wikimedia.org/T128503) (owner: 10MarcoAurelio) [17:09:20] (03PS5) 10MarcoAurelio: Adding .lighttpd.conf file [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/276209 [17:23:00] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123188 (10Andrew) Hm, is @cscott still out? [17:27:42] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2123204 (10Andrew) [17:31:39] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123229 (10ssastry) subbu: i'm not sure i know what parsoid-spof is, either. i'll take a look. what does "spof" stand for, i wonder? that's probably a good clue. single point of fai... [17:31:55] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123231 (10cscott) I don't think I'm responsible for having created `parsoid-spof`. Does anyone have an idea what `spof` stands for? That might be a clue. I guess if we started it up I might be able... [17:33:28] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123244 (10cscott) Maybe https://gerrit.wikimedia.org/r/#/c/70582/ is related? It was written by @Catrope , maybe he remembers what `parsoid-spof` was. [17:34:06] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2123259 (10Andrew) [17:34:28] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123261 (10cscott) From https://gerrit.wikimedia.org/r/68133: "parsoid-spof is maintained by the Parsoid team and is updated with the latest Parsoid code frequently. deployment-parsoid2 is not maintain... [17:36:26] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123262 (10cscott) It was also referenced from `$wgVisualEditorParsoidReportProblemURL` in https://gerrit.wikimedia.org/r/114100. [17:38:02] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123265 (10Andrew) I'm pretty sure 'spof' stands for 'single point of failure.' The instance has been shutdown for a couple of weeks and no one has complained... [17:46:19] 10MediaWiki-extensions-OpenStackManager: OpenStackManager: Instance deletion message is missing parameter $1 - https://phabricator.wikimedia.org/T130036#2123326 (10Krinkle) [17:50:01] andrewbogott: sorry I missed your ping earlier; I see subbu responded per mail, so I assume you are all set? [17:50:45] gwicke: still unclear what I should do with parsoid.wmflabs.org [17:50:56] but maybe followup on email so everyone knows what’s happening [17:52:35] andrewbogott: Hi, Here I'm :) [17:53:17] Kelson: I think I emailed you... [17:53:23] but, sorry, many things happening at once, one moment :) [17:54:51] andrewbogott: my understanding is that it can be deleted [17:54:57] andrewbogott: answered per email, so we can deal this asynchronously [17:55:10] gwicke: yep, sounds good, doing [17:55:11] Kelson: thanks! [17:55:36] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2123430 (10Andrew) [17:56:57] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2123204 (10Andrew) [17:57:23] Kelson: ok, so you’ve confirmed that they can’t be moved behind a web proxy [17:57:37] I still need to move them, though. Is *.mwoffliner.wmflabs.org ok? [17:58:04] andrewbogott: yes, yes [17:58:26] andrewbogott: so what would be for example the new name for mwoffliner1 ? [17:58:49] mwoffliner1.mwoffliner.wmflabs.org [17:58:51] it’s all in the email :) [18:00:14] andrewbogott: perfect for me [18:00:28] Kelson: do you need a migration period or can I just move things right now? [18:00:45] andrewbogott: you can do it right now, I'll fix immediatly the dependencies [18:00:54] great, thank you! [18:02:42] Kelson: ok, I’ve created the new names, they should be active in a moment. [18:02:49] I’ll wait a few minutes and then delete the old ones. [18:05:46] andrewbogott: ok, everything works fine, you can go ahead. [18:05:56] great [18:12:14] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2123486 (10Andrew) [18:16:14] 10MediaWiki-extensions-OpenStackManager: OpenStackManager: Instance deletion message is missing parameter $1 - https://phabricator.wikimedia.org/T130036#2123506 (10Krenair) [18:16:16] 6Labs: OS-EXT-SRV-ATTR:instance_name not set for some instances - https://phabricator.wikimedia.org/T123162#2123507 (10Krenair) [18:40:37] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2123603 (10Andrew) [19:01:36] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123708 (10ssastry) You can delete this instance. This is no longer being used .. and clearly no one has shouted at any of us since you disabled this. [19:01:53] 6Labs: Maybe delete instance parsoid-spof in 'visualeditor' project - https://phabricator.wikimedia.org/T128620#2123710 (10Andrew) 5Open>3Resolved deleted! [19:04:11] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2123762 (10Andrew) [19:05:02] 6Labs: Maybe delete jitsi project - https://phabricator.wikimedia.org/T130050#2123766 (10Krenair) [19:21:25] 10Tool-Labs-tools-wikiloves: Desenvolver aplicativo básico em Flask para a ferramenta - https://phabricator.wikimedia.org/T129712#2113596 (10Crang115) Não vejo problema em começarmos com algo parecido com o ptwikis. Acredito que naturalmente a demanda por funcionalidades diferentes irá mudar sua estrutura, mas n... [19:52:43] Is somebody around who can help me with changing access permissions of files in tool accounts? [19:54:41] 10Tool-Labs-tools-stewardbots, 6Stewards-and-global-tools: Cleanup of the project stewardbots - https://phabricator.wikimedia.org/T130031#2124109 (10Luke081515) [19:57:00] Hi to all. Could you answer the question of bots on Tool Labs? [20:00:26] seems like he is not interested [20:00:37] tseppelt: What's the problem? [20:02:03] (03PS4) 10Addshore: Add wikidata/.* to wikidata-feed [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/247831 [20:05:33] Here I am again. As everybody I have a user account with ssh access and a tool account with crontab access. When I want to upload files (ssh -> copy them to /data/project/...) I always get permission errors when I launch the scripts (via crontab). The files are owned by the user account not by the tool account. How can I change the ownership of the files? Or since this isn't allowed what is the workaround? [20:07:43] tseppelt: you should be able to use chown to make the tool bot user the owner of the file [20:08:42] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2124184 (10Andrew) [20:12:19] neither as the tool nor as the user I am allowed to change the ownership of the file (chown: changing ownership of ‘./Kaspar.jar’: Operation not permitted). [20:15:21] tseppelt: what command are you running as who in what directory [20:15:31] because that seems impossible [20:15:53] (03PS2) 10Addshore: Remove analytics/limn-wikidata-data [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/273428 [20:16:04] (03PS2) 10Addshore: Add analytics/wmde/.* to #wikimedia-de-tech [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/273429 [20:16:12] I am doing this: kaspar@tools-bastion-05:/data/project/kasparbot/run_pd_magic$ chown tools.kasparbot ./Kaspar.jar [20:18:03] tseppelt: have you tried 'take' as the tool account? [20:18:05] tseppelt: your file is not executable [20:18:16] so if you try to run it via cron as an exec it will fail [20:18:29] unless that's not your intention which I guess as a jar it isn't [20:18:29] but [20:18:32] -rw-rw-r-- 1 kaspar tools.kasparbot 3908105 Mar 15 19:25 Kaspar.jar [20:19:17] this /data/project/kasparbot/run_pd_magic/magic.php [20:19:33] is this teh cron you are running or does the cron run the run.sh [20:21:58] chasemp: take is the command I was looking for. I just changed the ownership. [20:22:02] Thank you! [20:22:29] (And run.sh is the file which has to be executable for the crontab) [20:22:53] alls well that ends well [20:26:15] 10Tool-Labs-tools-Other, 6Community-Tech, 7Community-Wishlist-Survey, 7Milestone: Pageview Stats tool - https://phabricator.wikimedia.org/T120497#2124279 (10kaldari) [20:41:01] !log mobile-smoketest deleted all instances, proxies, and the project itself [20:41:01] mobile-smoketest is not a valid project. [20:41:15] !log mobile-smoketests deleted all instances, proxies, and the project itself [20:41:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Mobile-smoketests/SAL, dummy [20:41:24] !log reading-smoketests deleted all instances, proxies, and the project itself [20:41:24] reading-smoketests is not a valid project. [20:41:36] !log reading-smoketest deleted all instances, proxies, and the project itself [20:41:52] andrewbogott: Tje second spring cleanup? :D [20:41:59] you made a space before the ! [20:42:07] !log reading-smoketest deleted all instances, proxies, and the project itself [20:42:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Reading-smoketest/SAL, dummy [20:42:13] much better, thanks :) [20:42:18] np ;) [20:44:45] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2124342 (10Andrew) [21:05:28] 6Labs, 10Phlogiston: phlogiston-2 hangs every week - https://phabricator.wikimedia.org/T129891#2124407 (10JAufrecht) There is a daily cron job that runs every evening (PT). It doesn't max out RAM or disk; it does run one CPU at 100%. It runs big Postgresql queries, mostly. However, the same arrangement on a... [22:43:09] !log graphite moved http://grafana.wmflabs.org to a web proxy [22:43:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Graphite/SAL, dummy [22:43:26] 6Labs: Enforce true multi-tenancy for labs public DNS - https://phabricator.wikimedia.org/T130032#2124825 (10Andrew) [23:21:10] 6Labs, 10Tool-Labs: Puppet errors on tools-web-static-01 and tools-web-static-02 - https://phabricator.wikimedia.org/T128411#2124933 (10scfc) a:5scfc>3None