[00:31:08] Hi, I'm trying to make a webpage for my tool according to https://wikitech.wikimedia.org/wiki/Help:Tool_Labs#Creating_a_tool_web_page. I don't have a ~/public_html folder for my tool. Do I need to create one? [00:36:36] I tried it out and it worked after I created the folder and started the webservice. [01:04:55] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Optimize edit count queries in XTools - https://phabricator.wikimedia.org/T163284#3192230 (10Samwilson) a:03Samwilson [09:26:12] Is anyone around that can add a user to the labs bastion project? [09:26:20] apparently during their account and project creation this never happened [09:32:50] 06Labs: Add "GoranSMilovanovic" to labs "bastion" project - https://phabricator.wikimedia.org/T165294#3262170 (10Addshore) [09:32:52] ^^ [09:33:03] 06Labs: Add "GoranSMilovanovic" to labs "bastion" project - https://phabricator.wikimedia.org/T165294#3262182 (10Addshore) p:05Triage>03High [10:11:42] (03PS1) 10Lokal Profil: minor indentation fix [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/353847 [10:45:03] (03CR) 10Jean-Frédéric: [C: 032] minor indentation fix [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/353847 (owner: 10Lokal Profil) [10:46:08] (03Merged) 10jenkins-bot: minor indentation fix [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/353847 (owner: 10Lokal Profil) [10:47:06] (03CR) 10jenkins-bot: minor indentation fix [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/353847 (owner: 10Lokal Profil) [12:33:21] Hi everyone, I discovered a bunch of two-years-ago-deleted eswiki pages that still appear in Labs page table... I guess it maybe a Labs problem because those pages don't appear in the page-titles dump, for example [12:33:51] jynus: Si estás por ahí, quizás tú puedas orientarme (me dijeron que preguntara a los DBA) [13:11:51] jem, tell me the names [13:12:00] or file a ticket on [13:14:08] leave a comment here: https://phabricator.wikimedia.org/T138967 [13:20:15] Ok, jynus [13:20:51] I got six of them by a trial-and-error query, but I don't know if there could be more [13:22:18] (That's what worries me the most) :) [13:23:17] the current labs hosts are EOL, we are preparing new hosts and reloading all content from 0 [13:25:20] Good [13:25:52] I explain the resons at: https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Database/Replica_drift [13:27:37] 06Labs, 10DBA: Labs database replica drift - https://phabricator.wikimedia.org/T138967#2415416 (10-jem-) I have found six eswiki deleted articles which still appear in the page table in Labs, located by using this trial-and-error query after one of them was detected in my Labs tool: ``` MariaDB [eswiki_p]> se... [13:29:10] jynus: couldnt the issue just described be resolved by just querying direct to prod db? [13:29:18] or is that not possible [13:29:26] no, it isn't [13:29:40] as in, yes, I can check and compare this spefic issue [13:29:46] but it will happen agaion [13:30:14] I see, [13:30:23] for the reasons I wrote on that article [13:30:35] {{Done}}, jynus, and I'll pass that link to the eswiki discussion [13:30:43] yes, jem, thanks [13:30:57] any isolated error can be fixed quickly [13:31:00] the problem is the model [13:31:17] for enwiki, s3 and commons [13:31:28] the new servers can be already tested [13:31:38] but not all wikis have been reimported yet [13:34:23] Ok [13:35:11] jynus: do i just query like normal to test new servers or do i need to query special params, and is s1 there [13:35:44] for the new servers [13:35:48] there are 2 provision urls [13:35:49] yes [13:36:03] (ok for testing, but eventually you should do nothing) [13:36:10] those are, IIRC [13:36:26] labsdb-web.eqiad.wmnet [13:36:36] and labsdb-analytics.eqiad.wmnet [13:36:49] same user and password than the current hosts [13:36:56] we are not publisizing them yet [13:37:03] because not all wikis are available yet [13:37:14] when we finish, we will ask for beta testers [13:37:20] ldap login right? [13:37:23] no [13:37:40] your .replica my.conf [13:37:53] the one for your tool [13:38:12] oh yeah derp... (im losing my mind) [13:38:37] there is many things new- new version, etc. [13:38:49] so we do not "support" those new servers yet [13:38:59] do you know s1 is imported? [13:39:14] yes, s1, s3 (that is 800 wikis) and s4 [13:39:18] s5 is next [13:39:30] and then s2, s6 and s7 [13:39:38] okay [13:39:49] so there are only around 20 wikis missing, but those are quite big [13:39:58] test if they work for you [13:40:54] and you can follow the progress here: https://phabricator.wikimedia.org/T153743 [13:41:26] but again, in the future those provisional urls may fail, etc. it is not considered a stable service yet [13:41:55] jynus: i dont plan on using them for anything important just to test to see the data reliablity and such [13:42:01] that is coold [13:42:09] that is exactly the point at this moment [13:42:22] and see how long it takes for me to break them xD just kidding [13:44:01] jem, I think that is a labsdb1003-only issue [13:44:40] I will fix in a few minutes, but you can always compare c1 and c3 if you get bad results [14:02:40] 06Labs, 10DBA: Labs database replica drift - https://phabricator.wikimedia.org/T138967#3263120 (10jcrespo) Fixed: ``` root@labsdb1003[eswiki_p]> select page_title from page where page_is_new = 1 and page_touched like '2015061%' and page_namespace = 0 and page_is_redirect = 0 and page_touched = page_links_updat... [14:22:24] 06Labs, 10Tool-Labs: Broken unicode characters / invalid UTF-8 on Tool Labs index - https://phabricator.wikimedia.org/T164971#3263170 (10jcrespo) The only thing that changed "last month or two" was the upgrade to 5.5 to MariaDB 10 (T157358). Some defaults changed there, but it is normally the responsibility of... [14:39:14] 06Labs: Request creation of labs project (to bridge IRC channels and Telegram groups) - https://phabricator.wikimedia.org/T164910#3250741 (10bd808) This sounds like the sort of bot that is generally a good fit for Tool Labs hosting. Today the best node.js support is offered by the Tool Labs Kubernetes... [14:41:30] 06Labs: Add "GoranSMilovanovic" to labs "bastion" project - https://phabricator.wikimedia.org/T165294#3262170 (10bd808) I checked https://tools.wmflabs.org/openstack-browser/user/goransm and indeed the user is showing as a member of the tools and wikidataconcepts projects but not the bastion project. Membership... [14:43:11] 06Labs, 10Tool-Labs: Broken unicode characters / invalid UTF-8 on Tool Labs index - https://phabricator.wikimedia.org/T164971#3263256 (10jcrespo) This comment kind of summarizes the whole thing- and it is probably very relevant as I will assume this is PHP: T122148#1898323 [14:50:34] 10Tool-Labs-tools-Attribution-Generator, 06TCB-Team, 15User-Tobi_WMDE_SW: Add additional Text to the PD-Images hint - https://phabricator.wikimedia.org/T165332#3263311 (10Tobi_WMDE_SW) [14:51:28] 10Tool-Labs-tools-Attribution-Generator, 06TCB-Team, 15User-Tobi_WMDE_SW: Add additional Text to the PD-Images hint - https://phabricator.wikimedia.org/T165332#3263326 (10Tobi_WMDE_SW) p:05Triage>03High [14:51:39] 06Labs, 10Tool-Labs, 15User-bd808: Broken unicode characters / invalid UTF-8 on Tool Labs index - https://phabricator.wikimedia.org/T164971#3263329 (10bd808) p:05Triage>03Normal a:03bd808 @jcrespo I agree that this is the result of sloppy handling of encoding on the part of the applications that read/w... [14:53:07] 06Labs, 10Tool-Labs, 15User-bd808: Broken unicode characters / invalid UTF-8 on Tool Labs index - https://phabricator.wikimedia.org/T164971#3263348 (10jcrespo) I am not asking you to handle it on your own, I can just convert it and we can change the config to use utf8mb4. Should we test on a sample table first? [14:58:10] 10Tool-Labs-tools-Xtools: Table mapping needs to support one to many - https://phabricator.wikimedia.org/T164556#3263365 (10Matthewrbowker) https://github.com/x-tools/xtools-rebirth/pull/32/ [15:03:06] 06Labs, 10Tool-Labs, 15User-bd808: Broken unicode characters / invalid UTF-8 on Tool Labs index - https://phabricator.wikimedia.org/T164971#3263399 (10bd808) >>! In T164971#3263348, @jcrespo wrote: > I am not asking you to handle it on your own, I can just convert it and we can change the config to use utf8m... [15:03:42] 06Labs, 10Tool-Labs, 15User-bd808: Broken unicode characters / invalid UTF-8 on Tool Labs index - https://phabricator.wikimedia.org/T164971#3263401 (10jcrespo) :-) [15:07:25] 06Labs: Add "GoranSMilovanovic" to labs "bastion" project - https://phabricator.wikimedia.org/T165294#3262170 (10Andrew) This ought to happen via $wgHooks['UserAddGroup'][] = 'OpenStackNovaUser::addUserToBastionProject'; Do we have anything resembling a specific date/time that the initial account creation happ... [15:07:46] 06Labs, 10MediaWiki-extensions-OpenStackManager: Add "GoranSMilovanovic" to labs "bastion" project - https://phabricator.wikimedia.org/T165294#3263447 (10bd808) I manually added GoranSMilovanovic to the bastion project to unblock this user. I'd like to leave this bug open until we can do some digging to see if... [15:08:32] 06Labs: Add new users to 'bastion' project via a Keystone hook - https://phabricator.wikimedia.org/T165337#3263453 (10Andrew) [15:09:49] 06Labs, 10MediaWiki-extensions-OpenStackManager: Add "GoranSMilovanovic" to labs "bastion" project - https://phabricator.wikimedia.org/T165294#3263485 (10bd808) >>! In T165294#3263445, @Andrew wrote: > This ought to happen via > > $wgHooks['UserAddGroup'][] = 'OpenStackNovaUser::addUserToBastionProject'; > >... [15:16:49] 06Labs, 10MediaWiki-extensions-OpenStackManager: Add "GoranSMilovanovic" to labs "bastion" project - https://phabricator.wikimedia.org/T165294#3263568 (10bd808) The user GoranSMilovanovic has never logged in via #striker, so that project isn't involved. [15:22:15] 06Labs: Add new users to 'bastion' project via a Keystone hook - https://phabricator.wikimedia.org/T165337#3263601 (10bd808) We probably don't want to add them to bastion on account creation. I think the equivalent of the OSM logic would be to check for bastion membership when changing project roles and grant th... [15:27:14] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10Striker: Reconsider WMCS user creation workflow w/out OSM - https://phabricator.wikimedia.org/T165343#3263642 (10Andrew) [15:27:28] 06Labs: Add new users to 'bastion' project via a Keystone hook - https://phabricator.wikimedia.org/T165337#3263656 (10Andrew) [15:27:30] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10Striker: Reconsider WMCS user creation workflow w/out OSM - https://phabricator.wikimedia.org/T165343#3263655 (10Andrew) [16:04:05] 06Labs: Request creation of labs project (to bridge IRC channels and Telegram groups) - https://phabricator.wikimedia.org/T164910#3263774 (10Acagastya) @bd808 I am already running the teleirc bot based on node.js locally on my machine. [16:46:10] It's fixed now, jynus, thanks [19:07:35] (03PS1) 10BryanDavis: Make django's makemigrations happy [labs/striker] - 10https://gerrit.wikimedia.org/r/353908 [19:07:38] (03PS1) 10BryanDavis: Add toolinfo.json style data [labs/striker] - 10https://gerrit.wikimedia.org/r/353909 (https://phabricator.wikimedia.org/T149458) [19:08:53] (03CR) 10jerkins-bot: [V: 04-1] Add toolinfo.json style data [labs/striker] - 10https://gerrit.wikimedia.org/r/353909 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [19:08:59] (03CR) 10BryanDavis: [C: 04-1] "I'm not quite ready for this to be reviewed seriously, but I wanted to get it in gerrit before traveling with my laptop." [labs/striker] - 10https://gerrit.wikimedia.org/r/353909 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [19:20:33] (03PS2) 10BryanDavis: Make django's makemigrations happy [labs/striker] - 10https://gerrit.wikimedia.org/r/353908 [19:20:35] (03PS2) 10BryanDavis: Add toolinfo.json style data [labs/striker] - 10https://gerrit.wikimedia.org/r/353909 (https://phabricator.wikimedia.org/T149458) [19:20:46] (03CR) 10BryanDavis: [C: 04-2] Add toolinfo.json style data [labs/striker] - 10https://gerrit.wikimedia.org/r/353909 (https://phabricator.wikimedia.org/T149458) (owner: 10BryanDavis) [20:27:59] PROBLEM - Puppet errors on tools-exec-1439 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [21:06:34] 10Tool-Labs-tools-Xtools, 06Community-Tech: Update all of the Xtools with new backend - https://phabricator.wikimedia.org/T165399#3265163 (10DannyH) [21:06:59] 10Tool-Labs-tools-Xtools, 06Community-Tech: Epic: Rewriting XTools - https://phabricator.wikimedia.org/T153112#3265179 (10DannyH) [21:07:01] 10Tool-Labs-tools-Xtools, 06Community-Tech: Update all of the Xtools with new backend - https://phabricator.wikimedia.org/T165399#3265178 (10DannyH) [21:08:00] RECOVERY - Puppet errors on tools-exec-1439 is OK: OK: Less than 1.00% above the threshold [0.0] [21:08:32] 10Tool-Labs-tools-Xtools, 06Community-Tech: Write tests for Xtools - https://phabricator.wikimedia.org/T165400#3265180 (10DannyH) [21:09:08] 10Tool-Labs-tools-Xtools, 06Community-Tech: Epic: Rewriting XTools - https://phabricator.wikimedia.org/T153112#3265196 (10DannyH) [21:09:11] 10Tool-Labs-tools-Xtools, 06Community-Tech: Write tests for Xtools - https://phabricator.wikimedia.org/T165400#3265195 (10DannyH) [21:13:29] 10Tool-Labs-tools-Xtools, 06Community-Tech: Investigation: Add OAUTH for Xtools - https://phabricator.wikimedia.org/T165401#3265226 (10DannyH) [21:20:00] 06Labs, 10Tool-Labs, 07Documentation: Document php override options for lighttpd - https://phabricator.wikimedia.org/T101994#1353224 (10bd808) Probably just need to document the `lighttpd-plain` backend better on https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Web/Lighttpd [21:30:18] 06Labs, 10Tool-Labs, 10Tools-Kubernetes, 07Documentation: Document basics of using a custom Kubernetes "Deployment" to operate a tool - https://phabricator.wikimedia.org/T165403#3265253 (10bd808) [21:30:49] 06Labs: Request creation of labs project (to bridge IRC channels and Telegram groups) - https://phabricator.wikimedia.org/T164910#3265269 (10bd808) >>! In T164910#3263774, @Acagastya wrote: > @bd808 I am already running the teleirc bot based on node.js locally on my machine. That's a great start. The... [21:40:20] 06Labs, 10Tool-Labs, 10Wikimedia-Hackathon-2017: Intro to Cloud Services (Labs, Tool Labs, database replicas, oh my) - https://phabricator.wikimedia.org/T164814#3265280 (10Rfarrand) Hello! Just letting you know that you can schedule this session now for the hackathon. Instructions and scheduling can be done... [21:41:13] 10Tool-Labs-tools-Xtools, 06Community-Tech: Investigation: Revive Article Blamer from Xtools? - https://phabricator.wikimedia.org/T165404#3265289 (10DannyH) [21:41:36] 10Tool-Labs-tools-Xtools, 06Community-Tech: Investigation: Revive Article Blamer from Xtools? - https://phabricator.wikimedia.org/T165404#3265306 (10DannyH) [21:42:31] 10Tool-Labs-tools-Xtools, 06Community-Tech: Epic: Rewriting XTools - https://phabricator.wikimedia.org/T153112#3265317 (10DannyH) [21:55:15] 06Labs, 10Tool-Labs, 10Wikimedia-Hackathon-2017: Intro to Cloud Services (Labs, Tool Labs, database replicas, oh my) - https://phabricator.wikimedia.org/T164814#3265335 (10bd808) [22:15:32] !log wikistats launching new instance wikistats-octopus with experimental stretch image [22:15:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikistats/SAL [23:07:07] 10Tool-Labs-tools-Xtools, 06Community-Tech: Update all of the Xtools with new backend - https://phabricator.wikimedia.org/T165399#3265974 (10DannyH) [23:07:37] 10Tool-Labs-tools-Xtools, 03Community-Tech-Sprint: Rewrite Edit Counter with new backend architecture - https://phabricator.wikimedia.org/T160481#3265975 (10DannyH) [23:47:30] 06Labs, 10Tool-Labs, 10Tools-Kubernetes, 07Documentation: Document basics of using a custom Kubernetes "Deployment" to operate a tool - https://phabricator.wikimedia.org/T165403#3266085 (10bd808) Work in progress at https://wikitech.wikimedia.org/wiki/Help:Tool_Labs/Kubernetes