[00:04:41] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [00:11:41] 06Labs, 10Labs-Infrastructure, 06Operations, 07Wikimedia-Incident: labservices1001 down, suspected overheating - https://phabricator.wikimedia.org/T152340#2895203 (10Andrew) a:05Andrew>03None [00:12:20] 06Labs, 10Labs-Infrastructure, 07LDAP: Remove shell user "80686" - https://phabricator.wikimedia.org/T63967#2895205 (10Andrew) 05Open>03stalled a:05Andrew>03None [00:57:46] 10Labs-project-Wikistats: automatic import of new miraheze wikis - https://phabricator.wikimedia.org/T153930#2895310 (10Dzahn) [00:57:58] 10Labs-project-Wikistats: automatic import of new miraheze wikis - https://phabricator.wikimedia.org/T153930#2895322 (10Dzahn) p:05Triage>03Normal [00:58:06] 10Labs-project-Wikistats: automatic import of new miraheze wikis - https://phabricator.wikimedia.org/T153930#2895310 (10Dzahn) a:03Dzahn [01:09:41] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [02:30:05] 10Tool-Labs-tools-Other: SVG Translate does not accept HTTPS URLs - https://phabricator.wikimedia.org/T125743#2895396 (10Glrx) The bug report is about entering a filename during the first step/page of SVGTranslate. I can enter "File:Butterworth filter bode plot.svg" and make it to the second page that offers fo... [02:35:41] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [03:11:48] (03PS1) 10Legoktm: grrrrit: Fully ignore L10n-bot [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328616 [03:11:59] (03CR) 10Legoktm: [C: 032] grrrrit: Fully ignore L10n-bot [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328616 (owner: 10Legoktm) [03:13:16] (03Merged) 10jenkins-bot: grrrrit: Fully ignore L10n-bot [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328616 (owner: 10Legoktm) [03:28:21] * Yvette peeks at striker. [03:28:30] Does it require a token? I still can't get into horizon. [03:29:19] Meh. [03:40:43] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:06:42] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [04:59:56] 10Striker: Allow changing LDAP password from Striker - https://phabricator.wikimedia.org/T153935#2895457 (10bd808) [05:00:54] (03PS1) 10BryanDavis: Cleanup a few things with account registration form [labs/striker] - 10https://gerrit.wikimedia.org/r/328620 [05:00:56] (03PS1) 10BryanDavis: Remove some vertical whitespace on linked accounts screen [labs/striker] - 10https://gerrit.wikimedia.org/r/328621 [05:00:58] (03PS1) 10BryanDavis: Allow changing LDAP password [labs/striker] - 10https://gerrit.wikimedia.org/r/328622 (https://phabricator.wikimedia.org/T153935) [05:01:55] (03PS2) 10BryanDavis: Allow changing LDAP password [labs/striker] - 10https://gerrit.wikimedia.org/r/328622 (https://phabricator.wikimedia.org/T153935) [05:11:41] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [05:59:10] 06Labs, 10Labs-Infrastructure, 07LDAP: Remove shell user "80686" - https://phabricator.wikimedia.org/T63967#2895516 (10yuvipanda) I think the reason for those debian guidelines is that a lot of tools are going to assume an all numeric username is actually a user id, rather than a username, causing confusion. [06:07:43] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [06:31:45] 06Labs, 10Labs-Infrastructure, 07LDAP: Remove shell user "80686" - https://phabricator.wikimedia.org/T63967#662340 (10bd808) >>! In T63967#1542321, @valhallasw wrote: >>>! In T63967#1542310, @80686 wrote: >> I would be happy if, instead of discussing this for months and locking me out of tools and Git, someo... [06:52:58] PROBLEM - Puppet run on tools-exec-1418 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [07:11:51] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2486960 (10Marostegui) That is a good idea! It would be really useful and easy to use. Apart from setting the right grants, we can also try to set up some sort of chroot or... [07:16:02] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2895567 (10yuvipanda) Yep, it would! Can you explain what you mean by 'fake' mysql server? [07:18:48] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2895568 (10yuvipanda) simple API would be: POST to labsdb-analytics.eqiad.wmnet/v1/analyze (or labsdb-web.eqiad.wmnet/v1/analyze) your SQL query, and it will return ANALYZE... [07:24:35] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2895572 (10Marostegui) >>! In T141095#2895567, @yuvipanda wrote: > Yep, it would! > > Can you explain what you mean by 'fake' mysql server? If we are not completely sure a... [07:27:56] RECOVERY - Puppet run on tools-exec-1418 is OK: OK: Less than 1.00% above the threshold [0.0] [07:54:56] 06Labs, 10Tool-Labs, 10PageImages, 15User-Urbanecm: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2895609 (10Urbanecm) [07:57:53] 06Labs, 10Tool-Labs, 10PageImages, 15User-Urbanecm: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2895612 (10Urbanecm) @Blahma At https://wikitech.wikimedia.org/wiki/Incident_documentation/20161202-20161201-PageImages you can reat incident doc for thi... [08:05:10] 06Labs, 10Labs-Sprint-109: Remove reliance on ldap $::projectid from shinkengen - https://phabricator.wikimedia.org/T108625#1525456 (10scfc) (Assuming this task is really about "Make shinkengen not rely on LDAP":) @AlexMonk-WMF, does the OpenStack API (as it is now exposed) allow to query the Puppet roles for... [09:19:31] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2895694 (10jcrespo) >>! In T141095#2894390, @yuvipanda wrote: > @jcrespo what do you think of a http service that is hosted on hardware somewhere and maintained by the labs... [09:21:08] (03PS1) 10Alexandros Kosiaris: Add k8s_infrastructure_users [labs/private] - 10https://gerrit.wikimedia.org/r/328642 [09:23:00] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2895695 (10jcrespo) > If we are not completely sure about grants and possible SQL injection, we can always generate fake data to populate the tables, Unless you plan to cr... [09:23:11] (03CR) 10Alexandros Kosiaris: [V: 032 C: 032] Add k8s_infrastructure_users [labs/private] - 10https://gerrit.wikimedia.org/r/328642 (owner: 10Alexandros Kosiaris) [09:31:01] 06Labs, 10Labs-Sprint-109: Remove reliance on ldap $::projectid from shinkengen - https://phabricator.wikimedia.org/T108625#2895708 (10AlexMonk-WMF) I'm doing it in https://gerrit.wikimedia.org/r/#/c/328611/ - the roles thing is not exactly an OpenStack API, but it is an API that lets you query puppet roles fo... [09:37:50] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2895714 (10yuvipanda) @jynus ah, I didn't know that (re: subqueries). TIL. I think in that case we should do the same service but with a SHOW EXPLAIN. API can remain the sa... [09:40:41] 06Labs, 10Labs-Infrastructure, 10DBA: Explore 'Analyze' statement as substitute for Explain - https://phabricator.wikimedia.org/T141095#2895716 (10jcrespo) >>! In T141095#2895714, @yuvipanda wrote: > @jynus ah, I didn't know that (re: subqueries). TIL. > > I think in that case we should do the same service... [11:26:16] 06Labs, 10Labs-Kubernetes, 10Tool-Labs, 10Prod-Kubernetes, 07kubernetes: Kubernetes discussion at Dev Summit - https://phabricator.wikimedia.org/T153943#2895796 (10yuvipanda) [12:10:16] !log video depooling v2c workers at encoding02 and encoding03 in order to make transcoding slower and have production videoscalers catch up (T153488) [12:10:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL [12:10:19] T153488: Commons video transcoders have over 6500 tasks in the backlog. - https://phabricator.wikimedia.org/T153488 [12:35:19] 06Labs, 10Labs-Sprint-109: Remove reliance on ldap $::projectid from shinkengen - https://phabricator.wikimedia.org/T108625#2896018 (10scfc) Ha! I'm not watching changes to the `shinken` module, so I hadn't noticed `get_instance_roles()` before (and all the other stuff you did there). So: Thanks! :-) [13:21:37] (03Draft1) 10Paladox: Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 [13:21:39] (03Draft2) 10Paladox: Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 [13:21:57] (03CR) 10jerkins-bot: [V: 04-1] Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 (owner: 10Paladox) [13:28:20] (03PS3) 10Paladox: Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 [13:28:42] (03CR) 10jerkins-bot: [V: 04-1] Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 (owner: 10Paladox) [13:28:49] (03PS4) 10Paladox: Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 [13:31:51] 10Wikibugs: Update irc3 to 0.9.7 - https://phabricator.wikimedia.org/T153947#2896079 (10Paladox) [13:33:16] (03PS5) 10Paladox: Connect wikibugs to irc over ssl [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/328663 (https://phabricator.wikimedia.org/T141089) [14:07:42] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [14:38:41] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [15:43:40] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [16:28:00] (03Abandoned) 10MarcoAurelio: Resurrecting old IRC watchbot project [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/326356 (owner: 10MarcoAurelio) [16:57:48] 10Tool-Labs-tools-Other: Requests originating from "status" tool - https://phabricator.wikimedia.org/T153955#2896411 (10Nemo_bis) [17:12:32] 06Labs, 10Labs-Sprint-109: Remove reliance on ldap $::projectid from shinkengen - https://phabricator.wikimedia.org/T108625#2896446 (10AlexMonk-WMF) a:03AlexMonk-WMF I think this was done by my previous puppet patch (https://gerrit.wikimedia.org/r/#/c/309008/). I think we should re-purpose it as 'remove reli... [17:14:15] 06Labs, 10Labs-Infrastructure, 10labs-sprint-117: switch to keystone api v3 - https://phabricator.wikimedia.org/T115027#1712853 (10AlexMonk-WMF) We have the v3 API enabled and have done for a while now. Do we need to move everything to using it, or is this done? [17:15:10] 06Labs, 10Labs-Infrastructure, 10labs-sprint-117: Support a multi-domain model in keystone - https://phabricator.wikimedia.org/T115026#2896451 (10AlexMonk-WMF) can we have more details for this please? [17:58:17] (03CR) 10BryanDavis: [C: 032] Bump static, striker, and wheels submodules [labs/striker/deploy] - 10https://gerrit.wikimedia.org/r/325814 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [17:58:22] (03Merged) 10jenkins-bot: Bump static, striker, and wheels submodules [labs/striker/deploy] - 10https://gerrit.wikimedia.org/r/325814 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [18:22:52] 06Labs, 10Tool-Labs, 10PageImages, 06Reading-Web-Backlog, and 2 others: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2896657 (10phuedx) @bmansurov, @Jdlrobson: Can you speak to why this query might not return all the rows that it should? IIRC there's... [18:22:56] (03PS1) 10BryanDavis: Update for SSH key management and password change [labs/striker/staticfiles] - 10https://gerrit.wikimedia.org/r/328701 [18:31:20] (03PS2) 10BryanDavis: Update for SSH key management and password change [labs/striker/staticfiles] - 10https://gerrit.wikimedia.org/r/328701 [18:31:22] (03PS1) 10BryanDavis: Pretty print staticfiles.json [labs/striker/staticfiles] - 10https://gerrit.wikimedia.org/r/328702 [18:31:54] (03CR) 10BryanDavis: [C: 032] Pretty print staticfiles.json [labs/striker/staticfiles] - 10https://gerrit.wikimedia.org/r/328702 (owner: 10BryanDavis) [18:32:00] (03Merged) 10jenkins-bot: Pretty print staticfiles.json [labs/striker/staticfiles] - 10https://gerrit.wikimedia.org/r/328702 (owner: 10BryanDavis) [18:42:20] 06Labs, 10Tool-Labs: apache::static_site should provide a way to work without SSL or with automatically created self-signed certificates - https://phabricator.wikimedia.org/T153818#2892029 (10Krenair) I think we could actually make this slightly more generic than just labs. The same would apply within producti... [18:44:17] 06Labs, 10Labs-Infrastructure, 06Community-Tech-Tool-Labs: invisible-unicorn (dynamicproxy) should provide an easy way to see where a host routes without knowing the project - https://phabricator.wikimedia.org/T115752#2896759 (10Krenair) To get it via the dynamicproxy-api HTTP API it would be. [18:47:55] (03PS1) 10BryanDavis: Add wheels for sshpubkeys; upgrade cryptography [labs/striker/wheels] - 10https://gerrit.wikimedia.org/r/328711 (https://phabricator.wikimedia.org/T144711) [18:59:39] (03PS1) 10BryanDavis: Bump wheels submodule for SSH public key management [labs/striker/deploy] - 10https://gerrit.wikimedia.org/r/328715 (https://phabricator.wikimedia.org/T144711) [19:07:01] Yvette: could you log a ticket then re: horizon if that same pass+2factor token works for wikitech? [19:09:44] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [19:09:50] 10Tool-Labs-tools-Other: Requests originating from "status" tool - https://phabricator.wikimedia.org/T153955#2896845 (10abian) This tool, really simple, makes 4 requests per hour and per (sub)domain. Its main feature is sending an email when a site is down, but there isn't any defined email address for wikimedia... [19:16:08] 10Tool-Labs-tools-Wikidata-Periodic-Table, 10Wikidata: Create a WDQS-based ElementProvider - https://phabricator.wikimedia.org/T122706#2896868 (10Ricordisamoa) [19:16:13] 06Labs, 06Discovery, 10Wikidata, 10Wikidata-Query-Service: Sunset of WDQ - https://phabricator.wikimedia.org/T153439#2896867 (10Ricordisamoa) [20:04:33] anyone know the magic kubectl command to kill a pod that webservice has lost track of? [20:06:10] 10Tool-Labs-tools-Other: Requests originating from "status" tool - https://phabricator.wikimedia.org/T153955#2896992 (10Nemo_bis) I gave 3 other options, but if you can't consider any of them please remove wikimedia.it from the tool. Thanks. [20:06:47] It's apparently: kubectl delete pod [20:06:55] too bad that didn't fix my problem :/ [20:10:41] bd808: what's the deal? [20:10:59] !log tools.bash Service was down, `webservice status` said not running, `kubectl get pods` disagreed [20:11:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bash/SAL [20:11:09] chasemp: sorted I guess [20:11:25] some bug in webservice status? [20:11:53] !log tools.bash Killed running pod with `kubectl delete pod bash-1448508424-kd6kx` and then followed up with `webservice --backend=kubernetes start` [20:11:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bash/SAL [20:12:16] maybe? the pod had been up for 33 days [20:12:27] webservice didn't see it, and the proxy thought it was down [20:12:37] but the pod was running fine [20:12:55] I killed the pod manually and it was respawed [20:13:18] the proxy still didn't see it, but that was fixed by running webservice start again [20:13:49] some of that makes sense :) [20:14:01] not your telling but the circumstance and outcomes [20:14:37] 2 different bugs: proxy not having the backend port registered, and webservice not seeing the deployment [20:14:41] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [20:14:52] likely yep [20:15:01] I would guess both were due to various restarts [20:15:59] the webservice part is partially explained by `kubectl get deployment` returning nothing [20:16:22] do k8s iteself had lost track of the deployment even though the pod was still active [21:32:30] 06Labs, 10Tool-Labs, 10PageImages, 06Reading-Web-Backlog, and 2 others: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2897271 (10Blahma) At this moment, the query returns 4 rows. Still yesterday, that was 5. A script or something must be working in th... [21:55:07] 06Labs, 10Tool-Labs, 10PageImages, 06Reading-Web-Backlog, and 2 others: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2894171 (10jcrespo) I do not know much about the whole incident, but maybe `page_image_free` will work instead of page_image? At leas... [22:05:41] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [22:12:03] 06Labs, 10Tool-Labs, 10PageImages, 06Reading-Web-Backlog, and 2 others: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2897343 (10Blahma) @jcrespo: Thank you for your hint. This is indeed the workaround that I have been using since yesterday. Is this a... [22:19:24] 10Tool-Labs-tools-Other: Requests originating from "status" tool - https://phabricator.wikimedia.org/T153955#2897347 (10abian) If we reduced frequency, this tool would be almost useless since it wouldn't detect short breaks and, in general, it wouldn't detect long breaks before the responsible detected them by h... [22:26:58] (03PS1) 10BryanDavis: Point SSH key goal at local key management screen [labs/striker] - 10https://gerrit.wikimedia.org/r/328841 (https://phabricator.wikimedia.org/T144711) [22:28:54] 06Labs, 10Tool-Labs, 10PageImages, 06Reading-Web-Backlog, and 2 others: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2897362 (10bmansurov) @Blahma, yes from now on there will be two page properties. If 'page_image_free' exist, but 'page_image' doesn'... [22:30:26] 06Labs, 10Tool-Labs, 10PageImages, 06Reading-Web-Backlog, and 2 others: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2897370 (10jcrespo) @Blahma Sadly, I can help you with the database itself, as I know no more about its contents than you probably do... [22:38:15] 06Labs, 10Tool-Labs: apache::static_site should provide a way to work without SSL or with automatically created self-signed certificates - https://phabricator.wikimedia.org/T153818#2897387 (10scfc) @Krenair: Do you have a pointer to `operations/puppet` where this has been done? [22:41:18] Lots of fun python/django code for folks to review -- https://gerrit.wikimedia.org/r/#/q/status:open+project:labs/striker [22:42:18] All of them are running on the Striker demo server -- https://striker.wmflabs.org/ [22:54:09] 10Tool-Labs-tools-Other: SVG Translate does not accept HTTPS URLs - https://phabricator.wikimedia.org/T125743#2897447 (10Glrx) Looking at https://github.com/Jarry1250/labs-svgtranslate/blob/master/svgtranslate.php Line numbers appear off by one. 542: $imagedata = $image->imageinfo( 999 ); apparently builds a... [23:02:32] (03CR) 10MusikAnimal: [C: 032] Remove some vertical whitespace on linked accounts screen [labs/striker] - 10https://gerrit.wikimedia.org/r/328621 (owner: 10BryanDavis) [23:10:41] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [23:17:34] 06Labs, 10Tool-Labs: apache::static_site should provide a way to work without SSL or with automatically created self-signed certificates - https://phabricator.wikimedia.org/T153818#2897478 (10Krenair) yeah, `modules/role/manifests/mediawiki/webserver.pp`, at the bottom [23:27:51] 06Labs, 10Tool-Labs, 10PageImages, 06Reading-Web-Backlog, and 2 others: Data disappeared from labs replica in cswiki_p.page_props - https://phabricator.wikimedia.org/T153888#2897492 (10Blahma) Thank you @bmansurov for explanation of the goal of the recent change and @jcrespo for expanding on it and pointin... [23:30:45] 10Tool-Labs-tools-Pageviews: Get unique count of editors when mutiple pages are provided - https://phabricator.wikimedia.org/T151605#2897494 (10MusikAnimal) p:05Triage>03High [23:36:43] 06Labs, 10Labs-Infrastructure, 07Regression: [Regression] Many url values have a malformed subdomain in wiki meta_p database table - https://phabricator.wikimedia.org/T153987#2897510 (10Krinkle) [23:36:49] 06Labs, 10Labs-Infrastructure, 07Regression: [Regression] Many url values have a malformed subdomain in wiki meta_p database table - https://phabricator.wikimedia.org/T153987#2897524 (10Krinkle) p:05Triage>03Unbreak! [23:38:56] 06Labs, 10Labs-Infrastructure, 07Regression: [Regression] Many url values have a malformed subdomain in wiki meta_p database table - https://phabricator.wikimedia.org/T153987#2897544 (10Krinkle) [23:39:55] Krenair: jynus: ^ [23:40:34] thanks, looking [23:41:00] no need to bug j.ynus about it yet, usually the labs team handles this level of issues [23:42:07] Krenair, yeah. now there's a "lang = db[:2]" line in it [23:42:14] see, now I'm doing it to myself. Krinkle ^ [23:42:24] lol [23:42:45] Krenair: Yeah, I pinged him since he recently added two rows I believe. [23:43:02] I think me and Chase did a lot more to it than that [23:43:05] Figured maybe may be aware of it having been repopulated it [23:43:10] yep [23:43:17] lang as [:2] doesn't seem too bad [23:43:21] they got repopulated using new code [23:43:22] but not for url [23:43:33] But yeah, even then, it's wrong. [23:44:12] it's just as bad [23:45:28] 06Labs, 10Labs-Infrastructure, 07Regression: [Regression] Many url values have a malformed subdomain in wiki meta_p database table - https://phabricator.wikimedia.org/T153987#2897561 (10Krinkle) This also affects GUC, as it may now produce a "diff" urls to a revision that doesn't exist on the target domain (... [23:46:45] Looks like it was https://gerrit.wikimedia.org/r/#/c/325949/7/modules/role/files/labs/db/views/maintain-meta_p.py [23:47:00] 06Labs, 10Tool-Labs: Add script_path to meta_p.wiki database - https://phabricator.wikimedia.org/T93483#2897563 (10Krinkle) I'd support addition of api_url instead of script_path. Adding script_path would make it slightly less hardcoded, but still somewhat fragile. All other information can be queried by tools... [23:47:30] which, of course [23:47:32] was self-merged [23:47:33] brilliant [23:49:23] 06Labs, 10Labs-Infrastructure, 07Regression: [Regression] Many url values have a malformed subdomain in wiki meta_p database table - https://phabricator.wikimedia.org/T153987#2897567 (10AlexMonk-WMF) This would be due to https://gerrit.wikimedia.org/r/#/c/325949/7/modules/role/files/labs/db/views/maintain-me... [23:52:00] 06Labs, 10Tool-Labs: Add api_url to meta_p.wiki database - https://phabricator.wikimedia.org/T93483#2897573 (10Krinkle) [23:52:25] Krenair: No unit tests? [23:56:42] Krenair: Hm.. yeah, seeing the updated version of the script does make it look a lot cleaner and also more obvious that is should probably just be a JSON endpoint hosted on noc.wikimedia.org [23:57:55] in retrospect that'd be much easier to maintain [23:58:22] * Krinkle goes to create a prototype [23:58:22] though I wish it didn't have to be [23:58:51] I said a new extension on meta that is just a wrapper of mediawiki-config [23:59:07] with a single api call [23:59:23] might as well extend sitematrix a bit [23:59:34] sitematrix is totally unsuited for this imho [23:59:39] It's model cannot deal with any of this [23:59:45] and we probably dont' want to put slice in there [23:59:51] and has_visualeditor