[05:00:09] bd808: no way i'm looking into it right now...but that NoUsername exception came back within hours without me noticing till now :/ [05:00:11] pywikibot.exceptions.NoUsername: Failed OAuth authentication for wikipedia:en: The authorization headers in your request are not valid: The request came from an invalid IP address. [05:14:14] AmandaNP: check the restrictions of the OAuth app [05:14:50] tgr: like the IPs? ya, already did, it's fine [05:15:28] which application is that? [05:15:59] wait. OAuth app restrictions? [05:16:09] yes [05:16:35] Special:OAuthConsumerRegistration -> manage [05:16:35] are we talking about the page onwiki or is there an aspect of oauth i'm not aware of [05:16:39] oh ok [05:16:54] there is a field called restrictions [05:17:02] or maybe it's just called IP, these days [05:18:23] I don't see a restriction field [05:18:37] but allowed IPs is everything [05:19:23] which app is that? [05:19:51] 4d062016815b03ef6a09dea8e62443a5 [05:25:19] actually I think I just noticed one of the files with the user config reverted back. [05:25:24] * AmandaNP does more testing [05:28:06] AmandaNP: when did you try for the last time? [05:28:42] I think it's working again actually, and it was 4 days ago. I'm just getting some stupid warnings that I think are my fault [05:31:01] ugh [05:31:20] wouldn't it be nice if we logged basic information like the consumer key for errors [05:31:35] well, as long as it's working again [06:34:47] PROBLEM - Puppet run on tools-bastion-05 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [06:59:18] PROBLEM - Puppet run on tools-webgrid-lighttpd-1413 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [07:14:49] RECOVERY - Puppet run on tools-bastion-05 is OK: OK: Less than 1.00% above the threshold [0.0] [07:19:26] 06Labs, 10MediaWiki-extensions-Linter: Make "linter" table available on Labs - https://phabricator.wikimedia.org/T160611#3105094 (10Legoktm) [07:39:18] RECOVERY - Puppet run on tools-webgrid-lighttpd-1413 is OK: OK: Less than 1.00% above the threshold [0.0] [10:33:14] 06Labs, 10Analytics, 10DBA: Discuss labsdb visibility of rev_text_id and ar_comment - https://phabricator.wikimedia.org/T158166#3105483 (10ArielGlenn) After my initial ping, I dropped this ball. Picking it back up again. [11:28:21] 06Labs, 10Huggle: Labs instance huggle.huggle.wmflabs needs to be replaced or deleted - https://phabricator.wikimedia.org/T157710#3105628 (10Petrb) Amazing job Andrew, it seems that it works just fine, XmlRcs was restarted and it works. Now the question is what we do about postgre database instance, unlike Xm... [11:29:22] 06Labs, 10Huggle: Labs instance huggle.huggle.wmflabs needs to be replaced or deleted - https://phabricator.wikimedia.org/T157710#3105630 (10Petrb) That is 6AM - 8PM EDT [13:11:43] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Lolnewyear2017 was created, changed by Lolnewyear2017 link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Lolnewyear2017 edit summary: Created page with "{{Tools Access Request |Justification=LOL |Completed=false |User Name=Lolnewyear2017 }}" [14:12:40] 06Labs, 10Huggle: Labs instance huggle.huggle.wmflabs needs to be replaced or deleted - https://phabricator.wikimedia.org/T157710#3106063 (10Andrew) @Petrb, I'm online now (which is, I believe, 10AM EDT) and will be for six hours at least. I should be available tomorrow during at least the same window. [14:36:28] !log testlabs removing 'novaadmin' from project-testlabs to confirm that it's not needed [14:36:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Testlabs/SAL [15:22:35] 10Tool-Labs-tools-Xtools, 06Community-Tech: [Epic] Rewrite XTools: Top edits - https://phabricator.wikimedia.org/T160137#3106386 (10Stevietheman) If I have a suggestion for improvement, should I open a separate phab ticket? I would like to see a "Top edited pages" list that shows the top 100 pages from all na... [15:41:40] 06Labs, 10Tool-Labs, 10Prod-Kubernetes, 10Tools-Kubernetes, 07kubernetes: Kubernetes discussion at Dev Summit - https://phabricator.wikimedia.org/T153943#3106480 (10akosiaris) Should I assume ? resolve as invalid ? [15:45:16] 06Labs, 10Tool-Labs, 10Prod-Kubernetes, 10Tools-Kubernetes, 07kubernetes: Kubernetes discussion at Dev Summit - https://phabricator.wikimedia.org/T153943#2895796 (10bd808) I think a lot of this has been worked on by @akosiaris and @yuvipanda in the last few months, but as far as I know item 1 (Documentat... [15:50:30] 06Labs, 10Graphite, 06Operations, 13Patch-For-Review: Move labs 'instances' data to graphite labs - https://phabricator.wikimedia.org/T143405#3106507 (10fgiunchedi) p:05Normal>03High a:05fgiunchedi>03None I can't work on this now, though `instances` is taking 165G on production graphite now. It'd b... [15:50:43] 06Labs, 10Graphite, 06Operations, 13Patch-For-Review, 15User-fgiunchedi: Move labs 'instances' data to graphite labs - https://phabricator.wikimedia.org/T143405#3106511 (10fgiunchedi) [15:51:35] petan: I'll be around for much the day today, if you happen by. [16:09:13] 06Labs, 10Tool-Labs, 10Prod-Kubernetes, 10Tools-Kubernetes, 07kubernetes: Kubernetes discussion at Dev Summit - https://phabricator.wikimedia.org/T153943#3106600 (10akosiaris) Ah yes, that wikitech documentation part is mine. It is relatively trivial but it does have some extra requirements so it makes s... [16:25:36] 10Tool-Labs-tools-Pageviews: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#3106745 (10Nuria) [16:26:51] 10Tool-Labs-tools-Pageviews: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#2749796 (10Nuria) We will be modifying pageviews.js https://www.npmjs.com/package/pageviews to add ability to query new AQS endpoint. [16:27:59] 06Labs, 10Tool-Labs: exim breaks if current directory doesn't exist - https://phabricator.wikimedia.org/T160654#3106750 (10Dispenser) [16:28:32] 10Tool-Labs-tools-Pageviews: Add ability to query new AQS endpoint to pageviews.js - https://phabricator.wikimedia.org/T160655#3106764 (10Nuria) [16:29:10] 10Tool-Labs-tools-Pageviews: Add ability to query new AQS endpoint to node pageview API client - https://phabricator.wikimedia.org/T160655#3106764 (10Nuria) [16:29:18] !log tools.stewardbots test [16:29:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [16:29:55] 10Tool-Labs-tools-Pageviews: Add ability to query for legacy pageviews for projects - https://phabricator.wikimedia.org/T149358#2749796 (10Nuria) [16:31:26] !log tools.stewardbots Updated list of managers [16:31:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [16:31:56] !log tools.stewardbots Fixed log parser in master [16:31:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL [16:47:26] 06Labs, 10Tool-Labs, 07Upstream: exim breaks if current directory doesn't exist - https://phabricator.wikimedia.org/T160654#3106836 (10zhuyifei1999) You might want to report this to upstream at https://bugs.exim.org/. I don't think labs can do anything about this, unless upstream fix this, or someone here fi... [16:59:07] SMalyshev: I accidentally recreated your openssl provisioning failure. Now to see if I can fix it (T160660) [16:59:07] T160660: apt-get failures related to openssl - https://phabricator.wikimedia.org/T160660 [16:59:41] bd808: great :) for me just doing apt-get install openssl cured it iirc [17:00:03] bd808: and yes, it looks exactly like what I saw, so it is indeed the same problem [17:00:51] it *probably* doesn't depend on roles too much as the chain starts with postfix which is not linked to any package afaik [17:01:15] chasemp, yuvipanda: would one of you be able to help me out with k8s auth questions at some point today? i'm making some good progress on the cluster setup but need some clarity about user/service accounts and the best way to provision them [17:02:57] i can also just ping you in the tasks if that works better for you [17:04:10] marxarelli: phab pings probably won't hurt. I think c.hase is eating and I haven't seen y.uvi yet today [17:04:23] bd808: rgr that. thanks [17:23:29] 06Labs, 10Tool-Labs, 07Upstream: exim breaks if current directory doesn't exist - https://phabricator.wikimedia.org/T160654#3107041 (10Dispenser) [[https://bugs.exim.org/show_bug.cgi?id=2078|Reported upstream]] [17:34:19] marxarelli: I understand most of our service account scheme, but some of it is yuvi custom and I have questions myself. Want to do a meeting next week early w/ us to talk it over? [17:35:21] chasemp: that would be great, yeah. do you have one planned already or should i suggest a time? [17:35:31] Hi [17:35:35] o/ [17:35:52] Meeting sounds great :) [17:36:14] yuvipanda: cool, let's shoot for early wed? [17:36:19] more like 10 am your time [17:36:27] (am also working on more unification patches between prod and tools k8s) [17:36:33] chasemp cool! Wfm [17:36:40] wfm, too [17:37:35] I'll shoot an invite [17:39:32] rad. thanks, chasemp [17:40:09] marxarelli: want to come up with a list of use cases and/or questions before hand and we can combine into an etherpad so we have at least a flimsy agenda? [17:40:24] step 1 walk through current, step 2 address outstanding questions, step 3 talk gongi forward [17:43:06] chasemp: sure thing. our ci/cd setup is going to involve more than just k8s but we can outline a naive and flimsy idea of how we see the whole system interoperating/integrating with k8s [17:43:54] strawman for convo works, as long as the user story (yeah I said it!) for authorization and authentication is fleshed out [17:44:04] bingo! [17:44:17] buzzword bingo that is. :P [17:44:52] * chasemp bathes in synergy [17:46:43] you should start wearing black turtlenecks, the monks robes of corporate synergeans [17:47:01] ahem I think you mean /tactical/ turtlenecks [17:47:37] whoa. i stand corrected. you are clearly more advanced than i could understand [17:48:35] thcipriani: ^ (user story/straw man/meeting) [17:48:43] I once made a gant chart that doubled as sheet music for the imperial march so yeah [17:49:10] tell me you made it in Mario Paint [17:49:16] *gantt [17:49:17] marxarelli: I'll add tyler but I think 3-4 is max for like a real convo [17:49:17] on snes [17:49:19] Or gnnat [17:49:24] Or gnaat [17:49:24] gnu-att [17:49:29] Two of a char there I'm sure [17:49:39] GNU/ATT [17:50:20] I always pronounce it GAH-NEW Aye-TTTTTTTTTT /smug superiority [17:52:26] * thcipriani reads back [17:52:39] cool, meeting next week sounds awesome :) [18:16:51] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107353 (10chasemp) >>! In T157359#3095669, @jcrespo wrote: > @aude @MaxSem @Kolossos Can you verify your applications (e.g. restarting them) and se... [18:19:10] 06Labs, 10DBA: page_lang column of the page table is not replicated to Labs - https://phabricator.wikimedia.org/T154355#3107372 (10chasemp) >>! In T154355#3099624, @TTO wrote: > `metawiki_p.page` now contains the page_lang column; however, `user_groups` view still dos not contain the `ug_expiry` column. Shall... [18:20:37] 06Labs, 10Tool-Labs, 10Tools-Kubernetes: Reassign service/pod IP ranges for kubernetes on tool labs - https://phabricator.wikimedia.org/T152399#3107375 (10chasemp) 05Open>03Resolved seems like this is sorted, we'll reopen if issues surface [18:23:10] 06Labs, 10Tool-Labs, 10Tools-Kubernetes: Reassign service/pod IP ranges for kubernetes on tool labs - https://phabricator.wikimedia.org/T152399#3107406 (10chasemp) raw etherpad script for posterity ```Problem: IP allocations for k8s services and the flannel overlay (Pods) are overlapping and the services a... [18:25:47] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107415 (10dschwen) Nope. My stuff fails now with: ``` ERROR: function setsrid(box3d, integer) does not exist LINE 6: SetSRID('BOX3D(-... [18:55:26] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107475 (10dschwen) After fixing those to `ST_SetSRID` my PostGIS query now fails with ``` ERROR: Operation on mixed SRID geometries ``` [19:03:37] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107510 (10jcrespo) That is probably a conquequence of a PostGIS upgrade. Can you post/point to the whole query/relevant code? [19:05:02] 06Labs, 10Labs-Infrastructure, 10Continuous-Integration-Infrastructure, 13Patch-For-Review: Puppet fails on integration instances: nfs_mount[home-on-labstoresvc]: umount: /home: not mounted - https://phabricator.wikimedia.org/T155820#3107512 (10chasemp) 05Open>03Resolved a:03chasemp [19:12:37] 06Labs: Investigate enabling host-based auth to all hosts from bastions - https://phabricator.wikimedia.org/T76971#3107564 (10chasemp) 05Open>03Invalid I spoke with @yuvipanda and in his words 'this idea should die in a fire' [19:20:44] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107585 (10dschwen) Sure the query is here: https://github.com/dschwen/wikiminiatlas/blob/master/tiles/jsontile.php#L115 [19:34:37] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107634 (10jcrespo) This could be the reason- requiring to setup the SRID for constants: http://gis.stackexchange.com/questions/68711/postgis-geomet... [19:38:26] 06Labs, 10Tool-Labs: Shut down "cewbot" - https://phabricator.wikimedia.org/T160264#3107643 (10chasemp) p:05Triage>03Normal @Kanashimi can you speak to this? > tools.cewbot:*:52910:kanashimi This is not the first complaint we have had of this bot spamming irc channels and creating chaos. > 1785960 0.342... [19:38:43] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107645 (10dschwen) Looks like the OSM data uses SRID 3857 and I compare to a Bounding Box with SRID 900913 [19:40:11] 06Labs: Investigate enabling host-based auth to all hosts from bastions - https://phabricator.wikimedia.org/T76971#823940 (10Platonides) +1 to the fire A compromise in a bastion host using HostBasedAuthentication means that the attacker can connect to every machine (reachable from it). This is not the case usin... [19:40:28] 06Labs, 10PAWS: paws returns 502 bad gateway - https://phabricator.wikimedia.org/T158685#3107652 (10chasemp) 05Open>03Resolved [19:42:10] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107654 (10dschwen) Ok, next issue is that suddenly the column `the_geom` does not exist anymore in the `land_polygons` and `coastlines` tables.... [19:44:01] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107655 (10dschwen) Ok, I think I'm back in business! Testing a bit more now. [19:50:53] 06Labs, 10Labs-Infrastructure, 10Continuous-Integration-Infrastructure: Labs instance ci-jessie-wikimedia-498353 can not be deleted - https://phabricator.wikimedia.org/T156636#3107666 (10chasemp) 05Open>03Resolved a:03chasemp marking resolved as this may be an artifact of bad config gone by but let's t... [19:52:14] 06Labs, 06Operations: Mount /public/dumps for osmit project - https://phabricator.wikimedia.org/T156586#3107675 (10chasemp) p:05Triage>03Normal @sabas88 we could configure /public/dumps to be available on all instances in this project. Is that acceptable? [19:53:34] 06Labs, 10Tool-Labs, 07Tracking: Tool Labs users missing replica.my.cnf (tracking) - https://phabricator.wikimedia.org/T135931#3107678 (10chasemp) [19:53:36] 06Labs, 10Tool-Labs: Several users and tools have invalid credentials in replica.my.cnf - https://phabricator.wikimedia.org/T154933#3107677 (10chasemp) [19:54:29] 06Labs, 10Horizon: User dschwen unable to log into horizon.wikimedia.org (An error occurred authenticating. Please try again later.) - https://phabricator.wikimedia.org/T154860#3107680 (10chasemp) @dschwen still happening? @andrew ping if so [19:54:54] 06Labs, 10DBA: page_lang column of the page table is not replicated to Labs - https://phabricator.wikimedia.org/T154355#3107682 (10TTO) I reckon we'd better keep @Aklapper happy and open a new task for the new issue :) [19:56:05] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, 13Patch-For-Review: labsdb1006/1007 (postgresql) maintenance - https://phabricator.wikimedia.org/T157359#3107687 (10jcrespo) Good to know- feel free to test and communicate issues- we will soon otherwise irrevocably delete the previous instance. Thanks... [20:00:52] 06Labs, 10Labs-Infrastructure, 10DBA: ug_expiry column of the user_groups table is not present on Labs - https://phabricator.wikimedia.org/T160686#3107713 (10TTO) [20:01:41] 06Labs, 10Horizon: User dschwen unable to log into horizon.wikimedia.org (An error occurred authenticating. Please try again later.) - https://phabricator.wikimedia.org/T154860#3107729 (10dschwen) Yes, it is still happening. [20:04:00] 06Labs, 10Tool-Labs, 07Tracking: Tool Labs users missing replica.my.cnf (tracking) - https://phabricator.wikimedia.org/T135931#3107735 (10chasemp) [20:04:02] 06Labs, 10Tool-Labs: Cannot access replica databases - access denied - https://phabricator.wikimedia.org/T151296#3107734 (10chasemp) [20:04:49] 06Labs, 10Labs-Infrastructure, 10DBA: LabsDB replica service for tools and labs - issues and missing available views (tracking) - https://phabricator.wikimedia.org/T150767#3107740 (10chasemp) [20:06:07] 06Labs, 10Labs-Infrastructure, 10Labs-project-other: Can't ssh into xenon.rcm.eqiad.wmflabs - https://phabricator.wikimedia.org/T149750#3107747 (10chasemp) 05Open>03Resolved a:03chasemp I'm working from the assumption this issue is fine now. [20:10:26] 06Labs, 06Operations, 06Research-and-Data-Backlog, 10hardware-requests: eqiad: 2 hardware access request for research labsdbs - https://phabricator.wikimedia.org/T146065#3107768 (10chasemp) 05Open>03declined My understanding is this has been put on hold until TBD. I don't want to leave this request fo... [20:14:15] 06Labs, 10Labs-Infrastructure, 10DBA: ug_expiry column of the user_groups table is not present on Labs - https://phabricator.wikimedia.org/T160686#3107789 (10chasemp) p:05Triage>03Normal I'll attempt to run the view generation when I can in the next few days [20:15:03] 06Labs, 10Horizon: User dschwen unable to log into horizon.wikimedia.org (An error occurred authenticating. Please try again later.) - https://phabricator.wikimedia.org/T154860#3107791 (10chasemp) @dschwen is 2fa working for you via wikitech currently? Can you disable and renable 2fa and see if it works in bo... [20:15:37] 06Labs, 10Horizon: User dschwen unable to log into horizon.wikimedia.org (An error occurred authenticating. Please try again later.) - https://phabricator.wikimedia.org/T154860#3107792 (10Andrew) Most often this is a result of clock drift on the device providing the 2fa code. Rebooting your phone might help. [20:18:03] 06Labs: Creating a instance with precise fails - https://phabricator.wikimedia.org/T140099#3107809 (10chasemp) 05Open>03Invalid this is no longer allowed [20:22:15] 06Labs, 10Horizon: User dschwen unable to log into horizon.wikimedia.org (An error occurred authenticating. Please try again later.) - https://phabricator.wikimedia.org/T154860#3107827 (10dschwen) I'll try that, but I seriously doubt this is the issue here. I use GA for a whole bunch of services and horizon is... [20:23:34] 06Labs: Create replica.my.cnf for bkeegan on tools - https://phabricator.wikimedia.org/T134074#3107831 (10chasemp) [20:23:36] 06Labs, 10Tool-Labs, 07Tracking: Tool Labs users missing replica.my.cnf (tracking) - https://phabricator.wikimedia.org/T135931#3107832 (10chasemp) [20:24:02] 10Tool-Labs-tools-Xtools, 06Community-Tech: [Epic] Rewrite XTools: Top edits - https://phabricator.wikimedia.org/T160137#3107833 (10kaldari) @Stevietheman: So basically an "All" option in the Namespace select list? It would be best to open that as a new Phab ticket (that is a subtask of this one). [20:30:23] 06Labs, 06Operations: Mount /public/dumps for osmit project - https://phabricator.wikimedia.org/T156586#3107843 (10Sabas88) Yes of course! That would do. [20:35:33] 06Labs, 10Tool-Labs, 10Tools-Kubernetes, 05Goal: Goal: Allow using k8s instead of GridEngine as a backend for webservices - https://phabricator.wikimedia.org/T129309#3107857 (10yuvipanda) [20:35:35] 06Labs, 10Tool-Labs, 10Tools-Kubernetes: Setup NSS inside containers used in Tool Labs - https://phabricator.wikimedia.org/T134748#3107854 (10yuvipanda) 05Open>03Resolved It seems fast enough without nscd caching. We can reopen if we get actual complaints about it being slow. [21:10:33] 06Labs, 06Operations: Mount /public/dumps for osmit project - https://phabricator.wikimedia.org/T156586#3108002 (10chasemp) It should appear on a Puppet run sometime in the next hour or so. [21:13:29] 06Labs, 06Operations: Mount /public/dumps for osmit project - https://phabricator.wikimedia.org/T156586#3108017 (10Sabas88) Thanks! [21:26:03] 10Striker: Add a web shell allowing people to perform actions as their tool from striker - https://phabricator.wikimedia.org/T144713#2608023 (10mmodell) This is something I've spend a lot of time thinking about in the context of offering a web interface to scap. [21:29:00] 10Striker, 06Project-Admins: Allow self-service creation of Maniphest projects for Tools - https://phabricator.wikimedia.org/T144111#2588823 (10mmodell) IMO this is the perfect use case for sub-projects. [21:44:15] 06Labs, 10Horizon: User dschwen unable to log into horizon.wikimedia.org (An error occurred authenticating. Please try again later.) - https://phabricator.wikimedia.org/T154860#3108268 (10dschwen) Yeah, no change [22:25:21] 06Labs, 10DBA, 10MediaWiki-extensions-Babel: Replicate babel db table on Labs - https://phabricator.wikimedia.org/T160713#3108521 (10Base) [22:58:29] 10Tool-Labs-tools-Xtools, 06Community-Tech: [Epic] Rewrite XTools: Top edits - https://phabricator.wikimedia.org/T160137#3108603 (10Samwilson) Sounds like a good idea. The namespace selection needs to be changed anyway because at the moment it is hardcoded into a view, and doesn't include non-Wikipedia namespa... [23:20:43] 06Labs: Close wmve-techteam - https://phabricator.wikimedia.org/T159589#3108645 (10White-Master) p:05Triage>03Normal Please, we need this.