[01:10:42] 06Labs, 10Horizon: Stop requiring two-factor authentication for horizon.wikimedia.org - https://phabricator.wikimedia.org/T161473#3132659 (10MZMcBride) [01:13:07] 06Labs, 10Horizon: Consider creating horizon.wmflabs.org convenience redirect - https://phabricator.wikimedia.org/T161474#3132672 (10MZMcBride) [01:48:24] 06Labs: Lost Wikitech 2FA details, recovery needed - https://phabricator.wikimedia.org/T159521#3132692 (10mschwarzer) @bd808 Thanks. I added the file: ``` mschwarzer@bastion-01:~$ pwd /home/mschwarzer mschwarzer@bastion-01:~$ echo "mschwarzer-2fa-recovery T159521" > reset_2fa.txt mschwarzer@bastion-01:~$ cat re... [01:59:11] in a botched attempt to migrate to a new git repository, I recently deleted the entirety of my home directory. Could someone help me recreate .my.cnf? Thanks. [01:59:27] tools name: magog [02:07:52] Magog_the_Ogre: did your replica.my.cnf get deleted? [02:08:15] no [02:09:05] madhuvishy, I mean YES [02:09:07] Magog_the_Ogre: ah are you looking for a different file? [02:09:10] I was looking at the wrong user [02:09:17] i'm in tool magog [02:09:19] and can see it [02:10:04] my user is tools.magog [02:10:06] sorry [02:11:33] Magog_the_Ogre: right, i'm looking at the contents of tool magog [02:11:49] and can see a bunch of files including replica.my.cnf [02:12:04] ls -l [02:12:05] drwxr-sr-x 2 tools.magog tools.magog 4096 Mar 19 18:42 refresh-configs [02:12:05] drwxr-sr-x 5 tools.magog tools.magog 4096 Mar 19 18:41 REL1_0 [02:12:12] no replica [02:12:33] https://www.irccloud.com/pastebin/KeeSEVP4/ [02:13:47] oh my, my bad [02:13:49] thank you [02:14:14] ah what were you looking at [02:15:24] I got confused by the capitalization [02:15:32] I didn't realize ls was case insensitive [02:40:19] 06Labs, 10DBA, 10MediaWiki-extensions-Babel, 06Security-Team, 06WMF-Legal: Replicate babel db table on Labs - https://phabricator.wikimedia.org/T160713#3108521 (10Bawolff) All this is public info (available already via API action=query&meta=babel, or just user page). It is totally ok to make this public... [03:45:05] PROBLEM - Free space - all mounts on tools-proxy-01 is CRITICAL: CRITICAL: tools.tools-proxy-01.diskspace._public_dumps.byte_percentfree (No valid datapoints found)tools.tools-proxy-01.diskspace.root.byte_percentfree (<44.44%) [04:06:19] !log tools erasing random log files on tools-proxy-01 to avoid filling the disk [04:06:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [04:19:27] 06Labs, 10Tool-Labs, 07Regression, 15User-Urbanecm: I have no access to DB with my recently created tool mostlinkedmissing - https://phabricator.wikimedia.org/T161466#3132794 (10madhuvishy) @bd808 @Urbanecm should be fixed now. Caused by the script tripping on user creation for user MnemonicFlow - which I... [04:35:08] RECOVERY - Free space - all mounts on tools-proxy-01 is OK: OK: tools.tools-proxy-01.diskspace._public_dumps.byte_percentfree (No valid datapoints found) [06:13:57] 06Labs, 10DBA, 10MediaWiki-extensions-Linter: Make "linter" table available on Labs - https://phabricator.wikimedia.org/T160611#3105094 (10Marostegui) The table is already replicated to labs, we'd only need the view to be created. ``` mysql:root@localhost [enwiki]> select @@hostname; +------------+ | @@host... [06:47:29] 06Labs, 10DBA: Expose ar_content_format and ar_content_model columns of archive table on Labs replicas - https://phabricator.wikimedia.org/T89741#1044220 (10Marostegui) These two columns are replicated in labs, but missing from the view. ``` mysql:root@localhost [enwiki]> select @@hostname; +------------+ | @@... [09:19:19] 06Labs, 10Tool-Labs: Access Denied - https://phabricator.wikimedia.org/T160585#3133122 (10Aklapper) Hi @Tomthirteen! Wikimedia Phabricator/Maniphest is for bug reports and enhancement requests. You could ask questions 'how to do something' on the Labs mailing list, IRC channels, or wiki page discussion pages i... [09:19:56] 06Labs, 10Tool-Labs: Access Denied - https://phabricator.wikimedia.org/T160585#3133127 (10Aklapper) [09:29:23] 06Labs, 10Labs-Infrastructure, 10DNS, 06Discovery, and 3 others: multi-component wmflabs.org subdomains doesn't work under simple wildcard TLS cert - https://phabricator.wikimedia.org/T161256#3133149 (10grin) >>! In T161256#3128643, @MaxSem wrote: > Now, in the time of HTTP/2.0 over TLS, there are modern... [09:35:02] 06Labs, 10Tool-Labs: Setup postgres credentials for all tool users - https://phabricator.wikimedia.org/T76167#3133167 (10akosiaris) @bd808, agreed. On top of that, postgres replication mechanisms, at least in the versions we currently host, as well as the upgrade paths make it really difficult to provide a rea... [13:29:26] 06Labs, 15User-Nikerabbit: Revert in 01/2017: Request creation of wmwcourse labs project - https://phabricator.wikimedia.org/T144388#3133889 (10Nikerabbit) Okay to go ahead on this. All instances are turned off already. Thanks for the opportunity. [13:33:15] 06Labs, 15User-Nikerabbit: Revert in 01/2017: Request creation of wmwcourse labs project - https://phabricator.wikimedia.org/T144388#3133897 (10chasemp) @Nikerabbit really cool stuff, we would be love to hear back how it worked out and what we could do better for this use case. It's not the typical one but we... [13:49:24] !log video Disable autoconfirmed + 50 edits requirement in v2c for GSoC demonstration [13:49:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL [14:19:23] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Deprecate precise instances in Labs by 2017-03-31 - https://phabricator.wikimedia.org/T143349#3134004 (10chasemp) [14:24:21] 06Labs: Close wmve-techteam - https://phabricator.wikimedia.org/T159589#3072574 (10Andrew) @White-Master, can you please clarify? You need the project to not be deleted, or you support its deletion? If you still need the project... for what? [14:31:08] 06Labs, 15User-Nikerabbit: Revert in 01/2017: Request creation of wmwcourse labs project - https://phabricator.wikimedia.org/T144388#3134010 (10Nikerabbit) Work well: * Prefix puppet is handy (I wish I had discovered it before starting to create instances) * Easy MediaWiki setup for each student (the focus was... [14:49:43] Anyone know where I should look to solve this: `Debug: Creating new connection for https://puppet:8140 [14:49:43] Error: Could not request certificate: getaddrinfo: Name or service not known [14:49:44] Exiting; failed to retrieve certificate and waitforcert is disabled` [14:49:59] This happens an a new labs instance where on Hiera (via Wikitech) I'm pointing it at my own puppet master (but obviously it isn't called 'puppet') [14:50:28] when I run `puppet agent -t --debug` [14:50:49] tarrow: these are the steps to make a selfhosted/standalone puppetmaster https://wikitech.wikimedia.org/wiki/Standalone_puppetmaster#Step_1:_Setup_a_standalone_puppetmaster [14:53:05] madhuvishy: I've been following that; obviously I was being an idiot and running puppet without sudo :/ [14:53:07] thanks [14:53:23] tarrow: aah okay :) [14:54:12] It seems surprising that running puppet as a mortal defaults to trying to connect to https://puppet:8140 [14:55:50] I *think* that when you run it as non-root it can't see the config files and tries to use some built-in default settings for finding a Puppetmaster [14:56:45] tarrow: it might be worth putting that error message and the missing sudo cause on the wiki page somewhere. Maybe start a "Troublshooting" section [14:56:56] bd808: yes! I will [14:57:15] people who make the docs better are my favorite people :) [15:04:59] 06Labs, 10Tool-Labs: Setup postgres credentials for all tool users - https://phabricator.wikimedia.org/T76167#3134092 (10bd808) 05Open>03declined Lets take the lack of activity between 2014-11-27 and 2017-03-26 as a sign that we aren't really going to do this. [15:11:40] !log bastion Added self (BryanDavis) as projectadmin [15:11:42] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bastion/SAL [15:12:28] 06Labs: Graphite vs. archive-instances - https://phabricator.wikimedia.org/T161518#3134101 (10Andrew) [15:25:56] 06Labs: Close wmve-techteam - https://phabricator.wikimedia.org/T159589#3134113 (10White-Master) I support its deletion [15:26:16] 06Labs: Delete wmve-techteam - https://phabricator.wikimedia.org/T159589#3134114 (10White-Master) [15:33:18] 06Labs, 15User-Addshore, 03WMDE-QWERTY-Team-Board: Create new labs project for development & testing of the FileImport & FileExport extensions - https://phabricator.wikimedia.org/T161218#3125019 (10Andrew) This is fine, but can you fill in the bug description a bit so we have records of what you're doing? A... [15:43:40] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Deprecate precise instances in Labs by 2017-03-31 - https://phabricator.wikimedia.org/T143349#3134222 (10chasemp) [16:07:49] 06Labs, 15User-bd808: Lost Wikitech 2FA details, recovery needed - https://phabricator.wikimedia.org/T159521#3134416 (10bd808) 05Open>03Resolved a:03bd808 I verified the /home/mschwarzer/reset_2fa.txt file contents and removed the row from `oathauth_users` on silver belonging to the user `Mschwarzer`. [16:12:44] 06Labs, 15User-Addshore, 03WMDE-QWERTY-Team-Board: Create new labs project for development & testing of the FileImport & FileExport extensions - https://phabricator.wikimedia.org/T161218#3134435 (10chasemp) [16:12:59] 06Labs, 15User-Addshore, 03WMDE-QWERTY-Team-Board: Create new labs project for development & testing of the FileImport & FileExport extensions - https://phabricator.wikimedia.org/T161218#3125019 (10chasemp) +1 [16:18:56] PROBLEM - Puppet run on tools-webgrid-generic-1402 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [16:22:10] 06Labs, 15User-Addshore, 03WMDE-QWERTY-Team-Board: Create new labs project for development & testing of the FileImport & FileExport extensions - https://phabricator.wikimedia.org/T161218#3134475 (10Addshore) [16:22:14] 06Labs, 07Tracking: Existing Labs project quota increase requests (Tracking) - https://phabricator.wikimedia.org/T140904#3134478 (10Andrew) [16:22:16] 06Labs: Revert increased quota for maps labs project - https://phabricator.wikimedia.org/T159843#3134476 (10Andrew) 05Open>03Resolved a:03Andrew [16:23:41] 06Labs, 07Tracking: Existing Labs project quota increase requests (Tracking) - https://phabricator.wikimedia.org/T140904#2480369 (10Andrew) [16:23:43] 06Labs: Revert temporary quota increase for fastcci project (when ready) - https://phabricator.wikimedia.org/T160798#3134482 (10Andrew) 05Open>03Resolved [16:48:09] 06Labs: Delete wmve-techteam - https://phabricator.wikimedia.org/T159589#3134547 (10Andrew) 05Open>03Resolved a:03Andrew [16:48:12] 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#3134549 (10Andrew) [16:58:57] RECOVERY - Puppet run on tools-webgrid-generic-1402 is OK: OK: Less than 1.00% above the threshold [0.0] [17:01:23] 06Labs, 15User-Addshore: Delete Cognate labs project - https://phabricator.wikimedia.org/T161217#3134619 (10Andrew) 05Open>03Resolved a:03Andrew [17:01:27] 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#3134621 (10Andrew) [17:02:56] !log deployment-prep cherry pick https://gerrit.wikimedia.org/r/344964 to puppetmaster to test upgrade to logstash 5.x [17:03:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [17:10:37] 06Labs, 10Tool-Labs, 07Tracking: Tool Labs users missing replica.my.cnf (tracking) - https://phabricator.wikimedia.org/T135931#3134639 (10madhuvishy) [17:10:41] 06Labs, 10Tool-Labs, 13Patch-For-Review, 07Tracking: Make maintain-dbusers.py create replica.my.cnf files for user accounts as well - https://phabricator.wikimedia.org/T158420#3134638 (10madhuvishy) 05Open>03Resolved [17:11:20] 06Labs, 10Tool-Labs, 07Tracking: Tool Labs users missing replica.my.cnf (tracking) - https://phabricator.wikimedia.org/T135931#2315661 (10madhuvishy) [17:11:24] 06Labs, 10Tool-Labs, 10WLX-Jury, 13Patch-For-Review, 10Wiki-Loves-Monuments (2016): Figure out a way to support java 1.8 on tool labs (For WLX Jury) - https://phabricator.wikimedia.org/T124903#3134645 (10madhuvishy) [17:11:26] 06Labs, 10Tool-Labs: About 71 users are missing replica.my.cnf - https://phabricator.wikimedia.org/T140592#3134641 (10madhuvishy) 05Open>03Resolved a:03madhuvishy All users have replica.my.cnfs now. Closing this. [17:13:10] 06Labs, 10Tool-Labs: User sdesabbata has no replica.my.cnf - https://phabricator.wikimedia.org/T157176#2998125 (10madhuvishy) This is done now, and replica.my.cnf exists in the user's home directory. @Sdesabbata Can you verify that it's working? [17:13:40] 06Labs, 10Tool-Labs: replica.my.cnf appears to not exist for my tool labs account - https://phabricator.wikimedia.org/T158389#3035571 (10madhuvishy) @Hall1467 Should exist now, can you verify it's working? [17:14:16] ^thanks for working on that [17:14:41] 06Labs: Create replica.my.cnf for bkeegan on tools - https://phabricator.wikimedia.org/T134074#2253983 (10madhuvishy) @Madcoverboy Should exist now. Can you verify that it's working? [17:17:12] jynus: :) [17:24:17] 06Labs, 10Tool-Labs: About 71 users are missing replica.my.cnf - https://phabricator.wikimedia.org/T140592#3134732 (10madhuvishy) [17:24:20] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Provision with data the new labsdb servers and provide replica service with at least 1 shard from a sanitized copy from production - https://phabricator.wikimedia.org/T147052#3134731 (10madhuvishy) [17:24:22] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Migrate existing labs users from the old servers, if possible using roles and start maintaining users on the new database servers, too - https://phabricator.wikimedia.org/T149933#3134729 (10madhuvishy) 05Open>03Resolved Closing this :) [17:29:33] 06Labs, 10Tool-Labs, 07Tracking: Tool Labs users missing replica.my.cnf (tracking) - https://phabricator.wikimedia.org/T135931#3134751 (10madhuvishy) [17:29:35] 06Labs, 10Tool-Labs: Several users and tools have invalid credentials in replica.my.cnf - https://phabricator.wikimedia.org/T154933#3134748 (10madhuvishy) 05Open>03Resolved a:03madhuvishy Closing this - all user accounts should have valid replica.my.cnfs now. @Danmichaelo you should be able to use your r... [17:39:06] 06Labs, 06Operations: Add monitoring for nfs-exportd on active labstore specifically - https://phabricator.wikimedia.org/T160838#3134759 (10chasemp) 05Open>03Resolved [17:45:56] 06Labs: Clean up data in /data/scratch/mwoffliner - https://phabricator.wikimedia.org/T144025#3134765 (10Kelson) @chasemp I have shrinked the whole stuff to ~50GB, it will take few months more to be able to shrink it more. It that good? [17:45:58] 06Labs, 10Tool-Labs: Restore replica.my.cnf for toolsbeta.admin - https://phabricator.wikimedia.org/T109807#1559682 (10madhuvishy) @scfc your home directory on `tools` should now have a replica file with credentials for your user (not tool) - you could use these credentials for admin purposes on other projects... [17:53:04] 06Labs: Clean up data in /data/scratch/mwoffliner - https://phabricator.wikimedia.org/T144025#3134812 (10chasemp) >>! In T144025#3134765, @Kelson wrote: > @chasemp I have shrinked the whole stuff to ~50GB, it will take few months more to be able to shrink it more. It that good? yep thanks [17:59:04] 06Labs, 10Labs-Infrastructure, 13Patch-For-Review: Deprecate precise instances in Labs by 2017-03-31 - https://phabricator.wikimedia.org/T143349#3134831 (10chasemp) [19:01:39] 06Labs, 07Tracking: New Labs project requests (tracking) - https://phabricator.wikimedia.org/T76375#3135013 (10Andrew) [19:01:41] 06Labs, 15User-Addshore, 03WMDE-QWERTY-Team-Board: Create new labs project for development & testing of the FileImport & FileExport extensions - https://phabricator.wikimedia.org/T161218#3135010 (10Andrew) 05Open>03Resolved a:03Andrew No camel case allowed, alas, but I've created the project mwfileimpo... [19:03:40] 06Labs, 15User-Addshore, 03WMDE-QWERTY-Team-Board: Create new labs project for development & testing of the FileImport & FileExport extensions - https://phabricator.wikimedia.org/T161218#3135014 (10chasemp) >>! In T161218#3135010, @Andrew wrote: > No camel case allowed, alas, but I've created the project mwf... [19:09:07] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3135041 (10Andrew) [19:09:57] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3135058 (10Andrew) [19:09:59] 06Labs, 10Labs-Infrastructure, 05MW-1.29-release (WMF-deploy-2017-03-28_(1.29.0-wmf.18)), 13Patch-For-Review: Support project creation without OpenStackManager - https://phabricator.wikimedia.org/T150091#3135057 (10Andrew) [19:14:39] 06Labs, 10Tool-Labs, 07Regression, 15User-Urbanecm: I have no access to DB with my recently created tool mostlinkedmissing - https://phabricator.wikimedia.org/T161466#3135078 (10Urbanecm) 05Open>03Resolved a:03madhuvishy I'm able to access to the database now. Thank you. [19:25:21] !log wikilabels ran P5141 to clear expired tasks [19:25:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [19:25:50] !log wikilabels (clarification) https://phabricator.wikimedia.org/P5141 [19:25:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [19:27:14] 06Labs: Graphite vs. archive-instances - https://phabricator.wikimedia.org/T161518#3135107 (10Andrew) root@labmon1001:/var/log/graphite# chown -R _graphite . We'll see if that fixes it. [19:29:22] 06Labs, 10MediaWiki-extensions-OpenStackManager, 10wikitech.wikimedia.org: Stop using OpenStackManager, make Wikitech an SUL wiki - https://phabricator.wikimedia.org/T161553#3135117 (10greg) [19:29:25] 06Labs, 06Operations, 10wikitech.wikimedia.org, 07HHVM: Move wikitech (silver) to HHVM - https://phabricator.wikimedia.org/T98813#3135116 (10greg) [19:30:01] 06Labs, 06Operations, 10wikitech.wikimedia.org, 07HHVM: Move wikitech (silver) to HHVM - https://phabricator.wikimedia.org/T98813#1278203 (10greg) Added T161553 as a subtask per above comments. [19:30:09] Hey folks. Check out http://spatialization.cs.umn.edu/ [19:30:27] It's a cool map-based tool built on top of data from a bunch of wikis. [19:30:37] The This-or-That games is pretty fun :) [19:30:50] Regretfully, this can't run on tool labs because of disk space needs. [19:31:04] They need at least 200 GB to host the memory-mapped files the system uses. [19:31:32] Just thought it would be a good time (given the lull in -labs chat) to talk about disk space needs and what solutions are on the horizon. [19:31:43] (or maybe on the horizon.wmflabs.org) [19:31:49] * halfak laughs to himself [19:32:48] chuckles (yea somebody saw that "on the horizon" thing) [19:33:11] clicks "chemistry of beer" [19:33:31] How Beer is related to Rhodium [19:33:32] No explanations are available [19:33:47] hmm. ok.. and funny enough that all the elements are WMF server names too [19:35:37] mutante, essentially, this is using the semantic similarity between concepts and mapable things to give you an interesting view. [19:35:55] I've been bugging the researchers to get their semantic relatedness API and this tool on labs, but they are blocked on this. [19:36:32] the beer one was strange yes [19:36:46] https://meta.wikimedia.org/wiki/Grants:IEG/WikiBrainTools [19:36:49] ^ related [19:37:34] "bots and cyborgs" wow [19:38:26] halfak: all very interesting and i understand the blocker is disk space. i don't really know about solutions but i think madhu would be a good person to talk to [19:38:50] I remember that one year ago I had quite some difficulty getting the dutch wiki as plain text for my word2vec model [19:39:21] (that's more related on the grant) [19:39:34] Gotcha mutante. Any chance you know anything about the performance of memory-mapped files? I wonder if we should even *try* nfs for that. [19:40:04] basvb, yeah the authors of the tool/grant have been looking a lot at vectors. Do you know about the navigation vectors stuff? [19:40:09] imagines a futuristic system where users donate disk space to things like this and this awesome distributed file system mounts the user-provided decentralized cloud drive [19:40:19] https://meta.wikimedia.org/wiki/Research:Wikipedia_Navigation_Vectors [19:40:56] never heard of that [19:40:59] let me read it [19:41:00] halfak: sorry, i don't know that [19:41:20] thanks anyway :) [19:41:27] yw [19:42:31] aah used for order of visiting pages [19:42:34] seems like a good ide [19:42:35] idea [19:43:19] language models can often be extended to other domains, have done so several times for lda/plsa [19:43:29] halfak: probably the most effective way is to make a ticket just requesting the needed disk space and then it will start the dicussion there. it might end up being long-term and low prio, but it would be there as something to come back to [19:44:45] mutante, oh yeah. I probably have an old ticket for that. Let me see if I can find it. [19:45:40] hmm... maybe not [19:45:48] doesn't the navigation vector solution also run into the fact that there is a huge difference between how readers and editors navigate wikipedia? [19:46:39] basvb, maybe. How do you know there is a difference? [19:46:53] And what difference might that have? [19:46:56] for search I understood that is an issue [19:47:08] I could imagine that for navigation it will also be [19:47:22] editors frequently go to loads of pages to change one minor thing [19:47:56] thus quickly hopping between them, whereas a reader quickly hopping between pages might mean they are not finding what they are interested in [19:48:28] but maybe that can be accounted for by having edit navigations (edit page) also within the vectors [19:49:19] "filter out sessions with less than 2 requests and more than 30 requests" aah that might do the trick [19:51:24] basvb, gotcha. I think editors will be drowned out by readers 10,000:1. [19:51:32] (I actually did the math on that one) [19:51:39] So maybe it won't really matter. [19:51:46] also accounting for time on wiki? [19:51:58] and the nr of pages visited? [19:52:04] nope. We don't track readers between requests but we can use the referrer. [19:52:26] when I navigate commons I easily visit hundreds of pages an hour [19:52:46] https://meta.wikimedia.org/wiki/Research:Wikipedia_clickstream [19:52:47] but well those sessions will be filtered by the max 30 pages [19:53:30] I mean time on wiki as average time spend on wiki [19:53:38] not in length of years :) [19:53:58] more saying: 1 editor for 10.000 reader does that also mean 1 edit hour for 10.000 read hours [19:54:11] or 1 editor page visit for 10.000 reader page visits [19:54:21] halfak: I can tell you that we did not budget for any major general purpose storage project in the FY17/18 planning. [19:54:24] 06Labs, 10Labs-Infrastructure, 07artificial-intelligence: Provide large disk space to wikibrain for memory-mapped file - https://phabricator.wikimedia.org/T161554#3135155 (10Halfak) [19:54:39] it was a candidate, but we found things that were more urgently needed [19:54:41] bd808, gotcha. I understand this is a little bit niche. [19:54:58] Though, having basic relatedness measures would open a lot of doors for tools. [19:55:25] interesting research on the navigation embeddings [19:55:28] I'm more hoping that there might be some options with vm provisioning. [19:57:36] If things go well I'd like to see an 'attached block storage' project in FY18/19. That would functionally be a service that would offer up large (and small) dedicated disk storage for projects similar to the EBS product at Amazon. [19:57:53] there are a lot of things that we would be able to do better with a system like that [19:58:16] but it won't be cheap or easy so it didn't make the cut for next year's paln [19:58:17] bd808, gotcha. That makes sense. [19:59:40] this limited budget and staffing problem is vexing. Why can't somebody just put a few billion in the Wikimedia trust so we don't have such arbitrary limits? ;) [20:01:27] halfak: I'm watching https://bids.berkeley.edu/resources/videos/engineering-intersection-productive-efficiency-ideology-and-ethical-ai-wikipedia as I have few minutes now and that 10000:1 reference there was cool having watched that vid, great presentation btw [20:01:55] \o/ thanks chasemp :) [20:02:15] I'm glad you're getting a chance to watch that. yuvipanda told me he'd never seen me talk about ORES until then [20:02:30] halfak: that moment when you packed in biology metaphors and a biologist is now in the audience :) [20:02:44] oh neat, yeah it's good. you're a comfortable presenter [20:03:10] heh. I talked to her afterwards and she said that it she approved my usage of biology as an explanatory tool :D [20:07:52] halfak how is wikibrain doing? Didn't really hear from it before but seems from a few years back, interesting concept [20:10:28] !log twl add Madhuvishy as project admin ( for enabling nfs - T159407) [20:10:32] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Twl/SAL [20:10:32] T159407: Requesting /data/project NFS share for Nova_Resource:Twl - https://phabricator.wikimedia.org/T159407 [20:26:49] chasemp: question if you may [20:27:20] nuria: !ask ;) [20:27:32] nuria: shoot [20:27:32] bd808: now that limn1 is DEAD [20:27:59] bd808: how do i do a 301 from http://reportcard.wmflabs.org/ to newdomain? is there a dns i can change in horizon? [20:28:41] do you want a 301 or just to point the old proxy at the new host? [20:29:08] the latter is as easy as using horizon to delete the existing proxy and then recreating with the new backend as the target [20:29:09] bd808: new host is in prod so i was thinking i could do a 301 [20:29:16] ah. ok [20:29:19] to newprod domain [20:29:26] I .. think we have a project just for such things [20:29:41] let me see if I can find how I did that... [20:29:45] wait [20:29:56] there are isseus with pointing labs url's as redirects to prod [20:30:05] otherwise i am going to have to have a fake machine in labs that just does the 301 [20:30:06] well, maybe not reverse was an issue but I guess that's ok [20:30:20] chasemp: i have done it before as we have migrated many tools [20:30:34] chasemp: but using different paths every time [20:30:46] nuria: I imagine there is a better way than a redirect instance yeah, can you make a task? it's possible we hard bake something into the proxy or andrewbogott will have a sustainable idea [20:30:49] chasemp: this is the first time we killed the instance completely [20:30:58] nuria: https://wikitech.wikimedia.org/wiki/Nova_Resource:Redirects [20:32:07] so you want reportcard.wmflabs.org to go to ... what? [20:32:30] bd808: good find [20:32:40] chasemp: I built it ;) [20:32:45] oh heh [20:32:54] bd808: let me verify [20:34:07] bd808: https://analytics.wikimedia.org/dashboards/reportcard [20:34:17] chasemp: what is a bit magical is that I remembered that I built it :) [20:34:35] bd808: i also do not have permits to edit that .. ahem... pretty hiera config [20:34:39] nuria: expected that that is a 404? [20:34:49] bd808: now it is yes, code needs to sync [20:34:56] bd808: i just deployed it 2 mins ago [20:35:13] ok. lets make a phab task to track this [20:35:36] I can make the hira edit and force the puppet run [20:36:09] bd808: i have one talsk [20:36:24] bd808: is this good enough: https://phabricator.wikimedia.org/T130117? [20:36:33] nuria: sure [20:39:34] bd808: ok, thank you [20:40:07] nuria: can you go into horizon and release the proxy for reportcard.wmflabs.org ? [20:41:13] bd808: yes, deleted proxy just now [20:41:21] !log redirects Added proxy config for reportcard.wmflabs.org (T130117) [20:41:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Redirects/SAL [20:41:24] T130117: Move reportcard to dashiki and new datasources - https://phabricator.wikimedia.org/T130117 [20:42:17] the ridirect is redirecting. endpoint is still a 404 at the moment [20:46:08] bd808: ok, yes, let me see that git cloned code [20:46:50] chasemp: can I add you as a co-admin of that redirect project? My current co-maintainer is about to take a wiki-break [20:46:57] sure thing [20:47:15] I was just thinking about teh sanity of killing some old toolserver redirects with this style of thing [20:47:33] somewhere we have an instance or two that do nothing but this madness [20:47:36] yeah. it could do them all really I think [20:47:47] that would make me happy [20:47:57] we invented it when I moved hatjitsu from a vm in reading to a tool [20:48:39] super nice [20:49:20] !log redirects Added Rush as a projectadmin [20:49:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Redirects/SAL [21:16:33] 06Labs, 10The-Wikipedia-Library, 13Patch-For-Review: Requesting /data/project NFS share for Nova_Resource:Twl - https://phabricator.wikimedia.org/T159407#3135396 (10madhuvishy) 05Open>03Resolved This is now done and /data/project is available for project twl. I only switched mount_nfs to true for the twl... [21:24:44] 06Labs, 10Labs-Infrastructure, 07artificial-intelligence: Provide large disk space to wikibrain for memory-mapped file - https://phabricator.wikimedia.org/T161554#3135409 (10bd808) p:05Triage>03Normal Custom image sizes are certainly possible in our OpenStack deployment. Can you give more concrete sizin... [22:31:57] 06Labs, 15User-Addshore, 03WMDE-QWERTY-Team-Board: Create new labs project for development & testing of the FileImport & FileExport extensions - https://phabricator.wikimedia.org/T161218#3135551 (10Addshore) >>! In T161218#3135010, @Andrew wrote: > No camel case allowed, alas, but I've created the project mw... [22:52:12] (03CR) 10EddieGP: [C: 031] Ping sending nick when reporting !log errors [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/343925 (owner: 10BryanDavis) [22:55:01] (03CR) 10Dzahn: [C: 031] "nice" [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/343925 (owner: 10BryanDavis)