[00:02:29] RECOVERY - Puppet failure on tools-exec-1212 is OK: OK: Less than 1.00% above the threshold [0.0] [00:08:42] (03CR) 10Tim Landscheidt: [C: 032] Add list-user-databases command [labs/toollabs] - 10https://gerrit.wikimedia.org/r/234934 (https://phabricator.wikimedia.org/T91231) (owner: 10Tim Landscheidt) [00:27:15] (03PS3) 10Tim Landscheidt: Add missing uploaders [labs/toollabs] - 10https://gerrit.wikimedia.org/r/269537 [00:30:21] RECOVERY - Puppet failure on tools-exec-1203 is OK: OK: Less than 1.00% above the threshold [0.0] [00:38:55] (03CR) 10Tim Landscheidt: [C: 04-2] Add missing uploaders [labs/toollabs] - 10https://gerrit.wikimedia.org/r/269537 (owner: 10Tim Landscheidt) [04:35:59] RECOVERY - Puppet failure on tools-flannel-etcd-01 is OK: OK: Less than 1.00% above the threshold [0.0] [05:10:34] The poor overworked NFS server is sad. :(( [05:11:11] working on tools-login reminds me of dialup speed [05:13:36] !log tools.sal Updated to https://github.com/bd808/SAL/commit/175732fb7143b0b864266ae74d711e2137a159b0 [05:43:03] !log tools.bash Updated to https://github.com/bd808/quips/commit/00bd30b07f5c01010f786d96fe65866d5cf4096d [05:59:17] bd808, you should install FiOS over there. XD [06:01:32] we just need to solve some bad patterns that we established when the project was much smaller [06:01:44] logging to nfs does not scale well [09:26:55] bd808: mosh! although that doesn't help when nfs is the bottleneck [12:55:56] RECOVERY - Puppet failure on tools-webgrid-lighttpd-1202 is OK: OK: Less than 1.00% above the threshold [0.0] [13:05:50] addshore: T109707 Thursday at WSes? [13:06:02] it is being deployed out of session? [13:41:01] RECOVERY - Puppet failure on tools-exec-1221 is OK: OK: Less than 1.00% above the threshold [0.0] [15:14:28] 6Labs, 10Wikimedia-Site-Requests, 10wikitech.wikimedia.org: Enable math extension on wikitech - https://phabricator.wikimedia.org/T126338#2014975 (10Dereckson) @Glaisher, yes: the goal were to disable all the unneeded extensions, to avoid an overload of not used features. [15:15:24] 6Labs, 10Wikimedia-Site-Requests, 10wikitech.wikimedia.org: Enable math extension on wikitech - https://phabricator.wikimedia.org/T126338#2014978 (10Dereckson) a:3Dereckson [15:37:23] 6Labs, 6operations, 10wikitech.wikimedia.org: Rename specific account in LDAP, Wikitech, Gerrit and Phabricator - https://phabricator.wikimedia.org/T85913#2015108 (10demon) [15:43:26] 6Labs, 6operations, 10wikitech.wikimedia.org: Rename specific account in LDAP, Wikitech, Gerrit and Phabricator - https://phabricator.wikimedia.org/T85913#2015132 (10demon) [15:43:41] 6Labs, 6operations, 10wikitech.wikimedia.org: Rename specific account in LDAP, Wikitech, Gerrit and Phabricator - https://phabricator.wikimedia.org/T85913#957178 (10demon) I think I got this right. It's been awhile, so please let me know immediately if it's not. [15:46:55] 10Labs-Other-Projects: Succesful pilot of Discourse on https://discourse.wmflabs.org/ as an alternative to wikimedia-l mailinglist - https://phabricator.wikimedia.org/T124690#2015146 (10AdHuikeshoven) [15:58:42] 6Labs, 10Wikimedia-Site-Requests, 10wikitech.wikimedia.org, 5Patch-For-Review: Enable math extension on wikitech - https://phabricator.wikimedia.org/T126338#2015164 (10Dereckson) p:5Triage>3Normal [16:07:22] (03CR) 10Hashar: [C: 031] "Good to see debian-glue is back up :-)" [labs/toollabs] - 10https://gerrit.wikimedia.org/r/268563 (owner: 10Tim Landscheidt) [16:42:07] 6Labs, 10Wikimedia-Site-Requests, 10wikitech.wikimedia.org, 5Patch-For-Review: Enable math extension on wikitech - https://phabricator.wikimedia.org/T126338#2011531 (10Dereckson) We reverted the change in 8c70c9e. The extension complains `texvc` isn't available, and doesn't pick Mathoid. [16:45:59] 6Labs, 6operations, 10wikitech.wikimedia.org, 5Patch-For-Review: Deploy Mathoid for Wikitech too, or texvc as fallback - https://phabricator.wikimedia.org/T126468#2015274 (10Dereckson) 3NEW [16:46:21] 6Labs, 10Wikimedia-Site-Requests, 10wikitech.wikimedia.org, 7Blocked-on-Operations, 5Patch-For-Review: Enable math extension on wikitech - https://phabricator.wikimedia.org/T126338#2015281 (10Dereckson) [17:38:31] RECOVERY - Puppet failure on tools-exec-1209 is OK: OK: Less than 1.00% above the threshold [0.0] [17:40:25] 6Labs, 6operations, 10wikitech.wikimedia.org: Rename specific account in LDAP, Wikitech, Gerrit and Phabricator - https://phabricator.wikimedia.org/T85913#2015495 (10demon) Only thing left is to deattach the LDAP account from Phabricator and attach the new one. Should setup OAuth first though so you have an... [17:47:52] (03PS1) 10Greg Grossmeier: -releng and -devtools changes [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/269737 [18:24:51] YuviPanda: Coren: Can you increase quota for integration project ASAP so that I can create an m1.large instance? [18:25:16] Getting "Failed to create instance." - presumably because of low quota (CPUs maybe?) [18:27:09] andrewbogott: ^ [18:27:23] Hey all, I'm having trouble connecting to multimedia-alpha.multimedia.eqiad.wmflabs, it says my publickey was denied access [18:27:33] It might be still configuring but I don't know how long that should take [18:27:55] The console output isn't encouraging, though [18:30:57] MarkTraceur: let me take a look [18:31:41] MarkTraceur: hm, I also can't login as root, so that suggests provisioning is going very much not well [18:32:06] 6Labs, 6operations, 10wikitech.wikimedia.org: Deploy Mathoid for Wikitech too, or texvc as fallback - https://phabricator.wikimedia.org/T126468#2015716 (10Krenair) [18:36:26] valhallasw`cloud: Yeah, that's no good [18:37:27] "Master hostname: 'labs-puppetmaster-codfw.wikimedia.org' not found. Retrying in 30 seconds" [18:38:15] but the host is in eqiad, so that's... weird? [18:38:20] and that hostname doesn't exist to begin with [18:40:20] oh, it's listed as secondary master in the manifests [18:43:32] and it would not be in wikimedia.org but rather codfw.wmnet [18:44:00] well, in prod [18:44:15] and in labs it would be wmflabs.org it would be wikimedia.org in prod [18:45:45] I didn't touch anything [18:45:55] I just created the instance and made it a mediawiki instance [18:46:04] Maybe I screwed up mediawiki somehow [18:49:36] valhallasw`cloud: Could you increase integration project quota? [18:52:08] Krinkle: no, I think that requires something on labsvirt [18:52:17] And I don't have access to that [18:52:21] Hm.. OK [18:52:28] I thought it would be a speical page for cloudadmin [18:52:40] Thanks [18:52:47] I couldn't find it [19:08:49] valhallasw`cloud: Rebooted, didn't help, I get the same hostname not found message [19:08:54] Still can't SSH, still can't HTTP [19:09:15] hrm. Maybe try to disable the mw-vagrant role, and see if it provisions without? [19:09:20] KK [19:10:08] No dice [19:10:20] I guess because if the master can't be found, it doesn't know its configuration changed? [19:12:27] re-reading the error, it's about salt, not puppet itself, so it should be OK :/ [19:12:32] Hm. [19:14:45] Krinkle: i’m here now, looking at your quota [19:14:51] thx [19:15:10] CPU from 80 to 84 should do it I think. [19:15:44] MarkTraceur: I'm at a loss. I'd go for re-creating the instance, but it's really not very optimal :( [19:15:55] Well, I haven't done anything with it, so whatever [19:17:49] Krinkle: better? [19:18:04] MarkTraceur: delete and try again, if it fails a second time I’ll have a look. [19:18:11] andrewbogott: thx, got it [19:18:23] Trying [19:20:20] OK now I'm back to not being able to SSH, I'm pretty sure it's done provisioning now [19:20:32] Salt is working [19:20:39] Oh, there we go [19:21:35] Trying to get MW set up now... [19:35:06] andrewbogott: OK, it's booting and SSHable but no MediaWiki seems to be showing up. [19:35:29] MarkTraceur: is that a vagrant question? [19:35:44] It's a...I guess it's the mediawiki_vagrant role on labs? [19:35:49] So yes but also no? [19:36:09] I don’t really know what the state of the art is for mw on labs. bd808 might have an opinion. [19:36:15] K. [19:40:13] Or maybe YuviPanda? [19:40:24] he's on vacation :) [19:40:29] Bollocks. [19:41:47] Maybe because I have the wrong port... [19:44:44] It looks like puppet complained about me using Debian instead of Ubuntu? [19:51:32] ... Yuvi on vacation? I beleive it not. [19:51:55] Coren: you are right, he joins every day :) [19:52:58] "Vacation" is a very fluid term for WMF [19:55:45] andrewbogott / chasemp, do you have time to take a look at that backup-restore-email? I think we can just restore the old homedir and move the current one in ~/old_homedir or something like that, and let them figure out the rest [20:04:17] valhallasw`cloud: I think andrew is looking at it now, but to my knowledge we don't have that timeframe to restore? [20:04:36] chasemp: yeah, andrewbogott is looking into it. I have no clue what the backup situation is either [20:04:55] I responded to the email thread [20:05:06] thanks! [20:05:56] So I'm going to be disappointed if I try to install something on labs with apt-get, aren't I [20:06:39] MarkTraceur: you'll be disappointed the next time you spin up a host and it's missing there, mostly. [20:06:45] but apt-get should just work [20:06:45] at first it will work but later you will regret it [20:06:48] Ah, whatever, that's fine [20:06:55] There isn't going to be much "later" [20:07:10] Oh, shoot, it's not there anyway [20:07:16] :) has been said for all of the misc projects :) [20:07:52] Literally the only thing I need this for is 1-2 months of testing and then we're deploying to betalabs so we don't need this dinky little test instance after that [20:08:39] i'll shup up, but that also sounds super familiar [20:08:42] Heh [20:08:52] Well, it's my own fault now, I've ignored your advice [20:09:04] But also I didn't get any results from apt-cache search thumbor, so I'm sunk anyway [20:09:13] Off to find documentation on puppetizing for labs. :( [20:09:24] (maybe gilles already has some magical incantations for that!!!) [20:09:41] MarkTraceur: if it's not in apt, it won't magically work through puppet either [20:09:52] valhallasw`cloud: No, I'll have to do something clever I'm sure [20:09:58] on vagrant I'm building it [20:10:03] in a venv [20:10:10] I know it's in pip, so that should suffice [20:10:23] gilles: Can has a link? [20:10:36] to what? the vagrant code? [20:10:39] Yeah [20:10:47] if you mix packages from distro with pip .. you will also not be happy [20:10:51] * mutante hides [20:11:01] mutante: I told you, there's no apt packages for it [20:11:11] And gilles says he's using a virtualenv so it should be fine [20:11:25] but for the dependencies there might be, that's what mutante is getting at I think [20:11:29] Ah, sure [20:11:31] if you tell pip to remove stuff you cant rely on it actually removing stuff [20:11:38] * MarkTraceur is gonna have a Bad Time!!! [20:11:43] That's what labs is for [20:12:09] then later the remants from pip intefere with stuff [20:12:22] What stuff? [20:12:29] and you look forever because you told pip to remove it already [20:12:47] for example, git review was broken because it used python-requests from pip [20:12:53] and not from the distro [20:12:54] MarkTraceur: vagrant/puppet/modules/thumbor/manifests/init.pp [20:15:00] In what repo? [20:15:38] Probably mw-vagrant, sorry, looking [20:17:23] OK super [20:20:08] andrewbogott: Seems internal subnet IPs are getting assigned to multiple instances [20:20:24] 61.17.68.10.in-addr.arpa domain name pointer integration-slave-trusty-1019.integration.eqiad.wmflabs. [20:20:24] 61.17.68.10.in-addr.arpa domain name pointer create-test-121.testlabs.eqiad.wmflabs. [20:20:35] 21:19 <•hashar> 12.17.68.10.in-addr.arpa. 60 IN PTR ci-jessie-wikimedia-22792.contintcloud.eqiad.wmflabs. [20:20:35] 21:19 <•hashar> 12.17.68.10.in-addr.arpa. 60 IN PTR integration-slave-trusty-1022.integration.eqiad.wmflabs. [20:20:56] MarkTraceur: still fighting with MediaWiki-Vagrant in Labs? Start reading here and shout for help when you find non-known issues -- https://wikitech.wikimedia.org/wiki/Help:MediaWiki-Vagrant_in_Labs [20:21:10] maybe that also explains why the phab instances arent reachable? [20:21:12] issue #1 it should like you found: it doesn't work on jessie yet [20:21:12] looks like some DNS entries deletion have been missed by the labs infra [20:21:34] Krinkle: I’ll have a look. I’m not sure if that’s happening ongoingly or if it was just a leak from when something was broken a while ago. [20:21:45] These were both created in the last 15 min [20:21:54] (integration instances) [20:22:03] bd808: Of course, because I blissfully ignored the thing that shouted "vagrant" at me on the security groups page. Thanks. [20:22:19] When I connect these IPs to Jenkins in a minute, need to be sure they end up on the right instance. [20:22:22] It's all IP based [20:22:50] 6Labs: Duplicate entries in labs internal dns - https://phabricator.wikimedia.org/T126518#2016334 (10Andrew) 3NEW a:3Andrew [20:57:35] Computing backlinks for 10,000 pages in 3.7 hours -- about 1.3 sec per page. According to documentation Toolserver was able to do 2 Million in 8 hours [21:34:14] Any ideas on how to stop queries from dying after 8 hours. I suspect a connection setting, but none seem to work. [21:35:33] 10Tool-Labs-tools-Article-request: Search Component for Article Requests - https://phabricator.wikimedia.org/T59871#2016742 (10Matthewrbowker) 5Open>3declined I am going to close this here, as this task was created when articlerequest looked very different. May re-open if I decide to implement. [21:36:59] Dispenser: the irc topic for this channel says that there might be potential replag due to work on the backend databases, maybe that's the cause [21:37:36] No its a query I've been trying to get running for month and its /exactly/ 8 hours [21:43:22] YuviPanda, I noticed something unusual. [21:43:43] I just got a report that half of Cyberbot is down. [21:43:58] When I check the logs to see what the cause is, the files are empty. [21:44:01] Yuvi is on vacation I think [21:44:06] Oh [21:44:13] valhallasw`cloud, ^^ [21:45:57] Cyberpower678: yes? [21:46:12] I just got a report that half of Cyberbot is down. [21:46:13] When I check the logs to see what the cause is, the files are empty. [21:46:16] valhallasw`cloud, ^ [21:46:30] yes, I read that [21:46:59] 6Labs, 10wikitech.wikimedia.org: https://wikitech.wikimedia.org/wiki/Special:SpecialPages gives "500 Internal Server Error" - https://phabricator.wikimedia.org/T126538#2016779 (10scfc) 3NEW [21:47:04] it doesn't give me anything to work with [21:47:05] The question is why are my log files completely empty, and my bots non-functional? [21:47:19] Completely random. [21:47:33] It's as if my bot crashed, and wiped the files with it. [21:47:36] Which is impossible. [21:47:50] again, you're giving me nothing to work with [21:47:53] 10Quarry: Make available more options for number of shown rows of resultset (Quarry) - https://phabricator.wikimedia.org/T126540#2016800 (10XXN) 3NEW [21:48:13] valhallasw`cloud, what do you need? [21:48:28] I don't know the internals of cyberbot, I don't know which jobs you're running, I don't know what logs files it should write to [21:48:49] Did someone just DoS Freenode? :O [21:48:56] they were looking at logs few days ago on here [21:49:15] Cyberpower678: No, server went offline and lost touch with the rest of the network. [21:51:06] 10Quarry: Add page navigation on top also (Quarry) - https://phabricator.wikimedia.org/T126542#2016825 (10XXN) 3NEW [21:52:04] Cyberpower678: they were looking at logs a few days ago on here. cyberbot had one of the biggest log files I think [21:52:20] valhallasw`cloud, /data/project/cyberbot/CyberbotI/RfUBot.out is completely wiped [21:52:35] valhallasw`cloud, 3077778 0.31097 RfUBot tools.cyberb r 02/05/2016 17:21:23 cyberbot@tools-exec-cyberbot.e 1 [21:52:54] suggests it should still be running, but it's not generating any output [21:53:05] That task is a continuous task. [21:54:34] tom29739, unlikely [21:54:42] The biggest should be 4G [21:54:46] Cyberpower678: I don't know. The file was cleared at midnight it seems, which might correlate with [Wed Feb 10 00:00:22 2016] there is a job named 'RfUBot' already active [21:55:22] valhallasw`cloud, the log files don't clear automaticaly [21:58:08] so the file does seem to be deleted, but I don't think we deleted any files when figuring out log file drive usage. chasemp? [21:58:41] the creation at midnight today does suggest it was deleted or moved somewhere yesterday [21:58:44] midnight? [21:58:47] reading [21:59:00] 6Labs, 10Tool-Labs: tools-exec-cyberbot and tools-exec-gift: Notice: /Stage[main]/Toollabs::Node::All/Labs_lvm::Swap[big]/Exec[create-swap-big]/returns: Volume group "vd" has insufficient free space (1678 extents): 2967 required. - https://phabricator.wikimedia.org/T126356#2016847 (10scfc) 5Open>3Resolved... [21:59:02] 6Labs, 10Tool-Labs: puppet failure on a large number of instances - https://phabricator.wikimedia.org/T126165#2016850 (10scfc) [21:59:07] chasemp: no, it was created at midnight because there's a daily jsub to make sure the host is running [21:59:20] so if it was created last midnight, it was deleted somewhere yesterday [22:00:06] I don't have an explanation unless a mistake was made, I would have truncated it w/ '>' either way [22:00:09] let me look [22:00:20] truncate would be OK in any case [22:00:51] 6Labs, 10Tool-Labs: tools-grid-master / almost full (929M/18G free) - https://phabricator.wikimedia.org/T126353#2016854 (10scfc) This is due to `/root` containing a lot of backups from the January operations: ``` root@tools-grid-master:~# du -hs * 4.0K 20auto-upgrades.ucf-dist 52K emergency_bin 6.5G... [22:01:47] valhallasw`cloud, chasemp: Why were they deleted though. I use those logs for debugging. [22:02:17] (03CR) 10Legoktm: [C: 032] -releng and -devtools changes [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/269737 (owner: 10Greg Grossmeier) [22:02:49] 6Labs, 10Tool-Labs, 5Patch-For-Review: Puppet/apt issues with libsndfile1 - https://phabricator.wikimedia.org/T124014#2016858 (10scfc) [22:03:15] 6Labs, 10Tool-Labs, 5Patch-For-Review: Puppet/apt issues with libsndfile1 - https://phabricator.wikimedia.org/T124014#2016860 (10valhallasw) 5Open>3Resolved ``` echo "foreign-architecture i386" > /etc/dpkg/dpkg.cfg.d/multiarch apt-get update apt-get purge ".*:i386" rm /etc/dpkg/dpkg.cfg.d/multiarch apt-g... [22:03:18] http://multimedia-alpha.wmflabs.org/ is still not working :( [22:03:43] Cyberpower678: *if* they have been deleted by us, that's because they were using an absurd amount of space on NFS, but again, they should not have been deleted in that case, just truncated [22:03:48] which suggests something else happened [22:04:08] Last I checked they were only a few hundred megabytes at most [22:04:14] what's the current state now? running but mystery of the logs [22:04:18] Which was yesterday [22:04:21] running but not logging [22:04:31] Cyberpower678: then it's unlikely they were deleted by us [22:04:41] valhallasw`cloud, well it wasn't by me either [22:04:55] why isn't it logging now aside from anything else [22:04:55] The logs were all still there yesterday [22:05:07] chasemp: stale file handle [22:05:20] chasemp, because the task isn't running even though it should be. [22:05:22] so it's writing to the old file handle [22:05:29] and maybe hanging because a buffer is full [22:05:37] can we restart the job to ensure current state is ok? [22:05:43] that would clue in for any further looking [22:05:43] I thinks [22:05:45] so [22:05:55] RECOVERY - Puppet failure on tools-exec-cyberbot is OK: OK: Less than 1.00% above the threshold [0.0] [22:06:10] I can restart Cyberbot easy. It would start logging again, and run. [22:06:32] The question is, what happened to my logs, and why did that stall Cyberbot, or vice versa? [22:06:39] valhallasw`cloud, chasemp ^ [22:07:21] I'm assuming a cleanup regex caught your logs foolishly, esp if they were greater than 1G, I don't know what these logs were atm [22:07:27] cyberbot stalled because it was writing to a stale file handle, filled up the buffer and then hangs there [22:07:46] the file handle was stale likely because the log file was removed or moved [22:08:07] but it would seem like restoring state to functional is first course of action [22:08:08] why *that* happened: not sure [22:08:55] Like I said though, the files were no bigger than 1G, when I checked yesterday. [22:09:15] * Cyberpower678 restarts Cyberbot [22:09:57] Error: Could not retrieve catalog from remote server: Error 400 on SERVER: OS ubuntu >= trusty required. at /etc/puppet/modules/vagrant/manifests/init.pp:13 on node multimedia-alpha.multimedia.eqiad.wmflabs [22:10:13] MarkTraceur: as bd808 mentioned: use trusty, not jessie [22:10:17] Oh [22:10:41] Sorry, missed that one [22:10:59] RECOVERY - Puppet failure on tools-exec-gift is OK: OK: Less than 1.00% above the threshold [0.0] [22:11:55] valhallasw`cloud, Cyberbot is running now.\ [22:12:10] logging is working? what's the path to the log? [22:12:37] Yes [22:13:25] chasemp, /data/project/cyberbot/CyberbotI/RfUBot.out [22:13:42] chasemp, btw, I routinely clean the logs myself. [22:13:58] I have a script that does that for me on a monthly bases. [22:14:18] The logs can never grow to be absurdly big [22:15:47] Did I just get netsplitted? [22:23:02] could I get someone to bump the cores quota on the deployment-prep project? [22:23:51] trying to rebuild the dpeloyment-bastion instance and I don't have the cpu quote I need. [22:25:23] thcipriani: I don't remember the how of it offhand and we are shorthanded atm, could this wait till monday? [22:27:14] chasemp: eh, sort of a high priority. beta isn't updating because of the bump to 5.5 https://integration.wikimedia.org/ci/job/beta-scap-eqiad/89370/console trying to build a new bastion now. [22:27:27] andrewbogott: about ^? [22:27:34] (since deployment-bastion is on precise) [22:28:19] lemme see what I can do to move this job over to mira-deployment in the meantime. [22:28:46] thcipriani: I can raise the quota, just a minute... [22:29:02] andrewbogott: awesome. Thank you! [22:29:52] thcipriani: you have five to go, is that not enough? [22:30:15] andrewbogott: the current m1.large makes for slow deploys since it rebuilds all the l10n cdb files. [22:30:32] ideally I wouldn't use an xlarge (since I don't need that much memory, just cores) [22:30:32] how many do you need? [22:30:49] chasemp, anything? [22:31:05] andrewbogott: if you up it by 5% that should work for the time being. I'll be able to clear up some resources once the move is done [22:31:42] some resources meaning current deployment-bastion. [22:31:48] 10Labs-Other-Projects: Succesful pilot of Discourse on https://discourse.wmflabs.org/ as an alternative to wikimedia-l mailinglist - https://phabricator.wikimedia.org/T124690#2016954 (10AdHuikeshoven) [22:32:16] thcipriani: does that work? [22:32:55] andrewbogott: looks like it should. Awesome. Thank you! [22:40:42] How do I generate a public RSA key? I generated a 2048bit one in Putty, and the propose OAuth form didn't like it. It didn't like the 4096bit one I generated either. [22:42:22] Help [22:44:06] tom29739: you used puttygen? that should work, it's probably about the output format. did you copy/paste it from puttygen? [22:44:17] Yeah [22:44:48] For OAuth registration, you probably need it in PEM format rather than SSH format [22:45:04] how do I do that [22:45:22] and I'm not sure if there is any documentation on how to use oauth with pubkey auth in general [22:45:30] I'm following valhallasw`cloud's tutorial at https://merlijn.vandeen.nl/2015/flask-mwoauth-on-tools.html [22:45:40] so I would just not provide a public key, and just use the keys provided by the server [22:45:44] hey, that's me ;-) [22:45:50] there isn't anything about the key in the docs [22:46:10] and I see the link to propose a consumer is also broken [22:46:31] It's here: https://meta.wikimedia.org/wiki/Special:OAuthConsumerRegistration/propose [22:46:37] I had to go look for it [22:46:45] let me update that... [22:47:17] OK, thanks for the help guys, I'm up and running, should be able to go from here [22:47:43] tom29739: just leave the field empty and you should be fine :-) [22:48:18] :) [22:49:42] tom29739: I'm off to bed, but feel free to poke me tomorrow if it's not working [22:50:24] sure thing [23:07:02] 6Labs, 10wikitech.wikimedia.org: https://wikitech.wikimedia.org/wiki/Special:SpecialPages gives "500 Internal Server Error" - https://phabricator.wikimedia.org/T126538#2017132 (10Krenair) ```2016-02-10 23:03:46 silver labswiki 1.27.0-wmf.13 fatal ERROR: [da5ffb6f] PHP Fatal Error: require(): Failed opening req... [23:13:01] 6Labs, 10wikitech.wikimedia.org: https://wikitech.wikimedia.org/wiki/Special:SpecialPages gives "500 Internal Server Error" - https://phabricator.wikimedia.org/T126538#2017149 (10Krenair) https://gerrit.wikimedia.org/r/#/c/267411/4/includes/SF_Utils.php [23:36:10] 6Labs, 6operations, 10wikitech.wikimedia.org: Update wikitech-static OS/PHP version - https://phabricator.wikimedia.org/T126385#2017211 (10Krenair) [23:39:13] 6Labs, 10Labs-Infrastructure, 10Continuous-Integration-Infrastructure: Bump labs quota for 'integration' project - https://phabricator.wikimedia.org/T126557#2017237 (10hashar) 3NEW