[02:17:52] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [02:52:53] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [03:54:19] andrewbogott: we need to keep data in language-lcmd, so let me check if I can update it. [03:54:27] andrewbogott: sorry for late reply. [04:43:54] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [05:23:52] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [10:54:41] 10Quarry: It should be possible to disable syntax highlight - https://phabricator.wikimedia.org/T147711#2701387 (10Base) [11:36:43] PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22) [11:55:59] 10MediaWiki-extensions-OpenStackManager: OpenStackNovaProject::deleteMember uses undefined $user - https://phabricator.wikimedia.org/T147716#2701477 (10Reedy) [12:43:09] PROBLEM - Host secgroup-lag-102 is DOWN: CRITICAL - Host Unreachable (10.68.17.218) [12:52:56] 10MediaWiki-extensions-OpenStackManager, 13Patch-For-Review, 07Technical-Debt: OpenStackManager should not call Article::getContent() - https://phabricator.wikimedia.org/T147714#2701613 (10Paladox) [16:02:46] 10MediaWiki-extensions-OpenStackManager, 13Patch-For-Review, 05WMF-deploy-2016-10-11_(1.28.0-wmf.22): OpenStackNovaProject::deleteMember uses undefined $user - https://phabricator.wikimedia.org/T147716#2701681 (10Reedy) 05Open>03Resolved a:03Paladox [16:23:36] (03PS1) 10Giuseppe Lavagetto: Add common::swift private data to allow testing of 314829 [labs/private] - 10https://gerrit.wikimedia.org/r/314830 [16:24:05] (03CR) 10Giuseppe Lavagetto: [C: 032 V: 032] Add common::swift private data to allow testing of 314829 [labs/private] - 10https://gerrit.wikimedia.org/r/314830 (owner: 10Giuseppe Lavagetto) [16:57:26] RECOVERY - Host tools-secgroup-test-102 is UP: PING OK - Packet loss = 0%, RTA = 0.77 ms [17:01:02] PROBLEM - Host tools-secgroup-test-102 is DOWN: CRITICAL - Host Unreachable (10.68.21.170) [17:01:56] hey all, anyone run into "OAuth callback URL not found in cache." errors when doing oauth from labs? [17:02:22] the message goes on to say "This is probably an error in how the application makes requests to the server. " but gives no indication of what type of error that might be [17:02:47] i'm using the mwoauth library, from less than 2 months ago [17:05:35] if ( $callback === null || !is_string( $callback ) ) { [17:05:36] throw new MWOAuthException( 'mwoauthdatastore-callback-not-found' ); [17:05:36] } [17:05:43] mhashemi: Try again? It's on the MW side [17:06:22] haha ok [17:06:36] it's kind of funny because the error says the exact opposite [17:08:11] yeah that works [17:08:29] can we update the message to at least say "try again" or something, it's causing confusion with some of our users [17:08:55] also, another funny thing, the trailing slash is apparently important for url routing to tools [17:09:08] as in http://tools.wmflabs.org/montage-beta/ loads great but http://tools.wmflabs.org/montage-beta not so much? [17:09:41] actually i think that may be on our end hmm [17:16:49] PROBLEM - Puppet run on tools-services-02 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [17:34:57] RECOVERY - Host tools-secgroup-test-103 is UP: PING OK - Packet loss = 0%, RTA = 0.69 ms [17:35:18] ´hi [17:35:35] I submitted a job with jsub [17:35:42] got "Your job 1732776 ("elo_feb_14") has been submitted" [17:35:57] but when I try to check for it with [17:36:10] job -v elo_feb_14 [17:36:21] I get nothing [17:36:23] when I run [17:36:25] qstat -j 1732776 [17:36:29] I get [17:36:34] Following jobs do not exist: [17:36:35] 1732776 [17:36:40] ... [17:36:48] can you help me pls what I am doing wrong? [17:56:49] RECOVERY - Puppet run on tools-services-02 is OK: OK: Less than 1.00% above the threshold [0.0] [17:59:53] shinken-wm: ? [18:03:45] shinken-wm is obviously a bot, why are you talking to it? [18:04:20] was not obvious to me [18:04:42] was the first response after my question [18:04:53] I was not sure if that is targeted at me or not [18:11:05] Wesalius: check elo_feb_14.out and .err? [18:14:40] valhallasw`cloud: https://paste.pound-python.org/show/b9jvCOYQPKWiDmYd5f9n/ [18:15:03] valhallasw`cloud: I dont get that error when I try a test run straight from terminal [18:15:53] valhallasw`cloud: that was in .err [18:16:19] PROBLEM - Host tools-exec-cyberbot is DOWN: CRITICAL - Host Unreachable (10.68.16.39) [18:16:56] Wesalius: sounds like python 2.6 v 2.7 (see the warning above the message) [18:17:04] try passing -l release=trusty to jsub [18:18:09] valhallasw`cloud: but I ran my script with "python3" [18:18:24] aha. [18:18:32] 3.3 or 3.2 v 3.4 then [18:18:39] u"..." was only introduced in 3.4. [18:23:48] valhallasw`cloud: when I run python3 --version on tool labs it gives Python 3.4.3 [18:24:17] Wesalius: when you run python --version on //tools-bastion-05// [18:24:24] not when you run it on, say, tools-exec-1201 [18:24:40] valhallasw`cloud: Python 3.4.3 [18:24:53] valhallasw`cloud: tools.hypobot@tools-bastion-03 [18:25:06] tools-bastion-0* runs ubuntu trusty, while tools-exec-12* hosts run ubuntu precise [18:25:17] different ubuntu version, different python version [18:25:51] hence: use -l release=trusty, to make sure it runs on hosts running ubuntu trusty [18:26:34] valhallasw`cloud: so "jsub -N jobname scriptname -l release=trusty"? [18:26:57] jsun -N jobname -l release=trusty scriptname [18:27:05] otherwise it's passed as an argument to the script [18:27:19] ok I will try it rightaway [18:31:10] RECOVERY - Host secgroup-lag-102 is UP: PING OK - Packet loss = 0%, RTA = 0.69 ms [18:32:18] PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22) [18:35:00] valhallasw`cloud: Thank you, it looks it is working as it should. [18:41:07] PROBLEM - Host secgroup-lag-102 is DOWN: CRITICAL - Host Unreachable (10.68.17.218) [18:53:11] is it possible to change instance shell account name of my account? [18:54:14] Wesalius: not at the moment. You can create a new wikitech account with a new shell user name, and move all your projects over [18:54:50] ok, thank you again ;-) [20:33:32] Anyone know if quarry is broken right now? Login link doesn't seem to work [20:35:34] nevermind, i was looking at the wrong url [20:47:49] PROBLEM - Puppet run on tools-services-02 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [20:50:49] PROBLEM - Puppet run on tools-webgrid-lighttpd-1416 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [21:27:49] RECOVERY - Puppet run on tools-services-02 is OK: OK: Less than 1.00% above the threshold [0.0] [21:30:49] RECOVERY - Puppet run on tools-webgrid-lighttpd-1416 is OK: OK: Less than 1.00% above the threshold [0.0] [23:30:36] 10MediaWiki-extensions-OpenStackManager, 13Patch-For-Review, 07Technical-Debt: OpenStackManager should not call Article::getContent() - https://phabricator.wikimedia.org/T147714#2701972 (10AlexMonk-WMF) 05Open>03Resolved