[01:08:57] <wikibugs>	 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 2 others: Create a "my first Python webservice" tutorial for Tool Labs - https://phabricator.wikimedia.org/T134494#2998955 (10bd808) a:03bd808 Work in progress at {R2048}, https://tools.wmflabs.org/my-first-flask-oauth-tool/, and...
[03:19:19] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/EagerLin was created, changed by EagerLin link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/EagerLin edit summary: Created page with "{{Tools Access Request |Justification=I want to create my tasks of Project.|Completed=false |User Name=EagerLin}}"
[03:19:47] <wikibugs>	 06Labs, 10Tool-Labs, 10Tools-Kubernetes: k8s webservice restart failure with `ValueError: get() more than one object; use filter` - https://phabricator.wikimedia.org/T156626#2999083 (10scfc) a:03scfc
[04:00:28] <wikibugs>	 06Labs, 10Tool-Labs: Delete /data/project/learning and /data/project/massaction on labstore - https://phabricator.wikimedia.org/T157208#2999113 (10scfc)
[04:01:03] <wikibugs>	 06Labs, 10Tool-Labs, 10MassAction, 15User-Addshore: Delete tool 'massaction' - https://phabricator.wikimedia.org/T157079#2999127 (10scfc)
[04:01:06] <wikibugs>	 06Labs, 10Tool-Labs: Delete /data/project/learning and /data/project/massaction on labstore - https://phabricator.wikimedia.org/T157208#2999113 (10scfc)
[04:02:13] <wikibugs>	 06Labs, 10Tool-Labs, 10MassAction, 15User-Addshore: Delete tool 'massaction' - https://phabricator.wikimedia.org/T157079#2994857 (10scfc)
[04:02:46] <wikibugs>	 06Labs, 10Tool-Labs: Delete tool `learning` - https://phabricator.wikimedia.org/T157057#2999131 (10scfc)
[04:08:41] <shinken-wm>	 PROBLEM - Puppet run on tools-exec-1411 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0]
[04:48:43] <shinken-wm>	 RECOVERY - Puppet run on tools-exec-1411 is OK: OK: Less than 1.00% above the threshold [0.0]
[05:10:10] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/EagerLin was modified, changed by EagerLin link https://wikitech.wikimedia.org/w/index.php?diff=1457616 edit summary: 
[05:13:12] <enterprisey>	 How can I change my OAuth callback URL?
[05:14:08] <tgr>	 Special:OAuthConsumerRegistration -> list -> update?
[05:14:18] <tgr>	 no sure it's one of the editable fields currently
[05:14:31] <enterprisey>	 tgr: I don't think it is
[05:14:37] <enterprisey>	 who do I need to bug to change it?
[05:14:50] <enterprisey>	 I typo'd the extension from nothing to .py :<
[05:51:17] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/EagerLin was modified, changed by EagerLin link https://wikitech.wikimedia.org/w/index.php?diff=1457646 edit summary: Do something for request
[06:27:29] <mhashemi>	 hey all, got an issue here, madhu was helping us, but she had to go to dinner and i don't think she's back
[06:28:16] <mhashemi>	 k8s is 404ing on all URLs and we can't see any real logs, so we have to move back to gridengine (k8s takes around 20 minutes to restart it seems)
[06:28:33] <mhashemi>	 so to move back to gridengine, i'm trying to stop the service
[06:28:45] <mhashemi>	 first i got a python stack trace from webservice itself
[06:28:50] <mhashemi>	 then now i see
[06:28:52] <mhashemi>	 $ webservice --backend=kubernetes stop
[06:28:53] <mhashemi>	 Your webservice is not running
[06:29:14] <mhashemi>	 but after several minutes of waiting i still see:
[06:29:19] * mhashemi sent a long message: mhashemi_2017-02-05_06:29:18.txt - https://matrix.org/_matrix/media/v1/download/matrix.org/hFXTstunwMXxxBOYMxDDRQaG
[06:37:13] <mhashemi>	 tgr: any ideas?
[06:39:22] <shinken-wm>	 RECOVERY - Puppet run on tools-worker-1004 is OK: OK: Less than 1.00% above the threshold [0.0]
[07:14:42] <shinken-wm>	 PROBLEM - Puppet run on tools-exec-1411 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0]
[07:32:19] <zhuyifei1999_>	 is the python stack trace you saw https://phabricator.wikimedia.org/T156626
[07:44:43] <shinken-wm>	 RECOVERY - Puppet run on tools-exec-1411 is OK: OK: Less than 1.00% above the threshold [0.0]
[09:02:31] <zhuyifei1999_>	 mhashemi: ^ I think I forgot to ping you
[09:03:28] <mhashemi>	 zhuyifei1999_: yes, that's the one
[09:04:02] <zhuyifei1999_>	 uh you just ignore that tracebak
[09:04:07] <zhuyifei1999_>	 *traceback
[09:05:53] <zhuyifei1999_>	 mhashemi: normally k8s shouldn't take 20mins to restart
[09:06:00] <zhuyifei1999_>	 what tool is it?
[09:18:01] <mhashemi>	 this is ifttt
[09:18:12] <mhashemi>	 so right now the wikipedia ifttt channel has been unfortunately out of commission for a few days
[09:31:50] <zhuyifei1999_>	 mhashemi: since you said the webservice can neither stop the webservice nor start it, I don't think I know what's going on without `become`ing it (it's not one of those I've seen)
[10:52:11] <zhuyifei1999_>	 !log video `$ pip install -U youtube-dl` from 2017.1.10 to 2017.2.4.1 on v2c frontend
[10:52:13] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL
[10:56:20] <zhuyifei1999_>	 !log video Git pulling v2c frontend to 9c86a9f and restarting webservice
[10:56:22] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Video/SAL
[13:55:33] <wikibugs>	 10Tool-Labs-tools-LTA-Knowledgebase: Create public access version for RfC - https://phabricator.wikimedia.org/T157220#2999418 (10Samtar)
[14:46:15] <wikibugs>	 10Tool-Labs-tools-LTA-Knowledgebase: Create public access version for RfC - https://phabricator.wikimedia.org/T157220#2999437 (10Samtar) 05Open>03Resolved https://tools.wmflabs.org/lta/publicdemo/
[17:11:35] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/WhitePhosphorus was created, changed by WhitePhosphorus link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/WhitePhosphorus edit summary: Created page with "{{Tools Access Request |Justification=To run my bot on [[:w:zh:Wikipedia:机器人/申请/WhitePhosphorus-bot|zhwiki]]. |Completed=false |User Name=WhitePhosphorus }}"
[17:16:14] <wikibugs>	 10Tool-Labs-tools-LTA-Knowledgebase: Add discussion area - https://phabricator.wikimedia.org/T157223#2999502 (10DatGuy)
[17:16:58] <wikibugs>	 10Tool-Labs-tools-LTA-Knowledgebase: Add discussion area - https://phabricator.wikimedia.org/T157223#2999514 (10DatGuy)
[18:09:59] <wikibugs>	 10Tool-Labs-tools-LTA-Knowledgebase, 10Wikimedia-Mailing-lists: Create mailing list for LTA Knowledgebase tool admins - https://phabricator.wikimedia.org/T156556#2999537 (10DatGuy) Any update?
[18:14:24] <shinken-wm>	 PROBLEM - Free space - all mounts on tools-worker-1004 is CRITICAL: CRITICAL: tools.tools-worker-1004.diskspace._var_lib_docker.byte_percentfree (No valid datapoints found)tools.tools-worker-1004.diskspace.root.byte_percentfree (<100.00%)
[18:31:44] <shinken-wm>	 PROBLEM - Puppet staleness on tools-worker-1004 is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [43200.0]
[18:40:50] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Pmacharr was created, changed by Pmacharr link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Pmacharr edit summary: Created page with "{{Tools Access Request |Justification=Support an open data project for establishing NCBI PubChem Database items and links in wikidata. |Completed=false |User Name=Pmacharr }}"
[19:24:23] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/EagerLin was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=1458703 edit summary: 
[19:24:27] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Pmacharr was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=1458705 edit summary: 
[19:24:44] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/WhitePhosphorus was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=1458706 edit summary: 
[19:51:57] <wm-bot>	 Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/JESSE REEVES was created, changed by JESSE REEVES link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/JESSE_REEVES edit summary: Created page with "{{Tools Access Request |Justification=TO BETTERHAND DELIVER A SIMPLER METHOD |Completed=false |User Name=JESSE REEVES }}"
[19:52:14] <wikibugs>	 06Labs, 10Tool-Labs, 06Project-Admins: Migrate Tools access request process to Phabricator - https://phabricator.wikimedia.org/T72625#2999671 (10scfc) @bd808: How does #Striker play along with this?  If someone signs up at https://toolsadmin.wikimedia.org/, where are users guided to for access to #Tool-Labs...
[19:56:03] <wikibugs>	 10Tool-Labs-tools-LTA-Knowledgebase: Account management module [UI] - https://phabricator.wikimedia.org/T155348#2999676 (10Samtar) 05Open>03Resolved
[20:18:06] <wikibugs>	 10Quarry: Quarry: Feature Request: Please Add Time-stamp to Result Page - https://phabricator.wikimedia.org/T157232#2999693 (10Boshomi)
[22:17:24] <wikibugs>	 06Labs, 10Tool-Labs, 06Project-Admins: Migrate Tools access request process to Phabricator - https://phabricator.wikimedia.org/T72625#2999816 (10bd808) >>! In T72625#2999671, @scfc wrote: > @bd808: How does #Striker play along with this?  If someone signs up at https://toolsadmin.wikimedia.org/, where are us...