[00:34:36] 06Labs, 10Labs-Infrastructure: New instance creation broken - https://phabricator.wikimedia.org/T144330#2596502 (10yuvipanda) [01:52:11] 10Quarry: Forking your own query results in a new one owned by YuviPanda - https://phabricator.wikimedia.org/T144309#2596611 (10Huji) Now it works fine. Could you please submit the patch that fixed it here before you close the task? [02:19:05] (03PS4) 10Krinkle: Clean up in preparation for the "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307104 (https://phabricator.wikimedia.org/T64914) [02:19:07] (03PS6) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [02:21:01] (03PS5) 10Krinkle: Clean up in preparation for the "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307104 (https://phabricator.wikimedia.org/T64914) [02:21:03] (03PS7) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [02:35:29] 10Tool-Labs-tools-Global-user-contributions, 13Patch-For-Review: Global user contributions: Implement "Recent only" feature - https://phabricator.wikimedia.org/T64914#2596652 (10Krinkle) a:03Krinkle [02:38:56] (03PS1) 10Krinkle: guc: Fix broken display of projects with non-zero edits [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307678 (https://phabricator.wikimedia.org/T118662) [02:39:18] 10Tool-Labs-tools-Global-user-contributions, 13Patch-For-Review, 07Regression: GUC tool always outputs "searched 1 projects" instead of actual count - https://phabricator.wikimedia.org/T118662#2596662 (10Krinkle) a:05Devirk>03Krinkle [02:39:38] (03CR) 10Krinkle: [C: 032] guc: Fix broken display of projects with non-zero edits [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307678 (https://phabricator.wikimedia.org/T118662) (owner: 10Krinkle) [02:40:27] (03CR) 10Krinkle: [V: 032] guc: Fix broken display of projects with non-zero edits [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307678 (https://phabricator.wikimedia.org/T118662) (owner: 10Krinkle) [02:40:48] 10Tool-Labs-tools-Global-user-contributions, 07Regression: GUC tool always outputs "searched 1 projects" instead of actual count - https://phabricator.wikimedia.org/T118662#2596666 (10Krinkle) 05Open>03Resolved [02:41:49] 10Tool-Labs-tools-Global-user-contributions: Global user contributions: Implement Atom/RSS feed output format - https://phabricator.wikimedia.org/T64920#2596671 (10Krinkle) [02:41:58] 10Tool-Labs-tools-Global-user-contributions, 13Patch-For-Review: Global user contributions: Implement "Recent only" feature - https://phabricator.wikimedia.org/T64914#648744 (10Krinkle) [02:42:00] 10Tool-Labs-tools-Global-user-contributions: Global user contributions: Implement Atom/RSS feed output format - https://phabricator.wikimedia.org/T64920#649290 (10Krinkle) [02:43:31] (03PS6) 10Krinkle: Clean up in preparation for the "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307104 (https://phabricator.wikimedia.org/T64914) [02:43:38] (03PS8) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [02:53:31] (03PS9) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [02:53:32] !log tools.jouncebot Cherry-picked https://gerrit.wikimedia.org/r/#/c/307333 for testing [02:53:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.jouncebot/SAL, Master [02:55:40] (03PS10) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [02:59:45] (03PS11) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:00:17] (03PS12) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:15:20] 06Labs, 10Labs-Infrastructure: Build new Precise base image - https://phabricator.wikimedia.org/T144335#2596700 (10Andrew) [03:26:06] (03PS7) 10Krinkle: Clean up in preparation for the "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307104 (https://phabricator.wikimedia.org/T64914) [03:26:08] (03PS13) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:30:55] (03PS14) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:31:28] (03PS15) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:35:10] (03PS16) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:36:41] (03PS17) 10Krinkle: [WIP] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:48:13] (03PS18) 10Krinkle: Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) [03:48:30] (03CR) 10Krinkle: [C: 032] Clean up in preparation for the "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307104 (https://phabricator.wikimedia.org/T64914) (owner: 10Krinkle) [03:48:35] (03CR) 10Krinkle: [C: 032] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) (owner: 10Krinkle) [03:48:37] (03CR) 10Krinkle: [V: 032] Implement "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307050 (https://phabricator.wikimedia.org/T64914) (owner: 10Krinkle) [03:48:42] (03CR) 10Krinkle: [V: 032] Clean up in preparation for the "Recent only" feature [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307104 (https://phabricator.wikimedia.org/T64914) (owner: 10Krinkle) [03:55:01] (03PS1) 10Krinkle: readme: Add 'composer install' to set up [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307683 [03:55:09] (03CR) 10Krinkle: [C: 032 V: 032] readme: Add 'composer install' to set up [labs/tools/guc] - 10https://gerrit.wikimedia.org/r/307683 (owner: 10Krinkle) [03:57:13] 10Tool-Labs-tools-Global-user-contributions: Global user contributions: Implement Atom/RSS feed output format - https://phabricator.wikimedia.org/T64920#2596717 (10Krinkle) [03:57:15] 10Tool-Labs-tools-Global-user-contributions, 13Patch-For-Review: Global user contributions: Implement "Recent only" feature - https://phabricator.wikimedia.org/T64914#2596715 (10Krinkle) 05Open>03Resolved Deployed to . There is a new dropdown menu featuring options "Recent... [04:46:22] what is the difference between wikimedia labs and tools labs? I would like to program a tool which is not a wiki extension, which should I use? [04:51:49] Gryllida: https://wikitech.wikimedia.org/wiki/Labs_labs_labs [04:54:00] am I correct in understanding that wikimedia labs is a thing for working on wiki software, and tools labs are tools which do not intend to be deployed 'on production'? [04:54:13] and thanks, the wiki page made it clear for me which one I need [04:57:13] Gryllida: not necessarily wiki software (i.e., mediawik) You can set up mediawiki instances on both tool labs and other labs projects [04:57:26] but generally that should not be done on tool labs, I think [05:01:43] Thanks... :) [05:15:52] can someone get this channel out of #wikimedia-bans? [05:16:08] I've no idea how to, but I think requiring registration to be here beats a good chunk of the positives of IRC... [05:16:32] yuvipanda: hi [05:16:49] hi [05:17:43] yuvipanda: what happened -- you were unable to join until you identified to nickserv? [05:20:12] yup [05:20:30] or rather, I was identified, and then I got disconnected, and auto re-connect failed [05:21:12] what error message do you get? [05:22:48] @appservice-irc:matrix.org kicked YuviPanda. Reason: IRC error on #wikimedia-labs: err_bannedfromchan [05:22:50] 10Quarry: Forking your own query results in a new one owned by YuviPanda - https://phabricator.wikimedia.org/T144309#2596738 (10yuvipanda) I, uh, just restarted redis and flushed out the db :| when bringing it back up after an outage earlier I had started the wrong redis instance... I really should move Quarry... [05:23:34] yuvipanda: are you able to join #wikimedia-bans ? [05:23:57] I have to run away right now though, so can't debug :( [05:24:10] I think bd808 told me yesterday that #wikimedia-bans started enforcing registration in an effort to fight spam [05:25:29] I think that restriction is gone now [05:25:41] bd808: it's still active. [05:25:42] it was active for ~15 hours or so [05:25:52] gh [05:25:54] ugh [05:26:34] bd808: the $~a entry at #wikimedia-bans seems to be it. [05:26:52] yeah, if they have $-a then auth is required [05:26:55] frack [05:27:36] yuvipanda: do you want the global restriction gone, or you want this channel to stop inheriting bans from #wikimedia-bans ? [05:27:45] yuvipanda: (whenever you're back) [05:27:59] Ideally, the global restriction should be gone. [05:28:06] ok [05:28:07] (got pulled in due to a possible fire) [05:28:46] yeah. I was promised yesterday that -a was temporary [05:29:57] yuvipanda: You could try to do /mode +e $~a [05:30:34] the way I've my client setup I can't realllly execute IRC commands tho [05:30:56] looks like maybe c put it back actually after lifting it for a while yesterday [05:32:22] the op flag I had here seems to have disappeared too :/ [05:32:57] uh [05:33:00] 20 bd808 +Aiotv (op) [modified 1w 1d 10h ago] [05:38:10] yuvipanda: the global restriction is gone now; ta :) [05:39:38] \o/ thank you, gryllida [05:59:38] 06Labs, 10Labs-Infrastructure: Instance creation and deletion on Labs is funky - https://phabricator.wikimedia.org/T144339#2596823 (10madhuvishy) [10:59:27] 10Tool-Labs-tools-Other: Geohack should be mobile friendly - https://phabricator.wikimedia.org/T103409#2597847 (10JGirault) [11:53:13] 06Labs, 10Mail: failed exim service on labs instances - https://phabricator.wikimedia.org/T135033#2286378 (10AlexMonk-WMF) I thought this had been fixed? [11:55:09] 06Labs, 07Documentation: Document, explain, diagram labs vlans and network setup - https://phabricator.wikimedia.org/T100529#2597947 (10hashar) Mark took time to explain at length the various network and wrote a nice summary on T140257#2597938 [12:44:05] 06Labs, 10Wikimedia-Labs-General, 10DBA, 06Operations, 07Tracking: Database replication services (tracking) - https://phabricator.wikimedia.org/T50930#2597985 (10jcrespo) [12:44:09] 06Labs, 10DBA, 06Editing-Analysis: Replicate editor_month table from analytics-store to Labs - https://phabricator.wikimedia.org/T143955#2597983 (10jcrespo) 05Open>03stalled You are asking an implementation "Replicate editor_month table from analytics-store to Labs", but not what you need to do on labs.... [13:12:07] 06Labs: Request creation of wmwcourse labs project - https://phabricator.wikimedia.org/T144388#2598041 (10Nikerabbit) [14:04:34] 06Labs, 10Labs-Infrastructure: New instance first puppet run is broken - https://phabricator.wikimedia.org/T144330#2598176 (10chasemp) [14:05:39] 06Labs, 10Labs-Infrastructure: New instance first puppet run is broken - https://phabricator.wikimedia.org/T144330#2596502 (10chasemp) ```root@disposable-1014-test-vm-09:~# /root/firstboot.sh + '[' '!' -f /var/lib/cloud/instance/boot-finished ']' + echo 'Enabling console logging for puppet while it does the in... [14:06:23] 06Labs, 10Labs-Infrastructure: New instance first puppet run is broken - https://phabricator.wikimedia.org/T144330#2598198 (10chasemp) [14:08:42] 06Labs, 10Labs-Infrastructure: New instance first puppet run is broken - https://phabricator.wikimedia.org/T144330#2598200 (10chasemp) [14:10:49] + project='{ [14:11:01] chasemp: the curl sed sed is off :( [15:31:42] for CI you can poke #wikimedia-releng [15:31:54] will probably end up stopping nodepool and prevent jenkins from processing jobs [15:31:58] patch will queue up in zuul [15:34:27] PROBLEM - Puppet run on tools-cron-01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:49:36] RECOVERY - Puppet run on tools-webgrid-lighttpd-1403 is OK: OK: Less than 1.00% above the threshold [0.0] [15:50:02] RECOVERY - Puppet run on tools-mail-01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:13] RECOVERY - Puppet run on tools-worker-1016 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:15] RECOVERY - Puppet run on tools-exec-1410 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:19] RECOVERY - Puppet run on tools-flannel-etcd-02 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:33] RECOVERY - Puppet run on tools-webgrid-lighttpd-1412 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:39] RECOVERY - Puppet run on tools-web-static-01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:43] RECOVERY - Puppet run on tools-k8s-master-01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:51] RECOVERY - Puppet run on tools-mail is OK: OK: Less than 1.00% above the threshold [0.0] [15:54:57] RECOVERY - Puppet run on tools-exec-1409 is OK: OK: Less than 1.00% above the threshold [0.0] [15:55:22] RECOVERY - Puppet run on tools-webgrid-lighttpd-1210 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:08] RECOVERY - Puppet run on tools-exec-1216 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:12] RECOVERY - Puppet run on tools-exec-gift is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:16] RECOVERY - Puppet run on tools-k8s-etcd-02 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:22] RECOVERY - Puppet run on tools-webgrid-lighttpd-1410 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:22] RECOVERY - Puppet run on tools-webgrid-lighttpd-1209 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:24] RECOVERY - Puppet run on tools-cron-01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:28] RECOVERY - Puppet run on tools-bastion-03 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:34] RECOVERY - Puppet run on tools-k8s-etcd-01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:36] RECOVERY - Puppet run on tools-exec-1217 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:40] RECOVERY - Puppet run on tools-worker-1021 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:41] RECOVERY - Puppet run on tools-bastion-02 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:50] RECOVERY - Puppet run on tools-elastic-01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:51] RECOVERY - Puppet run on tools-exec-1208 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:53] RECOVERY - Puppet run on tools-webgrid-lighttpd-1205 is OK: OK: Less than 1.00% above the threshold [0.0] [15:59:59] RECOVERY - Puppet run on tools-webgrid-generic-1402 is OK: OK: Less than 1.00% above the threshold [0.0] [16:00:05] RECOVERY - Puppet run on tools-webgrid-lighttpd-1408 is OK: OK: Less than 1.00% above the threshold [0.0] [16:00:05] RECOVERY - Puppet run on tools-webgrid-lighttpd-1409 is OK: OK: Less than 1.00% above the threshold [0.0] [16:00:15] RECOVERY - Puppet run on tools-exec-1212 is OK: OK: Less than 1.00% above the threshold [0.0] [16:36:51] !log tools Disabling puppet across tools hosts (T134896) [16:38:44] the bots are offline? [16:39:25] bd808: would you happen to know anything about ^? [16:39:50] I was just going to look [16:40:02] thanks [16:43:05] they all think they are running... [16:43:34] sometimes a network interruption will hose them up silently iirc [16:43:42] a restart may be in order [16:43:49] yeah, on it [16:45:45] labs-morebots: hello? [16:45:45] I am a logbot running on tools-exec-1213. [16:45:46] Messages are logged to wikitech.wikimedia.org/wiki/Server_Admin_Log. [16:45:46] To log a message, type !log . [16:50:49] !log Puppet disabling complete (T134896) [16:50:50] Puppet is not a valid project. [16:50:55] !log tools Puppet disabling complete (T134896) [16:51:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [16:51:15] Theres no stashbot [16:51:18] yeah [16:51:20] bd808 ^^ [16:52:44] poor handling of an irc hiccup I think. Should show up in a minute [16:52:53] thanks [16:54:59] !log tools Rsync-ed over latest backup of /srv/scratch from labstore1001 to labstore1003 [16:55:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [17:05:11] PROBLEM - Puppet run on tools-exec-1221 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [17:10:15] PROBLEM - Puppet run on tools-exec-1410 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [17:20:15] RECOVERY - Puppet run on tools-exec-1410 is OK: OK: Less than 1.00% above the threshold [0.0] [17:20:17] PROBLEM - Puppet run on tools-exec-1207 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [17:25:08] PROBLEM - Puppet run on tools-worker-1025 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [17:25:18] RECOVERY - Puppet run on tools-exec-1207 is OK: OK: Less than 1.00% above the threshold [0.0] [17:25:42] PROBLEM - Puppet run on tools-exec-1209 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [17:30:14] RECOVERY - Puppet run on tools-exec-1221 is OK: OK: Less than 1.00% above the threshold [0.0] [17:35:08] RECOVERY - Puppet run on tools-worker-1025 is OK: OK: Less than 1.00% above the threshold [0.0] [17:35:32] PROBLEM - Puppet run on tools-exec-1220 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [17:35:40] RECOVERY - Puppet run on tools-exec-1209 is OK: OK: Less than 1.00% above the threshold [0.0] [17:40:31] RECOVERY - Puppet run on tools-exec-1220 is OK: OK: Less than 1.00% above the threshold [0.0] [17:40:39] PROBLEM - Puppet run on tools-exec-1218 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [17:45:36] PROBLEM - Puppet run on tools-exec-1217 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [17:50:05] PROBLEM - Puppet run on tools-exec-1216 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [17:50:08] ^all me - should get fixed soon [17:50:18] chasemp: should we silence this? I don't know how to [17:50:19] PROBLEM - Puppet run on tools-worker-1008 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [17:50:28] PROBLEM - Puppet run on tools-worker-1007 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [17:50:38] RECOVERY - Puppet run on tools-exec-1218 is OK: OK: Less than 1.00% above the threshold [0.0] [17:50:54] PROBLEM - Puppet run on tools-worker-1005 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [17:50:57] !log tools Reenabling puppet across tools hosts. [17:50:57] Only way is to kill the bot I think [17:50:58] PROBLEM - Puppet run on tools-exec-1215 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [17:51:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [17:51:15] aah [17:55:19] PROBLEM - Puppet run on tools-k8s-master-02 is CRITICAL: CRITICAL: 11.11% of data above the critical threshold [0.0] [17:55:27] PROBLEM - Puppet run on tools-exec-1214 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [17:55:27] PROBLEM - Puppet run on tools-worker-1002 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [17:55:35] RECOVERY - Puppet run on tools-exec-1217 is OK: OK: Less than 1.00% above the threshold [0.0] [17:56:15] PROBLEM - Puppet run on tools-worker-1004 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [17:59:39] madhuvishy, the bot can be quieted [17:59:57] tom29739: ah how can I do that [18:00:05] @quiet shinken-wm [18:00:08] RECOVERY - Puppet run on tools-exec-1216 is OK: OK: Less than 1.00% above the threshold [0.0] [18:00:12] PROBLEM - Puppet run on tools-worker-1015 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [18:00:16] I think it's that [18:00:20] RECOVERY - Puppet run on tools-k8s-master-02 is OK: OK: Less than 1.00% above the threshold [0.0] [18:00:20] RECOVERY - Puppet run on tools-worker-1008 is OK: OK: Less than 1.00% above the threshold [0.0] [18:00:26] PROBLEM - Puppet run on tools-bastion-03 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [18:00:26] RECOVERY - Puppet run on tools-worker-1007 is OK: OK: Less than 1.00% above the threshold [0.0] [18:00:29] It's something. [18:00:30] PROBLEM - Puppet run on tools-worker-1017 is CRITICAL: CRITICAL: 10.00% of data above the critical threshold [0.0] [18:00:33] @q shinken-wm [18:00:33] !quiet shinken-wm [18:00:47] @uq shinken-wm [18:01:07] I am running http://meta.wikimedia.org/wiki/WM-Bot version wikimedia bot v. 2.8.0.0 [libirc v. 1.0.3] my source code is licensed under GPL and located at https://github.com/benapetr/wikimedia-bot I will be very happy if you fix my bugs or implement new features [18:01:07] @help [18:01:37] madhuvishy, it's @q and @unq [18:01:40] @unq shinken-wm [18:01:48] tom29739: cool! thanks [18:02:00] @q shinken-wm [18:02:01] Permission denied [18:02:16] ha [18:02:29] I'll add you. [18:02:35] thanks tom29739 :) [18:03:11] madhuvishy, you don't have a cloak :/ [18:03:37] sid60847@gateway/web/irccloud.com/x-scckqdtpkfwyyhed is your hostmask, which changes on each connect I think [18:03:38] 06Labs, 10Labs-Infrastructure, 07LDAP: Remove shell user "80686" - https://phabricator.wikimedia.org/T63967#2599116 (10demon) I don't understand why LDAP doesn't like the username. Can validnames be fixed? [18:03:47] weird - can you quiet it for now? I'll look into that after this migration [18:03:55] @q shinken-wm [18:03:58] Done. [18:04:00] thank you :) [18:14:16] !log gerrit gerrit-mysql instance has been setup following docs at https://phabricator.wikimedia.org/P3939 [18:14:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Gerrit/SAL, Master [18:15:02] arg, wrong project [18:15:42] !log git gerrit-mysql instance has been setup following docs at P3939 [18:15:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL, Master [18:16:10] !log git gerrit-test3 can be replicated following docs at P3637 [18:16:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Git/SAL, Master [18:16:22] /win 2 [18:18:44] !log tools Scratch migration complete for all k8s workers (T134896) [18:18:46] T134896: move nfs /scratch to labstore1003 - https://phabricator.wikimedia.org/T134896 [18:18:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [18:18:56] 06Labs, 06Operations, 06Release-Engineering-Team, 10wikitech.wikimedia.org, 07LDAP: Rename specific account in LDAP, Wikitech and Gerrit - https://phabricator.wikimedia.org/T133968#2599177 (10demon) 05Open>03Resolved >>! In T133968#2551726, @Sophivorus wrote: > I modified my rename request. The reque... [18:35:42] !log extdist adding self as temp admin to fix role class names [18:35:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Extdist/SAL, Master [18:36:46] legoktm: ^ eh.. i found that and added myself but i still don't see the instances [18:37:03] looks empty to me [18:37:13] mutante: uhh, you don't see extdist-01 and extdist-02? [18:37:25] no [18:37:26] they do exist... :P [18:37:35] can you click "Configure instance" [18:37:42] do you see the current role name there? [18:37:54] that is the part we'd have to change when that gets merged [18:38:16] i'm adding the new one to the "puppet groups" [18:38:22] so that it can be selected... [18:38:54] * mutante clicks "manage puppet groups" and sees the existing classes . so i am in the extdist context [18:39:13] clicks "Add class" [18:39:44] mutante legoktm role::labs::extdist vs role::extdist [18:39:47] former doesn't exist, latter does [18:40:23] we are fixing it to "role::extdist::extension" [18:40:35] or that would be the plan [18:41:08] i was able to add the class to the puppet groups [18:41:16] before the merge [18:41:20] mutante: oh, log out and log in again from wikitech? just fixed it for me... [18:41:21] so kind of before it exists [18:41:41] whaaat [18:42:01] role::extdist::extension? that... makes no sense, but ok I should shut up and not care. [18:42:03] * yuvipanda does [18:42:58] as opposed to role::extdist it doesn't cause warnings and we can stop include manifests/role one day [18:43:28] i am confused now what role::labs::extdist is [18:43:49] here's the thing that made me fix it in the first place too: [18:43:59] # = Class: role::labs::extdist [18:44:01] description [18:44:16] class role::extdist { [18:44:18] actual class name [18:45:46] i wanna fix puppet warnings and that inconsistency there [18:49:33] abandoned [18:50:07] gives up [18:50:50] :/ sorry [19:08:42] wikibugs is down [19:09:14] huh [19:09:17] everything died [19:09:29] 2016-08-31 18:33:23,932 - wikibugs.wb2-phab - INFO - Shutting down [19:09:53] 2016-08-31 18:41:37,600 - irc3.wikibugs - INFO - Trying to join #wikimedia-labs [19:09:53] 2016-08-31 18:41:37,600 - irc3.wikibugs - DEBUG - > JOIN #wikimedia-labs [19:09:54] 2016-08-31 18:42:03,378 - irc3.wikibugs - DEBUG - > QUIT :INT [19:09:56] weird. [19:10:51] legoktm: connection hang maybe? [19:11:15] !log tools.wikibugs started redis2irc and wikibugs jobs [19:11:21] I guess? [19:11:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikibugs/SAL, Master [19:13:18] I think normally tools mail redirects all mails? [19:14:11] Luke0815152: yes [19:14:16] unless tools-mail is dead again [19:14:31] 06Labs, 10DBA, 06Editing-Analysis, 05Security: Replicate editor_month table from analytics-store to Labs - https://phabricator.wikimedia.org/T143955#2599417 (10jcrespo) I think it would be easier if you created a public dump, then created a tool with database access and made it public, importing it every s... [19:15:00] valhallasw`cloud: I don't guess so, I recived my test mail :) [19:21:13] valhallasw`cloud hi we can support also draft1 in the gerrit reviewer bot as long as we doint give it drafts view rights it wont view drafts but will resolve the issue around gerrit inline editting not adding reviewers :) [19:36:19] !log tools Scratch migration on all non exec/worker nodes complete (T134896) [19:36:20] T134896: move nfs /scratch to labstore1003 - https://phabricator.wikimedia.org/T134896 [19:36:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL, Master [19:37:07] hi there! [19:43:53] Hi could i have some help, i clicked deactive floating ip from an instance i was going to delete and re create [19:44:04] but i carnt add the floating ip now to any of the instances [19:44:16] the project is git [19:44:27] and the floating ip i had it on was gerrit-test3 [19:47:20] in my companies' network (which i need to use on my laptop) are only the ports 80 and 443 open, so i can't access tools via ssh [19:47:34] is it possible to install something like shellinabox somewhere, to get access through port 443? [19:47:52] https://code.google.com/p/shellinabox/ [19:50:59] paladox: uh, what? how would draft rights help? [19:51:30] paladox: mediawiki-svn doesn't receive any messages about drafts [19:51:42] (or whatever the list is called these days, mediawiki-commits?) [19:52:14] (03CR) 10Jean-Frédéric: "@Edouard, would you be able to make these changes ? :)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/303933 (https://phabricator.wikimedia.org/T142570) (owner: 10EdouardHue) [19:52:26] valhallasw`cloud i mean for inline edits [19:52:28] (03CR) 10Jean-Frédéric: [C: 032] Add project to dbPrimaryKey [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/306012 (https://phabricator.wikimedia.org/T143481) (owner: 10Lokal Profil) [19:53:10] (03CR) 10Jean-Frédéric: "Ah, damn, wanted to test it locally first. Oh well − I’m pretty sure it will work :)" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/306012 (https://phabricator.wikimedia.org/T143481) (owner: 10Lokal Profil) [19:53:23] (03Merged) 10jenkins-bot: Add project to dbPrimaryKey [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/306012 (https://phabricator.wikimedia.org/T143481) (owner: 10Lokal Profil) [19:57:10] valhallasw`cloud What i mean is i spoken to upstream and they say we can do that [19:57:30] allow it to read draft-set or what ever it is for uploading drafts like it is for patchset [19:57:41] (03PS2) 10Jean-Frédéric: Setup local development environment for ErfgoedBot [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/303498 [19:57:57] (03CR) 10Jean-Frédéric: Setup local development environment for ErfgoedBot (032 comments) [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/303498 (owner: 10Jean-Frédéric) [19:58:00] but it wont have drafts rights so it wont read drafts but will read patchsets but inline edit fires the drafts instead of patchset which is intended [20:00:56] paladox: I have responded to your patchset on github -- please respond there. [20:02:47] !log tools.heritage Deployed latest from Git: 22496d6 (T143481), c964df5, 00ccf8a, 1891ee0, 4458eeb, 55fea41 [20:02:48] T143481: Fatal error: Cannot use object of type stdClass as array in FormatHtml.php on line 96 - https://phabricator.wikimedia.org/T143481 [20:02:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL, Master [20:04:39] chasemp hi, it seems ssh into new instances is broken [20:04:55] Im getting this [20:05:00] $ ssh -i /c/Users/**/.ssh/id_rsa.pub gerrit-test3 [20:05:00] Password: [20:05:01] Permission denied (publickey,keyboard-interactive). [20:05:01] Killed by signal 1. [20:05:20] or andrewbogott or yuvipanda ^^ [20:06:37] Or Krenair ^^ [20:07:07] Even ssh into bastion manually [20:07:15] and doing ssh gerrit-test3 fails [20:07:29] paladox@bastion-01:~$ ssh gerrit-test3 [20:07:29] The authenticity of host 'gerrit-test3 (10.68.18.136)' can't be established. [20:07:29] ECDSA key fingerprint is 92:d3:31:ff:02:cb:3c:df:54:74:23:74:d4:6d:f2:9b. [20:07:30] Are you sure you want to continue connecting (yes/no)? yes [20:07:30] Warning: Permanently added 'gerrit-test3,10.68.18.136' (ECDSA) to the list of known hosts. [20:07:30] Password: [20:07:31] Permission denied (publickey,keyboard-interactive). [20:07:57] (03Abandoned) 10Jean-Frédéric: Safeguard against non-array $row [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/305794 (https://phabricator.wikimedia.org/T143481) (owner: 10Jean-Frédéric) [20:08:39] paladox, you can't ssh into the bastion and then ssh to an instance [20:08:50] unless you use agent forwarding or something, which you shouldn't be doing [20:08:55] Krenair i can ssh into bastion. [20:09:12] Yes [20:09:14] and nope i am manually ssh into bastion for testing to see if something is broken with ssh for me [20:09:24] but i did ssh paladox@bastion.wmflabs.org [20:09:30] If you ssh to a bastion and then ssh to an instance from there, you should get a password prompt [20:09:37] Your ssh keys won't work without agent forwarding which you should not be using [20:09:49] Yes, but it dosent work with my password [20:09:53] it just fails [20:10:01] It works on the other instances [20:10:12] Your password actually works for logging into instances? [20:10:15] Yes [20:10:31] Okay... I seriously suggest you never actually use that either [20:10:35] This is my config file [20:10:36] Host gerrit-test3 [20:10:36] ProxyCommand ssh -a -W %h:%p -A paladox@bastion.wmflabs.org [20:10:36] User paladox [20:10:40] ssh -A? [20:11:08] I think it does that [20:11:21] I know what it does [20:11:59] But this problem seems to have happened after upgrading labs [20:12:16] from kilo to liberty [20:12:24] uh huh. [20:12:27] Before then it was working when i was creating istances [20:12:43] I know that other users are having this problem like mutante [20:12:46] There have been many successful instance creations since we upgraded to Liberty [20:13:01] Oh, but it seems it wont work with a password [20:13:06] I use my ssh key [20:13:12] but it seems to always ask for a password [20:13:56] This is my command [20:14:01] ssh -i /c/Users/**/.ssh/id_rsa.pub gerrit-test3 [20:14:09] I replace my real name with ** [20:15:01] Okay, yes [20:15:04] I looked at the console log [20:15:07] This instance is broken [20:15:14] But it's not because of Liberty [20:15:42] Oh [20:15:59] Is it because of a broken kernal [20:16:40] I think there was an update for a kernal and that broke things [20:16:52] Not sure if the new jessie image that is on labs includes this [20:16:53] kernal [20:16:58] Can you please stop jumping to such conclusions? [20:17:04] Ok [20:17:05] sorry [20:17:46] The issue is that it thinks it's in a project called '{', instead of 'git' [20:17:56] Oh [20:18:01] I know why [20:18:10] Ok thanks [20:18:30] I'm going to replace it with an instance with a new testing image that should have the problem fixed [20:18:40] Ok thanks [20:18:41] :) [20:20:13] This issue is my fault [20:20:24] Oh [20:20:56] Krenair yay it work [20:20:59] worked thanks [20:21:09] could you publish that image for everyone please? [20:21:35] it is already public [20:21:51] just gotta select 'debian-8.5-jessie (testing)' in the image dropdown instead of debian-8.5-jessie [20:21:52] Oh, i thought it was a test image [20:21:56] it is [20:21:56] Ah [20:22:12] Could it be made debian-8.5-jessie instead of debian-8.5-jessie (testing) please? [20:22:13] (and.rew made the image) [20:22:23] otherwise users wont click on debian-8.5-jessie (testing) due to the name [20:22:28] I expect that will happen soon, paladox [20:22:28] Oh [20:22:32] Ok thanks [20:24:34] 06Labs: Replace debian-8.5-jessie image with debian-8.5-jessie (testing) image - https://phabricator.wikimedia.org/T144439#2599861 (10Paladox) [20:24:40] Krenair i created ^^ for a reminder [20:24:50] for andrewbogott [20:27:37] !log tools.heritage Pulled latest pywikibot (branch 2.0) from Git: 8 commits, including fix for T144438. [20:27:38] T144438: ErfgoedBot categorisation task keeps crashing - https://phabricator.wikimedia.org/T144438 [20:27:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.heritage/SAL, Master [20:32:00]