[02:47:09] 10Striker: Request connection of ZppixBot repo(s) to Striker - https://phabricator.wikimedia.org/T151279#2812992 (10Zppix) [03:18:48] (03CR) 10Yuvipanda: [C: 032] jsub: guard against PYTHONPATH munging in caller's environment [labs/toollabs] - 10https://gerrit.wikimedia.org/r/322790 (https://phabricator.wikimedia.org/T147350) (owner: 10BryanDavis) [03:19:09] (03Merged) 10jenkins-bot: jsub: guard against PYTHONPATH munging in caller's environment [labs/toollabs] - 10https://gerrit.wikimedia.org/r/322790 (https://phabricator.wikimedia.org/T147350) (owner: 10BryanDavis) [03:27:39] a while back, someone made a tool for me. I had it bookmarked on my old computer, whose hard drives are currently being (very slowly) salvaged, and it's probable that I won't get the bookmarks, etc, back anyway [03:27:50] could anyone help me find the tool? [03:35:13] Dragonfly6-7, yes? [03:35:20] was it hosted here at tools? [03:35:50] If yes, https://tools.wmflabs.org/?list is a complete list, it would have it. If no, give details and I would try to find if I can [03:35:53] I believe it was, yes [03:35:58] * Dragonfly6-7 checks [03:36:18] https://tools.wmflabs.org/shortnames/ [03:36:52] .... if I can get it to load. [03:37:23] it doesn't seem to be loading. Can you figure out what's wrong? [03:37:42] cancel that [03:37:50] just took a bit longer than usual [03:39:24] gry - thank you. [04:55:20] 10Striker, 07Epic, 07Tracking: Manually connect existing Diffusion repos to tools in toolsadmin - https://phabricator.wikimedia.org/T144282#2813223 (10Krenair) [04:59:27] 10Striker, 07Epic, 07Tracking: Manually connect existing Diffusion repos to tools in toolsadmin - https://phabricator.wikimedia.org/T144282#2813224 (10Krenair) [05:00:30] 10Striker: Request connection of ZppixBot repo(s) to Striker - https://phabricator.wikimedia.org/T151279#2813241 (10Krenair) 05Open>03Resolved a:03Krenair Created: Tool: zppixbot Name: labs-tools-ZppixBot Phid: PHID-REPO-2v3vwh5fhc6jvoiexno3 [05:00:32] 10Striker, 07Epic, 07Tracking: Manually connect existing Diffusion repos to tools in toolsadmin - https://phabricator.wikimedia.org/T144282#2594816 (10Krenair) [08:23:08] 06Labs, 10Labs-Infrastructure, 10DBA: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2813424 (10Marostegui) db1095 got replication broken last night (reminder: it was imported from dbstore2001): ``` 2016-11-21 16:14:01 139805028624128 [E... [08:26:44] 06Labs, 10Labs-Infrastructure, 06Release-Engineering-Team, 07Beta-Cluster-reproducible, 07LDAP: Purge old instances from wmflabs Shinken - https://phabricator.wikimedia.org/T150339#2813425 (10hashar) 05Invalid>03Open p:05Triage>03High [08:28:11] 06Labs, 10Labs-Infrastructure, 06Release-Engineering-Team, 07Beta-Cluster-reproducible, 07LDAP: Purge old instances from wmflabs Shinken - https://phabricator.wikimedia.org/T150339#2782648 (10hashar) Reopened. Shinken still complains / notify about it. Turns out that all the instances were shutdown as t... [08:30:22] 06Labs, 10Labs-Infrastructure, 06Release-Engineering-Team, 07Beta-Cluster-reproducible, 07LDAP: Purge old instances from wmflabs Shinken - https://phabricator.wikimedia.org/T150339#2813434 (10hashar) 05Open>03Resolved a:03hashar Should be good now :] [08:49:36] 06Labs, 10Labs-Infrastructure, 10DBA: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2813443 (10Marostegui) I have run the first iteration of the script. By the way, I have created a new script that bypasses the safety measures of `redact... [09:00:26] 06Labs, 10Tool-Labs: Cannot access repliaca databases - access denied - https://phabricator.wikimedia.org/T151296#2813451 (10MnemonicFlow) [09:00:50] 06Labs, 10Tool-Labs: Cannot access replica databases - access denied - https://phabricator.wikimedia.org/T151296#2813463 (10MnemonicFlow) [09:31:48] 06Labs, 10Tool-Labs: Cannot access replica databases - access denied - https://phabricator.wikimedia.org/T151296#2813523 (10MnemonicFlow) [09:40:29] RECOVERY - Host tools-secgroup-test-102 is UP: PING OK - Packet loss = 0%, RTA = 1.17 ms [09:48:24] PROBLEM - Host tools-secgroup-test-102 is DOWN: CRITICAL - Host Unreachable (10.68.21.170) [09:55:18] 06Labs, 10Labs-Infrastructure, 06Release-Engineering-Team, 07Beta-Cluster-reproducible, 07LDAP: Purge old instances from wmflabs Shinken - https://phabricator.wikimedia.org/T150339#2813557 (10Krenair) 05Resolved>03Invalid No, deployment-pdf02 was not replaced by a jessie instance. Do not delete insta... [09:59:14] 06Labs, 10Labs-Infrastructure, 10DBA: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2813561 (10Marostegui) I have checked the following list of table.column making sure that the column has no records or they have the ID set to what the l... [10:00:16] 06Labs, 10Tool-Labs: C# MONO bot runs OK but not with jsub - https://phabricator.wikimedia.org/T150099#2813564 (10scfc) 05Open>03Resolved a:03Kotz [10:01:03] 06Labs, 10Labs-Infrastructure, 10DBA: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2813566 (10jcrespo) ``` MariaDB [(none)]> SHOW GLOBAL VARIABLES like 'slave_run_triggers_for_rbr'; +----------------------------+-------+ | Variable_name... [10:02:34] 06Labs, 10Labs-Infrastructure, 10DBA: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2813568 (10jcrespo) Also, please upload a redact_standard_output.sh which does not bypass the checks, only add db1095 as a good sanitarium host. [10:06:46] 06Labs, 10Labs-Infrastructure, 10DBA: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2813571 (10Marostegui) >>! In T150960#2813566, @jcrespo wrote: > ``` > MariaDB [(none)]> SHOW GLOBAL VARIABLES like 'slave_run_triggers_for_rbr'; > +----... [10:09:25] 06Labs, 10Labs-Infrastructure, 10DBA: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2813574 (10jcrespo) > and now > Changed to only allow db1095. Please add me as reviewer of both changes. [10:36:40] RECOVERY - Host secgroup-lag-102 is UP: PING OK - Packet loss = 0%, RTA = 1.45 ms [11:01:49] PROBLEM - Host secgroup-lag-102 is DOWN: PING CRITICAL - Packet loss = 100% [11:05:39] RECOVERY - Host tools-secgroup-test-103 is UP: PING OK - Packet loss = 0%, RTA = 1.12 ms [11:07:02] 06Labs, 06Operations: create-dbusers service failing on labstore1004 - https://phabricator.wikimedia.org/T151310#2813785 (10Volans) [11:21:11] PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22) [11:24:48] 10Tool-Labs-tools-Other: create tool to crunch metrics for views (play started) of video and audio files - https://phabricator.wikimedia.org/T116363#2813894 (10ezachte) @harej-NIOSH thanks These columns are a very minimal set. The idea behind counting image requests in bins per file size was that it allows maki... [12:59:33] 10Tool-Labs-tools-Other, 10Wikimedia-Video: create tool to crunch metrics for views (play started) of video and audio files - https://phabricator.wikimedia.org/T116363#2814070 (10TheDJ) [14:04:34] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814202 (10Marostegui) >>! In T150960#2810612, @Marostegui wrote: > Thanks - as per the replication filters, these tables woulld ne... [14:07:24] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814221 (10Marostegui) And as soon as I sent that: ``` 2016-11-22 14:04:55 139805000005376 [ERROR] Slave SQL: Error executing row... [14:11:04] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814227 (10jcrespo) > these tables woulld need to be dropped I have some comments of some tables that I know about: * some of tho... [14:15:38] 06Labs, 06Operations: labstore systemd state Icinga alarms - https://phabricator.wikimedia.org/T151322#2814238 (10Volans) [14:17:05] 10Tool-Labs-tools-Other, 10Wikimedia-Video: create tool to crunch metrics for views (play started) of video and audio files - https://phabricator.wikimedia.org/T116363#2814250 (10harej-NIOSH) @ezachte I would be interested in the data for full size images vs. thumbnail/icon, but this API focuses on the number... [14:17:29] 06Labs, 10Tool-Labs: Cannot access replica databases - access denied - https://phabricator.wikimedia.org/T151296#2814253 (10chasemp) p:05Triage>03Normal Did this work previously and, if so, when? [14:18:32] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814256 (10jcrespo) > And as soon as I sent that: We have to do some study: http://dev.mysql.com/doc/refman/5.6/en/replication-ru... [14:23:19] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814265 (10Marostegui) >>! In T150960#2814256, @jcrespo wrote: >> And as soon as I sent that: > > We have to do some study: > > h... [14:23:25] 06Labs, 06Operations: labstore systemd state Icinga alarms - https://phabricator.wikimedia.org/T151322#2814266 (10chasemp) p:05High>03Normal a:03madhuvishy labstore1002 is waiting for reimage, and labstore2001 is not in service atm but I'm not sure why in that case. But it can wait for @madhuvishy to re... [14:25:07] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814271 (10jcrespo) The problem is that, as do has preference over ignore, and ROW based and STATEMENT based behave differently, it... [14:25:19] 06Labs, 06Operations: labstore systemd state Icinga alarms - https://phabricator.wikimedia.org/T151322#2814272 (10Volans) Ok, I've ACK'ed the two critical in Icinga with this ticket. [14:27:31] Dumb question: how do I change the MySQL password for my tool? [14:28:24] Harej, it is not a dumb question [14:28:37] 06Labs, 06Operations: create-dbusers service failing on labstore1004 - https://phabricator.wikimedia.org/T151310#2814276 (10chasemp) I believe this may happen periodically as the script makes a connection to both ldap servers (to round robin queries) to determine if new users exist and those servers currently... [14:28:47] in the past, deleting the file would recreate it [14:28:58] and give you new credentials [14:29:08] That would actually be really cool. [14:29:19] I think there are plans for a more friendly approach [14:29:37] the problem is I am not 100% sure that will work now (but it should) [14:29:52] it won't [14:30:05] atm [14:30:05] :-( [14:30:14] I am sorry, Harej [14:30:56] Harej: drop a ticket and we can sort it out, but it may be a week or so [14:31:04] So, barring that... is there *any* way to change the password? [14:31:09] ^ [14:31:25] yes, make a ticket and we delete and recreate the account [14:31:32] Okay, will do [14:32:15] Harej: if you could include the user from the current file that would speed things up [14:32:23] it's just UID w/ 'u' or 's' prepend iirc [14:33:06] this is currently quite broken Harej so there is no good way to go about it [14:33:31] yep [14:33:38] u for normal users and s for service users [14:34:34] 06Labs, 10Tool-Labs: New SQL credentials for mediaplaycounts tool - https://phabricator.wikimedia.org/T151323#2814283 (10harej-NIOSH) [14:34:38] % [14:34:40] ^ [14:36:04] 06Labs, 10Tool-Labs: New SQL credentials for mediaplaycounts tool - https://phabricator.wikimedia.org/T151323#2814283 (10jcrespo) I can confirm @harej-NIOSH is the owner of tools.mediaplaycounts. [14:36:54] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814298 (10Marostegui) Should we stick to STATEMENT as of today (and as that is what we have today) instead of exploring other terr... [14:39:12] 06Labs, 10Labs-Infrastructure, 10DBA, 13Patch-For-Review: Initial data tests for db1095 (temporary db1069 - sanitarium replacement) - https://phabricator.wikimedia.org/T150960#2814299 (10jcrespo) > That is why I was suggesting that maybe we can include a full shard (maybe S1 or S5?) Sure, as long as it is... [14:46:56] 06Labs, 10Tool-Labs: New SQL credentials for mediaplaycounts tool - https://phabricator.wikimedia.org/T151323#2814313 (10chasemp) 05Open>03Resolved a:03chasemp I was already in the neighborhood so I went ahead and did this. > -r-------- 1 53189 53189 52 Nov 22 14:40 /exp/project/tools/project/mediaplayc... [15:06:31] 06Labs, 06Operations, 13Patch-For-Review, 07Tracking: Migrate tools to secondary labstore HA cluster (Scheduled on 11/14) [tracking] - https://phabricator.wikimedia.org/T146154#2814395 (10chasemp) [15:06:35] 06Labs, 06Operations, 13Patch-For-Review, 07Tracking: Add config option in tools webservice debian package to write logs to /dev/null - https://phabricator.wikimedia.org/T149946#2814392 (10chasemp) 05Open>03Resolved a:03chasemp We reverted everything yesterday afternoon and so far no incident. [15:06:40] 06Labs, 06Operations, 13Patch-For-Review, 07Tracking: Migrate tools to secondary labstore HA cluster (Scheduled on 11/14) [tracking] - https://phabricator.wikimedia.org/T146154#2652289 (10chasemp) >>! In T146154#2799384, @chasemp wrote: > On second thought this should remain open until {T149946} is done (a... [15:09:16] 06Labs, 10Tool-Labs: Delete probably obsolete mongo.creds.json files - https://phabricator.wikimedia.org/T151206#2814403 (10chasemp) 05Open>03Resolved a:03chasemp sure, thanks for tracking this down [15:13:11] !log tools readd attr +i to replica.my.cnf that seems to have gotten lost in rsync migration [15:13:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:18:41] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [15:21:17] 06Labs, 10Tool-Labs: toollabs: puppet super broken on tool-services-01 and -02 - https://phabricator.wikimedia.org/T151264#2814489 (10chasemp) 05Open>03Resolved This is in part due to T150726 (which still needs to be addressed) which complicated the migration for https://gerrit.wikimedia.org/r/#/c/322008/... [15:21:46] 06Labs, 06Operations, 13Patch-For-Review, 07Tracking: overhaul labstore setup [tracking] - https://phabricator.wikimedia.org/T126083#2814495 (10chasemp) [15:21:48] 06Labs, 06Operations, 13Patch-For-Review, 07Tracking: Migrate tools to secondary labstore HA cluster (Scheduled on 11/14) [tracking] - https://phabricator.wikimedia.org/T146154#2814494 (10chasemp) 05Open>03Resolved [15:22:00] RECOVERY - Puppet run on tools-services-02 is OK: OK: Less than 1.00% above the threshold [0.0] [15:24:42] PROBLEM - Puppet run on tools-services-01 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [15:42:45] chasemp: hello :) is there really a risk bumping the Nodepool quota can cause havoc on the openstack infra? [15:42:58] if you have worries, lets do that after thanks giving for sure. [15:43:06] else I am tempted to invoke {{be bold}} :D [15:43:17] Let's wait [15:43:24] but really it is your call. I have no idea of the impact on the infrastructure :/ [15:44:34] chasemp: we could do that next tuesday ? [15:44:43] sure [15:44:44] since as I understand it monday is quite busy [15:45:04] deal! [15:59:42] RECOVERY - Puppet run on tools-services-01 is OK: OK: Less than 1.00% above the threshold [0.0] [16:20:57] !log ores ores-web-03 has an issue (Socket timeout, CRIT) [16:20:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [16:24:40] tools-bastion-03 is very slow [16:39:50] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, and 3 others: Move dbproxy1010 and dbproxy1011 to labs-support network, rename them to labsdbproxy1001 and labsdbproxy1002 - https://phabricator.wikimedia.org/T149170#2814739 (10Cmjohnson) @jcrespo, these 2 servers have been moved to rack C5, connected to... [16:41:57] 06Labs, 10Labs-Infrastructure, 10DBA, 06Operations, and 3 others: Move dbproxy1010 and dbproxy1011 to labs-support network, rename them to labsdbproxy1001 and labsdbproxy1002 - https://phabricator.wikimedia.org/T149170#2814740 (10jcrespo) a:03jcrespo @Cmjohnson Thank you a lot! I will take it from here [16:42:58] !log tools.stashbot Restarted to pick up https://github.com/bd808/tools-stashbot/commit/9bc95fc -- subst: templates [16:43:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stashbot/SAL [16:45:32] tools-bastion-03 is very slow to me too [16:52:39] PROBLEM - Free space - all mounts on tools-docker-registry-01 is CRITICAL: CRITICAL: tools.tools-docker-registry-01.diskspace.root.byte_percentfree (<100.00%) [17:19:51] If you report this error, please include the details below. [17:19:52] Request ID [17:19:53] ccb4459aa78745eeb2eef14ef7bb832a [17:20:14] From toolsadmin [17:24:40] bastion-03 has so many folks running tools long term in place it's a pita to clean up so I'm going to reboot [17:25:20] All mine are on kubectl [17:25:25] Zppix|mobile: thanks. I'll see if I can dig up the error in our ELK logging [17:29:54] PROBLEM - SSH on tools-bastion-03 is CRITICAL: Connection refused [17:39:24] 06Labs, 10Tool-Labs, 10Gerrit, 10Pywikibot-core: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2814978 (10Multichill) [17:40:46] 06Labs, 10Gerrit: Strange errors when cloning operations/mediawiki-config from gerrit to labs NFS - https://phabricator.wikimedia.org/T142787#2814997 (10demon) [17:40:49] 06Labs, 10Tool-Labs, 10Gerrit, 10Pywikibot-core: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2814994 (10demon) [17:40:50] bastion-03 seems to have not come back [17:40:52] so that's interesting [17:41:05] PROBLEM - Host tools-bastion-03 is DOWN: CRITICAL - Host Unreachable (10.68.23.58) [17:44:11] 06Labs, 10Tool-Labs, 10Gerrit, 10Pywikibot-core: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2814978 (10Paladox) Try this http://stackoverflow.com/questions/17683295/git-bash-error-rpc-failed-result-18... [17:46:06] RECOVERY - Host tools-bastion-03 is UP: PING OK - Packet loss = 0%, RTA = 1.63 ms [18:15:23] 06Labs, 10Tool-Labs, 10Gerrit, 10Pywikibot-core: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2814978 (10chasemp) Does the shared copy of this library not work for you? root@tools-bastion-03:~# ls -al... [18:34:56] your chasefulness [18:42:31] 06Labs, 10Tool-Labs, 10Gerrit, 10Pywikibot-core: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2815292 (10Multichill) 05duplicate>03Open [18:45:02] 06Labs, 10Tool-Labs, 10Gerrit, 10Pywikibot-core: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2815297 (10Multichill) @Paladox I'll try later @chasemp That updates every night to master. Master is broken... [18:52:40] 06Labs, 10Tool-Labs, 10Gerrit, 10Pywikibot-core: Fresh clone of pywikibot from gerrit fails with error: RPC failed; result=56, HTTP code = 200 on Toollabs - https://phabricator.wikimedia.org/T151351#2815328 (10chasemp) That's a fair point on automatic updates, maybe there is a case to be made not to do tha... [19:13:09] 10Tool-Labs-tools-Pageviews: Implement a monthly granularity view for Pageviews - https://phabricator.wikimedia.org/T151373#2815449 (10MusikAnimal) [22:10:26] Good morning [22:10:41] 10Labs-project-Phabricator, 13Patch-For-Review: have a phabricator test instance in labs that uses a working puppet role - https://phabricator.wikimedia.org/T139475#2816359 (10Paladox) Also fixed in https://gerrit.wikimedia.org/r/#/c/322972/ [22:10:43] 10Striker: ToolsAdmin: Error 500 for ZppixBot repo listing - https://phabricator.wikimedia.org/T151409#2816360 (10Zppix) [22:23:43] 10Striker, 10Tool-Labs-tools-Zppixbot: ToolsAdmin: Error 500 for ZppixBot repo listing - https://phabricator.wikimedia.org/T151409#2816448 (10Zppix) [22:40:39] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 4 others: Set up process / criteria for taking over abandoned tools - https://phabricator.wikimedia.org/T87730#2816554 (10bd808) [23:29:46] 10Striker, 10Tool-Labs-tools-Zppixbot: ToolsAdmin: Error 500 for ZppixBot repo listing - https://phabricator.wikimedia.org/T151409#2816622 (10bd808) `django.core.urlresolvers.NoReverseMatch: Reverse for 'repo_view' with arguments '()' and keyword arguments '{'tool': 'zppixbot', 'repo': 'labs-tools-ZppixBot'}'... [23:52:35] (03PS1) 10BryanDavis: Allow uppercase in diffusion repo names [labs/striker] - 10https://gerrit.wikimedia.org/r/323088 (https://phabricator.wikimedia.org/T151409) [23:54:16] Krenair, YuviPanda: ^ trivial Striker bug fix [23:56:18] (03CR) 10Alex Monk: [C: 032] Allow uppercase in diffusion repo names [labs/striker] - 10https://gerrit.wikimedia.org/r/323088 (https://phabricator.wikimedia.org/T151409) (owner: 10BryanDavis) [23:56:33] 10Striker, 10Tool-Labs-tools-Zppixbot, 13Patch-For-Review, 15User-bd808: ToolsAdmin: Error 500 for ZppixBot repo listing - https://phabricator.wikimedia.org/T151409#2816684 (10bd808) a:03bd808 I have stopped the 500 error temporarily by editing the record created for T151279 to use all lower case. This i... [23:56:47] thanks Krenair [23:57:14] 10Striker, 10Tool-Labs-tools-Zppixbot, 13Patch-For-Review, 15User-bd808: ToolsAdmin: Error 500 for ZppixBot repo listing - https://phabricator.wikimedia.org/T151409#2816690 (10bd808) p:05Triage>03High [23:58:05] (03Merged) 10jenkins-bot: Allow uppercase in diffusion repo names [labs/striker] - 10https://gerrit.wikimedia.org/r/323088 (https://phabricator.wikimedia.org/T151409) (owner: 10BryanDavis)