[00:33:49] sigh [00:34:03] RECOVERY - Mathoid on deployment-mathoid is OK: HTTP OK: HTTP/1.1 200 OK - 925 bytes in 0.027 second response time [00:34:05] it left a/some channels so i restarted its IRC process [00:34:10] now it's gone from all :( [00:36:17] 10Gerrit, 10Operations, 10serviceops, 10Patch-For-Review: Convert Gerrit to use H2 as the database - https://phabricator.wikimedia.org/T211139 (10Dzahn) say something random to make wikibugs rejoin a channel [00:40:05] PROBLEM - Mathoid on deployment-mathoid is CRITICAL: connect to address 172.16.5.73 and port 10042: Connection refused [01:15:08] https://mailarchive.ietf.org/arch/msg/cfrg/NhiGvOFzcEw108YLwF_ndyfB1k4?fbclid=IwAR2NiuZLlbKK3xu5Vg1EysyZ2Dab7N9mgGYQNPC0p5tGPZOwuJBCQ7R7XQY [01:22:17] (03PS1) 10Kosta Harlan: Codehealth pipeline: Add more extensions [integration/config] - 10https://gerrit.wikimedia.org/r/510063 [03:50:03] RECOVERY - Mathoid on deployment-mathoid is OK: HTTP OK: HTTP/1.1 200 OK - 925 bytes in 0.027 second response time [04:01:03] PROBLEM - Mathoid on deployment-mathoid is CRITICAL: connect to address 172.16.5.73 and port 10042: Connection refused [06:22:54] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10Joe) >>! In T220235#5176630, @Ottomata wrote: > Could we use image version: latest in beta hiera? And somehow pull d... [06:25:58] PROBLEM - Puppet errors on integration-slave-jessie-1002 is CRITICAL: (Service Check Timed Out) [06:43:02] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10Krenair) Lets put together a list of all the services we need to set up as containers within beta (either because stu... [06:50:05] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10Joe) >>! In T220235#5179225, @Krenair wrote: > Lets put together a list of all the services we need to set up as cont... [06:54:26] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10Krenair) Alright, I guess in that case I'll create a VM for citoid later and try getting the container for that runni... [06:59:51] Phab admins: https://phabricator.wikimedia.org/p/Mr.deVega/ [07:04:24] nevermind, found a steward who could do it [07:06:53] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:07:27] Krenair: thanks, I was awake but didn't see this [07:08:04] 10Phabricator, 10Tools: Publicly log account bans made using the phab-ban tool - https://phabricator.wikimedia.org/T200856 (10revi) In the absence of official logging feature: Disabled https://phabricator.wikimedia.org/p/Mr.deVega/ for vandalism (If someone think it is fine to restore access pls do) [07:08:07] this one appears to be one that found its way through toolsadmin [07:09:50] xD [07:12:46] I wonder how, considering toolsadmin account creation is still disabled [07:12:57] maybe it was created in LDAP before but only just now being used to vandalise phab [07:23:33] <_joe_> Krenair: re: citoid - that's the one case where I'd put citoid and zotero on the same VM [07:24:05] makes sense [07:24:06] <_joe_> also ask for assistance in #sre-serviceops, I might not be available, but fabian and alex can help you get a working config for citoid/zoterov2 [07:24:34] <_joe_> and thanks for helping with that. In an ideal world, the teams developing new services would install them on beta [07:24:56] <_joe_> it might work out most of the times, but then we have people with no beta access, like wmde folks for termbox [07:31:15] Well, that's trivial to fix. [07:32:48] I'm off to an exam but I'll be back in a few hours and will hopefully remember to find out who that is and which of them are missing access [07:46:52] 10Gerrit, 10Release-Engineering-Team, 10translatewiki.net, 10Language-Team (Language-2019-April-June): Running translatewiki export for MediaWiki extensions: Too many concurrent connections (4) - max. allowed: 4 - https://phabricator.wikimedia.org/T222546 (10Nikerabbit) >>! In T222546#5158958, @Nikerabbit... [07:48:01] Good luck Krenair [07:50:18] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10akosiaris) >>! In T220235#5179194, @Joe wrote: >>>! In T220235#5176630, @Ottomata wrote: >> Could we use image versio... [08:41:09] (03PS1) 10Hashar: Switch cumin to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510086 (https://phabricator.wikimedia.org/T222512) [08:41:58] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: CI: upgrade tox or allow to override its version per-project - https://phabricator.wikimedia.org/T222512 (10hashar) 05Stalled→03Open `docker-registry.wikimedia.org/releng/tox:0.4.0` is now available on all J... [08:46:02] (03CR) 10Hashar: [C: 03+2] "The releng/tox:0.4.0 container is now available on all Jenkins slave thus I have updated the jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/510086 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [08:47:30] (03PS1) 10Hashar: Bump most jobs to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510087 (https://phabricator.wikimedia.org/T222512) [08:48:13] (03Merged) 10jenkins-bot: Switch cumin to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510086 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [08:48:54] (03CR) 10Hashar: [C: 03+2] Bump most jobs to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510087 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [08:51:03] (03Merged) 10jenkins-bot: Bump most jobs to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510087 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [08:52:27] (03PS2) 10Hashar: cumin-tox-publish: use the Python 3.7 env [integration/config] - 10https://gerrit.wikimedia.org/r/508319 (owner: 10Volans) [08:53:18] (03CR) 10Hashar: "Rebased to use releng/tox:0.4.0 container and I have updated the two publish jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/508319 (owner: 10Volans) [08:53:33] (03CR) 10Hashar: [C: 03+2] cumin-tox-publish: use the Python 3.7 env [integration/config] - 10https://gerrit.wikimedia.org/r/508319 (owner: 10Volans) [08:55:42] (03Merged) 10jenkins-bot: cumin-tox-publish: use the Python 3.7 env [integration/config] - 10https://gerrit.wikimedia.org/r/508319 (owner: 10Volans) [09:11:21] (03PS1) 10Hashar: docker: rebuild based on releng/tox:0.4.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510091 (https://phabricator.wikimedia.org/T222512) [09:16:45] (03CR) 10Hashar: [C: 03+2] docker: rebuild based on releng/tox:0.4.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510091 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [09:18:15] (03Merged) 10jenkins-bot: docker: rebuild based on releng/tox:0.4.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510091 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [09:19:03] !log Building docker containers releng/tox-*:0.4.0 [09:19:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:31:06] (03PS1) 10Hashar: Bump misc tox jobs to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510096 (https://phabricator.wikimedia.org/T222512) [09:32:30] (03PS2) 10Jforrester: Codehealth pipeline: Add to Echo, Flow, and PageTriage extensions [integration/config] - 10https://gerrit.wikimedia.org/r/510063 (owner: 10Kosta Harlan) [09:32:45] (03CR) 10Jforrester: [C: 03+1] Codehealth pipeline: Add to Echo, Flow, and PageTriage extensions [integration/config] - 10https://gerrit.wikimedia.org/r/510063 (owner: 10Kosta Harlan) [09:39:56] 10Continuous-Integration-Config: operations/puppet patches having CR+2 are not retested on a rebase - https://phabricator.wikimedia.org/T223209 (10hashar) [09:41:39] (03CR) 10Hashar: [C: 03+2] Bump misc tox jobs to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510096 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [09:43:40] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: CI: upgrade tox or allow to override its version per-project - https://phabricator.wikimedia.org/T222512 (10hashar) 05Open→03Resolved All containers have been updated except the special cases: * operations-... [09:43:55] !log Upgraded all tox jobs to tox 3.10.0 [09:43:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:45:42] (03Merged) 10jenkins-bot: Bump misc tox jobs to tox 3.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/510096 (https://phabricator.wikimedia.org/T222512) (owner: 10Hashar) [09:48:54] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: CI: upgrade tox or allow to override its version per-project - https://phabricator.wikimedia.org/T222512 (10hashar) Announced on the QA list. [09:52:00] 10Continuous-Integration-Config: Whitelisted users without +2 rights can no longer recheck patches which have a +2 - https://phabricator.wikimedia.org/T223212 (10LucasWerkmeister) [09:52:23] 10Continuous-Integration-Config: Whitelisted users without +2 rights can no longer recheck patches which have a +2 - https://phabricator.wikimedia.org/T223212 (10LucasWerkmeister) [09:54:13] hashar: ^^ [10:02:10] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Wikidata, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) > With respect to the end point checks it would be great to hear what we are trying to achieve with them. Our servic... [10:02:16] 10Release-Engineering-Team (Watching / External), 10Growth-Team, 10Notifications, 10MW-1.34-notes (1.34.0-wmf.5; 2019-05-14), 10Patch-For-Review: Echo Selenium tests - Build failure - Cannot find module wdio-mediawiki/Util - https://phabricator.wikimedia.org/T223150 (10zeljkofilipin) p:05Triage→03Norm... [10:06:08] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban): operations/puppet patches having CR+2 are not retested on a rebase - https://phabricator.wikimedia.org/T223209 (10hashar) [10:06:35] 10Release-Engineering-Team (Watching / External), 10Growth-Team, 10Notifications, 10MW-1.34-notes (1.34.0-wmf.5; 2019-05-14), 10Patch-For-Review: Echo Selenium tests - Build failure - Cannot find module wdio-mediawiki/Util - https://phabricator.wikimedia.org/T223150 (10zeljkofilipin) 05Open→03Resolved... [10:07:09] (03PS1) 10Hashar: Allow tests to run on trivial rebase [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/510112 (https://phabricator.wikimedia.org/T223209) [10:07:55] 10Release-Engineering-Team (Watching / External), 10Growth-Team, 10Notifications, 10MW-1.34-notes (1.34.0-wmf.5; 2019-05-14), 10Patch-For-Review: Echo Selenium tests - Build failure - Cannot find module wdio-mediawiki/Util - https://phabricator.wikimedia.org/T223150 (10zeljkofilipin) a:05zeljkofilipin→... [10:12:32] (03CR) 10Hashar: [C: 04-1] "Actually copyMaxScore default to false and it is not set in operations/puppet or All-Projects.git ..." [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/510112 (https://phabricator.wikimedia.org/T223209) (owner: 10Hashar) [10:12:34] 10Phabricator, 10CommRel-Design, 10CommRel-Internals: Create Phabricator form for CommRel-Design and Comms requests and add a link to it in the "Star" dropdown - https://phabricator.wikimedia.org/T223102 (10Qgil) [10:13:05] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Wikidata, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) >>! In T220402#5177862, @Pablo-WMDE wrote: > Hi @akosiaris - thanks for getting back to us. > >> sending a Host: HT... [11:15:58] 10Phabricator, 10CommRel-Design, 10CommRel-Internals: Create Phabricator form for CommRel-Design and Comms requests and add a link to it in the "Star" dropdown - https://phabricator.wikimedia.org/T223102 (10Quiddity) Note that this tool exists which greatly simplifies things: https://tools.wmflabs.org/phabul... [11:23:56] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Wikidata, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10Pablo-WMDE) Hi @akosiaris, thanks for taking the time to explain the way the `Host` header is intended to be used. If I unders... [11:28:55] PROBLEM - Disk space on contint1001 is CRITICAL: DISK CRITICAL - free space: / 1891 MB (4% inode=53%): https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space [11:32:41] (03PS1) 10Awight: mediawiki-phan 0.1.15: reduce memory usage [integration/config] - 10https://gerrit.wikimedia.org/r/510140 (https://phabricator.wikimedia.org/T219114) [11:32:45] 10Phabricator, 10CommRel-Design, 10CommRel-Internals: Create Phabricator form for CommRel-Design and Comms requests and add a link to it in the "Star" dropdown - https://phabricator.wikimedia.org/T223102 (10Aklapper) a:05hdothiduc→03None @hdothiduc: Assuming you don't plan to create this form yourself, h... [11:41:56] 10Phabricator: Herald rules' transcripts can only be viewed by members of #Trusted-Contributors, it seems - https://phabricator.wikimedia.org/T207376 (10Aklapper) 05Stalled→03Declined Unfortunately closing this report as no further information has been provided. @Sau226: After you have provided the informat... [11:42:29] 10Phabricator: AphrontCountQueryException when trying to visit my Profile in Phabricator - https://phabricator.wikimedia.org/T205817 (10Aklapper) @RheingoldRiver: Are you able to access https://phabricator.wikimedia.org/settings/panel/external/ ? Does it list your two accounts? What happens exactly if you try to... [11:44:44] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: operations/puppet patches having CR+2 are not retested on a rebase - https://phabricator.wikimedia.org/T223209 (10hashar) Relevant Gerrit code: ` lang=java,name=gerrit-server/src/main/java/com/google/gerrit/server/Appr... [11:45:36] PROBLEM - Host deployment-mathoid is DOWN: CRITICAL - Host Unreachable (172.16.5.73) [11:48:43] hashar: I think “rebase” is a special case [11:48:55] Where by a +2 will still be there after rebasing [11:49:07] yeah the code is at https://phabricator.wikimedia.org/T223209#5180160 [11:49:16] Since upstream do that quite a lot and only a new patch set removes it [11:49:16] the +2 is copied :( [11:50:06] I was expecting labels.Code-Review.copyMaxScore = false to prevent the +2 to be copied entirely ;] [11:53:47] 10Phabricator: AphrontCountQueryException when trying to visit my Profile in Phabricator - https://phabricator.wikimedia.org/T205817 (10RheingoldRiver) Oh, now I'm able to remove - when I opened the ticket, I got the same error come up when I attempted to delete, but now it let me unlink successfully - if that's... [11:54:13] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Backlog), 10Operations, 10SRE-Access-Requests: Request: add awight to contint-docker - https://phabricator.wikimedia.org/T223262 (10awight) [11:54:24] Heh [11:55:58] 10Beta-Cluster-Infrastructure, 10serviceops, 10Patch-For-Review: Puppet broken on VMs in deployment-prep - https://phabricator.wikimedia.org/T221654 (10Krenair) deleted deployment-mathoid [11:56:22] 10Beta-Cluster-Infrastructure: Migrate away from Debian Jessie to Debian Stretch - https://phabricator.wikimedia.org/T218729 (10Krenair) [11:58:45] hashar: see how they do it in 2.16? Possible they may allow you to override it [11:59:54] paladox: I think it is the same :D [12:01:00] (03PS2) 10Awight: Reduce memory usage by omitting progress bar [integration/config] - 10https://gerrit.wikimedia.org/r/510140 (https://phabricator.wikimedia.org/T219114) [12:01:01] (03PS1) 10Awight: Use phan images with disabled progress bar [integration/config] - 10https://gerrit.wikimedia.org/r/510143 (https://phabricator.wikimedia.org/T219114) [12:03:57] 10Release-Engineering-Team, 10Operations, 10Release Pipeline, 10Wikidata, and 5 others: Introduce wikidata termbox SSR to kubernetes - https://phabricator.wikimedia.org/T220402 (10akosiaris) >>! In T220402#5180031, @Pablo-WMDE wrote: > Hi @akosiaris, > > thanks for taking the time to explain the way the `... [12:11:56] 10Continuous-Integration-Config: Whitelisted users without +2 rights can no longer recheck patches which have a +2 - https://phabricator.wikimedia.org/T223212 (10hashar) The change had `Code-Review +2` by Amir and `Verified -1` by Jenkins. The `recheck` event did match: ` zuul.IndependentPipelineManager: Event... [12:12:27] (03Abandoned) 10Hashar: Allow tests to run on trivial rebase [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/510112 (https://phabricator.wikimedia.org/T223209) (owner: 10Hashar) [12:13:48] 10Gerrit: Unable to login to gerrit - https://phabricator.wikimedia.org/T223266 (10Shirayuki) [12:25:14] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: operations/puppet patches having CR+2 are not retested on a rebase - https://phabricator.wikimedia.org/T223209 (10hashar) ` zuul.Scheduler: Processing trigger event 10Continuous-Integration-Config: Whitelisted users without +2 rights can no longer recheck patches which have a +2 - https://phabricator.wikimedia.org/T223212 (10hashar) Same issue as T223209 [12:27:44] (03PS1) 10Hashar: Revert "zuul: skip test/test-prio for CR+2 changes" [integration/config] - 10https://gerrit.wikimedia.org/r/510148 (https://phabricator.wikimedia.org/T105474) [12:28:53] (03CR) 10Hashar: [C: 03+2] Revert "zuul: skip test/test-prio for CR+2 changes" [integration/config] - 10https://gerrit.wikimedia.org/r/510148 (https://phabricator.wikimedia.org/T105474) (owner: 10Hashar) [12:29:30] :,/ [12:30:22] (03Merged) 10jenkins-bot: Revert "zuul: skip test/test-prio for CR+2 changes" [integration/config] - 10https://gerrit.wikimedia.org/r/510148 (https://phabricator.wikimedia.org/T105474) (owner: 10Hashar) [12:33:11] 10Gerrit: Unable to login to gerrit - https://phabricator.wikimedia.org/T223266 (10Aklapper) Can you log into wikitech.wikimedia.org successfully? Have you tried both capital first letter and non-capital first letter on Gerrit? [12:34:44] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10Upstream: 'recheck' on a CR+2 patch should trigger gate-and-submit, not test - https://phabricator.wikimedia.org/T105474 (10hashar) 05Resolved→03Open That caused a few side effects such as T223212 or T... [12:35:02] 10Continuous-Integration-Config, 10Patch-For-Review: Whitelisted users without +2 rights can no longer recheck patches which have a +2 - https://phabricator.wikimedia.org/T223212 (10hashar) 05Open→03Resolved a:03hashar I have reverted the change that caused the issue. Sorry for the inconvenience. [12:35:13] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: operations/puppet patches having CR+2 are not retested on a rebase - https://phabricator.wikimedia.org/T223209 (10hashar) 05Open→03Resolved a:03hashar I have reverted the change that caused the issue. Sorry for th... [12:35:52] 10Continuous-Integration-Config, 10Patch-For-Review: Whitelisted users without +2 rights can no longer recheck patches which have a +2 - https://phabricator.wikimedia.org/T223212 (10LucasWerkmeister) Oh no :( in my opinion the recheck convenience was totally worth this small regression! [12:38:31] 10Continuous-Integration-Config, 10Patch-For-Review: Whitelisted users without +2 rights can no longer recheck patches which have a +2 - https://phabricator.wikimedia.org/T223212 (10LucasWerkmeister) (but perhaps the other regression was more significant, I wouldn’t know about that) [13:01:54] 10Project-Admins: Move #International-Developer-Events under #Events_Team - https://phabricator.wikimedia.org/T219608 (10Aklapper) a:03Aklapper [13:05:34] 10Project-Admins: Move #International-Developer-Events under #Events_Team - https://phabricator.wikimedia.org/T219608 (10Rfarrand) Yes! [13:17:46] 10Phabricator: AphrontCountQueryException when trying to visit my Profile in Phabricator - https://phabricator.wikimedia.org/T205817 (10Aklapper) 05Open→03Resolved I'm not aware of any fix, but it wasn't clear to me either that you had already tried that approach before. Was just an idea that came to my mind... [13:18:30] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:20:56] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10Ottomata) eventgate-main is up in both beta in via service::docker and in prod k8s. Both eventgate-analytics and eve... [13:38:06] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T220730 (10hashar) [13:38:41] Are there any precedents for a browser test that checks integration between two extensions? I see how to inject a LocalSettings.php fragment via tests/browser/, but not sure how I can cause the source for another extension to be cloned. [13:42:34] 10Phabricator: @Phabricator_maintenance is sending email notifications - https://phabricator.wikimedia.org/T216867 (10Aklapper) (For the records: Still failing on 20190514 in T219608) [13:43:43] awight: Locally? Or in CI? [13:43:52] 10Project-Admins: Move #International-Developer-Events under #Events_Team - https://phabricator.wikimedia.org/T219608 (10Aklapper) 05Open→03Resolved * renamed old to-be-archived project, to allow creation of new subproject with the same name * created subproject #Events_Team 🡒 #International-Developer-Events... [13:44:21] awight: https://github.com/wikimedia/integration-config/blob/master/zuul/parameter_functions.py#L141-L146 [13:46:22] Reedy: Yes, thank you! [13:48:45] (03PS1) 10Awight: Provide WikiEditor to FileImporter tests [integration/config] - 10https://gerrit.wikimedia.org/r/510167 (https://phabricator.wikimedia.org/T190829) [14:03:44] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T220730 (10fgiunchedi) [14:08:21] 10Gerrit: Unable to login to gerrit - https://phabricator.wikimedia.org/T223266 (10Paladox) @Aklapper case is no longer is a problem :) We switched it so it’s always lowercase. So I’m going to say 99% that the username in All-Users contains an uppercase this is not matching. [14:13:59] 10Phabricator, 10Developer-Advocacy (Apr-Jun 2019): Re-evaluate our use of Phabricator Conpherence chat - https://phabricator.wikimedia.org/T127640 (10mmodell) >>! In T127640#5154388, @Aklapper wrote: > * Re T127640#2116945: "less intimidating than IRC" has become moot as we use Zulip for GSoC and Outreachy p... [14:25:52] 10Phabricator, 10Developer-Advocacy (Apr-Jun 2019): Re-evaluate our use of Phabricator Conpherence chat - https://phabricator.wikimedia.org/T127640 (10Aklapper) >>! In T127640#5181169, @mmodell wrote: > should we look at making zulip more widely available to the broader technical community? It seems like a re... [14:29:53] 10Gerrit: Server error when visiting particular patch - https://phabricator.wikimedia.org/T223278 (10Urbanecm) [14:33:06] Well I fixed that one :) [14:34:26] 10Gerrit: Server error when visiting particular patch - https://phabricator.wikimedia.org/T223278 (10Paladox) I fixed this a few months for gerrit 2.16 :) [14:52:23] How can I search all mediawiki core and extension code? I searched on github and phab, but I'd like to be sure I don't have any blind spots because of how they index repos. [14:52:35] how do others do this? [14:53:13] 10Phabricator, 10Phabricator (Upstream), 10Epic, 10Upstream: [EPIC] Gather requirements from teams for Phab project management feature requests - https://phabricator.wikimedia.org/T105404 (10mmodell) [14:53:15] 10Phabricator: Add fields to support bug specific information - https://phabricator.wikimedia.org/T92708 (10mmodell) [14:53:18] 10Phabricator, 10User-MModell: Add support for task types - https://phabricator.wikimedia.org/T93499 (10mmodell) 05Open→03Resolved It seems that the `task types` experiment has been a success. With many types implemented and no major issues so far I think this can be marked as resolved. [14:53:34] milimetric: clone of them on your local machine ? ;D [14:53:40] milimetric: or use https://codesearch.wmflabs.org/search/ ;D [14:54:01] hashar: I could clone, but is there an easy way to clone all extensions? [14:55:17] milimetric: the codesearch tool is useful in that regard ^ [14:55:45] milimetric: various people have various solutions to the "clone it all" problem, eg: https://github.com/zeljkofilipin/gerrit/blob/master/git-clone.sh [14:56:45] ah, very cool. Also, the codesearch tool is great, I'll spread word of it far and wide. Thank you all! [14:56:58] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10Train Deployments: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notice: Undefined variab... - https://phabricator.wikimedia.org/T223281 [14:57:36] milimetric: just give credit to legoktm for codesearch :) [14:58:21] I don't know who this Lego person is, but he's about to blow up! [14:58:58] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10Train Deployments: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notice: Undefined variab... - https://phabricator.wikimedia.org/T223281 [14:59:16] (https://twitter.com/OVOJosh/status/550855852111192064) [14:59:41] lmao [14:59:48] (seriously though codesearch is ♥) [15:00:35] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10Train Deployments: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notice: Undefined variab... - https://phabricator.wikimedia.org/T223281 [15:01:45] https://groups.google.com/forum/m/#!topic/repo-discuss/92PqVTBTbXI [15:02:27] Pull requests in gerrit (prototype) [15:06:12] 10Phabricator, 10Developer-Advocacy (Apr-Jun 2019): Re-evaluate our use of Phabricator Conpherence chat - https://phabricator.wikimedia.org/T127640 (10chasemp) >>>! In T127640#5176939, @chasemp wrote: >> Security team has an ongoing chat with the stewards via conpherence. So far we (Security) have proposed... [15:06:36] 10Phabricator, 10User-MModell: Add support for task types - https://phabricator.wikimedia.org/T93499 (10mmodell) [15:07:11] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10Train Deployments: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notice: Undefined variab... - https://phabricator.wikimedia.org/T223281 [15:12:19] 10Phabricator, 10Developer-Advocacy (Apr-Jun 2019): Re-evaluate our use of Phabricator Conpherence chat - https://phabricator.wikimedia.org/T127640 (10Aklapper) >>! In T127640#5178820, @Peachey88 wrote: > There are valid and useful rooms @Peachey88: Please provide references for your statement, apart from Site... [15:15:16] 10Gerrit: "Server error: line 1:33 no viable alternative at character '['" when visiting particular patch - https://phabricator.wikimedia.org/T223278 (10Aklapper) [15:15:37] 10Phabricator, 10User-MModell: Add support for task types - https://phabricator.wikimedia.org/T93499 (10mmodell) [15:17:36] 10Project-Admins: Project for Wikimedia Finland - https://phabricator.wikimedia.org/T222442 (10Aklapper) @Susannaanas: ping - could you please reply? Thanks! [15:18:32] (03PS1) 10Kosta Harlan: Add Shivansh Bindal to whitelist for GSoC '19 [integration/config] - 10https://gerrit.wikimedia.org/r/510179 [15:19:59] (03CR) 10Kosta Harlan: "> Patch Set 2: Commit message was updated." [integration/config] - 10https://gerrit.wikimedia.org/r/510063 (owner: 10Kosta Harlan) [15:20:28] 10Phabricator, 10Release-Engineering-Team (Kanban), 10Security-Team, 10User-MModell: Create a security issue task type with additional attributes - https://phabricator.wikimedia.org/T204160 (10mmodell) Should we resolve this task? It seems like the new type is being used successfully. @chasemp: What do you... [15:27:38] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10VisualEditor-MediaWiki, and 2 others: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notic... - https://phabricator.wikimedia.org/T223281 [15:29:08] 10Scap: Investigate scap-cdb-rebuild idling until pressing ENTER repeatedly - https://phabricator.wikimedia.org/T223287 (10hashar) [15:34:52] 10Phabricator, 10CommRel-Design, 10CommRel-Internals: Create Phabricator form for CommRel-Design and Comms requests and add a link to it in the "Star" dropdown - https://phabricator.wikimedia.org/T223102 (10Qgil) Is it possible to create the form but not link it from the "Star" for everyone? Just have a link... [15:34:58] (03PS1) 10Paladox: Usernametolower shirayuki [All-Users] (refs/meta/external-id) - 10https://gerrit.wikimedia.org/r/510183 (https://phabricator.wikimedia.org/T223266) [15:36:06] 10Phabricator (Search), 10Release-Engineering-Team (Next), 10User-MModell: make phabricator search match projects based on alterenate hashtags - https://phabricator.wikimedia.org/T215085 (10greg) p:05Triage→03Normal [15:45:24] 10Scap: Investigate scap-cdb-rebuild idling until pressing ENTER repeatedly - https://phabricator.wikimedia.org/T223287 (10hashar) The last message were: 2019-05-14T15:14:48mw1263 INFO sync_common Copying from deploy1001.eqiad.wmnet to mw1263.eqiad.wmnet 2019-05-14T15:14:48mw1263 INFO sync_common Copying from... [15:45:53] 10Scap: Investigate scap-cdb-rebuild idling until pressing ENTER repeatedly - https://phabricator.wikimedia.org/T223287 (10hashar) p:05Triage→03Low We will see next train / week whether that still happens. [15:46:25] * paladox has found more users that have upper case usernames. [15:46:50] 10Scap: Investigate scap-cdb-rebuild idling until pressing ENTER repeatedly - https://phabricator.wikimedia.org/T223287 (10Reedy) I've had something like this before with scap on syncing to the servers, and the progress updates seem to get stuck and the process doesn't finish until I sit there holding enter I a... [15:47:17] 10Phabricator, 10CommRel-Design, 10CommRel-Internals: Create Phabricator form for CommRel-Design and Comms requests and add a link to it in the "Star" dropdown - https://phabricator.wikimedia.org/T223102 (10Aklapper) Yes, via `https://phabricator.wikimedia.org/maniphest/task/edit/form/XX/` format (replace `X... [15:47:58] 10Scap: Investigate scap-cdb-rebuild idling until pressing ENTER repeatedly - https://phabricator.wikimedia.org/T223287 (10hashar) Ah thank you Sam! So I am not alone ;] From Tyler, next time I should try with `scap --verbose sync "foobar"` to get debug messages directly to the console and see what happens. [15:49:15] 10Phabricator (Search), 10Release-Engineering-Team (Next), 10User-MModell: make phabricator search match projects based on alternate hashtags - https://phabricator.wikimedia.org/T215085 (10Aklapper) [15:50:26] 10Phabricator (Search), 10Release-Engineering-Team (Next), 10User-MModell: make phabricator search match projects based on alternate hashtags - https://phabricator.wikimedia.org/T215085 (10Aklapper) Also see T222870 when it comes to project search results missing items. [15:54:06] 10Gerrit: "Server error: line 1:33 no viable alternative at character '['" when visiting particular patch - https://phabricator.wikimedia.org/T223278 (10Urbanecm) Aha, thanks. Didn't know. [15:54:21] hashar thcipriani https://phabricator.wikimedia.org/P8523 (that's most of the usernames i could find with caps!) (over 1512 users have caps) [15:54:54] my grep was "grep -rnw './' -e 'gerrit:.*[A-Z].*'" [15:55:59] 10Gerrit: "Server error: line 1:33 no viable alternative at character '['" when visiting particular patch - https://phabricator.wikimedia.org/T223278 (10Paladox) [15:56:07] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Patch-For-Review: Upgrade to Gerrit 2.16.8 - https://phabricator.wikimedia.org/T200739 (10Paladox) [15:59:28] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T220730 (10Jdforrester-WMF) [15:59:34] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10VisualEditor-MediaWiki, and 3 others: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notic... - https://phabricator.wikimedia.org/T223281 [16:04:40] paladox: yeah I guess we have to migrate those eventually :/ [16:04:50] yup :( [16:04:53] which ends up being blocked on gerrit 2.16 upgrade [16:04:57] but it will happen eventually [16:04:57] 10Scap: Investigate scap-cdb-rebuild idling until pressing ENTER repeatedly - https://phabricator.wikimedia.org/T223287 (10Reedy) >>! In T223287#5181586, @hashar wrote: > Ah thank you Sam! So I am not alone ;] > > From Tyler, next time I should try with `scap --verbose sync "foobar"` to get debug messages direc... [16:06:25] hashar the good news is i think i've removed all the blockers for 2.16! [16:06:41] one of the blockers was merged last night (unblocking it)! [16:06:52] i merged 2 of them last night ^ [16:06:56] disable reverse DNS lookup [16:07:02] and list projects from secondary index [16:07:11] and restarted gerrit [16:07:25] ^ [16:08:10] 10Release-Engineering-Team (Kanban), 10RESTBase, 10VisualEditor, 10VisualEditor-MediaWiki, and 4 others: [{exception_id}] {exception_url} ErrorException from line 599 of /srv/mediawiki/php-1.34.0-wmf.4/extensions/VisualEditor/includes/ApiVisualEditor.php: PHP Notic... - https://phabricator.wikimedia.org/T223281 [16:08:57] paladox: mutante: I was in a chat with Tyler a minunte or so ago. Seems we want the latest gerrit 2.15 first + some plugin installed [16:09:07] yup [16:09:11] + a few things like logging and prometheus monitoring [16:09:26] then I guess Tyler will have brain availability to tackle at the 2.16 upgrade. [16:09:26] im hopping to get prometheus monitoring merged today [16:09:27] ok, ACK [16:09:32] which is better done after the hackathon anyway [16:09:42] tldr: soon! ;] [16:09:47] :)! [16:10:21] I am off, gotta prepare stuff ! *wave* [16:10:38] cu hashar, sounds good [16:10:46] ^ [16:10:51] yes, let's get the logging part done [16:11:02] dunno know about the users with caps part [16:11:08] be back in a bit as well [16:33:58] (03Abandoned) 10Krinkle: utils: Add zuul-layout shaker [integration/config] - 10https://gerrit.wikimedia.org/r/501812 (owner: 10Krinkle) [17:25:52] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Backlog), 10Operations: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10Dzahn) Alright, it's time again for CRIT: https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&h... [17:26:20] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10Dzahn) a:05RobH→03hashar [17:27:57] ACKNOWLEDGEMENT - Disk space on contint1001 is CRITICAL: DISK CRITICAL - free space: / 1502 MB (3% inode=52%): daniel_zahn https://phabricator.wikimedia.org/T207707#5135476 https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space [17:32:20] RECOVERY - Disk space on contint1001 is OK: DISK OK https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space [17:33:28] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Backlog), 10Release Pipeline: disk space alert on contint1001 - https://phabricator.wikimedia.org/T217094 (10Dzahn) [17:33:30] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10Dzahn) [17:33:42] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10Dzahn) [17:33:49] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Patch-For-Review: contint1001: DISK WARNING - free space: /srv 88397 MB (10% inode=94%): - https://phabricator.wikimedia.org/T219850 (10Dzahn) [17:36:48] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10Dzahn) As before /var/log/zuul is many Gigabytes and a large percentage of / and debug logging is enabled.... [17:36:59] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10Dzahn) p:05Normal→03High [17:46:19] this is checkers ui (https://gerrit-review.googlesource.com/c/zoekt/+/224352) (click "checks" tab) (first party ci in gerrit) [17:54:54] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations: contint1001 store docker images on separate partition or disk - https://phabricator.wikimedia.org/T207707 (10RobH) >>! In T207707#4937008, @thcipriani wrote: >>>! In T207707#4909130, @Dzahn wrote: >> Let's ask dcops i... [17:57:51] (03PS1) 10Brennen Bearnes: Add Dockerfile templates for local-charts [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) [17:59:36] (03CR) 10Brennen Bearnes: "For review, at least as a starting point, during our 2019-05-14 20:00 UTC pairing." [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) (owner: 10Brennen Bearnes) [18:00:59] (03CR) 10Jforrester: Add Dockerfile templates for local-charts (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) (owner: 10Brennen Bearnes) [18:01:58] (03CR) 10jerkins-bot: [V: 04-1] Add Dockerfile templates for local-charts [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) (owner: 10Brennen Bearnes) [18:04:10] (03PS2) 10Brennen Bearnes: Add Dockerfile templates for local-charts [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) [18:04:25] (03CR) 10Brennen Bearnes: Add Dockerfile templates for local-charts (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) (owner: 10Brennen Bearnes) [18:05:26] (03PS1) 10Pwirth: Add BlueSpiceRating [integration/config] - 10https://gerrit.wikimedia.org/r/510214 [18:05:32] (03CR) 10jerkins-bot: [V: 04-1] Add Dockerfile templates for local-charts [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) (owner: 10Brennen Bearnes) [18:07:24] (03PS2) 10Pwirth: Add BlueSpiceRating [integration/config] - 10https://gerrit.wikimedia.org/r/510214 [18:34:53] 10Continuous-Integration-Config, 10Release-Engineering-Team (Backlog), 10Zuul, 10Patch-For-Review, 10Upstream: 'recheck' on a CR+2 patch should trigger gate-and-submit, not test - https://phabricator.wikimedia.org/T105474 (10hashar) a:05hashar→03None The patch worked but it had a few culprit as descr... [18:36:42] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T220730 (10hashar) [19:15:05] (03CR) 10Hashar: [C: 04-1] "I would rather not have those local development images in integration/config and hmm it copy paste!" [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) (owner: 10Brennen Bearnes) [19:34:45] (03CR) 10Hashar: "From a chat with Tyler/Brennen. Lets try to get a dedicated namespace on the docker registry and setup all the credentials/config files et" [integration/config] - 10https://gerrit.wikimedia.org/r/510212 (https://phabricator.wikimedia.org/T218360) (owner: 10Brennen Bearnes) [19:38:10] (03CR) 10Hashar: [C: 03+2] Add Shivansh Bindal to whitelist for GSoC '19 [integration/config] - 10https://gerrit.wikimedia.org/r/510179 (owner: 10Kosta Harlan) [19:39:58] (03Merged) 10jenkins-bot: Add Shivansh Bindal to whitelist for GSoC '19 [integration/config] - 10https://gerrit.wikimedia.org/r/510179 (owner: 10Kosta Harlan) [19:43:46] (03CR) 10Hashar: [C: 03+2] Provide WikiEditor to FileImporter tests [integration/config] - 10https://gerrit.wikimedia.org/r/510167 (https://phabricator.wikimedia.org/T190829) (owner: 10Awight) [19:45:39] (03Merged) 10jenkins-bot: Provide WikiEditor to FileImporter tests [integration/config] - 10https://gerrit.wikimedia.org/r/510167 (https://phabricator.wikimedia.org/T190829) (owner: 10Awight) [19:48:39] (03CR) 10Hashar: [C: 03+2] "Good catch!" [integration/config] - 10https://gerrit.wikimedia.org/r/509944 (https://phabricator.wikimedia.org/T218598) (owner: 10Kosta Harlan) [19:49:59] (03CR) 10Hashar: [C: 03+2] "refreshed ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/502995 (owner: 10Hashar) [19:54:59] (03Merged) 10jenkins-bot: Codehealth: Allow jobs to execute concurrently [integration/config] - 10https://gerrit.wikimedia.org/r/509944 (https://phabricator.wikimedia.org/T218598) (owner: 10Kosta Harlan) [19:55:02] (03Merged) 10jenkins-bot: quibble-integration: only run php55 for REL1_27 [integration/config] - 10https://gerrit.wikimedia.org/r/502995 (owner: 10Hashar) [20:04:47] 10Gerrit, 10Release-Engineering-Team, 10translatewiki.net, 10Language-Team (Language-2019-April-June): Running translatewiki export for MediaWiki extensions: Too many concurrent connections (4) - max. allowed: 4 - https://phabricator.wikimedia.org/T222546 (10Raymond) @Nikerabbit Again getting "Received dis... [20:14:19] Project beta-code-update-eqiad build #246654: 04FAILURE in 1 min 18 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/246654/ [20:24:19] Yippee, build fixed! [20:24:19] Project beta-code-update-eqiad build #246655: 09FIXED in 1 min 18 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/246655/ [20:27:17] 10Gerrit, 10Release-Engineering-Team, 10translatewiki.net, 10Language-Team (Language-2019-April-June): Running translatewiki export for MediaWiki extensions: Too many concurrent connections (4) - max. allowed: 4 - https://phabricator.wikimedia.org/T222546 (10Nikerabbit) That shouldn't happen unless there i... [20:28:57] 10Release-Engineering-Team (Kanban), 10Developer Productivity, 10local-charts: Define a blubber file for a local-dev parsoid docker image - https://phabricator.wikimedia.org/T223331 (10jeena) p:05Triage→03Normal [20:30:30] (03PS1) 10Awight: Minor copyediting [integration/quibble] - 10https://gerrit.wikimedia.org/r/510246 [20:39:06] 10Continuous-Integration-Infrastructure, 10Jenkins: Jenkins jobs regularly being queued while resources appear to be readily available - https://phabricator.wikimedia.org/T218458 (10hashar) The puppet catalog compiler jobs benefit from it. They are run on two instances and one of them had its disk filling up q... [20:47:17] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10puppet-compiler: Puppet catalog compiler - increasing max concurrent jobs - https://phabricator.wikimedia.org/T221969 (10hashar) I thought about this task a little bit. The current instances have 4 vCPUs. The operations-puppet-catalog-com... [21:02:33] 10Continuous-Integration-Config, 10MediaWiki-extensions-Scribunto, 10Wikidata, 10Patch-For-Review, 10Wikidata-Campsite (Wikidata-Campsite-Iteration-∞): [Task] Add Scribunto to extension-gate in CI - https://phabricator.wikimedia.org/T125050 (10Anomie) >>! In T125050#5120646, @hashar wrote: > Scribunto ha... [21:05:54] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10Krenair) `krenair@deployment-docker-citoid01:~$ curl 'http://localhost:1970/api?search=10.1038%2Fng.590&format=mediaw... [21:15:11] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 3 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10Krenair) hold on a minute, that zotero instance does not exist, why does this work? [22:17:15] 10Gerrit, 10Patch-For-Review: Unable to login to gerrit - https://phabricator.wikimedia.org/T223266 (10Shirayuki) I have tried capital first letter, non-capital first letter and email address. I can log into wikitech.wikimedia.org. [22:36:05] 10Release-Engineering-Team, 10MediaWiki-SWAT-deployments: SWAT Shepherds seem wrong - https://phabricator.wikimedia.org/T223087 (10Rxy) I remember that time are almost SWAT-ed by zeljkof. I can available that time if I have a deploy access (I have no deploy access or logstash access now). [22:56:11] (03CR) 10Dduvall: [C: 03+2] pipeline: Provide a rickety but useful system test [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502919 (owner: 10Dduvall) [22:56:54] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502919 (owner: 10Dduvall) [22:56:56] (03Merged) 10jenkins-bot: pipeline: Provide a rickety but useful system test [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502919 (owner: 10Dduvall) [22:57:22] (03CR) 10jenkins-bot: pipeline: Provide a rickety but useful system test [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/502919 (owner: 10Dduvall) [23:01:06] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Pywikibot, 10Wikimedia-Hackathon-2019, 10Pywikibot-tests: Magul's quick tests doesn't run anymore - https://phabricator.wikimedia.org/T186208 (10Dvorapa) [23:04:05] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Pywikibot, 10Wikimedia-Hackathon-2019, 10Pywikibot-tests: Magul's quick tests doesn't run anymore - https://phabricator.wikimedia.org/T186208 (10Dvorapa) This will be challenge for Hackaton then. I heard that @greg will attend, so I... [23:15:27] 10Release-Engineering-Team (Kanban), 10Wikimedia-Site-requests, 10WikimediaMessages: Put "shim" code for namespaces, logs, and log i18n into WikimediaMessages so we can undeploy extensions - https://phabricator.wikimedia.org/T222918 (10greg) Should this be a blocker of the removal of UserMerge/CodeReview? [23:35:00] PROBLEM - Content Translation Server on deployment-sca01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:39:48] RECOVERY - Content Translation Server on deployment-sca01 is OK: HTTP OK: HTTP/1.1 200 OK - 904 bytes in 0.022 second response time [23:45:58] PROBLEM - Content Translation Server on deployment-sca01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:57:03] 10Phabricator, 10Developer-Advocacy (Apr-Jun 2019): Re-evaluate our use of Phabricator Conpherence chat - https://phabricator.wikimedia.org/T127640 (10Tgr) >>! In T127640#5181344, @chasemp wrote: > The general gist is above in the comment from a steward. IRC's limitations of no history, no alerting, etc. Con... [23:57:40] (03PS1) 10Dduvall: pipeline: Fix invalid SETUP/TEARDOWN const references [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/510271 [23:58:20] (03CR) 10Thcipriani: [C: 03+2] "deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/509943 (https://phabricator.wikimedia.org/T218598) (owner: 10Kosta Harlan) [23:59:01] (03CR) 10PipelineBot: "pipeline-dashboard: service-pipeline-test" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/510271 (owner: 10Dduvall)