[01:35:37] 10Release-Engineering-Team-TODO, 10GitHub-Mirrors: Disable "Automated security fixes" on Wikimedia Org - https://phabricator.wikimedia.org/T237337 (10Reedy) Disabled.. Emails to come [01:43:40] 10Release-Engineering-Team-TODO, 10GitHub-Mirrors: Disable "Automated security fixes" on Wikimedia Org - https://phabricator.wikimedia.org/T237337 (10Reedy) 05Open→03Resolved a:03Reedy https://lists.wikimedia.org/pipermail/wikitech-l/2019-November/092738.html and https://lists.wikimedia.org/pipermail/med... [07:04:29] Project beta-code-update-eqiad build #271329: 04FAILURE in 1 min 28 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/271329/ [07:14:29] Yippee, build fixed! [07:14:30] Project beta-code-update-eqiad build #271330: 09FIXED in 1 min 28 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/271330/ [10:38:28] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO (201911), 10International-Developer-Events, 10Wikimedia-Technical-Conference-2019, and 2 others: Wikimedia Technical Conference 2019 Session: System level testing: patterns an... - https://phabricator.wikimedia.org/T234635 [10:55:52] 10Project-Admins: Create User-Dyolf77 project on phabricator - https://phabricator.wikimedia.org/T237799 (10Ammarpad) [11:02:02] Thcipriani: https://gerrit-review.googlesource.com/c/gerrit/+/244612 [11:02:03] \o/ [13:41:54] 10Gerrit, 10Scoring-platform-team: gerrit: scoring/ores/editquality takes a long time to git gc - https://phabricator.wikimedia.org/T237807 (10thcipriani) [14:20:02] 10Phabricator, 10User-Josve05a: My profile picture on Phabricator looks wierd - https://phabricator.wikimedia.org/T235348 (10Josve05a) I've changed to another internet connection, still seeing the same issue, I will try another browser as well. {F31060254} [15:47:24] 10Phabricator, 10User-Josve05a: My profile picture on Phabricator looks wierd - https://phabricator.wikimedia.org/T235348 (10Masumrezarock100) I still can not reproduce this problem. Have you tried right clicking on the image and opening the image in a new tab? [16:44:13] 10Phabricator: Collapse long "Related Gerrit Patches" when there are too many - https://phabricator.wikimedia.org/T237816 (10Ammarpad) [16:44:44] 10Phabricator: Collapse "Related Gerrit Patches" when there are too many - https://phabricator.wikimedia.org/T237816 (10Ammarpad) [17:47:53] PROBLEM - Parsoid on deployment-parsoid09 is CRITICAL: connect to address 172.16.5.63 and port 8000: Connection refused [17:47:53] PROBLEM - Parsoid on deployment-mediawiki-parsoid10 is CRITICAL: connect to address 172.16.0.141 and port 8000: Connection refused [18:35:10] 10Phabricator: Collapse "Related Gerrit Patches" when there are too many - https://phabricator.wikimedia.org/T237816 (10Ammarpad) [19:05:50] 10Beta-Cluster-Infrastructure: cs.wikipedia is outside main matrix - https://phabricator.wikimedia.org/T237823 (10Dvorapa) [19:22:26] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10serviceops-radar, and 2 others: Gerrit account cache has a faulty reentrant lock causing http/sendemail threads to stall completely - https://phabricator.wikimedia.org/T224448 (10Paladox) Since we moved to new h... [20:20:07] 10Project-Admins: Create User-Dyolf77 project on phabricator - https://phabricator.wikimedia.org/T237799 (10MGChecker) a:05Aklapper→03MGChecker [20:23:27] 10Gerrit, 10Release-Engineering-Team-TODO, 10serviceops-radar: Gerrit GC thrashing during branch cut - https://phabricator.wikimedia.org/T231872 (10Paladox) 05Open→03Resolved a:03Paladox Going to boldly close this as resolved. It was mentioned on IRC that things look better since we've moved to new har... [20:23:36] 10Gerrit, 10Release-Engineering-Team-TODO, 10serviceops-radar: Gerrit GC thrashing during branch cut - https://phabricator.wikimedia.org/T231872 (10Paladox) a:05Paladox→03None [20:24:27] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: cs.wikipedia is outside main matrix - https://phabricator.wikimedia.org/T237823 (10Reedy) 05Open→03Resolved a:03Reedy [20:28:31] 10Project-Admins: Create User-Dyolf77 project on phabricator - https://phabricator.wikimedia.org/T237799 (10MGChecker) 05Open→03Resolved Requested public project #User-Dyolf77 has been created: https://phabricator.wikimedia.org/project/profile/4377/ Please encourage interested people to visit the project an... [22:33:47] Apparently the threads issue with gerrit may have been a kernel bug. So when we upgraded we gained a new kernel. [22:34:09] https://gerrit-review.googlesource.com/c/gerrit/+/153090/4#message-10cc8f42c24c28b1cb29c441c9aff13684555654 [22:37:43] 10Gerrit, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10serviceops-radar, and 2 others: Gerrit account cache has a faulty reentrant lock causing http/sendemail threads to stall completely - https://phabricator.wikimedia.org/T224448 (10Paladox) Interestingly this may...