[00:07:03] 10Phabricator: Form 46 imagery is broken - https://phabricator.wikimedia.org/T219739 (10Krinkle) >>! In T219739#5074639, @Krinkle wrote: > I've fixed it now for both images manually, but this should probably be reported upstream. Done, at 10Gerrit, 10Release-Engineering-Team, 10Patch-For-Review, 10User-notice: Make PolyGerrit the default ui - https://phabricator.wikimedia.org/T196812 (10Krinkle) Looks like this may be redundant with {T200739}. Switching the default for our 2.15 seems problematic given we know certain workflows are broken o... [02:33:55] 10Phabricator, 10Release-Engineering-Team, 10Operations, 10Wikimedia-Incident: Analyze and amend (if necessary) workflow of user reporting and detecting large regressions/outages - https://phabricator.wikimedia.org/T219589 (10Aklapper) > In particular, we were told some people thought of making the ticket... [05:27:48] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<10.00%) [06:43:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10MediaWiki-Database, 10Quibble, 10Patch-For-Review: Enable MariaDB/MySQL strict mode on CI db hosts - https://phabricator.wikimedia.org/T119371 (10jcrespo) @hashar Can you confirm all of CI is running TRADITIONAL (including sq... [06:52:45] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:06:09] PROBLEM - Puppet errors on deployment-kafka-main-2 is CRITICAL: CRITICAL: 6.74% of data above the critical threshold [3.0] [07:07:56] PROBLEM - Puppet errors on deployment-urldownloader02 is CRITICAL: CRITICAL: 7.78% of data above the critical threshold [3.0] [07:17:53] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10MediaWiki-Database, 10Quibble, 10Patch-For-Review: Enable MariaDB/MySQL strict mode on CI db hosts - https://phabricator.wikimedia.org/T119371 (10hashar) TLDR: I thought enabling the setting in the server config was enough, b... [07:19:12] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10MediaWiki-Database, 10Quibble, 10Patch-For-Review: Enable MariaDB/MySQL strict mode on CI db hosts - https://phabricator.wikimedia.org/T119371 (10jcrespo) Thanks for clarifying, I have commented on https://gerrit.wikimedia.or... [07:47:13] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10MediaWiki-Database, 10Quibble, 10Patch-For-Review: Enable MariaDB/MySQL strict mode on CI db hosts - https://phabricator.wikimedia.org/T119371 (10hashar) That should now be enabled for the master branch. We might then backpor... [07:58:15] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10MediaWiki-Database, 10Quibble, 10Patch-For-Review: Enable MariaDB/MySQL strict mode on CI db hosts - https://phabricator.wikimedia.org/T119371 (10jcrespo) `ONLY_FULL_GROUP_BY` may be delayed until we can test on a mariadb ver... [08:39:38] 10Release-Engineering-Team, 10MediaWiki-Core-Testing, 10Wikimedia-production-error (Shared Build Failure), 10phan: phan 1.2.6 is OOMing on MediaWiki core - https://phabricator.wikimedia.org/T219114 (10hashar) > Disabling phan isn't an option due to the amount of issues it regularly catches. Worst case we c... [09:06:04] RECOVERY - Puppet errors on deployment-kafka-main-2 is OK: OK: Less than 1.00% above the threshold [2.0] [09:07:57] RECOVERY - Puppet errors on deployment-urldownloader02 is OK: OK: Less than 1.00% above the threshold [2.0] [09:14:09] (03CR) 10Hashar: "To build Debian packages, we have a set of instances that use the puppet class packages_builder with all our hooks and setting up cowbuild" [integration/config] - 10https://gerrit.wikimedia.org/r/500381 (https://phabricator.wikimedia.org/T216712) (owner: 10Giuseppe Lavagetto) [11:25:08] 10Release-Engineering-Team (Kanban), 10commit-message-validator, 10Patch-For-Review: commit-message-validator fail when an extra Hosts: header is mentioned - https://phabricator.wikimedia.org/T219629 (10aborrero) thanks! [11:29:35] 10Release-Engineering-Team (Kanban), 10Browser-Tests, 10MW-1.33-notes (1.33.0-wmf.25; 2019-04-09), 10Patch-For-Review, and 4 others: CI failing: Steps that require login are failing - https://phabricator.wikimedia.org/T219920 (10zeljkofilipin) [11:40:46] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests, 10User-greg: Add legoktm to gerritadmin LDAP group (restoring previously held access) - https://phabricator.wikimedia.org/T219086 (10MarcoAurelio) Perhaps in the meawhile we could restore @Legoktm access. Under the new Gerrit privilege policy (and... [11:41:52] 10Continuous-Integration-Config, 10Operations, 10Patch-For-Review, 10User-zeljkofilipin: npm 6 consistently fails with "Z_DATA_ERROR: invalid distance too far back" on some repos - https://phabricator.wikimedia.org/T215562 (10MoritzMuehlenhoff) a:05MoritzMuehlenhoff→03Krinkle >>! In T215562#5082327, @K... [11:55:46] thcipriani: hey! please lemme know when you're around :) [12:16:47] 10Phabricator, 10Release-Engineering-Team, 10Operations, 10Wikimedia-Incident: Analyze and amend (if necessary) workflow of user reporting and detecting large regressions/outages - https://phabricator.wikimedia.org/T219589 (10Yann) Hi, Sorry, but where to discuss this if not here? I agree that many users... [12:22:16] RECOVERY - Puppet errors on deployment-sentry01 is OK: OK: Less than 1.00% above the threshold [2.0] [12:36:57] RECOVERY - Puppet errors on deployment-cache-upload04 is OK: OK: Less than 1.00% above the threshold [2.0] [12:39:36] (03PS1) 10Hashar: Remove /p/ from /info/refs call [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/501201 (https://phabricator.wikimedia.org/T214807) [12:40:52] (03Abandoned) 10Hashar: Remove /p/ from /info/refs call [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/491641 (https://phabricator.wikimedia.org/T214807) (owner: 10Paladox) [12:44:17] (03PS1) 10Hashar: Update GitPython to 2.1.11 [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/501203 (https://phabricator.wikimedia.org/T214739) [12:44:45] (03Abandoned) 10Hashar: Update GitPython to 2.1.11 [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/486702 (https://phabricator.wikimedia.org/T214739) (owner: 10Paladox) [12:47:02] (03PS3) 10Hashar: gerrit: query solely for change not anything [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/475904 (https://phabricator.wikimedia.org/T198968) [12:54:42] (03PS4) 10Hashar: WMF: backport gerrit: use change: when querying changes [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/475904 (https://phabricator.wikimedia.org/T198968) [12:55:48] (03CR) 10Hashar: "I have upstreamed it https://review.openstack.org/#/c/620328/ and slightly refactored there to introduce queryChange()." [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/475904 (https://phabricator.wikimedia.org/T198968) (owner: 10Hashar) [13:18:30] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:25:04] 10Gerrit, 10Release-Engineering-Team (Next), 10DBA, 10Operations: Gerrit is failing to connect to db on gerrit2001 thus preventing systemd from working - https://phabricator.wikimedia.org/T176532 (10Paladox) 05Stalled→03Resolved Closing this as resolved since this will be resolved with T200739 [13:25:07] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Operations, 10Patch-For-Review: Reimage gerrit2001 as stretch - https://phabricator.wikimedia.org/T168562 (10Paladox) [13:26:22] yay hashar! [13:30:22] paladox: :))) [13:57:22] (03PS1) 10Hashar: WMF: get version from pkg_resources [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/501323 (https://phabricator.wikimedia.org/T162787) [13:59:36] 10Phabricator, 10Release-Engineering-Team, 10Operations, 10Wikimedia-Incident: Analyze and amend (if necessary) workflow of user reporting and detecting large regressions/outages - https://phabricator.wikimedia.org/T219589 (10Aklapper) Yann, this task is about detecting large regressions and outages. Pleas... [14:06:39] (03PS1) 10Hashar: 2.5.1-wmf6: bugfix and Gerrit 2.16 support [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/501325 (https://phabricator.wikimedia.org/T198968) [14:09:05] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Deploy Zuul 2.5.1-wmf6 - https://phabricator.wikimedia.org/T208426 (10hashar) [14:09:58] 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Patch zuul to remove /p/ from /info/refs call - https://phabricator.wikimedia.org/T214807 (10hashar) [14:10:00] 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Update zuul's GitPython dep - https://phabricator.wikimedia.org/T214739 (10hashar) [14:10:05] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Backlog), 10Zuul, 10Patch-For-Review, 10User-Addshore: Upgrade pbr for zuul - https://phabricator.wikimedia.org/T162787 (10hashar) [14:10:07] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10Upstream: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) [14:10:09] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Deploy Zuul 2.5.1-wmf6 - https://phabricator.wikimedia.org/T208426 (10hashar) [14:10:24] paladox: that is a mess really :] [14:10:31] oh [14:10:39] so https://gerrit.wikimedia.org/r/#/c/integration/zuul/+/501325/ [14:10:42] is the tentative release [14:10:51] the CI job must have build a deb package which can be tested :D [14:11:04] yup [14:11:12] * paladox tests [14:11:15] I integrated your patches [14:11:43] the one about removing /p/ should probably be send to upstream :] [14:11:43] thanks :) [14:12:03] thank you so much for theissue you found ( /p/ and GitPython outdated) [14:12:28] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10User-Addshore: Upgrade pbr for zuul - https://phabricator.wikimedia.org/T162787 (10hashar) a:03hashar [14:13:00] hashar your welcome :) [14:13:15] 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review, 10Upstream: Patch zuul to remove /p/ from /info/refs call - https://phabricator.wikimedia.org/T214807 (10hashar) a:05hashar→03Paladox Would be nice to upstream the fix :] [14:13:25] 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Update zuul's GitPython dep - https://phabricator.wikimedia.org/T214739 (10hashar) a:03Paladox [14:13:35] now [14:13:41] I am going to check the zuul.deb content [14:13:46] and diff it with the previous version: ] [14:14:52] hashar works! [14:14:53] http://gerrit-zuul.wmflabs.org/zuul/ [14:19:06] that was fast :] [14:19:10] Zuul version: 2.5.2.dev17 [14:19:11] hmm [14:19:21] that should show the package version!!? [14:19:52] hashar i thought you changed that? [14:19:59] hashar with https://gerrit.wikimedia.org/r/501323 [14:20:19] yup [14:20:39] but who knows what pkg_resources is doing :] [14:20:50] so it's getting the specified version where ever 2.5.2.dev17 is defined in zuul [14:20:52] heh [14:24:15] well with the python version installed by zuul [14:24:35] dcausse: hey, I'm around, what's up? [14:25:00] thcipriani: wanted about gerrit, will msg you [14:25:03] to talk [14:25:09] /usr/share/python/zuul/bin/python [14:25:09] kk [14:25:14] >>> import pkg_resources [14:25:14] >>> pkg_resources.get_distribution('zuul').version [14:25:14] '2.5.1-wmf4' [14:25:18] paladox: ^ [14:25:25] oh [14:25:38] ah i see [14:25:52] i think the zuul python scripts were never overwritten [14:26:00] so it's still using the scap version [14:26:13] hmm [14:26:15] nope [14:26:16] /usr/bin/zuul [14:26:21] shows the correct location [14:26:26] #!/usr/share/python/zuul/bin/python [14:27:55] zuul --version [14:27:55] Zuul version: 2.5.1-wmf6-0-20190404140657.1448-jessie-wikimedia-1.gbp3eadc9 [14:28:29] yeahhhhhh [14:28:37] at least it no more dies [14:28:39] though [14:28:46] that depends on the pbr version you got [14:29:07] aha! [14:29:20] hashar it is using the scap built, /etc/systemd/system/zuul.service was never overwritten [14:29:26] $ /usr/share/python/zuul/bin/pip freeze|grep pbr [14:29:26] pbr==0.8.2 [14:29:34] that is on contint1001 [14:30:26] hashar works now [14:30:26] http://gerrit-zuul.wmflabs.org/zuul/ [14:30:44] "Zuul version: 2.5.1-wmf6-0-20190404140657.1448-jessie-wikimedia-1.gbp3eadc9" [14:31:09] cooool [14:31:52] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Deploy Zuul 2.5.1-wmf6 - https://phabricator.wikimedia.org/T208426 (10hashar) Package rebuild and published at https://people.wikimedia.org/~hashar/debs/zuul_2.5.1-wmf6/ [14:40:01] (03CR) 10Paladox: [C: 03+1] 2.5.1-wmf6: bugfix and Gerrit 2.16 support [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/501325 (https://phabricator.wikimedia.org/T198968) (owner: 10Hashar) [14:44:38] (03CR) 10Hashar: [C: 03+2] "Paladox gave it a smoke test on WMCS !! So at least this version seems to start just fine." [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/501325 (https://phabricator.wikimedia.org/T198968) (owner: 10Hashar) [14:44:49] paladox: so theorically I could upgrade it now [14:44:55] but I don't have time ahead of me to babysit it [14:44:57] so hmm [14:45:07] I am afraid that will be for monday unfortunately [14:45:21] ok [14:45:29] at least we got a deb package with all your patches!!! [14:45:35] then I guess [14:45:37] scap3 [14:45:37] (03Merged) 10jenkins-bot: 2.5.1-wmf6: bugfix and Gerrit 2.16 support [integration/zuul] (debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/501325 (https://phabricator.wikimedia.org/T198968) (owner: 10Hashar) [14:46:11] :) [14:48:33] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Deploy Zuul 2.5.1-wmf6 - https://phabricator.wikimedia.org/T208426 (10hashar) I am out of time to deploy the new version today. So that would be for Monday! [14:52:31] and I announced it on the QA list [14:52:32] for now [14:52:34] kids time [14:52:35] dinner etc [14:52:37] ;) [15:13:39] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Generate baseline analysis of all extensions - https://phabricator.wikimedia.org/T219156 (10zeljkofilipin) a:05zeljkofilipin→03None [15:17:59] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10Readers-Web-Backlog (Tracking), 10User-zeljkofilipin: selenium-daily-beta-MediaWiki fails due to QuickSurveys inserting HTML in the content - https://phabricator.wikimedia.org/T217544 (10zeljkofilipin) a:03zeljkofilipin [15:18:35] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Testing, 10Readers-Web-Backlog (Tracking), 10User-zeljkofilipin: selenium-daily-beta-MediaWiki fails due to QuickSurveys inserting HTML in the content - https://phabricator.wikimedia.org/T217544 (10zeljkofilipin) p:05Triage→03Normal [15:18:57] 10Release-Engineering-Team (Backlog), 10Operations: mwdebug2001 and mwdebug2002 "/" almost full - https://phabricator.wikimedia.org/T219989 (10greg) [15:19:21] 10Release-Engineering-Team (Backlog), 10Developer Productivity: Add Windows installation Documentation and Install Script for local-charts repo - https://phabricator.wikimedia.org/T219438 (10greg) [15:19:59] 10Continuous-Integration-Config, 10Release-Engineering-Team (Backlog), 10JavaScript: Upgrade all CI jobs from node6/npm3 to node10/npm6 across all projects - https://phabricator.wikimedia.org/T211784 (10greg) [15:20:09] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Backlog), 10Jenkins: Jenkins warning JENKINS-2111 path sanitization ineffective - https://phabricator.wikimedia.org/T217791 (10greg) [15:29:55] (03PS6) 10WMDE-Fisch: Create selenium-daily-beta-AdvancedSearch Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/460516 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [15:31:10] (03CR) 10WMDE-Fisch: Create selenium-daily-beta-AdvancedSearch Jenkins job (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/460516 (https://phabricator.wikimedia.org/T188742) (owner: 10Zfilipin) [15:33:25] (03PS1) 10Pablo Grass (WMDE): termbox: build production variant in CI [integration/config] - 10https://gerrit.wikimedia.org/r/501339 (https://phabricator.wikimedia.org/T220107) [15:36:09] (03CR) 10jerkins-bot: [V: 04-1] termbox: build production variant in CI [integration/config] - 10https://gerrit.wikimedia.org/r/501339 (https://phabricator.wikimedia.org/T220107) (owner: 10Pablo Grass (WMDE)) [15:37:21] (03CR) 10Pablo Grass (WMDE): "This change is ready for review." [integration/config] - 10https://gerrit.wikimedia.org/r/501339 (https://phabricator.wikimedia.org/T220107) (owner: 10Pablo Grass (WMDE)) [15:45:23] 10Release-Engineering-Team (Kanban), 10LDAP-Access-Requests, 10User-greg: Add legoktm to gerritadmin LDAP group (restoring previously held access) - https://phabricator.wikimedia.org/T219086 (10RobH) a:05hashar→03Legoktm Please note that both @greg and @hashar have suggested an alternative to granting th... [15:45:30] (03PS2) 10Pablo Grass (WMDE): termbox: build production variant in CI [integration/config] - 10https://gerrit.wikimedia.org/r/501339 (https://phabricator.wikimedia.org/T220107) [15:48:51] (03CR) 10jerkins-bot: [V: 04-1] termbox: build production variant in CI [integration/config] - 10https://gerrit.wikimedia.org/r/501339 (https://phabricator.wikimedia.org/T220107) (owner: 10Pablo Grass (WMDE)) [15:52:19] zeljkof: am around if you want to talk CI and https://phabricator.wikimedia.org/T219920#5083358 but am attending the staff meeting so a little distracted [15:53:13] jdlrobson: I'm around [15:53:26] I'll be around after the meeting too, we can chat then [15:53:39] sweet [15:53:41] I'll leave comments in gerrit/phab, didn't have the time yet :/ [15:54:16] zeljkof: just want to have a path to getting those login tests back so I can create some tasks to make that happen before I head on vacation next week. [15:54:27] zeljkof: keen to understand what happened [15:55:10] (03PS3) 10Pablo Grass (WMDE): termbox: build production variant in CI [integration/config] - 10https://gerrit.wikimedia.org/r/501339 (https://phabricator.wikimedia.org/T220107) [16:03:32] (03CR) 10Pablo Grass (WMDE): "Please see the ticket for further inspiration why the idea for this came up." [integration/config] - 10https://gerrit.wikimedia.org/r/501339 (https://phabricator.wikimedia.org/T220107) (owner: 10Pablo Grass (WMDE)) [16:28:24] ping, can someone with +2 on integration/config merge/update: https://gerrit.wikimedia.org/r/c/integration/config/+/500719 [16:39:44] (03PS9) 10Urbanecm: Setup gate-and-submit-l10n for wikimedia-cz/tracker [integration/config] - 10https://gerrit.wikimedia.org/r/479738 [16:58:35] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Facilitate Scrum of scrums - https://phabricator.wikimedia.org/T220130 (10zeljkofilipin) [16:58:58] 10Release-Engineering-Team (Kanban), 10User-zeljkofilipin: Facilitate Scrum of scrums - https://phabricator.wikimedia.org/T220130 (10zeljkofilipin) p:05Triage→03Normal [17:00:20] bblack: I can roll it out, but afaik the jjb change needs to be a separate commit in order to pass merge tests. [17:00:31] as the docker version can't exist until after I merge and deploy that [17:01:12] ah [17:01:16] ok, will split [17:04:32] (03PS3) 10BBlack: operations-dnslint: create version 0.0.5 [integration/config] - 10https://gerrit.wikimedia.org/r/500719 [17:04:34] (03PS1) 10BBlack: operations-misc: upgrade dnslint to 0.0.5 [integration/config] - 10https://gerrit.wikimedia.org/r/501358 [17:04:43] Krinkle: ^ [17:05:33] bblack: cool [17:05:49] bblack: btw, do you have docker-pkg locally? [17:06:09] nope [17:06:26] For later, local can be tested per https://www.mediawiki.org/wiki/Continuous_integration/Docker [17:06:32] I'll do a build locally now [17:07:14] $ docker-pkg -c dockerfiles/config.yaml --no-pull --select '*dns*' dockerfiles [17:07:17] to see that it builds without errors [17:07:29] (03CR) 10Krinkle: [C: 03+2] operations-dnslint: create version 0.0.5 [integration/config] - 10https://gerrit.wikimedia.org/r/500719 (owner: 10BBlack) [17:07:34] cool, that worked. deploying now with fab. [17:07:41] which will rebuild it again, on contint1001 [17:09:03] (03Merged) 10jenkins-bot: operations-dnslint: create version 0.0.5 [integration/config] - 10https://gerrit.wikimedia.org/r/500719 (owner: 10BBlack) [17:17:25] !log Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/500719 ( [17:17:26] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:18:25] (03CR) 10Krinkle: [C: 03+2] "Used JJB to recompile and upload 1 new Jenkins job config." [integration/config] - 10https://gerrit.wikimedia.org/r/501358 (owner: 10BBlack) [17:20:08] bblack: Got a few confusing messages during the remote docker-pgk building, but despite being red, do not appear to be actual errors. I guess we'll find out if it's not working :) [17:20:16] [contint1001.wikimedia.org] out: 2019-04-04 17:18:13,184 [docker-pkg-build] INFO - Step 6/9 : RUN git clone --depth 1 https://gerrit.wikimedia.org/r/operations/dns "${DNSDIR}" (image.py:176) [17:20:16] [contint1001.wikimedia.org] out: 2019-04-04 17:18:13,185 [docker-pkg-build] INFO - (image.py:176) [17:20:16] [contint1001.wikimedia.org] out: 2019-04-04 17:18:13,334 [docker-pkg-build] INFO - ---> Running in 0780bc6237bb (image.py:176) [17:20:16] [contint1001.wikimedia.org] out: 2019-04-04 17:18:14,167 [docker-pkg-build] INFO - Cloning into '/srv/workspace/dnslint'... [17:20:16] [contint1001.wikimedia.org] out: (image.py:176) [17:20:20] That was coloured in red. [17:20:38] (03Merged) 10jenkins-bot: operations-misc: upgrade dnslint to 0.0.5 [integration/config] - 10https://gerrit.wikimedia.org/r/501358 (owner: 10BBlack) [17:29:36] Krinkle: thanks, seems to be working ok: recheck on https://gerrit.wikimedia.org/r/c/operations/dns/+/500731 -> success https://integration.wikimedia.org/ci/job/operations-dns-lint-docker/380/console [17:29:46] cool :) [17:41:59] zeljkof: are you around now? [17:57:21] I'm not seeing a "submit" icon on https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/MinervaNeue/+/500132/ -to bypass Jenkins when it chokes... is that a permissioning problem? [18:04:34] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T206679 (10greg) a:03mmodell [18:04:57] jdlrobson: sorry, on the phone, had to go [18:05:22] oh :/ [18:11:21] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Jade, 10Scoring-platform-team: Clone gerrit repo mediawiki/extensions/JADE to mediawiki/extensions/Jade - https://phabricator.wikimedia.org/T212180 (10mmodell) a:03mmodell [18:11:45] jdlrobson: the 'gate' jobs can differ from the 'test' jobs (from which the V+2 is). They differ in composition, conditional logic, and also in merge target (gate jobs includes other patches being merges and merges since the last test, so that master can't start failing). [18:12:27] https://integration.wikimedia.org/zuul/ shows it's in the queue behind an MF patch. [18:12:59] where 1 phpunit job is still running, currently at 48%. [18:13:04] should merge in 6min or so [18:14:44] its been longer than 6 mins :/ [18:15:06] https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/MinervaNeue/+/500132/ was 10:54 [18:15:24] 6min to go from 48% to 100% on phpunit. [18:15:34] for a gated extension like MF [18:15:59] Looks like its faster than I thought. [18:16:16] there we go [18:16:16] all 6 patches now merged at once. As MF/phpunit was holding the others back, but the others had their tests completed already [18:16:23] was just surprised it was taking so long and didn't seem normal [18:16:57] always check https://integration.wikimedia.org/zuul/ to see why CI is behaving the way it is. There are a few known bugs in Zuul scheduling, but this wasn't one. [18:17:17] marxarelli: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EventBus/+/501372 should unblock the train. [18:18:37] James_F: was just reviewing that. the citoid issue was fixed as well [18:19:07] thanks for all the wrangling yesterday [18:21:40] Any time. :-) [18:27:48] (03PS1) 10Krinkle: zuul: Add placeholder to filer input (and improve title text) [integration/docroot] - 10https://gerrit.wikimedia.org/r/501374 [18:27:49] (03PS1) 10Krinkle: Add README.md [integration/docroot] - 10https://gerrit.wikimedia.org/r/501375 [18:28:17] (03CR) 10Krinkle: [C: 03+2] zuul: Add placeholder to filer input (and improve title text) [integration/docroot] - 10https://gerrit.wikimedia.org/r/501374 (owner: 10Krinkle) [18:28:20] (03CR) 10Krinkle: [C: 03+2] Add README.md [integration/docroot] - 10https://gerrit.wikimedia.org/r/501375 (owner: 10Krinkle) [18:28:50] (03Merged) 10jenkins-bot: zuul: Add placeholder to filer input (and improve title text) [integration/docroot] - 10https://gerrit.wikimedia.org/r/501374 (owner: 10Krinkle) [18:28:52] (03Merged) 10jenkins-bot: Add README.md [integration/docroot] - 10https://gerrit.wikimedia.org/r/501375 (owner: 10Krinkle) [18:28:55] (03CR) 10jenkins-bot: zuul: Add placeholder to filer input (and improve title text) [integration/docroot] - 10https://gerrit.wikimedia.org/r/501374 (owner: 10Krinkle) [18:28:57] (03CR) 10jenkins-bot: Add README.md [integration/docroot] - 10https://gerrit.wikimedia.org/r/501375 (owner: 10Krinkle) [19:22:37] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.33.0-wmf.24 deployment blockers - https://phabricator.wikimedia.org/T206678 (10Krinkle) [19:44:30] (03CR) 10Hashar: [C: 03+2] "Makes sense! Thanks for the ordering :]" [integration/config] - 10https://gerrit.wikimedia.org/r/500178 (owner: 10Lucas Werkmeister (WMDE)) [19:47:20] (03Merged) 10jenkins-bot: Add my private email address to the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/500178 (owner: 10Lucas Werkmeister (WMDE)) [19:49:19] 10Release-Engineering-Team (Kanban), 10Quibble, 10Patch-For-Review: Quibble should errors out when a git submodule fails - https://phabricator.wikimedia.org/T198980 (10hashar) And it indeed works: ` Submodule 'lib/ve' (https://gerrit.wikimedia.org/r/VisualEditor/VisualEditor.git) registered for path 'lib/ve'... [19:50:45] PROBLEM - App Server Main HTTP Response on deployment-mediawiki-07 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:55:37] RECOVERY - App Server Main HTTP Response on deployment-mediawiki-07 is OK: HTTP OK: HTTP/1.1 200 OK - 48008 bytes in 0.863 second response time [20:09:25] (03PS1) 10Hashar: Add --git-parallel=8 to most Quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/501398 (https://phabricator.wikimedia.org/T211701) [20:10:54] (03CR) 10Hashar: [C: 03+2] "Let the magic happen. I will most probably make it the default later on :)" [integration/config] - 10https://gerrit.wikimedia.org/r/501398 (https://phabricator.wikimedia.org/T211701) (owner: 10Hashar) [20:12:54] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Quibble (marble): Quibble should clone repositories in parallel - https://phabricator.wikimedia.org/T211701 (10hashar) Left to do I guess is to have the command default to 8 worker threads which should be fine?! Maybe. [20:13:07] (03Merged) 10jenkins-bot: Add --git-parallel=8 to most Quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/501398 (https://phabricator.wikimedia.org/T211701) (owner: 10Hashar) [20:42:38] 10Release-Engineering-Team (Next), 10Citoid, 10Release Pipeline, 10serviceops, and 2 others: Migrate citoid to kubernetes - https://phabricator.wikimedia.org/T213194 (10Jdforrester-WMF) Is this now completed? [20:43:24] 10Release-Engineering-Team (Next), 10CX-cxserver, 10Release Pipeline, 10serviceops, and 3 others: Migrate cxserver to kubernetes - https://phabricator.wikimedia.org/T213195 (10Jdforrester-WMF) Is this now completed? [20:44:23] 10Continuous-Integration-Infrastructure, 10Gerrit, 10Release-Engineering-Team (Kanban), 10Zuul, 10Patch-For-Review: Zuul cancels all changes when a change is manually merged - https://phabricator.wikimedia.org/T203846 (10hashar) I have missed upgrading Zuul but should do it next monday (T208426). [20:44:24] (03PS1) 10Krinkle: dockerfiles: Create node10:0.5.0 images [integration/config] - 10https://gerrit.wikimedia.org/r/501407 (https://phabricator.wikimedia.org/T215562) [20:44:51] (03CR) 10Krinkle: [C: 03+2] "Tested locally and confirmed that for both mwext-Flow and perf-fresnel, 0.4.0 fails and 0.5.0 passes. Woo!" [integration/config] - 10https://gerrit.wikimedia.org/r/501407 (https://phabricator.wikimedia.org/T215562) (owner: 10Krinkle) [20:46:26] (03PS1) 10Krinkle: jjb: update npm jobs to use node10:0.5.0 docker image [integration/config] - 10https://gerrit.wikimedia.org/r/501408 (https://phabricator.wikimedia.org/T215562) [20:46:50] (03Merged) 10jenkins-bot: dockerfiles: Create node10:0.5.0 images [integration/config] - 10https://gerrit.wikimedia.org/r/501407 (https://phabricator.wikimedia.org/T215562) (owner: 10Krinkle) [20:47:05] 10Continuous-Integration-Config, 10MediaWiki-General-or-Unknown, 10Multi-Content-Revisions, 10Core Platform Team (Code Health (TEC13)), and 3 others: Some PHPUnit tests consistently fail when collecting coverage report - https://phabricator.wikimedia.org/T183777 (10hashar) 05Open→03Resolved Indeed, it... [20:47:06] (03CR) 10Jforrester: "Yay." [integration/config] - 10https://gerrit.wikimedia.org/r/501407 (https://phabricator.wikimedia.org/T215562) (owner: 10Krinkle) [20:47:31] !log Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/501407 [20:47:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:47:48] 10Release-Engineering-Team (Next), 10CX-cxserver, 10Release Pipeline, 10serviceops, and 3 others: Migrate cxserver to kubernetes - https://phabricator.wikimedia.org/T213195 (10jijiki) Traffic is being served from k8s, we will mark this as resolved after we merge a couple of cleanup patches (like the last o... [20:47:48] James_F: assuming nothing breaks on the jjb roll out, we can then re-enable it on other repos where it previously failed. [20:48:20] Krinkle: That'd be nice. We broke a few other repos too, so… ;-) [20:48:24] 10Continuous-Integration-Config, 10Operations, 10Patch-For-Review, 10User-zeljkofilipin: npm 6 consistently fails with "Z_DATA_ERROR: invalid distance too far back" on some repos - https://phabricator.wikimedia.org/T215562 (10Krinkle) [20:49:33] 10Release-Engineering-Team, 10Release Pipeline, 10serviceops, 10Core Platform Team Backlog (Watching / External), 10Services (watching): TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production ... - https://phabricator.wikimedia.org/T212801 [20:49:38] 10Release-Engineering-Team (Next), 10Citoid, 10Release Pipeline, 10serviceops, and 2 others: Migrate citoid to kubernetes - https://phabricator.wikimedia.org/T213194 (10jijiki) 05Open→03Resolved a:03jijiki @Jdforrester-WMF @akosiaris I am marking this as resolved, please reopen if you feel we are mi... [20:50:27] 10Continuous-Integration-Config, 10Tool-ldap: Add CI checks to tool-ldap - https://phabricator.wikimedia.org/T220151 (10MarcoAurelio) [20:50:32] 10Continuous-Integration-Config, 10Operations: operations/puppet CI errors not being displayed in console log - https://phabricator.wikimedia.org/T214726 (10hashar) [20:50:42] 10Continuous-Integration-Config, 10Tool-ldap: Add CI checks to tool-ldap - https://phabricator.wikimedia.org/T220151 (10MarcoAurelio) [20:52:58] (03CR) 10Krinkle: [C: 03+2] "Recompiled and uploaded 13 jobs matching "*node10*"" [integration/config] - 10https://gerrit.wikimedia.org/r/501408 (https://phabricator.wikimedia.org/T215562) (owner: 10Krinkle) [20:53:44] 10Project-Admins: Create phabricator project for Extension:Blackout - https://phabricator.wikimedia.org/T203227 (10hashar) 05Stalled→03Declined >>! In T203227#4975309, @Aklapper wrote: > I don't see active development in https://gerrit.wikimedia.org/r/#/q/project:mediawiki/extensions/Blackout hence I propose... [20:54:26] Krinkle: Hmm. https://integration.wikimedia.org/ci/job/visualeditor-node10-browser-docker/283/console died with "Unable to find image 'docker-registry.wikimedia.org/releng/node10-test-browser:0.5.0' locally". [20:54:36] Is that just unfortunate timing? [20:57:14] (03Merged) 10jenkins-bot: jjb: update npm jobs to use node10:0.5.0 docker image [integration/config] - 10https://gerrit.wikimedia.org/r/501408 (https://phabricator.wikimedia.org/T215562) (owner: 10Krinkle) [21:03:03] (03CR) 10Hashar: "Took me a while to come to this patch, I apologize. See inline, we need to use the template {{ apt_install }} when installing packages. T" (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/493638 (owner: 10Paladox) [21:13:08] (03PS7) 10Paladox: Docker: Add bazel image [integration/config] - 10https://gerrit.wikimedia.org/r/493638 [21:13:12] (03CR) 10Paladox: Docker: Add bazel image (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/493638 (owner: 10Paladox) [21:13:37] hashar bazel won't work with nouser (as it stores cache stuff in HOMEDIR/) [21:14:34] (03PS1) 10Hashar: Add tox job for labs/tools/ldap [integration/config] - 10https://gerrit.wikimedia.org/r/501416 (https://phabricator.wikimedia.org/T220151) [21:15:51] 10Continuous-Integration-Config, 10Tool-ldap, 10Patch-For-Review: Add CI checks to tool-ldap - https://phabricator.wikimedia.org/T220151 (10hashar) I went with just `flake8`, the python linter ;) [21:17:52] James_F: Yeah, docker-pkg had to re-try a few times because of the dependencies. [21:18:20] I deployed it when the command seemed succesfull, but actually only node10 succeeded -test and -test-browser failed. Looks like it did them in the wrong order. [21:18:22] Should be good now [21:20:23] Krinkle: I had a similar issue recently and I think Giuseppe has a patch for it [21:20:31] there is a flow in the logic somewhere [21:20:44] hashar: It works for me locally but only when I set --no-pull [21:20:48] yes [21:20:52] but for the remote one, it used to work fine [21:20:57] but that one now has the same issue. [21:21:09] so I have to run deploy_docker N times for each level of dependency [21:21:15] then I dot know why it tries to pull from the registry when the image most probably already got build and is available in the daemon [21:21:30] or maybe it just tries to download it since it is not published yet [21:21:57] yeah, it still discovers them in the right order, and does it one at a time. The log is literally: 1) node10:0.5.0; succesful, 2) building node10-test, cannot find node10:0.5.) [21:21:58] the finite state machine thus as a flaw :] [21:22:29] Krinkle: if you could share your discoveries on https://gerrit.wikimedia.org/r/#/c/operations/docker-images/docker-pkg/+/501017/ I guess that will be apprecaited :] [21:22:39] ahha [21:22:40] good log [21:23:11] so yeah it should not attempt to pull when the image is known to not have been published but is to be build [21:23:31] and eventually a safe check should assert the parents got build (== they are on the local docker daemon) [21:23:48] anyway. Joe is replacing all that logic anyway apparently. But I haven't looked at his patch yet :( [21:24:00] twist [21:27:24] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Jade, 10Scoring-platform-team: Clone gerrit repo mediawiki/extensions/JADE to mediawiki/extensions/Jade - https://phabricator.wikimedia.org/T212180 (10mmodell) I created the repo, trying to push all of the refs to it is giving me trouble though [21:27:33] I read some post about Bazel having support for Docker images ( https://github.com/bazelbuild/rules_docker ) [21:27:37] gotta look at it ;] [21:28:31] James_F: passing now on EL [21:28:55] "the Docker images produced by container_image are deterministic / reproducible." [21:28:58] \o/ [21:29:05] Krinkle: Yay. [21:29:47] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Jade, 10Scoring-platform-team: Clone gerrit repo mediawiki/extensions/JADE to mediawiki/extensions/Jade - https://phabricator.wikimedia.org/T212180 (10MarcoAurelio) When importing a repo I usually do: * git clone --bare ssh://$repo_clone_url * git push --mi... [21:31:22] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Jade, 10Scoring-platform-team: Clone gerrit repo mediawiki/extensions/JADE to mediawiki/extensions/Jade - https://phabricator.wikimedia.org/T212180 (10mmodell) ok I pushed all of the refs, I think it should be identical now [21:31:29] hashar: I'm very skeptical of that. Does that mean the builds have mock /dev/random and mock timeofday, and no network access for things like apt? [21:31:53] I have no idea :] [21:32:16] they mention stripping timestamps entirely [21:32:32] and I don't even know whether there is support for apt [21:32:38] 10Continuous-Integration-Config, 10Release-Engineering-Team (Backlog), 10JavaScript: Upgrade all CI jobs from node6/npm3 to node10/npm6 across all projects - https://phabricator.wikimedia.org/T211784 (10Krinkle) [21:32:44] 10Continuous-Integration-Config, 10Operations, 10Patch-For-Review, 10User-zeljkofilipin: npm 6 consistently fails with "Z_DATA_ERROR: invalid distance too far back" on some repos - https://phabricator.wikimedia.org/T215562 (10Krinkle) 05Open→03Resolved [21:33:19] one use case I have seen is to use apt on a host to download reuired packages and resolve dependencies [21:33:28] then COPY them in the container and just install them with dpkg -i [21:34:10] but that means that the source for the image is the Dockerfile + all the .deb (though they could be symbolic link [21:34:28] or whatever other mecanism that does not use docker build [21:34:42] meanwhile Krinkle , kudos on that libz thing and Z_DATA_ERROR ! [21:35:02] hashar: Thanks. 3 months of comms with npm CLI support desk. [21:35:11] All the way down the rabbit hole that is Debian packing. [21:35:46] :(( [21:36:14] zeljkof stepped upon a similar issue with fibers [21:36:46] I cant remember the detail but it is something like fibers@2 does not support node 10, while fibers@3 only support node 10 [21:36:55] and fibers is a dependency of webdriver.io .. [21:37:28] it is complicated :/ [21:39:09] hashar: Yeah, once wdio runs per-repo, we can slowly upgrade it as-needed for individual repos together with the node version they use for Jenkins. [21:39:33] except gated extensions, will need to change together. [21:39:55] or we go with something different [21:40:32] (03PS1) 10Krinkle: Switch various jobs from node6/npm3 to node10/npm6 [integration/config] - 10https://gerrit.wikimedia.org/r/501428 (https://phabricator.wikimedia.org/T211784) [21:40:38] I remember a proposal to have a new repo that would have the end to end / selenium tests for wikimedia [21:40:54] probably the mediawiki/core wdio.conf.js should no more run tests for all extensions/* [21:41:14] and i still have to add the logic in quibble to run wdio from the root of the extension [21:45:30] (03CR) 10Krinkle: [C: 03+2] Switch various jobs from node6/npm3 to node10/npm6 [integration/config] - 10https://gerrit.wikimedia.org/r/501428 (https://phabricator.wikimedia.org/T211784) (owner: 10Krinkle) [21:46:18] hashar: Right, but that means developers will never maintain or run them. [21:46:28] (and imho can't even if they want to) [21:47:22] I don't know really :] gotta think a bit more about it but that will be for next week (hopefully) [21:47:35] (03Merged) 10jenkins-bot: Switch various jobs from node6/npm3 to node10/npm6 [integration/config] - 10https://gerrit.wikimedia.org/r/501428 (https://phabricator.wikimedia.org/T211784) (owner: 10Krinkle) [21:48:07] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/501428 [21:48:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:48:36] hashar: sorry, I was a bit too direct there. I didn't think about it either. We should consider alternatives for sure! [21:56:53] Krinkle: I guess I will write down a proposal and a .plan then loop in a few people (you, zelko other wdio users :D ) [21:56:57] anyway [21:57:03] congrats for the node10 progress! [21:57:47] +1 [21:59:57] and I am heading to bed.. slightly before midnight [22:00:02] ! [22:10:00] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Jade, 10Scoring-platform-team: Clone gerrit repo mediawiki/extensions/JADE to mediawiki/extensions/Jade - https://phabricator.wikimedia.org/T212180 (10MarcoAurelio) Looks good from a quick //coup d'œil//. Now they have to stop committing to JADE and continue... [22:11:36] 10Continuous-Integration-Config, 10Tool-ldap, 10Patch-For-Review: Add CI checks to tool-ldap - https://phabricator.wikimedia.org/T220151 (10MarcoAurelio) Thanks @hashar - The only maintainer of the tool is @Legoktm so I'll leave to him any decision he may want to make. [22:15:34] Krinkle: can you deploy https://gerrit.wikimedia.org/r/#/c/integration/config/+/500360/ ? [22:17:31] (03CR) 10Krinkle: [C: 03+2] Whitelist user Nikitrain on CI [integration/config] - 10https://gerrit.wikimedia.org/r/500360 (owner: 10MarcoAurelio) [22:17:40] hauskatze: LGTM [22:17:54] * hauskatze purrs [22:18:03] :D [22:18:27] I'm tired of doing 'recheck' for patches for new contributors because jenkins does not review any of them now apparently :| [22:19:55] (03Merged) 10jenkins-bot: Whitelist user Nikitrain on CI [integration/config] - 10https://gerrit.wikimedia.org/r/500360 (owner: 10MarcoAurelio) [22:26:44] hauskatze: Yeah, we used to have a very basic 'check' pipeline that ran a php linter [22:27:23] but that was removed to reduce operational overhead given it was very rarely used only. instead, investing in so that soon we can make the main 'test' pipeline allowed and safe for all users. [22:27:54] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/500360 [22:27:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:43:16] for https://gerrit.wikimedia.org/r/#/c/wikipeg/+/501143/ I need a CI environment that has both nodejs and PHP [22:43:59] there the original node.js test which just needs node.js, and the new PHP test in which a PHP script starts up a temporary node.js server [22:44:48] any thoughts on how this should be done? currently everything runs from "npm test" but I can split it up [22:50:19] TimStarling: adding a composer-test and npm-test job both would be fairly straight forward. A combined one is a bit more difficult but a custom job could be written, like oojs-ui has. [22:52:23] from composer.json a "test" entrypoint could exist. Looks like there is generated code here, which I'm presuming isn't committed to git, so it needs both, is that right? [22:53:04] yes [22:53:50] it uses node.js to generate 97 fragments of PHP code which are then run with eval() [22:53:58] TimStarling: k, you'll need a dedicated job + dockerfile in that case. [22:54:08] can take inspiration from oojs-ui's node+php dockerfile. [22:54:16] ok [22:54:22] https://github.com/wikimedia/integration-config/tree/master/dockerfiles [22:55:00] I'd recommend importing node10-test instead of 'npm-test' so that you skip the node6>node10 migration (ooui is on node 6 still) [22:55:54] the way David Majda used a Makefile is weird: every target is phony, there's no dependencies, it's just a glorified shell script [22:56:17] and he uses space indents everywhere which is extra awkward when it comes time to edit the makefile [22:56:42] heh [22:56:50] the Makefile has the test commands and the commands to rebuild the generated code which is checked in [22:56:54] To test/debug the Dockerfile locally, check https://www.mediawiki.org/wiki/Continuous_integration/Docker [22:57:03] (03PS1) 10Jforrester: [Flow] Migrate from extension-jsduck to extension-javascript-documentation [integration/config] - 10https://gerrit.wikimedia.org/r/501442 [22:57:14] (03PS2) 10Jforrester: [Flow] Migrate from extension-jsduck to extension-javascript-documentation [integration/config] - 10https://gerrit.wikimedia.org/r/501442 [23:30:20] 10Continuous-Integration-Config, 10Fresnel, 10Performance-Team: Make it possible to run Fresnel on MediaWiki extension repos - https://phabricator.wikimedia.org/T220162 (10Krinkle) [23:30:35] 10Continuous-Integration-Config, 10Fresnel, 10Performance-Team: Make it possible to run Fresnel on MediaWiki extension repos - https://phabricator.wikimedia.org/T220162 (10Krinkle) p:05Triage→03High [23:31:43] (03CR) 10Krinkle: [C: 03+2] [Flow] Migrate from extension-jsduck to extension-javascript-documentation [integration/config] - 10https://gerrit.wikimedia.org/r/501442 (owner: 10Jforrester) [23:33:41] (03Merged) 10jenkins-bot: [Flow] Migrate from extension-jsduck to extension-javascript-documentation [integration/config] - 10https://gerrit.wikimedia.org/r/501442 (owner: 10Jforrester) [23:37:48] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/501442 [23:37:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL