[00:26:43] 10MediaWiki-Codesniffer, 10MediaWiki-extensions-Other, 10MediaWiki-extensions-Variables: Libraryupgrader seemingly ignores allowedPrefix options - https://phabricator.wikimedia.org/T203418 (10MGChecker) [01:34:17] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10MGChecker) I would like to request addition to the #acl*Project-Admins group, as I every now and then would like to create projects for MediaWiki extensions if I start working on the... [01:42:27] Project beta-scap-eqiad build #221040: 04FAILURE in 12 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221040/ [01:43:57] Project beta-scap-eqiad build #221041: 04STILL FAILING in 11 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221041/ [01:54:03] Project beta-scap-eqiad build #221042: 04STILL FAILING in 15 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221042/ [02:04:08] Project beta-scap-eqiad build #221043: 04STILL FAILING in 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221043/ [02:13:59] Project beta-scap-eqiad build #221044: 04STILL FAILING in 15 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221044/ [02:17:55] 01:42:26 error: The last gc run reported the following. Please correct the root cause [02:17:55] 01:42:26 and remove .git/gc.log. [02:17:55] 01:42:26 Automatic cleanup will not be performed until the file is removed. [02:17:55] 01:42:26 warning: unable to access '/home/krenair/.config/git/attributes': Permission denied [02:18:02] Krenair: ^^ [02:18:14] ew [02:18:30] that's weird [02:18:40] what's my lastlog on that server legoktm? [02:19:40] krenair pts/0 10.68.18.65 Sun Sep 2 12:42:18 +0000 2018 [02:19:52] so why has it suddenly broken [02:24:08] Project beta-scap-eqiad build #221045: 04STILL FAILING in 17 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221045/ [02:25:07] I don't even have a .config directory [02:25:28] removed .git/gc.log in mediawiki-staging [02:31:14] 10Gerrit, 10VPS-project-libraryupgrader, 10Patch-For-Review: libraryupdater does not Code-Review+2 some extra library - https://phabricator.wikimedia.org/T189369 (10Legoktm) 05Open>03Resolved a:03Legoktm [02:34:00] Project beta-scap-eqiad build #221046: 04STILL FAILING in 15 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221046/ [02:44:00] Project beta-scap-eqiad build #221047: 04STILL FAILING in 14 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221047/ [02:54:02] Project beta-scap-eqiad build #221048: 04STILL FAILING in 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221048/ [03:04:03] Project beta-scap-eqiad build #221049: 04STILL FAILING in 15 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221049/ [03:14:02] Project beta-scap-eqiad build #221050: 04STILL FAILING in 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221050/ [03:21:10] repeated in /srv/mediawiki/.git/gc.log [03:39:51] Yippee, build fixed! [03:39:51] Project beta-scap-eqiad build #221051: 09FIXED in 16 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221051/ [03:48:56] legoktm, ^ [04:03:39] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Aklapper) @MGChecker: Here you go. (I'm not sure we've documented also setting the `bugzilla=` or `phabricator=` parameter in the infobox on extension homepages on mediawiki.org once... [04:04:16] 10Phabricator, 10Project-Admins: WMEE to pilot using Estonian in chapter project management - https://phabricator.wikimedia.org/T203409 (10Aklapper) [04:09:33] 10Phabricator, 10Project-Admins: WMEE to pilot using Estonian in chapter project management - https://phabricator.wikimedia.org/T203409 (10Aklapper) 05Open>03Resolved Thanks for your interest and welcome! Let's try! :) We do not require English here. For example, most tasks under #wikimedia-user-group-bas... [04:10:35] 10Phabricator, 10Project-Admins: WMEE to pilot using Estonian in chapter project management - https://phabricator.wikimedia.org/T203409 (10Aklapper) (Whoops - please feel free to reopen if you'd like to use this task also for planning your subprojects, or file a separate task under #WMEE!) [04:23:35] Krenair: awesome [04:49:25] (03PS1) 10Legoktm: TopTenPages depends upon HitCounters [integration/config] - 10https://gerrit.wikimedia.org/r/457808 [04:49:44] (03CR) 10Legoktm: [C: 032] TopTenPages depends upon HitCounters [integration/config] - 10https://gerrit.wikimedia.org/r/457808 (owner: 10Legoktm) [04:51:15] (03Merged) 10jenkins-bot: TopTenPages depends upon HitCounters [integration/config] - 10https://gerrit.wikimedia.org/r/457808 (owner: 10Legoktm) [04:51:46] !log deployed https://gerrit.wikimedia.org/r/457808 [04:51:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:05:04] (03CR) 10Legoktm: "Current status: This has been deployed for mediawiki-quibble* jobs for ~3 days, and all *quibble* jobs for ~1 day. I'll look at doing anot" [integration/config] - 10https://gerrit.wikimedia.org/r/457070 (https://phabricator.wikimedia.org/T203181) (owner: 10Legoktm) [07:09:06] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Upstream, 10Wikimedia-log-errors (Shared Build Failure): Error "TransportException 404 Not Found" in Jenkins jobs using composer - https://phabricator.wikimedia.org/T182266 (10Legoktm) p:05Normal>03Unbreak! The frequency of... [07:23:10] 10Release-Engineering-Team (Next), 10MediaWiki-General-or-Unknown, 10MW-1.29-release: Formalise and Announce REL1_29 EOL - https://phabricator.wikimedia.org/T197669 (10Legoktm) 05Open>03Resolved a:03Legoktm Resolved: there will be one more 1.29 security+maintenance release that will happen in/by Septem... [08:30:20] (03PS1) 10Hashar: docker: quibble-stretch-bundle support for mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/457837 (https://phabricator.wikimedia.org/T203178) [08:32:27] (03CR) 10Hashar: [C: 032] docker: quibble-stretch-bundle support for mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/457837 (https://phabricator.wikimedia.org/T203178) (owner: 10Hashar) [08:35:18] (03Merged) 10jenkins-bot: docker: quibble-stretch-bundle support for mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/457837 (https://phabricator.wikimedia.org/T203178) (owner: 10Hashar) [08:38:30] (03CR) 10Zfilipin: [C: 031] Add back Selenium tests for Wikibase [integration/config] - 10https://gerrit.wikimedia.org/r/457675 (https://phabricator.wikimedia.org/T189762) (owner: 10Hashar) [08:51:31] (03PS1) 10Hashar: Migrate mediawiki/selenium integration job to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/457843 [08:51:34] https://integration.wikimedia.org/ci/job/mediawiki-selenium-integration-docker/1/console [08:51:35] works! [08:51:51] (03CR) 10Hashar: [C: 032] Migrate mediawiki/selenium integration job to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/457843 (owner: 10Hashar) [08:52:20] (03PS2) 10Hashar: Migrate mediawiki/selenium integration job to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/457843 (https://phabricator.wikimedia.org/T203178) [08:59:16] (03CR) 10Hashar: [C: 032] Migrate mediawiki/selenium integration job to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/457843 (https://phabricator.wikimedia.org/T203178) (owner: 10Hashar) [09:02:13] (03Restored) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [selenium] - 10https://gerrit.wikimedia.org/r/330671 (owner: 10Hashar) [09:03:17] (03Merged) 10jenkins-bot: Migrate mediawiki/selenium integration job to Docker [integration/config] - 10https://gerrit.wikimedia.org/r/457843 (https://phabricator.wikimedia.org/T203178) (owner: 10Hashar) [09:03:56] (03PS3) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [selenium] - 10https://gerrit.wikimedia.org/r/330671 [09:08:56] mediawiki/selenium integration test migrated to docker *flexes* [09:09:05] (03Abandoned) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [selenium] - 10https://gerrit.wikimedia.org/r/330671 (owner: 10Hashar) [09:09:33] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar) [09:29:14] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin, 10Wikimedia-Incident: Create selenium-daily-beta-MediaWiki daily Jenkins job - https://phabricator.wikimedia.org/T185011 (10zeljkofilipin) [09:30:04] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin, 10Wikimedia-Incident: Create selenium-daily-beta-MediaWiki daily Jenkins job - https://phabricator.wikimedia.org/T185011 (10zeljkofilipin) [09:31:06] (03PS1) 10Hashar: Migrate ReadingLists to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/457855 (https://phabricator.wikimedia.org/T196567) [09:31:36] (03CR) 10Hashar: [C: 032] Migrate ReadingLists to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/457855 (https://phabricator.wikimedia.org/T196567) (owner: 10Hashar) [09:31:37] 10Release-Engineering-Team (Kanban), 10Reading List Service, 10Reading-Infrastructure-Team-Backlog, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review: [ReadingLists] No registered builder available for ReadingLists. - https://phabricator.wikimedia.org/T196567 (10hashar)... [09:33:02] (03Merged) 10jenkins-bot: Migrate ReadingLists to Quibble [integration/config] - 10https://gerrit.wikimedia.org/r/457855 (https://phabricator.wikimedia.org/T196567) (owner: 10Hashar) [09:41:39] 10Release-Engineering-Team (Kanban), 10Scap: Document scap swat command - https://phabricator.wikimedia.org/T196411 (10mmodell) p:05Normal>03High [10:00:21] 10Phabricator, 10Release-Engineering-Team (Kanban): Make sure elasticsearch 6 is supported in phabricator - https://phabricator.wikimedia.org/T181393 (10mmodell) [10:07:16] 10Diffusion, 10Repository-Admins, 10User-Luke081515: Connect/Link Phabricator/Maniphest projects to Diffusion repositories - https://phabricator.wikimedia.org/T120915 (10MGChecker) How is this going? Is this done for now? [10:10:20] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin, 10Wikimedia-Incident: Create selenium-daily-beta-MediaWiki daily Jenkins job - https://phabricator.wikimedia.org/T185011 (10zeljkofilipin) Videos of failed tests: {F25648028} {F25648029} {F25648030}... [10:11:02] 10Project-Admins, 10Release-Engineering-Team (Next): Create Trusted Contributors project? - https://phabricator.wikimedia.org/T145832 (10MGChecker) Is it possible to set group-specific rate limits on Phabricator? If yes, I think we should set lower limits for people who aren't part of this project, to hamper v... [10:21:00] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team (Kanban), 10releng-201718-q3, 10Epic, 10Patch-For-Review: [EPIC] Migrate Mediawiki jobs from Nodepool to Docker - https://phabricator.wikimedia.org/T183512 (10hashar) [10:47:51] 10Phabricator-Sprint-Extension, 10Technical-Debt: Deprecate Phabricator Sprint extension - https://phabricator.wikimedia.org/T90906 (10mydeveloperday) Simply removing the entire function leads to the following exception when entering the Sprint application {F25648289} I think at a minimum it needs protecte... [11:07:26] 10Project-Admins, 10Release-Engineering-Team (Next): Create Trusted Contributors project? - https://phabricator.wikimedia.org/T145832 (10Aklapper) @MGChecker: That is already the case. [11:08:35] 10Phabricator, 10Trusted-Contributors: Whitelist the Trusted-Contributors group from rate limit - https://phabricator.wikimedia.org/T198614 (10Aklapper) For the records, the current approach via our antivandalism extension has members of #trusted-contributors on the allowlist. However our implementation is no... [11:13:49] 10Phabricator, 10RelEng-Archive-FY201718-Q2: Allow users to restrict View Policy when creating Pastes - https://phabricator.wikimedia.org/T145749 (10Aklapper) [11:13:53] 10Project-Admins, 10Release-Engineering-Team (Next): Create Trusted Contributors project? - https://phabricator.wikimedia.org/T145832 (10Aklapper) 05Open>03Resolved a:03mmodell The project has been created, hence closing this task. For any further tweaking please file separate tasks. [11:17:53] (03Abandoned) 10Zfilipin: WIP Increase timeout of daily Selenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/437486 (https://phabricator.wikimedia.org/T167432) (owner: 10Zfilipin) [11:24:26] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [11:38:01] (03PS39) 10Zfilipin: Selenium daily tests for beta using Docker/wdio [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar) [11:38:13] (03CR) 10Zfilipin: "PS39 is a rebase" [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar) [12:01:06] (03PS40) 10Zfilipin: Selenium daily tests for beta using Docker/wdio [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar) [12:01:36] (03CR) 10Zfilipin: "PS40 adds support for creating graphs from junit results." [integration/config] - 10https://gerrit.wikimedia.org/r/443931 (https://phabricator.wikimedia.org/T188742) (owner: 10Hashar) [12:06:25] (03PS1) 10Zfilipin: Create selenium-daily-beta-MediaWiki Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/457881 (https://phabricator.wikimedia.org/T185011) [12:07:36] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin, 10Wikimedia-Incident: Create selenium-daily-beta-MediaWiki daily Jenkins job - https://phabricator.wikimedia.org/T185011 (10zeljkofilipin) [12:12:22] (03PS1) 10Zfilipin: Create selenium-daily-beta Jenkins jobs [integration/config] - 10https://gerrit.wikimedia.org/r/457882 (https://phabricator.wikimedia.org/T188742) [12:13:41] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:16:31] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:17:16] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:18:27] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:19:22] RECOVERY - Host deployment-certcentral02 is UP: PING OK - Packet loss = 0%, RTA = 2.00 ms [12:19:44] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:20:35] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10MW-1.32-release-notes (WMF-deploy-2018-09-04 (1.32.0-wmf.20)), 10Patch-For-Review, 10User-zeljkofilipin: Run tests daily targeting beta cluster for all repositories with Selenium tests - https://phabricator.wikimedia.org/T188742 (10zeljkofilip... [12:22:36] RECOVERY - Host deployment-certcentral-testclient02 is UP: PING OK - Packet loss = 0%, RTA = 34.96 ms [12:24:21] PROBLEM - Host deployment-certcentral02 is DOWN: CRITICAL - Host Unreachable (10.68.23.13) [12:46:54] RECOVERY - Free space - all mounts on integration-slave-docker-1025 is OK: OK: All targets OK [12:48:54] (03PS1) 10Robert Vogel: Add dependency for Skin:EUCopyrightCampaignSkin [integration/config] - 10https://gerrit.wikimedia.org/r/457892 (https://phabricator.wikimedia.org/T203295) [12:51:47] (03CR) 10Hashar: [C: 032] Add dependency for Skin:EUCopyrightCampaignSkin [integration/config] - 10https://gerrit.wikimedia.org/r/457892 (https://phabricator.wikimedia.org/T203295) (owner: 10Robert Vogel) [12:53:13] (03Merged) 10jenkins-bot: Add dependency for Skin:EUCopyrightCampaignSkin [integration/config] - 10https://gerrit.wikimedia.org/r/457892 (https://phabricator.wikimedia.org/T203295) (owner: 10Robert Vogel) [13:20:14] 10Deployments, 10MediaWiki-Maintenance-scripts: scap rebuildLocalisationCache.php runs "30 threads" all on the same CPU - https://phabricator.wikimedia.org/T203458 (10hashar) [13:21:13] 10Deployments, 10MediaWiki-Maintenance-scripts, 10HHVM: scap rebuildLocalisationCache.php runs "30 threads" all on the same CPU - https://phabricator.wikimedia.org/T203458 (10hashar) [13:24:02] 10Deployments, 10Release-Engineering-Team, 10MediaWiki-Maintenance-scripts, 10HHVM: scap rebuildLocalisationCache.php runs "30 threads" all on the same CPU - https://phabricator.wikimedia.org/T203458 (10hashar) I guess `pcntl_fork` sets some CPU affinitiy? :( [13:29:29] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations: mwscript rebuildLocalisationCache.php takes 40 minutes on HHVM (rather than ~5 on PHP 5) - https://phabricator.wikimedia.org/T191921 (10hashar) [13:29:32] 10Deployments, 10Release-Engineering-Team, 10MediaWiki-Maintenance-scripts, 10HHVM: scap rebuildLocalisationCache.php runs "30 threads" all on the same CPU - https://phabricator.wikimedia.org/T203458 (10hashar) [13:31:05] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations: mwscript rebuildLocalisationCache.php takes 40 minutes on HHVM (rather than ~5 on PHP 5) - https://phabricator.wikimedia.org/T191921 (10hashar) I have hit that today. From my dupe task T203458 : rebuildLocalisationCache.php is run with --threads=30... [13:48:39] (03PS1) 10Robert Vogel: Revert "Add dependency for Skin:EUCopyrightCampaignSkin" [integration/config] - 10https://gerrit.wikimedia.org/r/457905 [14:00:21] PROBLEM - Free space - all mounts on integration-slave-jessie-1004 is CRITICAL: CRITICAL: integration.integration-slave-jessie-1004.diskspace._srv.byte_percentfree (<22.22%) [14:15:20] RECOVERY - Free space - all mounts on integration-slave-jessie-1004 is OK: OK: All targets OK [14:24:10] PROBLEM - Free space - all mounts on integration-slave-docker-1026 is CRITICAL: CRITICAL: integration.integration-slave-docker-1026.diskspace.root.byte_percentfree (<55.56%) [14:35:45] 10Project-Admins, 10Security-Team: Undefined #Security-General and #Security-Other - https://phabricator.wikimedia.org/T109328 (10chasemp) a:03chasemp [14:39:11] RECOVERY - Free space - all mounts on integration-slave-docker-1026 is OK: OK: All targets OK [14:39:55] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-StopForumSpam, 10Wikimedia-extension-review-queue: Deploy StopForumSpam to the Beta Cluster - https://phabricator.wikimedia.org/T181217 (10MarcoAurelio) [14:47:37] (03PS1) 10Hashar: Quibble jobs wipe src on completion [integration/config] - 10https://gerrit.wikimedia.org/r/457918 [14:47:57] (03CR) 10Hashar: "Untested :]" [integration/config] - 10https://gerrit.wikimedia.org/r/457918 (owner: 10Hashar) [15:01:40] 10Phabricator, 10Release-Engineering-Team (Watching / External), 10Mail, 10Operations, and 3 others: Phabricator outbound email seems to have a SPOF of mx1001 - https://phabricator.wikimedia.org/T196916 (10herron) >>! In T196916#4552742, @ArielGlenn wrote: > Does this need more review/commentary before mov... [15:22:02] 10Phabricator, 10Release-Engineering-Team (Kanban): Publish the source for phabricator-antivandalism - https://phabricator.wikimedia.org/T202080 (10mmodell) p:05Triage>03Normal [15:26:05] 10Release-Engineering-Team (Kanban): Create keyholder gerrit repo - https://phabricator.wikimedia.org/T203108 (10mmodell) @faidon: The main thing in the diffusion repo is the debian packaging work that we did to get it in shape for publishing a deb. [15:26:55] (03PS1) 10Lokal Profil: Add commit-message-validator to labs/tools/heritage [integration/config] - 10https://gerrit.wikimedia.org/r/457926 (https://phabricator.wikimedia.org/T2033099) [15:29:29] 10MediaWiki-Codesniffer, 10security-team-backlog, 10Security: Security related Static Analysis - https://phabricator.wikimedia.org/T192207 (10chasemp) [15:31:51] 10Release-Engineering-Team (Watching / External), 10Security-Data-Mapping, 10Documentation, 10User-greg: Release Engineering Data Map - https://phabricator.wikimedia.org/T133239 (10chasemp) 05stalled>03declined Based on age and activity I'm closing, please reopen if that is incorrect :) [15:38:18] (03PS1) 10Ema: vhtcpd: run debian-glue for commits targeting the debian branch [integration/config] - 10https://gerrit.wikimedia.org/r/457929 [15:39:46] (03CR) 10jerkins-bot: [V: 04-1] vhtcpd: run debian-glue for commits targeting the debian branch [integration/config] - 10https://gerrit.wikimedia.org/r/457929 (owner: 10Ema) [15:49:57] 10Continuous-Integration-Config, 10Librarization, 10security-team-backlog, 10Composer, 10Security: Expand our usage of FriendsOfPHP/security-advisories - https://phabricator.wikimedia.org/T180278 (10chasemp) [15:51:03] 10Release-Engineering-Team, 10cloud-services-team, 10Wikimedia-log-errors: labtestweb2001: Memcached error for key "WANCache:m:global:Wikimedia\Rdbms\LoadBalancer:server-read-only:db2037" on server "127.0.0.1:11213": SERVER HAS FAILED AND IS DISABLED UNTIL TIMED RETR... - https://phabricator.wikimedia.org/T203479 [15:51:19] 10Release-Engineering-Team, 10cloud-services-team, 10wikitech.wikimedia.org, 10Wikimedia-log-errors: labtestweb2001 is sending updates to a read-only db host: db2037 - https://phabricator.wikimedia.org/T201082 (10hashar) [16:03:13] 10Release-Engineering-Team, 10Operations, 10puppet-compiler, 10Jenkins, and 2 others: Upgrade Puppet compilers to Stretch - https://phabricator.wikimedia.org/T191438 (10herron) The config to proxy https://puppet-compiler.wmflabs.org across both jessie and stretch compiler hosts (4 hosts total) is live and... [16:06:13] 10MediaWiki-Releasing, 10Phabricator, 10Project-Admins, 10security-team-backlog: Create "security pre-announce" group in Phab (to easier allow 3rd parties who get pre-release notifications to access Security tasks) - https://phabricator.wikimedia.org/T108360 (10chasemp) [16:07:44] 10MediaWiki-Releasing, 10Release-Engineering-Team, 10Security: Streamline/automate MW tarball security release process - https://phabricator.wikimedia.org/T156445 (10chasemp) [16:09:01] 10Release-Engineering-Team, 10cloud-services-team, 10Wikimedia-log-errors: labtestweb2001: Memcached error for key "WANCache:m:global:Wikimedia\Rdbms\LoadBalancer:server-read-only:db2037" on server "127.0.0.1:11213": SERVER HAS FAILED AND IS DISABLED UNTIL TIMED RETR... - https://phabricator.wikimedia.org/T203479 [16:14:05] 10Release-Engineering-Team (Someday), 10Operations, 10security-team-backlog, 10User-greg: Determine a core set or a checklist of permissions for deployment purpose - https://phabricator.wikimedia.org/T140270 (10chasemp) [16:14:40] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Upstream, 10Wikimedia-log-errors (Shared Build Failure): Error "TransportException 404 Not Found" in Jenkins jobs using composer - https://phabricator.wikimedia.org/T182266 (10Krinkle) I also e-mailed packagist.org support yeste... [16:17:09] 10MediaWiki-Codesniffer, 10MediaWiki-General-or-Unknown, 10Technical-Debt: Encourage type hints for function parameters and return after moving MediaWiki to PHP 7 - https://phabricator.wikimedia.org/T178136 (10EBernhardson) >>! In T178136#4546957, @MGChecker wrote: > I would appreciate a sniff checking if ty... [16:18:34] legoktm: https://packagist.org/mirrors - I don't know what the bug is exactly, but if it's within the operational layer and not the composer/packagist software itself (e.g. their cdns or mirrors not working well), then running our own might help. [16:18:43] Also, do these urls go through a Squid of sorts for caching? [16:18:45] I guess not. [16:18:54] probably hard to do given https [16:18:58] but I don't know much about that. [16:20:44] (03CR) 10Hashar: vhtcpd: run debian-glue for commits targeting the debian branch (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/457929 (owner: 10Ema) [16:28:28] 10Release-Engineering-Team (Kanban), 10Scap, 10User-zeljkofilipin, 10Wikimedia-Incident: Perform scap canary checks after sync-wikiversions - https://phabricator.wikimedia.org/T198640 (10thcipriani) [16:28:33] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations, 10Patch-For-Review: Update Debian Package for Scap to 3.8.5-1 - https://phabricator.wikimedia.org/T203271 (10thcipriani) 05Open>03Resolved All seems working. Thank you @fgiunchedi ! [16:32:10] 10Release-Engineering-Team (Kanban), 10Scap, 10User-zeljkofilipin, 10Wikimedia-Incident: Perform scap canary checks after sync-wikiversions - https://phabricator.wikimedia.org/T198640 (10thcipriani) 05Open>03Resolved Ran a noop `sync-wikiversions` after the scap upgrade to 3.8.5-1 and canary checks (+... [16:32:38] 10Release-Engineering-Team (Kanban), 10MediaWiki-Core-Tests, 10Easy, 10Patch-For-Review, 10User-zeljkofilipin: All repositories with Selenium tests should use wdio-mediawiki - https://phabricator.wikimedia.org/T199113 (10zeljkofilipin) [16:44:41] quick diffusion question, https://phabricator.wikimedia.org/D1109 says ElasticFulltextStorageEngine.php had 121 lines change, but the diff view shows maybe 30 or 40. What am i doing wrong? [16:49:06] weird, I dunno [16:49:10] cc twentyafterfour ^ [16:53:46] ebernhardson: weird indeed, I can't explain the discrepency right off hand... [16:53:59] twentyafterfour: fun :) I'll pull that patch and compare in git locally [16:54:45] the diff view looks correct though, I just don't know why it says 121 lines changed [16:55:07] oh, thats better [16:55:11] PROBLEM - Free space - all mounts on integration-slave-docker-1026 is CRITICAL: CRITICAL: integration.integration-slave-docker-1026.diskspace.root.byte_percentfree (<11.11%) [16:55:20] ohh I see what's up I think [16:55:26] it's ignoring whitespace changes [16:55:39] there was quite a bit of indentation change due to removing the for-loop [16:55:58] so the raw diff has 121 lines changed because a lot of whitespace shows as + and - [16:59:55] twentyafterfour: that makes a bunch of sense, thanks! [17:01:03] 10Phabricator-Sprint-Extension, 10Technical-Debt: Deprecate Phabricator Sprint extension - https://phabricator.wikimedia.org/T90906 (10epriestley) Several callsites are testing for `ProjectCreateProjectsCapability` on the `SprintApplication`. This is probably not what was intended. The current behavior is to... [17:02:17] aha! [17:09:52] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations: mwscript rebuildLocalisationCache.php takes 40 minutes on HHVM (rather than ~5 on PHP 5) - https://phabricator.wikimedia.org/T191921 (10hashar) on deployment-deploy01: ``` mwscript rebuildLocalisationCache.php --wiki="testwiki" --outdir="/tmp/scap_l1... [17:12:59] (03CR) 10Legoktm: [C: 032] Revert "Add dependency for Skin:EUCopyrightCampaignSkin" [integration/config] - 10https://gerrit.wikimedia.org/r/457905 (owner: 10Robert Vogel) [17:13:09] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations: mwscript rebuildLocalisationCache.php takes 40 minutes on HHVM (rather than ~5 on PHP 5) - https://phabricator.wikimedia.org/T191921 (10hashar) Then I am using taskset to find the CPU affinity mask. The maintenance script is tied to CPU 1: ``` 16735... [17:13:30] thcipriani: so yeah something sets the CPU affinity of rebuildLocalsationCache.php :\\\ [17:13:31] https://phabricator.wikimedia.org/T191921#4556939 [17:13:43] Krinkle: how do we point composer to use the mirror? it looks straightforward to set up a mirror [17:14:43] legoktm: I assume by ENV, or an .rc file, or cli parameter. [17:15:31] legoktm: Jordi replied by e-mail. saying he'll reply on GitHub "when it is fixed" [17:15:34] (03Merged) 10jenkins-bot: Revert "Add dependency for Skin:EUCopyrightCampaignSkin" [integration/config] - 10https://gerrit.wikimedia.org/r/457905 (owner: 10Robert Vogel) [17:15:41] I assume that means he's on to something. [17:15:46] sweet [17:16:20] !log deploying https://gerrit.wikimedia.org/r/457905 [17:16:23] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:20:13] RECOVERY - Free space - all mounts on integration-slave-docker-1026 is OK: OK: All targets OK [17:22:55] 10Release-Engineering-Team, 10Patch-For-Review: tools.wmflabs.org/versions caching - https://phabricator.wikimedia.org/T202734 (10Dzahn) >>! In T202734#4543474, @bd808 wrote: > I've applied @Legoktm's patch. When @Krinkle's apache config lands we can revert it to avoid useless cache pollution. It has landed. [17:27:26] Project beta-scap-eqiad build #221101: 04FAILURE in 13 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221101/ [17:27:51] ^ /me looking [17:28:04] oh [17:28:46] that's a new one [17:40:53] greg-g: It looks like the trimmed-down Monday schedule for Labor Day was carried over to next Monday and the Monday after as well. Am I correct in assuming that's a mistake, and is it OK if I fix it on the wiki page? [17:43:15] Yippee, build fixed! [17:43:15] Project beta-scap-eqiad build #221102: 09FIXED in 15 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/221102/ [17:54:37] RoanKattouw: eek, correct [17:54:46] on a call right now, can get to it later [17:55:45] Sure no riush [18:03:20] now what is the name of the gerrit file i am looking for to unblock https://gerrit.wikimedia.org/r/c/operations/puppet/+/423794/ [18:03:24] i completly forgot [18:03:34] should have done it when i knew the file name [18:07:23] found it https://github.com/GerritCodeReview/gerrit/blob/master/java/com/google/gerrit/pgm/util/LogFileCompressor.java [18:09:37] (03PS2) 10Hashar: Only run debian-glue when debian/* is changed [integration/config] - 10https://gerrit.wikimedia.org/r/457929 (owner: 10Ema) [18:11:13] (03CR) 10Hashar: "There was a fixme about running debian-glue solely when a debian/ file is changed. That is much better than manually filtering branches :]" [integration/config] - 10https://gerrit.wikimedia.org/r/457929 (owner: 10Ema) [18:40:48] 10Project-Admins, 10Security-Team: Undefined #Security-General and #Security-Other - https://phabricator.wikimedia.org/T109328 (10chasemp) 05Open>03Resolved As part of revitalizing the security group here we are reviewing our workflow processes :) >>! In T109328#4324821, @Aklapper wrote: > * I propose to... [18:50:10] 10Continuous-Integration-Config, 10RelEng-Archive-FY201718-Q2, 10Composer, 10Upstream, 10Wikimedia-log-errors (Shared Build Failure): Error "TransportException 404 Not Found" in Jenkins jobs using composer - https://phabricator.wikimedia.org/T182266 (10Krinkle) p:05Unbreak!>03Normal >>! **Seldeak** w... [18:54:25] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations: mwscript rebuildLocalisationCache.php takes 40 minutes on HHVM (rather than ~5 on PHP 5) - https://phabricator.wikimedia.org/T191921 (10hashar) `/proc/self/status` has informations about the process notably: > * Cpus_allowed: Mask of CPUs on which t... [19:06:11] PROBLEM - Free space - all mounts on integration-slave-docker-1026 is CRITICAL: CRITICAL: integration.integration-slave-docker-1026.diskspace.root.byte_percentfree (<22.22%) [19:12:45] thcipriani: the beta(scap-eqiad failure eariler that was probably me doing a killall php as www-data [19:13:17] that's kind of what I figured when I saw the error :) [19:19:48] hasharAway: as far as I know shell/limits only applies to wfShell commands, not maintenance scripts, and not eval.php [19:20:02] Project beta-update-databases-eqiad build #28079: 04FAILURE in 2.1 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/28079/ [19:20:42] It seems like a first step to enable JIT and set --threads=1 would already improve the speed, which previous comments have verified. [19:21:40] It'd be good to figure out why it is limited, but on the other hand, a first step would help as well. It's been a while the task is open without a change. [19:23:01] I abandoned some scap change a while ago that I could dust off. My perception was that php7 was closer than it now appears, hence the subtask of moving beta deployment servers. [19:23:36] I'll add that to my todo list [19:26:12] RECOVERY - Free space - all mounts on integration-slave-docker-1026 is OK: OK: All targets OK [19:28:01] Krinkle: yaaay [19:38:21] fyi Microsoft Edge support in polygerrit has just been fixed in 2.15 (if anyone uses microsoft edge) it has been fixed in master since december. [20:14:28] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T191065 (10Krinkle) [20:20:07] 10Continuous-Integration-Infrastructure, 10Wikimedia-log-errors (Shared Build Failure): Jenkins jobs for MediaWiki failing with 'npm: shasum check failed' - https://phabricator.wikimedia.org/T203506 (10Krinkle) p:05Triage>03High [20:20:41] 10Continuous-Integration-Infrastructure, 10Wikimedia-log-errors (Shared Build Failure): Jenkins jobs for MediaWiki failing with 'npm: shasum check failed' - https://phabricator.wikimedia.org/T203506 (10Krinkle) [20:22:07] legoktm: ugh, trading one error for another [20:22:08] https://integration.wikimedia.org/ci/job/wmf-quibble-core-vendor-mysql-hhvm-docker/2000/console [20:22:13] 00:01:39.377 [Seld\JsonLint\ParsingException] [20:22:13] 00:01:39.379 "./composer.json" does not contain valid JSON [20:22:17] That's a new one? [20:22:35] lolwut [20:22:38] Yippee, build fixed! [20:22:39] Project beta-update-databases-eqiad build #28080: 09FIXED in 2 min 38 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/28080/ [20:23:12] PROBLEM - Free space - all mounts on integration-slave-docker-1026 is CRITICAL: CRITICAL: integration.integration-slave-docker-1026.diskspace.root.byte_percentfree (<44.44%) [20:24:41] Krinkle: actually, I suspect that host ran out of disk space given ^^ and writing the file failed [20:25:02] right, the other issue [20:25:31] thcipriani: hmm, shouldn't the auto-offliner noticed / filled up on 1026? [20:26:22] https://integration.wikimedia.org/ci/computer/integration-slave-docker-1026/ now says it's offline, Disk space is too low. Only 0.771GB left on /tmp. [20:26:28] and another failure from that node for mw/FlaggedRevs [20:26:29] https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php70-docker/9364/console [20:26:36] offlining a node does not abort its jobs [20:26:40] does jenkins not reschedule jobs if it goes offline [20:26:44] well that's problematic [20:26:51] so it takes another 10 minutes before stuff actually stops or fails by itself. [20:28:00] I've now had 5, different, CI failures on the same commit in a row. [20:28:20] I didn't do anything and / is emptying [20:28:23] legoktm: it runs hourly for /srv and / checks those partitions are < 95% full. So there are lots of reasons it might not have disconnected. [20:28:55] it was at 96% so it would have met that threshold [20:29:05] but it probably filled up after the last run? [20:29:06] should probably update the frequency now that I've got it working and I'm sure it's not going to spam everyone [20:29:10] can we increase the frequency? [20:29:13] can we run it every 30 seconds instead and depool at (space - executors * space needed for a big job ) instead? [20:29:16] oh, great :) [20:29:40] I don't know how much 5% is, but I woudl guess 6 executors need more than that typically. [20:30:08] hrm, I could probably work that out. I assume there's some way to get # of executors [20:30:21] via the groovy/java api [20:30:31] It's tricky though, because I think we're close to disk space being optimal for running. [20:30:47] With my formula we'd need 2x the space and never use half of it. [20:31:17] seems better to limit the number of executors to the amount of space available, and to make sure workspaces are wiped afterwards. [20:31:25] then we'd never have a full disk, except in exceptional cases. [20:31:36] it did have 5 concurrent jobs [20:31:49] or 6? whatever the max was [20:32:00] currently jobs are cleared at the beginning of the next run, right? [20:32:31] jenkins has a way to wipe at the end of the job. I enabled this for the few jobs we had in 2013, but it might've not stuck. [20:32:35] am i supposed to add new wikis to beta sites ? https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/456192/ [20:32:48] probably because we started to use workspaces as a git cache, but we've stopped doing that afaik [20:33:22] mutante: I was going to just deploy the fixcopyright.wm stuff onto beta's metawiki, I didn't think it was worth setting up another wiki in beta for [20:34:01] Krinkle: we just keep cache/ log/ and tmp/ for the quibble jobs, but tmp/ is going away because tmpfs, log/ doesn't matter because jenkins keeps those as artifacts, and cache/ gets rsync'd from castor anyways [20:34:04] last I checked we use /srv/git as a reference repository and don't use workspaces to cache anything [20:34:10] ok, so that sounds like the entire config is different anyways [20:34:30] does it make sense to test changes on it given that? [20:34:39] thcipriani: right, so post-build cleaning seems safe in that case. [20:34:54] PROBLEM - Free space - all mounts on integration-slave-docker-1025 is CRITICAL: CRITICAL: integration.integration-slave-docker-1025.diskspace.root.byte_percentfree (<55.56%) [20:35:22] sigh [20:35:37] now 1025 / is filled (96%) [20:35:45] but I suspect we're still under-spaced / over-executed in that it regularly happens if the executors are all used, it will always reach disk capacity. Does that come from something other than workspaces? [20:35:58] Even if we clear workspaces at build start, that wouldn't accumulate. [20:36:00] the docker images themselves are stored in / [20:36:14] PROBLEM - SSH on integration-slave-docker-1005 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:36:33] * legoktm pets shinken-wm [20:36:48] mutante: I don't think we need fixcopyright in beta if that's what you're asking [20:37:17] * Hauskatze thinks we don't need fixcopyright anywhere [20:37:28] I can definitely get # of executors per agent: https://javadoc.jenkins.io/hudson/model/Computer.html#countExecutors-- how much space does each job take at this point? [20:37:40] Hauskatze: ? [20:37:49] legoktm: yea, that's what i'm asking. thanks i abandoned my change. i am not sure if having that setup helps us with much since we can't use it for testing [20:38:11] RECOVERY - Free space - all mounts on integration-slave-docker-1026 is OK: OK: All targets OK [20:38:24] mutante: since it's just a single MediaWiki page, I think we can test it relatively well on a separate wiki [20:39:21] depends what you want to test.. not apache changes though [20:40:10] !log github: created https://github.com/wikimedia/mediawiki-extensions-CreatedPagesList for T203431 [20:40:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:40:18] T203431: Missing GitHub mirror of Extension:CreatedPagesList (on Gerrit for ~2 months) - https://phabricator.wikimedia.org/T203431 [20:43:16] legoktm: creating a wiki for just a single page... with all the work wiki creation does imply plus that I don't like this kind of any-copyright activism; as an author speaking. [20:43:26] *anti-copyright [20:43:39] 10Project-Admins, 10Release-Engineering-Team (Next), 10Trusted-Contributors: Create Trusted Contributors project? - https://phabricator.wikimedia.org/T145832 (10MGChecker) [20:45:46] thcipriani: I'm not sure. [20:46:23] I'll try an average of all the workspace sizes and see what that is [20:46:28] thcipriani: Might be best to check the actual workspaces over the period of an hour or so and see how big the biggest one becomes. [20:46:33] Yeah [20:46:48] thcipriani: Note that T179963 makes it worse. [20:46:49] T179963: Workspaces for mwgate-php55lint / mwgate-php70lint are getting huge - https://phabricator.wikimedia.org/T179963 [20:47:05] 10Release-Engineering-Team, 10GitHub-Mirrors, 10User-MarcoAurelio: Missing GitHub mirror of Extension:CreatedPagesList (on Gerrit for ~2 months) - https://phabricator.wikimedia.org/T203431 (10MarcoAurelio) Tagging releng just in case they want to review. I am used to //delete// mirrors, not to //create// the... [20:47:10] Because some jobs clone all of mediawiki-core as an artefact instead of a shallow clone which would take up much less space. [20:49:09] Hauskatze: ah, agreed about the wiki creation part. But this is our first time doing this so I think we can improve for next time [20:50:00] legoktm: yeah [20:50:20] well, hopefully there's no next time [20:50:21] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T191065 (10greg) 05Open>03Resolved [20:50:25] legoktm: I just realised, the dependant pipeline in zuul, it isn't aware of branches. [20:50:33] nopeee [20:50:37] so patches for wmf.19 are blocked on wmf.20 [20:51:04] RECOVERY - SSH on integration-slave-docker-1005 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u5 (protocol 2.0) [20:51:48] this is somewhat understandable given that jobs have dependencies from other repos, and while zuul-cloner tries the same branch by name first, it falls back to master. So at least master can/should block other ones. [20:51:51] but not otherwise [20:54:53] RECOVERY - Free space - all mounts on integration-slave-docker-1025 is OK: OK: All targets OK [20:55:47] (03PS2) 10Legoktm: make-wmf-branch: Add fixcopyright.wm.o extensions and skin [tools/release] - 10https://gerrit.wikimedia.org/r/456779 (https://phabricator.wikimedia.org/T203296) [20:57:10] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations: mwscript rebuildLocalisationCache.php takes 40 minutes on HHVM (rather than ~5 on PHP 5) - https://phabricator.wikimedia.org/T191921 (10hashar) Using `PHP=php7.0 mwscript` it is not affected. So I guess HHVM ends up invoking `sched_setaffinity` whene... [20:57:15] thcipriani: hhvm.stats.enable_hot_profiler = 0 [20:57:56] HHVM only has a few calls to sched_setaffinity , one is the extension hotprofiler. Once disabled magic :] [20:59:27] I don't understand why we're not using PHP 7 for that [21:00:06] https://phabricator.wikimedia.org/T191921#4160131 [21:02:10] thcipriani: I will check with joe whether we can disable the hot profiler [21:02:19] legoktm: I don't know what is the status of hhvm -> php7.0 migration [21:02:53] for this one script it was usable back in April [21:03:14] on beta the deploy server are moving to stretch so we can test out php7 as I got it [21:10:23] (03CR) 10Cicalese: [C: 032] make-wmf-branch: Add fixcopyright.wm.o extensions and skin [tools/release] - 10https://gerrit.wikimedia.org/r/456779 (https://phabricator.wikimedia.org/T203296) (owner: 10Legoktm) [21:11:08] (03Merged) 10jenkins-bot: make-wmf-branch: Add fixcopyright.wm.o extensions and skin [tools/release] - 10https://gerrit.wikimedia.org/r/456779 (https://phabricator.wikimedia.org/T203296) (owner: 10Legoktm) [21:15:10] (03CR) 10Hashar: "Consider adding commit-message-validator directly in the labs/tools/heritage repository. It already relies on tox." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/457926 (https://phabricator.wikimedia.org/T2033099) (owner: 10Lokal Profil) [21:22:58] 10Beta-Cluster-Infrastructure, 10Core-Platform-Team, 10Patch-For-Review: Deploy EU copyright stuff to beta cluster - https://phabricator.wikimedia.org/T203299 (10Legoktm) a:03Legoktm [21:25:11] 10Phabricator: Document phabricator user groups in a central place - https://phabricator.wikimedia.org/T203511 (10MGChecker) [21:29:05] 10Gerrit, 10Release-Engineering-Team: Where did the Privacy Policy/Code of Conduct go on gerrit? - https://phabricator.wikimedia.org/T203512 (10greg) p:05Triage>03High [21:32:28] 10Gerrit, 10Release-Engineering-Team: Where did the Privacy Policy/Code of Conduct go on gerrit? - https://phabricator.wikimedia.org/T203512 (10Paladox) The changes were never merged to add them :) [21:35:24] 10Gerrit, 10Patch-For-Review: Add a link to the Code of Conduct to the footer of Gerrit - https://phabricator.wikimedia.org/T196835 (10greg) [21:35:26] 10Gerrit, 10Release-Engineering-Team: Where did the Privacy Policy/Code of Conduct go on gerrit? - https://phabricator.wikimedia.org/T203512 (10greg) [21:35:28] 21:10:49 21:10:49 Started cache_git_info [21:35:29] 21:22:55 21:22:55 Finished cache_git_info (duration: 12m 05s) [21:35:40] it really takes 12m for that? [21:36:03] 10Gerrit, 10Patch-For-Review: Add a link to the Code of Conduct to the footer of Gerrit - https://phabricator.wikimedia.org/T196835 (10greg) p:05Normal>03High We need this out sooner than later. [21:51:13] 10MediaWiki-Codesniffer: Create a sniff that makes sure function @annotations order makes sense - https://phabricator.wikimedia.org/T203514 (10MaxSem) [21:52:39] 10MediaWiki-Codesniffer: Validate order of Doxygen annotations in documentation comments - https://phabricator.wikimedia.org/T175374 (10Legoktm) [21:52:41] 10MediaWiki-Codesniffer: Create a sniff that makes sure function @annotations order makes sense - https://phabricator.wikimedia.org/T203514 (10Legoktm) [22:05:38] (03PS1) 10Thcipriani: Maintenance: run disconnect full disk every 5 min [integration/config] - 10https://gerrit.wikimedia.org/r/458063 [22:05:40] (03PS1) 10Thcipriani: Maintenance: calculate diskFull size per executor [integration/config] - 10https://gerrit.wikimedia.org/r/458064 [22:14:04] greg-g: I'm going to need a deployment window tomorrow to push out the fixcopyright.wm.o stuff [22:34:44] 10Release-Engineering-Team (Kanban), 10Scap, 10Operations: mwscript rebuildLocalisationCache.php takes 40 minutes on HHVM (rather than ~5 on PHP 5) - https://phabricator.wikimedia.org/T191921 (10Krinkle) @hashar Nice research! For web servers, HHVM has 1 worker process per CPU (this happens before affinity... [22:35:32] greg-g: I took https://wikitech.wikimedia.org/w/index.php?title=Deployments&type=revision&diff=1802011&oldid=1802005 for now, let me know if that time doesn't work [22:45:37] (03CR) 10Krinkle: "This seems fine, but depends on what kind of provisioning CI uses for these hosts." [integration/config] - 10https://gerrit.wikimedia.org/r/458064 (owner: 10Thcipriani) [22:45:43] (03CR) 10Krinkle: [C: 031] Maintenance: run disconnect full disk every 5 min [integration/config] - 10https://gerrit.wikimedia.org/r/458063 (owner: 10Thcipriani) [23:09:41] legoktm: looks fine :) [23:21:03] (03PS2) 10Thcipriani: Maintenance: run disconnect full disk every 5 min [integration/config] - 10https://gerrit.wikimedia.org/r/458063 [23:25:11] (03CR) 10Thcipriani: [C: 032] "deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/458063 (owner: 10Thcipriani) [23:28:39] (03Merged) 10jenkins-bot: Maintenance: run disconnect full disk every 5 min [integration/config] - 10https://gerrit.wikimedia.org/r/458063 (owner: 10Thcipriani) [23:48:25] 10Beta-Cluster-Infrastructure, 10Core-Platform-Team, 10Patch-For-Review: Deploy EU copyright stuff to beta cluster - https://phabricator.wikimedia.org/T203299 (10Legoktm) 05Open>03Resolved https://meta.wikimedia.beta.wmflabs.org/wiki/Fix_copyright Note that the ULS Accept-Language stuff isn't enabled on... [23:48:27] greg-g: Since you didn't get around to fixing the deployment schedule for the next few Mondays, is it OK if I fix it for you? [23:48:54] Selfish motivation: I want to schedule a deployment for Sept 17 and the SWAT window that I need for that doesn't currently exist on the calendar :)