[03:11:14] 10Phabricator: Cannot view pages when logged into Phabricator under a not-yet-approved account. - https://phabricator.wikimedia.org/T197550#4295923 (10MZMcBride) p:05Triage>03High An issue that impairs the ability of a user to perform basic functions such as reading a task is a high priority to get resolved.... [03:11:33] andre__: Such a troll. [03:14:48] 10Phabricator: Cannot view pages when logged into Phabricator under a not-yet-approved account. - https://phabricator.wikimedia.org/T197550#4295930 (10MZMcBride) I tried to create a test account just now and a verified e-mail address is required. Since when? [03:21:07] 10Phabricator: Cannot view pages when logged into Phabricator under a not-yet-approved account. - https://phabricator.wikimedia.org/T197550#4295931 (10MZMcBride) Am I understanding this issue correctly? The current behavior when a new user registers a Wikimedia Phabricator account to file a bug or report some ki... [05:59:13] 10Phabricator: Cannot view pages when logged into Phabricator under a not-yet-approved account. - https://phabricator.wikimedia.org/T197550#4295972 (10Krenair) Requiring approval is justified, blocking the ability to read until they're approved is not. [06:02:28] 10Continuous-Integration-Config, 10MediaWiki Language Extension Bundle: Run php5 tests for MLEB extensions - https://phabricator.wikimedia.org/T197561#4295973 (10Nikerabbit) [07:25:53] 10Continuous-Integration-Config, 10MediaWiki Language Extension Bundle: Run php5 tests for MLEB extensions - https://phabricator.wikimedia.org/T197561#4295973 (10Legoktm) Do you mean just the composer tests or the actual MediaWiki PHPUnit tests? The latter would need to run against an older version since 1.31+... [07:57:30] 10Continuous-Integration-Config, 10MediaWiki Language Extension Bundle: Run php5 tests for MLEB extensions - https://phabricator.wikimedia.org/T197561#4296154 (10Nikerabbit) Does running composer tests with PHP5 actually help to find incompatibilities? It would be fine if the PHP5 tests are run against an old... [08:18:51] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4296171 (10Mainframe98) It appears that the history of rMW is still stuck on importing, and no commits are listed after Monday, June 11. Gerrit correctly reports commits after that date: https:/... [08:27:19] 10Deployments, 10Release-Engineering-Team (Watching / External), 10Operations, 10HHVM, and 3 others: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#4296188 (10Joe) a:03Joe [08:27:41] 10Deployments, 10Release-Engineering-Team (Watching / External), 10Operations, 10HHVM, and 3 others: Translation cache exhaustion caused by changes to PHP code in file scope - https://phabricator.wikimedia.org/T103886#1401646 (10Joe) will merge this change once we're out of the deployment freeze. [08:41:23] 10Release-Engineering-Team, 10Scap, 10Operations: find a way to systematically update the deployment server name across all repos - https://phabricator.wikimedia.org/T197470#4296237 (10Joe) p:05Triage>03High [08:45:47] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline: Add CI namespace in staging k8s cluster - https://phabricator.wikimedia.org/T196654#4296242 (10Joe) p:05Triage>03Normal a:03Joe [09:05:02] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4296271 (10MarcoAurelio) I think @mmodell disabled some stuff (phid?, I don't remember) to help ease the db transactions after the ignoring of the refs/.*/.*/meta ignores. That might be? [10:20:41] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review: Add CI namespace in staging k8s cluster - https://phabricator.wikimedia.org/T196654#4296449 (10Joe) I created a namespace called `ci` that you can deploy to using helm as long as you use the kubeconfig `/etc/kubernet... [10:20:48] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review: Add CI namespace in staging k8s cluster - https://phabricator.wikimedia.org/T196654#4296450 (10Joe) 05Open>03Resolved [10:48:52] 10Phabricator, 10Release-Engineering-Team, 10Mail, 10Operations, 10Wikimedia-Incident: Phabricator outbound email seems to have a SPOF of mx1001 - https://phabricator.wikimedia.org/T196916#4296486 (10Joe) p:05Triage>03High [11:01:35] 10Phabricator: Cannot view pages when logged into Phabricator under a not-yet-approved account. - https://phabricator.wikimedia.org/T197550#4296513 (10Aklapper) p:05High>03Triage The number of affected user account is very small and the account approval queue is processed. So I'm going to reset the task prio... [11:15:51] 10Beta-Cluster-Infrastructure, 10ORES, 10Scoring-platform-team, 10Beta-Cluster-reproducible, 10Wikimedia-log-errors: InvalidArgumentException for betacluster eswiki - https://phabricator.wikimedia.org/T197584#4296536 (10MarcoAurelio) [11:32:16] 10Beta-Cluster-Infrastructure, 10ORES, 10Scoring-platform-team, 10Beta-Cluster-reproducible, 10Wikimedia-log-errors: InvalidArgumentException for betacluster eswiki - https://phabricator.wikimedia.org/T197584#4296581 (10awight) [11:35:40] 10Beta-Cluster-Infrastructure, 10ORES, 10Scoring-platform-team, 10Beta-Cluster-reproducible, 10Wikimedia-log-errors: InvalidArgumentException for betacluster eswiki - https://phabricator.wikimedia.org/T197584#4296591 (10MarcoAurelio) I made https://es.wikipedia.beta.wmflabs.org/?diff=33280 and the page n... [12:22:00] 10Phabricator (Upstream), 10Upstream: Cannot view pages when logged into Phabricator under a not-yet-approved account. - https://phabricator.wikimedia.org/T197550#4296667 (10Aklapper) [12:26:13] PROBLEM - SSH on integration-slave-docker-1016 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:39:50] 10Release-Engineering-Team, 10Operations: Scap error from mwdebug2001.codfw.wmnet: sync: write failed on "/srv/mediawiki/wmf-config/InitialiseSettings.php": No space left on device (28) - https://phabricator.wikimedia.org/T197275#4296714 (10Joe) a:03Joe [12:41:03] RECOVERY - SSH on integration-slave-docker-1016 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) [12:42:28] 10Release-Engineering-Team, 10Operations: Scap error from mwdebug2001.codfw.wmnet: sync: write failed on "/srv/mediawiki/wmf-config/InitialiseSettings.php": No space left on device (28) - https://phabricator.wikimedia.org/T197275#4296716 (10Joe) mwdebug2001 now has 8 free gigabytes, but one must wonder how we... [12:55:31] 10Release-Engineering-Team, 10Operations: Scap error from mwdebug2001.codfw.wmnet: sync: write failed on "/srv/mediawiki/wmf-config/InitialiseSettings.php": No space left on device (28) - https://phabricator.wikimedia.org/T197275#4296760 (10Reedy) ~4GB per MW version. 1.7GB l10n cdbs... 1.7GB of l10n json file... [13:14:52] 10Phabricator, 10Release-Engineering-Team (Kanban), 10WorkType-Maintenance: Phabricator errors when filing new Maniphest task (due to "Can Edit Task Policies" policy for application Maniphest) - https://phabricator.wikimedia.org/T127271#4296806 (10Aklapper) 05Open>03Resolved [13:40:22] 10Project-Admins: Add #SVG tag to Phabricator - https://phabricator.wikimedia.org/T194188#4296878 (10Aklapper) a:03Volker_E [13:50:37] 10Release-Engineering-Team, 10ORES, 10Scoring-platform-team (Current): Document: ORES deployment caused some sort of downtime - https://phabricator.wikimedia.org/T197191#4296930 (10Halfak) 05Open>03declined [14:06:28] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4296959 (10mmodell) As far as I can tell, rMW is importing properly now. [14:07:30] 10Continuous-Integration-Infrastructure, 10SyntaxHighlight: Failed to invoke Pygments: /usr/bin/env: python: No such file or directory - https://phabricator.wikimedia.org/T197601#4296960 (10Reedy) [14:10:13] 10Continuous-Integration-Infrastructure, 10SyntaxHighlight: Failed to invoke Pygments: /usr/bin/env: python: No such file or directory - https://phabricator.wikimedia.org/T197601#4296990 (10Reedy) [14:12:18] Hi - it looks to me like Quibble is preventing a patch of mine from getting merged in because of the use of a deprecated MediaWiki hook (LinkEnd). [14:12:41] Here's the patch: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/PageForms/+/440858/ , and here's the error output: https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-hhvm-docker/5381/console [14:13:51] I'm planning to add in the use of its replacement hook, HtmlPageLinkRendererEnd - but I'm also planning to keep the use of LinkEnd in there, for backward compatibility with MW < 1.28. [14:14:03] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4297010 (10mmodell) If there are any others which haven't imported properly please update this ticket. Currently I'm not aware of any others. [14:14:30] So - is there any way to prevent Quibble from "vetoing" this patch? [14:14:43] ...and all future patches? [14:14:47] Fixing the test error is the obvious way [14:15:27] I guess you wrap it in some sort of version conditional [14:16:42] Reedy: I don't think that test is failing, though... as far as I can tell, the issue is just with the use of LinkEnd. [14:17:02] Or am I misunderstanding the error message? [14:20:41] Is there some kind of "ignore deprecation warnings" setting I can add? That might be the easiest solution, assuming I understand the error correctly. [14:22:05] $this->hideDeprecated() ? [14:23:36] A bit of a hack... [14:24:58] Reedy: sounds good enough for me! Let me try that... [14:27:07] 10Continuous-Integration-Infrastructure, 10SyntaxHighlight: Failed to invoke Pygments: /usr/bin/env: python: No such file or directory - https://phabricator.wikimedia.org/T197601#4296960 (10hashar) The Docker images for Quibble have the `python3` which is a dependency of Quibble itself. There is no python2 pac... [14:40:37] Yaron: Keeping LinkEnd is fine, as long as you only register it conditionally for older versions (then you don't get warnings that convert to failures during test runs) [14:43:07] Nikerabbit: ah, I was thinking to just add a check like "if MW >= 1.28, exit" to the onLinkEnd() function. [14:44:13] Yaron: yeah but that way doesn't prevent deprecation warnings :/ [14:44:35] It sure doesn't. :) [14:45:06] Conditional registration can't be done directly in extension.json, can it? [14:45:18] I would have to put that stuff into a "callback" function? [14:46:31] Yaron: you mean https://www.mediawiki.org/wiki/Manual:Extension_registration#Customizing_registration ? [14:46:45] Right. [14:46:57] Yes, I should just do that. [15:25:11] 10Continuous-Integration-Infrastructure, 10SyntaxHighlight, 10Patch-For-Review: Failed to invoke Pygments: /usr/bin/env: python: No such file or directory - https://phabricator.wikimedia.org/T197601#4297232 (10Reedy) Backports are above. I don't really see any reason we can't require python3. It's not like... [15:47:54] Is it okay if I do some schema changes on beta cluster? how db is structured there? [15:48:31] (I practically want to drop a create it again so auto increment gets reset and cleaned) [15:48:38] *a table [15:53:52] okay, we have a master and a replica [15:53:59] db03 and db04 [15:56:24] 10Beta-Cluster-Infrastructure, 10Cassandra, 10RESTBase-Cassandra, 10Services (done): Puppet failure on deployment-cassandra3-0[12] - https://phabricator.wikimedia.org/T196830#4297349 (10mobrovac) The failure was due to a mismatch in Cassandra version. We were in the process of upgrading it, and that proces... [15:58:39] Okay, I make the whole enwiki in beta cluster readonly for a minute and do this. Will be fine [16:05:22] !log making enwiki in beta clsuter readonly [16:05:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:07:09] Amir1: You know update.php just runs them, rihgt? [16:07:12] So you don't have to do them nanually [16:07:18] !log change_tag_def is back now [16:07:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:07:35] Reedy: no, it's because changes I've made I have to re-do it [16:07:44] update.php doesn't work [16:15:23] !log ladsgroup@deployment-tin:~$ mwscript populateChangeTagDef.php --wiki=enwiki [16:15:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:16:26] ladsgroup@deployment-tin:~$ mwscript populateChangeTagDef.php --wiki=enwiki [16:16:26] [Mon Jun 18 16:15:25 2018] [hphp] [19912:7fa9d1735200:0:000001] [] [16:16:26] Fatal error: Class undefined: MediaWiki\MediaWikiServices in /srv/mediawiki-staging/php-master/maintenance/populateChangeTagDef.php on line 41 [16:16:33] facepalm [16:23:09] 10Release-Engineering-Team, 10Structured-Data-Commons, 10Wikidata: Create test version of commons in group0 - https://phabricator.wikimedia.org/T197616#4297435 (10daniel) [16:25:24] 10Release-Engineering-Team, 10Structured-Data-Commons, 10Wikidata: Create test version of commons in group0 - https://phabricator.wikimedia.org/T197616#4297460 (10Reedy) [16:26:21] 10Release-Engineering-Team, 10Structured-Data-Commons, 10Wikidata: Create test version of commons in group0 - https://phabricator.wikimedia.org/T197616#4297465 (10daniel) [16:26:54] 10Release-Engineering-Team, 10Structured-Data-Commons, 10Wikidata: Create test version of commons in group0 - https://phabricator.wikimedia.org/T197616#4297435 (10Reedy) Removed test.commons.wikimedia.org because that's then a new SSL cert etc required Are some of the test wikis going to be targetting this... [16:28:51] 10Gerrit, 10Release-Engineering-Team: Gerrit has created duplicate accounts for some users - https://phabricator.wikimedia.org/T197083#4297494 (10mmodell) [16:28:53] 10Gerrit, 10Release-Engineering-Team: gerrit: run "LocalUsernamesToLowerCase" utility on gerrit host to fix mixed case usernames in gerrit's accounts db - https://phabricator.wikimedia.org/T197257#4297492 (10mmodell) 05Open>03Invalid @demon: that's probably true. I think the dupes actually got introduced m... [16:46:00] PROBLEM - Free space - all mounts on deployment-mediawiki06 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki06.diskspace.root.byte_percentfree (<11.11%) [16:51:03] RECOVERY - Free space - all mounts on deployment-mediawiki06 is OK: OK: All targets OK [16:54:33] 10Release-Engineering-Team, 10Structured-Data-Commons, 10Wikidata: Create test version of commons in group0 - https://phabricator.wikimedia.org/T197616#4297435 (10greg) Reminder that https://commons.wikimedia.beta.wmflabs.org/wiki/Main_Page exists and is there for your use. Are you expecting some content to... [16:57:11] 10Release-Engineering-Team, 10Structured-Data-Commons, 10Wikidata: Create test version of commons in group0 - https://phabricator.wikimedia.org/T197616#4297600 (10daniel) @greg This is not urgent. We discussed it briefly and found it to be a good idea. This ticket is here so we can exchange further thoughts.... [17:01:13] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.32.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T191054#4297609 (10greg) 05Open>03Resolved [17:02:38] 10Deployments, 10Release-Engineering-Team (Someday): Scope out "deployment-dashboard" project - https://phabricator.wikimedia.org/T137729#4297611 (10greg) [17:03:04] 10Release-Engineering-Team, 10Epic: FY2017/18 Program 3 Outcome 2 Objective 2: Define and implement a process to regularly address technical debt across the Foundation - https://phabricator.wikimedia.org/T174095#4297614 (10greg) [17:25:40] !log ladsgroup@deployment-tin:~$ mwscript populateChangeTagDef.php --wiki=enwiki [17:25:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:02:50] 10Gerrit, 10Release-Engineering-Team, 10Upstream: Unable to edit external-ids ref in notedb due to validation - https://phabricator.wikimedia.org/T197192#4297777 (10mmodell) We've responded upstream with answers to these questions. https://bugs.chromium.org/p/gerrit/issues/detail?id=9256 [18:04:30] 10Gerrit, 10Release-Engineering-Team: Gerrit has created duplicate accounts for some users - https://phabricator.wikimedia.org/T197083#4278455 (10thcipriani) @mmodell updated the upstream report with the current best plan he has and answers to all their specific questions: https://bugs.chromium.org/p/gerrit/is... [18:05:33] 10Gerrit, 10Release-Engineering-Team: Gerrit has created duplicate accounts for some users - https://phabricator.wikimedia.org/T197083#4297782 (10thcipriani) [18:05:35] 10Gerrit, 10Phabricator, 10LDAP: Having difficulty logging into Phabricator via LDAP when multiple accounts returned for username (gerrit: Duplicate users: smccandlish) - https://phabricator.wikimedia.org/T138672#4297781 (10thcipriani) [18:06:44] 10Gerrit, 10Phabricator, 10LDAP: Having difficulty logging into Phabricator via LDAP when multiple accounts returned for username (gerrit: Duplicate users: smccandlish) - https://phabricator.wikimedia.org/T138672#2406941 (10thcipriani) Removed {T197083} as parent. This task is similar, but we think it has di... [18:10:04] 10Gerrit, 10Release-Engineering-Team: Gerrit has created duplicate accounts for some users - https://phabricator.wikimedia.org/T197083#4297786 (10mmodell) [18:38:49] PROBLEM - Puppet errors on deployment-elastic05 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [0.0] [19:18:52] RECOVERY - Puppet errors on deployment-elastic05 is OK: OK: Less than 1.00% above the threshold [0.0] [19:50:19] 10Phabricator, 10Release-Engineering-Team, 10Mail, 10Operations, 10Wikimedia-Incident: Phabricator outbound email seems to have a SPOF of mx1001 - https://phabricator.wikimedia.org/T196916#4298063 (10herron) Network connectivity looks good from phab1001 to both MX servers. ``` phab1001:~# nc -vz mx1001.... [21:20:31] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4270440 (10Tgr) What's the rationale behind Diffusion importing repositories at all? It was supposed to be a step towards Phabricator-based code review, but that plan was abandoned - maybe it wo... [21:25:48] 10Diffusion: Diffusion commits stuck in 'Importing...' status for too long - https://phabricator.wikimedia.org/T196855#4270440 (10greg) >>! In T196855#4298258, @Tgr wrote: > What's the rationale behind Diffusion importing repositories at all? It was supposed to be a step towards Phabricator-based code review, bu... [22:37:46] 10Release-Engineering-Team (Kanban), 10Surveys, 10User-greg: Developer Satisfaction Survey - https://phabricator.wikimedia.org/T197635#4298382 (10greg) p:05Triage>03Normal [23:43:35] 10Continuous-Integration-Config, 10MediaWiki Language Extension Bundle: Run php5 tests for MLEB extensions - https://phabricator.wikimedia.org/T197561#4298528 (10Legoktm) >>! In T197561#4296154, @Nikerabbit wrote: > Does running composer tests with PHP5 actually help to find incompatibilities? It depends what...