[00:31:30] ssh to deployment-memc0* doesn't seem to work [00:35:08] Reedy, I can ssh to memc02 [00:35:20] and 03 [00:35:28] yep, and 04 [00:35:51] hmm [00:35:55] will try again in a few [00:42:30] 10Deployment-Systems, 10Architecture, 10Wikimedia-Developer-Summit-2016-Organization, 7Availability: WikiDev 16 working area: Software engineering - https://phabricator.wikimedia.org/T119032#1840071 (10bd808) >>! In T119032#1835009, @daniel wrote: > @RobLa-WMF My concern is about the target audience. Do we... [00:45:38] just hanging [00:46:13] ssh -vvv? [00:46:35] only seems to be memc hosts [00:46:54] dns is wrong [00:46:59] debug1: Connecting to deployment-memc04 [10.68.17.69] port 22. [00:47:08] 10.68.16.14 on wikitech [00:47:30] reedy@tools-bastion-01:~$ nslookup deployment-memc04 [00:47:30] Server: 208.80.155.118 [00:47:30] Address: 208.80.155.118#53 [00:47:30] Non-authoritative answer: [00:47:30] Name: deployment-memc04.eqiad.wmflabs [00:47:32] Address: 10.68.17.69 [00:47:34] reedy@tools-bastion-01:~$ [00:48:26] it is 10.68.17.69 [00:48:53] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-memc02.deployment-prep.eqiad.wmflabs [00:48:57] Wikitech says otherwise [00:49:03] that's 02 [00:49:03] (and it doesn't work) [00:49:05] we're looking at 04 [00:49:31] I've been up over 18 hours [00:55:56] ssh: connect to host deployment-memc02 port 22: Connection timed out [01:12:49] pdf too [05:54:38] 10Continuous-Integration-Config, 5Patch-For-Review, 3Wikipedia-Android-App: java-mwapi: Add verification tasks when new patch gets uploaded - https://phabricator.wikimedia.org/T108735#1840465 (10Niedzielski) @hashar, I think this lib is slated for deprecation and that this task can be closed for now. It's po... [07:58:59] 10Deployment-Systems, 10MediaWiki-extensions-LocalisationUpdate, 7I18n, 7Wikimedia-log-errors: l10n-update not updating Vector and extensions - https://phabricator.wikimedia.org/T103879#1840546 (10Nemo_bis) Cc Milićević https://translatewiki.net/wiki/Thread:Support/ConfirmEdit_Fancy_Captcha_translations_no... [08:47:53] 6Release-Engineering-Team, 7Database, 7user-notice: Requests to globally reset a user's skin preferences - https://phabricator.wikimedia.org/T119206#1840592 (10Edgars2007) >>! In T119206#1838886, @demon wrote: > Running the script now for all wikis which you have a local account, should be complete in a few... [09:15:56] 10Continuous-Integration-Config, 5Patch-For-Review, 3Wikipedia-Android-App: java-mwapi: Add verification tasks when new patch gets uploaded - https://phabricator.wikimedia.org/T108735#1840616 (10hashar) 5Open>3Resolved Per @Niedzielski , thank you! [10:10:25] 7Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 5Patch-For-Review, and 2 others: create a Wikibase browser test job running against a fresh MediaWiki installation - https://phabricator.wikimedia.org/T118284#1840774 (10Lydia_Pintscher) [10:17:49] 10Continuous-Integration-Config, 10Wikidata, 5Patch-For-Review, 3Wikidata-Sprint-2015-11-17, 3Wikidata-Sprint-2015-12-01: [Task] Add Wikidata to extension-gate in CI - https://phabricator.wikimedia.org/T96264#1840832 (10Lydia_Pintscher) [10:21:32] (03PS1) 10Hashar: Drop URL from jslint deprecation message [integration/config] - 10https://gerrit.wikimedia.org/r/256184 [10:21:41] (03CR) 10Hashar: [C: 032] Drop URL from jslint deprecation message [integration/config] - 10https://gerrit.wikimedia.org/r/256184 (owner: 10Hashar) [10:22:38] (03Merged) 10jenkins-bot: Drop URL from jslint deprecation message [integration/config] - 10https://gerrit.wikimedia.org/r/256184 (owner: 10Hashar) [10:30:35] !log Upgrading Zuul on Trusty and Jessie labs slaves to 2.1.0-60-g1cc37f7-wmf4... [10:30:37] qa-morebots: ping [10:30:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:30:39] I am a logbot running on tools-exec-1211. [10:30:39] Messages are logged to https://tools.wmflabs.org/sal/releng. [10:30:39] To log a message, type !log . [10:30:40] qa-morebots: poke [10:30:40] I am a logbot running on tools-exec-1211. [10:30:40] Messages are logged to https://tools.wmflabs.org/sal/releng. [10:30:40] To log a message, type !log . [10:37:36] !log kicking puppetmaster on integration-puppetmaster : out of memory [10:37:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [11:02:23] (03PS1) 10Phedenskog: Test the PerformanceInspector extension [integration/config] - 10https://gerrit.wikimedia.org/r/256199 (https://phabricator.wikimedia.org/T118204) [11:15:41] 7Browser-Tests, 10Wikidata: Make Wikidata performance test again able to load Italy - https://phabricator.wikimedia.org/T119950#1840948 (10adrianheine) 3NEW [11:16:55] 7Browser-Tests, 10Wikidata, 3Wikidata-Sprint-2015-12-01: Make Wikidata performance test again able to load Italy - https://phabricator.wikimedia.org/T119950#1840956 (10Lydia_Pintscher) [11:27:00] 7Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 5Patch-For-Review, and 2 others: create a Wikibase browser test job running against a fresh MediaWiki installation - https://phabricator.wikimedia.org/T118284#1840987 (10adrianheine) You could at least ask the people that did the reverse move not... [11:38:43] 10Beta-Cluster-Infrastructure, 6Labs, 10Labs-Infrastructure, 6operations, 5Patch-For-Review: Make all ldap users have a sane shell (/bin/bash) - https://phabricator.wikimedia.org/T86668#1841074 (10fgiunchedi) [11:48:26] 7Browser-Tests, 10Continuous-Integration-Config, 10Wikidata, 5Patch-For-Review, and 2 others: create a Wikibase browser test job running against a fresh MediaWiki installation - https://phabricator.wikimedia.org/T118284#1841103 (10daniel) @adrianheine It's not that we are moving the tests back. This is abo... [11:52:16] 10Deployment-Systems, 3Scap3: create an environment object that centralizes the file and directory lookup logic for scap3 - https://phabricator.wikimedia.org/T119643#1841107 (10mmodell) [13:02:37] (03CR) 10Hashar: [C: 032] ":)" [integration/config] - 10https://gerrit.wikimedia.org/r/256199 (https://phabricator.wikimedia.org/T118204) (owner: 10Phedenskog) [13:04:13] (03Merged) 10jenkins-bot: Test the PerformanceInspector extension [integration/config] - 10https://gerrit.wikimedia.org/r/256199 (https://phabricator.wikimedia.org/T118204) (owner: 10Phedenskog) [13:08:10] (03CR) 10Hashar: "Deployed :-)" [integration/config] - 10https://gerrit.wikimedia.org/r/256199 (https://phabricator.wikimedia.org/T118204) (owner: 10Phedenskog) [13:09:10] (03PS2) 10Hashar: Extract mw parser tests to standalone jobs [integration/config] - 10https://gerrit.wikimedia.org/r/256006 (https://phabricator.wikimedia.org/T114314) [14:01:44] Hashar: thanks :) [14:02:02] (03PS1) 10Hashar: Replace mw-run-phpunit.sh with mw-phpunit.sh [integration/config] - 10https://gerrit.wikimedia.org/r/256215 (https://phabricator.wikimedia.org/T114314) [14:02:20] phedenskog: hey :-) [14:02:30] phedenskog: you can look at mediawiki/extensions/BoilerPlate [14:02:51] usually you can just copy paste all its content to have some foundation to build your new extension [14:03:05] let me know if you need help with CI / test entry points [14:12:13] (03PS3) 10Hashar: Extract mw parser tests to standalone jobs [integration/config] - 10https://gerrit.wikimedia.org/r/256006 (https://phabricator.wikimedia.org/T114314) [14:13:10] (03CR) 10Hashar: [C: 032] "Jobs updated" [integration/config] - 10https://gerrit.wikimedia.org/r/256215 (https://phabricator.wikimedia.org/T114314) (owner: 10Hashar) [14:14:50] (03Merged) 10jenkins-bot: Replace mw-run-phpunit.sh with mw-phpunit.sh [integration/config] - 10https://gerrit.wikimedia.org/r/256215 (https://phabricator.wikimedia.org/T114314) (owner: 10Hashar) [14:36:18] arhg [14:36:35] !log bin/mw-phpunit.sh: line 31: phpunit_args[@]: unbound variable [14:36:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:48:46] (03PS1) 10Hashar: mw-phpunit.sh: allow empty phpunit args [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256222 [14:49:09] (03CR) 10Hashar: [C: 032] mw-phpunit.sh: allow empty phpunit args [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256222 (owner: 10Hashar) [14:49:28] !log mw-phpunit.sh error is fixed via https://gerrit.wikimedia.org/r/256222 [14:49:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:49:58] (03Merged) 10jenkins-bot: mw-phpunit.sh: allow empty phpunit args [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256222 (owner: 10Hashar) [14:55:10] F********************************** SALT [14:55:49] !log salt --show-timeout '*' cmd.run 'cd /srv/deployment/integration/slave-scripts; git pull' [14:55:52] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [15:05:03] (03PS1) 10Hashar: mw-phpunit.sh just set an empty arg '' [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256225 [15:05:26] (03CR) 10Hashar: [C: 032] mw-phpunit.sh just set an empty arg '' [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256225 (owner: 10Hashar) [15:06:15] (03Merged) 10jenkins-bot: mw-phpunit.sh just set an empty arg '' [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256225 (owner: 10Hashar) [16:01:48] (03CR) 10Hashar: [C: 032] Extract mw parser tests to standalone jobs [integration/config] - 10https://gerrit.wikimedia.org/r/256006 (https://phabricator.wikimedia.org/T114314) (owner: 10Hashar) [16:05:05] (03CR) 10Paladox: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/246983 (owner: 10Paladox) [16:05:21] (03CR) 10jenkins-bot: [V: 04-1] [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246983 (owner: 10Paladox) [16:05:33] hashar: Could you merge https://gerrit.wikimedia.org/r/#/c/246983/ first then https://gerrit.wikimedia.org/r/#/c/246424/ per comment at https://gerrit.wikimedia.org/r/#/c/246424/ [16:06:48] !log split mediawiki core parser tests under Zend to their own job https://gerrit.wikimedia.org/r/#/c/256006/ [16:06:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:07:47] (03PS3) 10Paladox: [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246983 [16:08:40] (03Merged) 10jenkins-bot: Extract mw parser tests to standalone jobs [integration/config] - 10https://gerrit.wikimedia.org/r/256006 (https://phabricator.wikimedia.org/T114314) (owner: 10Hashar) [16:08:54] (03PS4) 10Paladox: [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246983 [16:15:40] 5Continuous-Integration-Scaling, 6operations, 7Icinga, 7Monitoring, 7Nodepool: flapping "permission denied" disk space alarm for temporary image on labnodepool1001 - https://phabricator.wikimedia.org/T104975#1841595 (10coren) 5Open>3Resolved a:3coren This is now fixed for the labstores as well (T11... [16:20:08] (03PS1) 10Paladox: Add new template mediawiki-gate [integration/config] - 10https://gerrit.wikimedia.org/r/256238 [16:20:58] (03CR) 10jenkins-bot: [V: 04-1] Add new template mediawiki-gate [integration/config] - 10https://gerrit.wikimedia.org/r/256238 (owner: 10Paladox) [16:29:47] (03PS2) 10Paladox: Add new template mediawiki-gate [integration/config] - 10https://gerrit.wikimedia.org/r/256238 [16:33:28] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure: Convert all repos to use npm instead of jslint which is deprecated - https://phabricator.wikimedia.org/T119973#1841667 (10Paladox) 3NEW [16:36:01] hashar: https://phabricator.wikimedia.org/search/query/LVZanpjGAtMK/#R I couldn't find the task that you mentioned yesterday that this might be a duplicate of: https://phabricator.wikimedia.org/T119141 [16:37:05] (03PS1) 10Hashar: mw-phpunit.sh: always exclude Broken,ParserFuzz,Stub, [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256242 [16:37:15] (03CR) 10Hashar: [C: 032] mw-phpunit.sh: always exclude Broken,ParserFuzz,Stub, [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256242 (owner: 10Hashar) [16:37:36] greg-g: I havent triaged those Phabricator tasks :( [16:37:37] yet [16:38:19] (03Merged) 10jenkins-bot: mw-phpunit.sh: always exclude Broken,ParserFuzz,Stub, [integration/jenkins] - 10https://gerrit.wikimedia.org/r/256242 (owner: 10Hashar) [16:40:57] blblb [16:40:58] idle idle [16:41:06] 5Gerrit-Migration, 15User-greg: Proof of concept of code review in Phabricator - https://phabricator.wikimedia.org/T560#1841718 (10greg) 5Open>3Resolved a:3greg This task isn't really valid anymore. If teams want to start using Differential, they can, just ask us. There are caveats (you don't get all of... [16:41:07] 5Gerrit-Migration: Plan to migrate code review from Gerrit to Phabricator - https://phabricator.wikimedia.org/T18#1841721 (10greg) [16:41:08] I am splitting mediawiki phpunit zend tests in two jobs [16:41:28] and since I am not paying attention they broke :-D [16:42:53] * hashar rolls the drums [16:45:51] found it https://phabricator.wikimedia.org/T103251 [16:45:59] (03PS1) 10Hashar: Run mediawiki-phpunit-parsertests-zend on mediawiki/vendor [integration/config] - 10https://gerrit.wikimedia.org/r/256247 [16:46:10] (03CR) 10Hashar: [C: 032] Run mediawiki-phpunit-parsertests-zend on mediawiki/vendor [integration/config] - 10https://gerrit.wikimedia.org/r/256247 (owner: 10Hashar) [16:46:52] 3releng-201516-q2: [keyresult] Code review RFC (Differential) - Write, publish, publicize, and respond to/incorporate feedback. - https://phabricator.wikimedia.org/T114311#1841771 (10greg) >>! In T114311#1805691, @Aklapper wrote: > @greg: Should this task block / be listed in {T584}? I'm still failing to see th... [16:47:20] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 5Patch-For-Review: Create generic "tox" job that runs multiple environments - https://phabricator.wikimedia.org/T103251#1841773 (10greg) [16:47:21] 10Continuous-Integration-Config: Migrate python tox CI jobs to Nodepool - https://phabricator.wikimedia.org/T119141#1841772 (10greg) [16:47:33] 10Continuous-Integration-Config, 15User-greg: Migrate python tox CI jobs to Nodepool - https://phabricator.wikimedia.org/T119141#1841774 (10greg) 5Open>3Resolved a:3greg {{done}} [16:47:34] 3releng-201516-q2: [keyresult] Migrate majority of CI jobs to Nodepool (part 1) - https://phabricator.wikimedia.org/T114315#1841777 (10greg) [16:48:28] 10Continuous-Integration-Config, 5Patch-For-Review, 7Ruby: Move Bundler Jenkins jobs to Nodepool instances - https://phabricator.wikimedia.org/T114860#1841786 (10greg) @zeljkofilipin: Status? [16:48:44] 3releng-201516-q2: [keyresult] Migrate majority of CI jobs to Nodepool (part 1) - https://phabricator.wikimedia.org/T114315#1691169 (10greg) [16:49:35] 3releng-201516-q2: [keyresult] Migrate majority of CI jobs to Nodepool (part 1) - https://phabricator.wikimedia.org/T114315#1841790 (10greg) [16:51:22] (03Merged) 10jenkins-bot: Run mediawiki-phpunit-parsertests-zend on mediawiki/vendor [integration/config] - 10https://gerrit.wikimedia.org/r/256247 (owner: 10Hashar) [16:53:58] ostriches: does REL1_26 means REL1_24 is gone now ? [16:55:19] Haven't announced it, but soon. [16:55:36] ostriches: someone filled a task regarding announcing EOL [16:55:50] Task #? [16:59:18] ostriches: https://phabricator.wikimedia.org/T119852 Do regular EOL announcements for MW branches?! [16:59:48] and the user also asked for pre-release announcement [16:59:58] though I think we do pre announce for security releases [17:01:14] 6Release-Engineering-Team: Do regular EOL announcements for MW branches?! - https://phabricator.wikimedia.org/T119852#1841848 (10demon) Absolutely, branches are announced when they're EOL'd. 1.24.x will likely get one final point release, which is why I hadn't announced its EOL yet. [17:01:57] hashar: Yes, we pre-announce security releases about a day in advance usually. [17:03:58] meanwhile [17:04:11] I have split the parsertests under Zend to their standalone job [17:04:21] should slightly speed up mediawiki +2 [17:04:26] by roughly 3 minutes [17:04:28] apparently [17:05:16] :) [17:07:02] 10Continuous-Integration-Infrastructure, 10MediaWiki-Unit-tests, 10Parsoid, 5MW-1.27-release-notes, and 2 others: Speed up mediawiki-phpunit-hhvm and mediawiki-phpunit-zend Jenkins jobs - https://phabricator.wikimedia.org/T114314#1841867 (10hashar) The MediaWiki PHPUnit test suite is run for Zend with two... [17:07:13] 10Continuous-Integration-Infrastructure, 10MediaWiki-Unit-tests, 10Parsoid, 5MW-1.27-release-notes, and 2 others: Speed up mediawiki-phpunit-hhvm and mediawiki-phpunit-zend Jenkins jobs (parsertests are slow) - https://phabricator.wikimedia.org/T114314#1841870 (10hashar) [17:07:44] 6Release-Engineering-Team: Do regular EOL announcements for MW branches?! - https://phabricator.wikimedia.org/T119852#1841871 (10Kghbln) 5Open>3Resolved a:3Kghbln I have just also seen that this action item is actually already in [[ https://www.mediawiki.org/wiki/Release_checklist#Setup_and_announcements |... [17:13:14] 10Continuous-Integration-Infrastructure, 10MediaWiki-Unit-tests, 10Parsoid, 5MW-1.27-release-notes, and 2 others: Speed up mediawiki-phpunit-hhvm and mediawiki-phpunit-zend Jenkins jobs (parsertests are slow) - https://phabricator.wikimedia.org/T114314#1841885 (10hashar) 5Open>3Resolved Splitting the p... [17:24:40] 10Gitblit-Deprecate, 10Diffusion: redirect gerrit repo paths to diffusion callsigns - https://phabricator.wikimedia.org/T110607#1841925 (10mmodell) [17:26:13] ostriches: https://phabricator.wikimedia.org/D68 contains the remaining URL redirection patterns [17:27:29] woot. lemme finish my coffee and I'll review [17:27:51] wee [17:36:54] (03CR) 10Hashar: [C: 04-1] "I don't see the value of this change. Compare:" [integration/config] - 10https://gerrit.wikimedia.org/r/256238 (owner: 10Paladox) [17:37:10] I am done for today [17:37:13] :-} [17:41:21] g'n... [17:48:29] 10Beta-Cluster-Infrastructure: `trebuchet_master` getting set incorrectly in deployment-prep - https://phabricator.wikimedia.org/T119988#1842019 (10thcipriani) 3NEW [17:51:24] twentyafterfour: reviewed. [18:02:43] twentyafterfour: accepted [18:08:03] twentyafterfour: So if we can get that deployed, we can tweak the Gerrit config to start pointing straight to the new Phab application. [18:08:19] That should reduce a ton of the traffic off the top and help us see if there's any other major URL patterns we need to handle. [18:11:52] 10Gitblit-Deprecate, 10Diffusion: redirect gerrit repo paths to diffusion callsigns - https://phabricator.wikimedia.org/T110607#1842128 (10mmodell) a:5mmodell>3demon @demon: the phabricator redirection rules are now deployed on `iridium`, can you configure gerrit to use these url patterns? (I included the... [18:12:58] 10Gitblit-Deprecate, 10Diffusion: redirect gerrit repo paths to diffusion callsigns - https://phabricator.wikimedia.org/T110607#1842134 (10demon) Working on a patch now for Gerrit. [18:13:01] 10Gitblit-Deprecate, 10Diffusion: redirect gerrit repo paths to diffusion callsigns - https://phabricator.wikimedia.org/T110607#1842135 (10mmodell) Actually, before we can close this we need to point git.wikimedia.org at phabricator. But for now we can tell gerrit to redirect to `phabricator.wikimedia.org` ins... [18:13:51] ostriches: deployed. And I've reassigned the ticket to you for the gerrit config bits. https://phabricator.wikimedia.org/T110607#1842128 [18:14:19] that means that gitblit-deprecate is almost complete! :) [18:27:55] 10Gitblit-Deprecate, 10Diffusion: Process to request the read-only mirror of a non-gerrit code repository in Diffusion - https://phabricator.wikimedia.org/T75983#1842216 (10demon) Right now my inclination on repository requests (also in the vein of T1009) is to just file a request against #repo-admins which is... [18:35:06] 10Gitblit-Deprecate: Avoid double notifications from mediawiki/extensions parent project - https://phabricator.wikimedia.org/T100944#1842258 (10mmodell) 5Open>3Resolved a:3mmodell Notifications have been disabled for {rMEXT}, this should not be an issue anymore. [18:38:00] 10Differential, 5Gerrit-Migration: Ensure default branches for arcanist and libphutil from gerrit and diffusion clones are compatible with phabricator.wikimedia.org - https://phabricator.wikimedia.org/T118049#1842280 (10mmodell) a:3demon @demon: it's up to you, updating the HEAD ref on gerrit should be enoug... [18:41:02] 5Gerrit-Migration: Update Code Review related documentation on wiki pages - https://phabricator.wikimedia.org/T207#1842300 (10mmodell) [18:41:03] 10Differential, 5Gerrit-Migration, 7Documentation: Create example workflows for differential showing old way and new way side by side - https://phabricator.wikimedia.org/T117058#1842301 (10mmodell) [18:44:33] 5Gerrit-Migration: Ability for a privileged application to provide test status of a commit - https://phabricator.wikimedia.org/T190#1842320 (10mmodell) @greg: all we really need is to install arcanist on the jenkins slaves and this would work already. The top of every differential revision has a list of test res... [18:45:01] 10Differential, 5Gerrit-Migration: Phabricator and Arcanist versions must be kept in sync because of occasional breaking api changes between phabricator versions. - https://phabricator.wikimedia.org/T91422#1842326 (10demon) [18:45:02] 10Differential, 5Gerrit-Migration: Ensure default branches for arcanist and libphutil from gerrit and diffusion clones are compatible with phabricator.wikimedia.org - https://phabricator.wikimedia.org/T118049#1842324 (10demon) 5Open>3Resolved Whoops forgot about this. All done on Gerrit, all 3 point to `st... [18:48:20] twentyafterfour: Is T118669 easy? [18:49:18] phabricator upstream just deprecated the events we are using for the security extension [18:50:41] ostriches: T118669 is impossible [18:50:54] Good to know [18:51:00] rather, phabricator doesn't have the same policy controls on differential that it has on maniphest [18:51:29] 5Gerrit-Migration, 6Phabricator: Disable policies on Differential - https://phabricator.wikimedia.org/T118669#1842374 (10mmodell) Phabricator doesn't have the same policy controls on differential that it has on maniphest, so there is not currently any way to implement this change. [18:51:43] 5Gerrit-Migration, 6Phabricator: Disable policies on Differential - https://phabricator.wikimedia.org/T118669#1842375 (10mmodell) 5Open>3stalled [18:52:02] 5Gerrit-Migration, 6Phabricator: Disable policies on Differential - https://phabricator.wikimedia.org/T118669#1806107 (10mmodell) p:5Normal>3Low wishlist. [18:52:35] 5Gerrit-Migration, 6Phabricator, 10Phabricator-Upstream: Disable policies on Differential - https://phabricator.wikimedia.org/T118669#1842380 (10mmodell) [19:00:13] list of servers I can't ssh into in deployment is growing [19:03:20] greg-g: What's the deploy rule for this week? [19:05:02] https://gerrit.wikimedia.org/r/256269 [19:19:15] 6Release-Engineering-Team, 6Phabricator, 7Puppet: phabricator at labs is not up to date - https://phabricator.wikimedia.org/T117441#1842484 (10mmodell) Clone {rPHDEP} (master) into `/srv/phab/`, then run `git submodule update` and that's it! For example: ```lang=bash sudo git clone https://gerrit.wikimedi... [19:30:22] (03PS1) 10Paladox: [ZeroPortal] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/256276 [19:31:13] (03PS2) 10Paladox: [ZeroPortal] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/256276 [19:31:26] (03PS3) 10Paladox: [ZeroPortal] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/256276 [19:36:10] more or less back [19:36:26] marxarelli: kudos on the javascript/selenium experimentation :-} [19:45:28] hashar: oh, thanks. there are some other options i'd like to try out as well [19:52:53] (03PS5) 10Hashar: [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246983 (owner: 10Paladox) [19:53:55] (03PS6) 10Hashar: [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246983 (owner: 10Paladox) [19:54:42] (03CR) 10Hashar: [C: 032] [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246983 (owner: 10Paladox) [19:55:40] (03Merged) 10jenkins-bot: [Flow] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/246983 (owner: 10Paladox) [20:10:34] (03PS1) 10Hashar: AdManager, BayesianFilter make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/256282 [20:10:45] (03CR) 10Hashar: [C: 032] AdManager, BayesianFilter make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/256282 (owner: 10Hashar) [20:12:04] (03Merged) 10jenkins-bot: AdManager, BayesianFilter make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/256282 (owner: 10Hashar) [20:24:28] (03PS1) 10Hashar: [CharRangeSpan] make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/256293 [20:24:43] (03CR) 10Hashar: [C: 032] [CharRangeSpan] make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/256293 (owner: 10Hashar) [20:27:02] (03Merged) 10jenkins-bot: [CharRangeSpan] make tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/256293 (owner: 10Hashar) [20:36:39] (03CR) 10Paladox: "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/246983 (owner: 10Paladox) [20:44:29] (03PS1) 10Hashar: [Bootstrap] switch to composer / jsonlint [integration/config] - 10https://gerrit.wikimedia.org/r/256336 [20:44:40] (03CR) 10Hashar: [C: 032] [Bootstrap] switch to composer / jsonlint [integration/config] - 10https://gerrit.wikimedia.org/r/256336 (owner: 10Hashar) [20:44:46] (03PS1) 10Paladox: [Bootstrap] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/256337 [20:45:46] (03CR) 10Paladox: "https://gerrit.wikimedia.org/r/#/c/152335/" [integration/config] - 10https://gerrit.wikimedia.org/r/256337 (owner: 10Paladox) [20:45:58] hashar: Could you review https://gerrit.wikimedia.org/r/#/c/256337/ please. [20:47:12] 10Gitblit-Deprecate: Avoid double notifications from mediawiki/extensions parent project - https://phabricator.wikimedia.org/T100944#1842850 (10Nemo_bis) >>! In T100944#1842258, @mmodell wrote: > Notifications have been disabled for {rMEXT}, this should not be an issue anymore. Great! [20:47:22] (03Merged) 10jenkins-bot: [Bootstrap] switch to composer / jsonlint [integration/config] - 10https://gerrit.wikimedia.org/r/256336 (owner: 10Hashar) [21:04:29] Ok, this is stupid [21:04:37] Why can ssh timeout to some boxes, but work to tohers [21:12:57] timing out on the way to the bastion or between the bastion and the target host? [21:21:37] marxarelli: we have decided to merge the CI and browser tests weekly checkin, using the btest timeslot (and thus moving CI one hour later) [21:22:21] marxarelli: I have created another event gcal. You probably want to cancel the "triage browser test" one which is in your calendar [21:22:53] hashar: sounds great. fewer meetings! [21:22:59] yeah [21:23:15] I should push that event in the WMF Engineering [21:24:05] but I am lazy :D [21:24:31] you are the least lazy person i know :) [21:24:48] 10Gitblit-Deprecate: Avoid double notifications from mediawiki/extensions parent project - https://phabricator.wikimedia.org/T100944#1842949 (10demon) Probably should do the same for rSKIN too. [21:50:34] hashar, thanks for speeding up the tests [21:52:18] 10Continuous-Integration-Infrastructure, 10MediaWiki-Unit-tests, 10Parsoid, 5MW-1.23-release, and 7 others: Speed up mediawiki-phpunit-hhvm and mediawiki-phpunit-zend Jenkins jobs (parsertests are slow) - https://phabricator.wikimedia.org/T114314#1843005 (10hashar) Poked wikitech-l about it: **CI parserte... [21:54:08] Krenair: that is part of our KPI now [21:54:32] Krenair: though we are still trying to figure out which metric to take in account :-} [21:55:34] https://grafana.wikimedia.org/dashboard/db/releng-zuul?panelId=14&fullscreen <-- max(time) changes spend in gate-and-submit (any project) [21:55:55] greg-g: ^^^ [21:56:21] (tough the KPI graph only reflects mediawiki/core https://grafana.wikimedia.org/dashboard/db/releng-kpis ) [21:58:30] **disappears** [22:06:08] 10Continuous-Integration-Config, 5Patch-For-Review, 7Ruby: Move Bundler Jenkins jobs to Nodepool instances - https://phabricator.wikimedia.org/T114860#1843025 (10hashar) We talked about it during the CI weekly meeting. It is pretty much done, the last repos to migrate were operations/puppet and mediawiki/co... [22:08:09] 10Continuous-Integration-Config, 5Continuous-Integration-Scaling, 7WorkType-NewFunctionality: Migrate javascript npm CI jobs to Nodepool - https://phabricator.wikimedia.org/T119143#1843027 (10hashar) So I gave that one a try. A big stopper is that some repositories use Karma which expects a local setup of Me... [22:13:01] Permission denied (publickey). from pdf02 [22:15:43] Reedy, looking [22:18:26] /etc/ssh/userkeys/root: Is a directory [22:18:27] what [22:19:55] lol [22:20:14] Reedy: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_November_30th answer should be there [22:20:41] Hmm. Does data loss include stuff that's generateable? [22:21:01] Wanting to try and stem some of the "data loss" from the link tables [22:21:12] deployment-pdf02.deployment-prep.eqiad.wmflabs: [22:21:13] total 12 [22:21:13] drwx------ 3 root root 4096 Nov 23 04:17 . [22:21:13] drwx------ 3 root root 4096 Nov 23 04:17 .. [22:21:13] drwx------ 2 root root 4096 Nov 23 04:17 .ssh [22:21:14] what [22:21:33] (that's `ls -al /etc/ssh/userkeys/root`) [22:21:53] remove it and re-run puppet agent -tv ? [22:22:02] or just run puppet anyway and see what it does [22:25:25] puppet won't even run , Reedy [22:25:33] sweeet [22:25:42] i guess your key is already on it? [22:25:45] ?[1;31mError: Could not send report: Server hostname 'deployment-puppetmaster.eqiad.wmflabs' did not match server certificate; expected one of deployment-puppetmaster.deployment-prep.eqiad.wmflabs, DNS:deployment-puppetmaster.deployment-prep.eqiad.wmflabs, DNS:puppet, DNS:puppet.deployment-prep.eqiad.wmflabs?[0m [22:25:57] I tried to add my key to the root file but it still won't let me in [22:26:53] still have to run commands via salt [22:29:09] pretty fscked [22:29:51] tried /root/.ssh/authorized_keys, /etc/ssh/userkeys/root [22:36:42] krenair@deployment-salt:~$ sudo salt 'deployment-pdf02.deployment-prep.eqiad.wmflabs' cmd.run 'cd ~; pwd' [22:36:42] deployment-pdf02.deployment-prep.eqiad.wmflabs: [22:36:42] /home/hashar [22:36:44] I give up. [22:37:30] $HOME is ~hashar... why [22:38:47] :/ [22:39:43] /etc/passwd disagrees [22:39:43] root:x:0:0:root:/root:/bin/bash [22:40:02] probably some salt config making it run as hashar? [22:47:27] 10Deployment-Systems, 10Architecture, 10Wikimedia-Developer-Summit-2016-Organization, 7Availability: WikiDev 16 working area: Software engineering - https://phabricator.wikimedia.org/T119032#1843116 (10greg) I personally think that T114320 (Differential as code-review) is a really important topic for WikiD... [22:49:06] any news about gitblit? about 3 weeks ago i heard it was going to be killed within days [22:49:28] and kept telling paladox that :) [22:52:09] salt 'deployment-pdf02.deployment-prep.eqiad.wmflabs' cmd.run 'sed -i -e s/deployment-puppetmaster.eqiad.wmflabs/deployment-puppetmaster.eqiad.wmflabs/g /etc/puppet/puppet.conf' [22:53:14] mutante: someone said days? [22:53:38] Krenair: puppet fixed and run on pdf02 [22:54:00] It changed a ton [22:54:03] greg-g: yes, "within this week" etc [22:54:34] And I can logon [22:54:39] Reedy: pdf02?? [22:54:48] mutante: deployment-pdf02 [22:54:58] puppet config was using really wrong hostnames [22:55:00] :) that doesnt exist in prod anymore since a long time [22:55:08] heh [22:55:25] pdf01-03 were in pmtpa [22:55:34] now it's ocg100x if anything [22:55:52] mutante: who said that? [22:57:27] greg-g: i'll have to search irc logs, unfortunately i did not specify the source [22:57:44] root@deployment-pdf02:/home/reedy# dpkg -l | grep puppetmaster [22:57:45] iF puppetmaster 3.4.3-1ubuntu1.1 all Centralized configuration management - master startup and compatibility scripts [22:57:45] ii puppetmaster-common 3.4.3-1ubuntu1.1 all Puppet master common scripts [22:57:47] What is this shit? [22:59:14] i wonder if there is a point in running that at all [22:59:28] what would it be used for.. if it's the old PDF stuff [22:59:56] it's got the new ocg stuff installed on it [23:00:12] 10Differential, 5Gerrit-Migration, 10Security-Reviews: security review of phabricator.w.o before being used for git hosting and code review - https://phabricator.wikimedia.org/T117552#1843154 (10greg) @csteipp: my inclination is that all of Phabricator does not need a security review before we use it for cod... [23:00:21] nobody knows how to reinstall that in prod,btw [23:00:27] lol [23:02:54] greg-g: sorry, can't find it. my own quote was "i heard", so i meant "somebody said on IRC" but i dont know [23:03:42] so, hearsay, thus, not a promise, thus, don't be surprised if it doesn't happen [23:04:12] yea, i'm not. we just keep telling people who upload changes that they won't get merged because "soon" [23:12:23] no, because end of life/not worth the time while we kill it [23:14:45] yea, i understand. he was just trying to revert it to the status quo [23:14:50] I think we could kill gitblit today actually, but it'll probably take a little work to make git.wikimedia.org route to phabricator properly [23:14:58] actually he wanted reverts [23:15:29] * greg-g nods [23:15:30] yeah [23:15:36] it's a slow death, sadly [23:15:39] twentyafterfour: Apache redirects? [23:15:50] would we put these on the cluster.. or ? [23:16:55] twentyafterfour: Kill it and replace it with a "coming soon" banner [23:17:05] twentyafterfour: Fewer complaints than leaving it up, I guess. [23:17:44] heh [23:17:44] (03Abandoned) 10Paladox: [Bootstrap] Update Jenkins tests [integration/config] - 10https://gerrit.wikimedia.org/r/256337 (owner: 10Paladox) [23:17:47] It's at least not lying [23:18:27] 10Differential, 5Gerrit-Migration, 10Security-Reviews: security review of phabricator.w.o before being used for git hosting and code review - https://phabricator.wikimedia.org/T117552#1843227 (10mmodell) FWIW, the upstream project is very competent at security and I review the changes when pulling from upstr... [23:18:32] 5Gerrit-Migration: Preserve code review history - https://phabricator.wikimedia.org/T617#1843229 (10greg) >>! In T617#1251499, @Ricordisamoa wrote: >>>! In T617#1251479, @mmodell wrote: >> Well bugzilla got imported into phabricator. That really isn't practical with gerrit - it was a huge amount of work to impor... [23:18:55] you should use on of the "men at work" animated gifs [23:19:39] 5Gerrit-Migration: Provide static dump of Gerrit - https://phabricator.wikimedia.org/T617#1843231 (10greg) [23:19:49] James_F: I agree, we should kill it [23:22:39] ostriches: you're far more familiar with gitblit than I am. What remains to be done? [23:23:51] well, we have to buy a case of Champaign [23:25:04] Tsk. [23:25:11] * champagne [23:25:16] i guess it needs to be decided where git.wm.org is supposed to point to in DNS [23:25:41] either Apache cluster or phabricator server.. or .. [23:25:47] tx James_F :) [23:25:50] well it should point to the same IP as phabricator. But I think the proxies will need to be configured to handle the name [23:25:51] and then whereever that is..Apache redirects? [23:25:56] and rewrite rules [23:26:02] well sort of true [23:26:09] if we want to use git.wm.o for actual git things [23:26:13] we would have to do some shuffling [23:26:38] but for the moment we could just point it at the phab IP and add the relevant configs I guess [23:26:49] we just want to redirect old URLs to their equivalent places in phabricator, the phab part of that is already done [23:27:11] right but we are talking host headers here and misc-web and varnish configs etc in one case [23:27:16] i wonder if people expect that git.wm.org can do actual git things [23:27:18] using it for git over ssh is another bigger task (would be nice but not that important) [23:28:07] should be pretty simple to point it at the phab IP and add to varnish, eh mutante? also do the apache stuff [23:28:15] I agree let's deal w/ ssh and git later [23:28:16] It may not be too hard to get public git-over-https working in phab [23:28:39] sure, and I don't care at all but if you do that everyone will expect git over ssh to work [23:29:28] well everyone will expect everything to work, of course ;) but gitblit hasn't worked right since I started here over a year and a half ago [23:29:56] so `no route to host` would be an improvement [23:30:07] 10Gitblit-Deprecate, 10Diffusion: Process to request the read-only mirror of a non-gerrit code repository in Diffusion - https://phabricator.wikimedia.org/T75983#1843257 (10greg) >>! In T75983#1842216, @demon wrote: > Right now my inclination on repository requests (also in the vein of T1009) is to just file a... [23:31:20] I have no objection to pointing git.wm.o at phab as soon as can be :) [23:33:26] we can make it just show https://upload.wikimedia.org/wikipedia/commons/a/af/Under_construction_icon-yellow.svg [23:34:01] all I really know about gitblit is it crashes often and way more ppl use it than I would ever have guessed [23:34:11] honestly, I've pulled up the UI maybe twice in 2 years [23:34:16] and that was to see if it came back up :) [23:35:56] Every time I've pulled up the UI it's been an accident. [23:37:42] 10Differential, 5Gerrit-Migration, 10Security-Reviews: security review of phabricator.w.o before being used for git hosting and code review - https://phabricator.wikimedia.org/T117552#1843282 (10greg) (I agree ;) )