[00:30:04] !log deploying https://gerrit.wikimedia.org/r/482392 / create node10 mage [00:30:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [00:30:05] image* [00:30:11] [contint1001.wikimedia.org] out: PermissionError: [Errno 13] Permission denied: '/tmp/docker-pkg-build.log' [00:30:35] legoktm@contint1001:/tmp$ ls -l | grep pkg [00:30:35] -rw-r--r-- 1 krinkle wikidev 0 Jan 6 00:39 docker-pkg-build.log [00:31:04] legoktm: Aye, I'll rm. [00:31:26] I see the fabfile does it normally [00:31:38] (done) [00:31:42] maybe it didn't when the creation failed? [00:31:51] Yeah, it just stops [00:31:57] building now [00:32:00] cool :) [00:42:00] (03PS1) 10Krinkle: Create node-10-docker job template and use for Fresnel [integration/config] - 10https://gerrit.wikimedia.org/r/482572 (https://phabricator.wikimedia.org/T203239) [00:43:18] (03CR) 10Krinkle: Create node-10-docker job template and use for Fresnel (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/482572 (https://phabricator.wikimedia.org/T203239) (owner: 10Krinkle) [00:44:19] Krinkle: https://paste.fedoraproject.org/paste/6elY5yc-qjq35iix6yCrCw/raw [00:44:29] Krinkle: kept the full log on contint1001 [00:45:02] legoktm: Hm.. "no basic auth credentials" is the issue yes? [00:45:17] seems like it [00:45:32] And you haven't seen that beforre? [00:45:55] nope [00:45:56] never [00:46:01] I gotta go now [00:46:08] I moved the log to /tmp/docker-pkg-build.log.node10 [00:46:49] Thanks [00:49:44] It looks like test-browser failed to get test, then test failed to get plain, and then plain succeeded. Maybe the "auth" is a fuzzy version of saying the image doesn't exist, so maybe the node10-test will work now, and then on the third time the browser one. [00:50:04] I couldn't find it before, but I guess this might be what those control files are meant to prevent :) [00:53:27] (03PS1) 10Krinkle: Add 'control' files for node10 images [integration/config] - 10https://gerrit.wikimedia.org/r/482573 (https://phabricator.wikimedia.org/T203239) [07:41:18] Project beta-code-update-eqiad build #230763: 04FAILURE in 1 min 6 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/230763/ [07:44:00] Yippee, build fixed! [07:44:01] Project beta-code-update-eqiad build #230764: 09FIXED in 59 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/230764/ [08:11:44] (03CR) 10D3r1ck01: "@Umh, I'm thinking this is good to go? Or is there something left to do?" [integration/config] - 10https://gerrit.wikimedia.org/r/482146 (owner: 10D3r1ck01) [08:23:31] 10Beta-Cluster-Infrastructure, 10Analytics, 10User-Elukey: TCP connections between analytics and deployment-prep - https://phabricator.wikimedia.org/T208870 (10elukey) @thcipriani ping :) [09:54:54] (03CR) 10Thiemo Kreuz (WMDE): [C: 03+1] "I see zero of such issues in the test run. Is this correct?" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/482375 (owner: 10Umherirrender) [10:49:40] (03CR) 10Hashar: "You would probably want CI to use mediawiki/vendor to ship the dependencies (and thus use the CI template extension-quibble). Which also " (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/482146 (owner: 10D3r1ck01) [10:52:06] (03CR) 10Hashar: [C: 03+2] "Job updated!" [integration/config] - 10https://gerrit.wikimedia.org/r/481922 (owner: 10Volans) [10:52:34] (03CR) 10Hashar: [C: 03+2] Run quibble for extension CiteDrawer [integration/config] - 10https://gerrit.wikimedia.org/r/482296 (owner: 10Umherirrender) [10:52:49] thanks a lot hashar! :) [10:54:56] (03Merged) 10jenkins-bot: cumin: increase build timeout [integration/config] - 10https://gerrit.wikimedia.org/r/481922 (owner: 10Volans) [10:54:59] (03Merged) 10jenkins-bot: Run quibble for extension CiteDrawer [integration/config] - 10https://gerrit.wikimedia.org/r/482296 (owner: 10Umherirrender) [11:03:43] volans: :) [11:07:29] 10Release-Engineering-Team (Watching / External), 10Operations, 10Release Pipeline, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Revisit the logging work done on Q1 2017-2018 for the standard pod setup - https://phabricator.wikimedia.org/T207200 (10akosiaris) [11:10:34] (03CR) 10D3r1ck01: "Thanks and will fix the qqq.json part now!" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/482146 (owner: 10D3r1ck01) [11:21:13] 10Release-Engineering-Team (Watching / External), 10Operations, 10Release Pipeline, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Revisit the logging work done on Q1 2017-2018 for the standard pod setup - https://phabricator.wikimedia.org/T207200 (10akosiaris) >>! In T207200#... [11:26:26] happy new year hashar [11:26:26] :D [11:46:22] hmm, i cant set this account to be an admin :/ [11:46:23] https://commons.wikimedia.beta.wmflabs.org/wiki/Special:UserRights/Fisch-WMDE [11:46:29] it just says [11:46:29] Conflict of user rights changes! Please review and confirm your changes. [11:46:59] maybe https://phabricator.wikimedia.org/T164211 [12:48:23] (03CR) 10Hashar: [C: 03+2] "Then it is all good :) thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/482146 (owner: 10D3r1ck01) [12:50:14] (03Merged) 10jenkins-bot: Add SparkPost mediawiki extension into CI [integration/config] - 10https://gerrit.wikimedia.org/r/482146 (owner: 10D3r1ck01) [12:52:29] (03PS6) 10Daimona Eaytoy: Add dependencies for AbuseFilter [integration/config] - 10https://gerrit.wikimedia.org/r/481570 [13:19:42] zeljkof: https://integration.wikimedia.org/ci/view/Selenium/job/selenium-daily-beta-WikibaseLexeme/135/console is fixed :D [13:19:58] well, the tests fail, but it runs [13:31:46] addshore: great! [13:31:57] it doesnt log into the selenium user [13:31:59] thats the next thing [13:32:04] any recommendations? [13:32:30] 00:09:17.400 Error: ratelimited: As an anti-abuse measure, you are limited from performing this action too many times in a short space of time, and you have exceeded this limit. Please try again in a few minutes. [13:32:38] hm [13:32:55] in the middle of lunch, will ping you in 10-20 minutes :) [13:32:59] ack :P [13:33:01] :) [13:33:02] enjoy! [13:42:49] I want to adjust the security jobs to run more staggered (because they are hitting rate limits and sending me lots of spam) [13:43:01] Any tips on how to do that (or suggestions of docs I should read)? [13:44:48] addshore: ratelimit is a bit odd :) [13:45:23] * bawolff currently browsing through https://docs.openstack.org/infra/jenkins-job-builder/ [13:45:36] looking at wmf-config/InitialiseSettings.php I see $wgRateLimitsExcludedIps['+testiwkidatawiki']=> 10.68.16.0/21 // Jenkins and Sauce labs T167432 [13:45:37] T167432: Run Wikibase daily browser tests on Jenkins - https://phabricator.wikimedia.org/T167432 [13:45:49] though that is the IP range of the old openstack region [13:46:28] there is a "noratelimit" permission we could add for the logged in user [13:46:59] but hmm probably we can drop the ratelimit on beta when that comes from the WMCS ip range [13:47:22] Having your auto unit tests have bot rights might make sense for other reasons, like keeping the recentchanges clean [13:48:18] then tests probably do not expect to be done as bots :-/ But I guess those can be adjusted [13:48:56] hashar: are the docker nodes in the new open stack region now? [13:53:07] We will be able to soon make gerrit high available (by using multi-master) making gerrit2001 a master so you can switch between cobalt/gerrit2001. (https://github.com/GerritForge/plugins_multi-site) [13:53:51] *multi-site [13:54:01] Hmm, maybe quiet-period is what I'm looking for. But not sure if that is for the precise same job only, or any of the type [13:54:28] addshore: yeah. I am sending a change to adjust that limit [13:59:55] addshore: though that is only for testwikidatawiki (both prod and deployment-prep) [14:00:29] addshore: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/482640/1/wmf-config/InitialiseSettings.php :) [14:06:13] oh hashar, there is no testwikidatawiki on deployment-prep [14:06:21] we would also needed it for wikidatawiki on deployment prep :P [14:06:37] so in InitialiseSettings-labs too [14:10:50] addshore: ahhhh. Well I guess feel free to hijack my change and add anything that is needed [14:11:09] though for production that means that anything from WMCS would no more be ratelimited [14:11:20] eg a rogue bot targetting prod wikidatawiki [14:11:34] well, not if we just do it on the -labs file, then it is just beta [14:13:34] hashar: a more cool way would be to have a hook at the point the rate liit decision is made, and for beta just have a hook in mediawiki-config that checks if the user == "Selenium user" then ignore rate limits [14:14:07] I suppose for my trying to have a delay in the job, adding something like `sleep 1900` isn't an acceptable way to do this [14:22:30] maybe i can use the parameterized-scheduler-plugin. Not sure if that's installed/available [14:32:01] (03CR) 10Thiemo Kreuz (WMDE): [C: 04-1] "I played around with a bunch of edge-cases, and believe I found a relevant one:" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/446271 (https://phabricator.wikimedia.org/T199768) (owner: 10Prtksxna) [14:41:45] googlig jenkins quiet-time documentation. I ended up at fanfic [14:47:00] 10Gerrit, 10Release-Engineering-Team, 10GitHub-Mirrors, 10Scoring-platform-team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10hashar) From the Gerrit log for git garbage collection: ` gc_log:[2019-01-05 03:48:46,483] [WorkQueue-1] INFO : [scoring/ores/articlequalit... [14:54:00] 10Gerrit, 10Release-Engineering-Team, 10GitHub-Mirrors, 10Scoring-platform-team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10hashar) > We have several repos which each contain large machine learning model files, and these repos are all configured to mirror *from*... [14:58:05] (03PS1) 10Brian Wolff: Add quiet-period limits to php-composer-security-docker [integration/config] - 10https://gerrit.wikimedia.org/r/482646 (https://phabricator.wikimedia.org/T206442) [14:58:47] 10Gerrit, 10Release-Engineering-Team, 10GitHub-Mirrors, 10Scoring-platform-team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10hashar) [14:58:54] Well there is my attempt, but i don't really know what i am doing [14:59:28] 10Continuous-Integration-Infrastructure, 10Operations, 10SRE-Access-Requests, 10Patch-For-Review, 10Performance-Team (Radar): Add krinkle to contint-docker group - https://phabricator.wikimedia.org/T213015 (10herron) Patch looks good to me. However, a 3 day waiting period applies here. Barring any obje... [15:13:18] PROBLEM - Disk space on contint1001 is CRITICAL: DISK CRITICAL - free space: / 847 MB (1% inode=56%) [15:13:45] ^^ that is me :( [15:13:47] wrong partition [15:14:32] RECOVERY - Disk space on contint1001 is OK: DISK OK [15:26:53] 10Continuous-Integration-Infrastructure, 10Operations, 10SRE-Access-Requests, 10Patch-For-Review, 10Performance-Team (Radar): Add krinkle to contint-docker group - https://phabricator.wikimedia.org/T213015 (10herron) p:05Triage→03Normal [15:28:15] 10Phabricator, 10Release-Engineering-Team, 10Operations, 10Patch-For-Review: Convert Phabricator mail config to use cluster.mailers - https://phabricator.wikimedia.org/T212989 (10herron) p:05Triage→03Normal [15:30:37] 10Release-Engineering-Team (Watching / External), 10Operations, 10serviceops, 10vm-requests: Increase mwdebugXXXX hosts CPU and memory(?) - https://phabricator.wikimedia.org/T212955 (10herron) [15:30:47] 10Release-Engineering-Team (Watching / External), 10Operations, 10serviceops, 10vm-requests: Increase mwdebugXXXX hosts CPU and memory(?) - https://phabricator.wikimedia.org/T212955 (10herron) p:05Triage→03High [15:46:15] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 3 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10jcrespo) I agree with Manuel T197616, I would have preferred creating it on s3 for is... [16:04:30] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline: Kubernetes Production Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10Ottomata) [16:18:37] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 3 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10Jdforrester-WMF) >>! In T197616#4859391, @jcrespo wrote: > Based on comments that rem... [16:22:42] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline, 10Documentation: Kubernetes Production Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10Aklapper) [16:27:11] 10Release-Engineering-Team, 10Release Pipeline, 10serviceops, 10Core Platform Team Backlog (Watching / External), 10Services (watching): TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production ... - https://phabricator.wikimedia.org/T212801 [16:27:15] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline, 10Documentation: Kubernetes Production Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10thcipriani) [16:27:45] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline, 10Documentation: Kubernetes Production Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10thcipriani) p:05Triage→03Normal [16:28:26] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline, 10Documentation: TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10akosiaris) [16:30:25] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline, 10Documentation: TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10akosiaris) Yeah it's part of the TEC3 goal to do so (it's Outcome 6/Output 6.1 under https://www.mediawiki.... [16:34:26] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10serviceops, 10Developer-Wishlist (2017), and 3 others: Relocate CI generated docs and coverage reports - https://phabricator.wikimedia.org/T137890 (10hashar) The new publisher is wrong, I made a mistake in the rsync command tha... [16:36:01] 10Release-Engineering-Team, 10Release Pipeline, 10serviceops, 10Core Platform Team Backlog (Watching / External), 10Services (watching): TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production ... - https://phabricator.wikimedia.org/T212801 [16:36:28] (03PS1) 10Hashar: Fix rsync source dir when publishing to doc1001 [integration/config] - 10https://gerrit.wikimedia.org/r/482662 (https://phabricator.wikimedia.org/T137890) [16:37:00] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10serviceops, 10Developer-Wishlist (2017), and 3 others: Relocate CI generated docs and coverage reports - https://phabricator.wikimedia.org/T137890 (10hashar) I will keep doing verifications to make sure content is properly publ... [16:46:51] (03CR) 10Hashar: [C: 03+2] "Deployed, seems to be working. Will reverify tomorrow." [integration/config] - 10https://gerrit.wikimedia.org/r/482662 (https://phabricator.wikimedia.org/T137890) (owner: 10Hashar) [16:47:25] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream: Move KafkaSSE development from Differential to Gerrit - https://phabricator.wikimedia.org/T212420 (10Milimetric) [16:47:57] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream: Move KafkaSSE development from Differential to Gerrit - https://phabricator.wikimedia.org/T212420 (10Ottomata) For this particular project, I'd like to move to github. This is a generic library that is non mediawiki specific. I'll try to... [16:49:32] (03Merged) 10jenkins-bot: Fix rsync source dir when publishing to doc1001 [integration/config] - 10https://gerrit.wikimedia.org/r/482662 (https://phabricator.wikimedia.org/T137890) (owner: 10Hashar) [16:53:35] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 3 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10Marostegui) I wonder why was this created in s4 if we were asked if we preferred s3 a... [16:56:49] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 3 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10jcrespo) I've been told there was some breakage based on assuming s4 ==> commons, or... [16:58:34] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 3 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10Jdforrester-WMF) >>! In T197616#4859717, @Marostegui wrote: > I wonder why was this c... [16:59:06] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 3 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10Reedy) >>! In T197616#4859717, @Marostegui wrote: > I wonder why was this created in... [17:09:17] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 3 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10Marostegui) Waiting for one hour only is not realistic, specially if asked at 19:00 U... [17:20:13] 10Release-Engineering-Team (Kanban), 10Code-Health-Metrics, 10Patch-For-Review, 10User-zeljkofilipin: Code health metrics spike - https://phabricator.wikimedia.org/T207046 (10zeljkofilipin) a:03zeljkofilipin [17:24:47] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline, 10Documentation: TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10Ottomata) Awesome, those are good starts, I'll check those out thank you! [17:32:49] 10Diffusion, 10Release-Engineering-Team, 10GitHub-Mirrors, 10Scoring-platform-team: LFS objects are not mirroring from Github through Phab to Gerrit consistently - https://phabricator.wikimedia.org/T212818 (10awight) 05duplicate→03Open Hi! This seems to be a much different issue than the articlequalit... [18:29:48] 10Release-Engineering-Team (Watching / External), 10DBA, 10SDC Engineering, 10SDC General, and 2 others: Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdforrester-WMF [18:33:04] 10Release-Engineering-Team, 10Release Pipeline, 10serviceops, 10Core Platform Team Backlog (Watching / External), 10Services (watching): TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production ... - https://phabricator.wikimedia.org/T212801 [18:33:46] 10Release-Engineering-Team, 10Release Pipeline, 10serviceops, 10Core Platform Team Backlog (Watching / External), 10Services (watching): TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production ... - https://phabricator.wikimedia.org/T212801 [18:33:58] 10Release-Engineering-Team, 10Release Pipeline, 10serviceops, 10Core Platform Team Backlog (Watching / External), 10Services (watching): TEC3:O3:O3.1:Q3 Goal - Move cxserver, citoid, changeprop, eventgate (new service) and ORES (partially) through the production ... - https://phabricator.wikimedia.org/T212801 [18:49:44] 10Gerrit, 10Release-Engineering-Team, 10GitHub-Mirrors, 10Scoring-platform-team: articlequality repo mirroring is broken - https://phabricator.wikimedia.org/T212962 (10awight) @hashar Thanks for all the helpful diagnostics! I pushed commits straight from my local repo to gerrit, and created a new referenc... [18:50:08] 10Release-Engineering-Team (Backlog), 10ORES, 10Operations, 10Scoring-platform-team, 10Release Pipeline (Blubber): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10thcipriani) [18:55:25] looks like PolyGerrit development will be be ramped up (according to https://groups.google.com/forum/#!topic/repo-discuss/xdpRTFUMBUQ ) [18:59:49] we're still stuck on 2.15 :) [19:01:01] heh [19:02:28] (03CR) 10Legoktm: [C: 03+2] Add 'control' files for node10 images [integration/config] - 10https://gerrit.wikimedia.org/r/482573 (https://phabricator.wikimedia.org/T203239) (owner: 10Krinkle) [19:04:20] (03Merged) 10jenkins-bot: Add 'control' files for node10 images [integration/config] - 10https://gerrit.wikimedia.org/r/482573 (https://phabricator.wikimedia.org/T203239) (owner: 10Krinkle) [19:07:19] 10Release-Engineering-Team (Backlog), 10ORES, 10Operations, 10Scoring-platform-team, 10Release Pipeline (Blubber): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10Ottomata) I'll need multiple service deployments for the same rep... [19:22:19] !log building node10 docker images w/ https://gerrit.wikimedia.org/r/482573 this time [19:22:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:22:26] [contint1001.wikimedia.org] out: Will build the following images: [19:22:26] [contint1001.wikimedia.org] out: * docker-registry.discovery.wmnet/releng/node10-test:0.3.0 [19:22:26] [contint1001.wikimedia.org] out: * docker-registry.discovery.wmnet/releng/node10-test-browser:0.2.0 [19:22:33] Krinkle: ^ looks like the correct order this time [19:34:03] 10Release-Engineering-Team, 10Operations, 10Prod-Kubernetes, 10Release Pipeline, 10Documentation: TEC3:O6:O:6.1:Q3: Deployment Pipeline Documentation - https://phabricator.wikimedia.org/T213090 (10Ottomata) FYI I added some more notes for the EventGate deployment based on some IRC convos today: https://... [19:41:29] (03CR) 1020after4: [C: 03+1] Add dockerfile/job for automating deploy notes [integration/config] - 10https://gerrit.wikimedia.org/r/481947 (owner: 10Thcipriani) [19:43:10] legoktm: splendid :) [19:43:21] root@f9be04891987:/src# node --version [19:43:21] v10.4.0 [19:43:21] root@f9be04891987:/src# npm --version [19:43:21] 6.5.0 [19:43:26] (node10-test:latest) [19:50:22] (03PS2) 10Krinkle: Create node-10-docker job template and use for Fresnel [integration/config] - 10https://gerrit.wikimedia.org/r/482572 (https://phabricator.wikimedia.org/T203239) [19:52:38] (03CR) 10Krinkle: [C: 03+2] "Compiled and uploaded job 'fresnel-node-10-docker'" [integration/config] - 10https://gerrit.wikimedia.org/r/482572 (https://phabricator.wikimedia.org/T203239) (owner: 10Krinkle) [19:53:27] (03PS4) 10Krinkle: Fix nyc and npm-update bugs due to unwritable HOME [integration/config] - 10https://gerrit.wikimedia.org/r/482527 (https://phabricator.wikimedia.org/T212602) [19:55:20] (03Merged) 10jenkins-bot: Create node-10-docker job template and use for Fresnel [integration/config] - 10https://gerrit.wikimedia.org/r/482572 (https://phabricator.wikimedia.org/T203239) (owner: 10Krinkle) [20:07:19] legoktm: Krinkle kudos on nodejs 10 container :) [20:07:44] mutante: Guten Tag. For doc1001.eqiad.wmnet and the migration of doc.wikimedia.org , I need some more time to verify the migration [20:08:01] mutante: and I found a mistake in my rsync command which wsa breakin everything :( [20:08:59] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/482572 [20:09:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:12:10] (03PS1) 10Krinkle: Switch Fresnsel from node10-test to node10-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) [20:12:49] !log Delete job 'fresnel-npm6-browser-node-6-docker' and 'fresnel-node-10-docker' [20:12:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:13:17] (03CR) 10Krinkle: [C: 03+2] "Compiled and uploaded 'fresnel-node10-browser-docker' job" [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) (owner: 10Krinkle) [20:14:22] (03CR) 10jerkins-bot: [V: 04-1] Switch Fresnsel from node10-test to node10-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) (owner: 10Krinkle) [20:15:51] (03CR) 10jerkins-bot: [V: 04-1] Switch Fresnsel from node10-test to node10-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) (owner: 10Krinkle) [20:16:27] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Ottomata) [20:16:49] (03CR) 10Krinkle: [C: 03+2] "race condition, it does exist now." [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) (owner: 10Krinkle) [20:19:28] (03CR) 10jerkins-bot: [V: 04-1] Switch Fresnsel from node10-test to node10-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) (owner: 10Krinkle) [20:21:39] (03PS2) 10Krinkle: Switch Fresnsel from node10-test to node10-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) [20:23:23] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Ottomata) Docs updated here: https://wikitech.wikimedia.org/wiki/EventStreams/Administration#Deployment [20:25:20] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Ottomata) The next time we build/deploy EventStreams, KafkaSSE from diffusion will no longer be used. Can we close... [20:25:32] (03CR) 10Krinkle: [C: 03+2] Switch Fresnsel from node10-test to node10-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) (owner: 10Krinkle) [20:26:46] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Ottomata) [20:28:44] (03Merged) 10jenkins-bot: Switch Fresnsel from node10-test to node10-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/482695 (https://phabricator.wikimedia.org/T133646) (owner: 10Krinkle) [20:29:16] !log Reloading Zuul to apply https://gerrit.wikimedia.org/r/482695 [20:29:17] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:41:11] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Legoktm) >>! In T212420#4859662, @Ottomata wrote: > For this particular project, I'd like to move to github. This i... [20:48:30] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Ottomata) Most of the time I'm mostly unoppionated and am all for gerrit, especially when the target audience of the... [20:54:47] 10Release-Engineering-Team (Backlog), 10ORES, 10Operations, 10Scoring-platform-team, 10Release Pipeline (Blubber): The continuous release pipeline should support more than one service per repo - https://phabricator.wikimedia.org/T210267 (10Ottomata) Q: would blubber's variants be enough to support the ws... [20:56:49] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Reedy) >>! In T212420#4860661, @Ottomata wrote: > But for softwares that are very generic and intended to be used wi... [20:59:03] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Paladox) We can install https://gerrit-review.googlesource.com/admin/repos/plugins/github (which is what gerrithub uses to pull in pull requests) [20:59:09] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Ottomata) > Are you likely to get many contributors? You never know! But for KafkaSSE, probably not. :) [21:01:30] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Paladox) T37497#4860677 - We can install the GitHub plugin (which gerrithub) uses to pull requests in. So users cont... [21:30:10] 10Phabricator, 10Analytics, 10Analytics-Kanban, 10Wikimedia-Stream, 10Patch-For-Review: Move KafkaSSE development from Differential to Github - https://phabricator.wikimedia.org/T212420 (10Ottomata) If something like ^ worked nicely, my pro github arguments would be all moot and I'd be fine with gerrit a... [21:31:26] 10Scap, 10ORES, 10Scoring-platform-team: Investigate: why are we getting overload errors during ORES deployments? - https://phabricator.wikimedia.org/T213116 (10awight) Maybe this is because scap is restarting the services in serial, but not accounting for the long warm-up period for each box. We could add... [21:56:20] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate deployment-prep to eqiad1 - https://phabricator.wikimedia.org/T208101 (10mmodell) [21:56:24] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10cloud-services-team, 10Patch-For-Review: Ensure there are no hard-coded IPs in use for beta - https://phabricator.wikimedia.org/T208262 (10mmodell) 05Open→03Resolved I guess this is resolved to the extent that it is possible to resol... [22:12:02] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Reedy) >>! In T37497#4860677, @Paladox wrote: > We can install https://gerrit-review.googlesource.com/admin/repos/plugins/github (which is what... [22:12:58] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Paladox) Nope, haven't tried it yet. Though i can :) [22:13:57] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Reedy) >>! In T37497#4860871, @Paladox wrote: > Nope, haven't tried it yet. Though i can :) Would be good for starters to see it working etc.... [22:14:48] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Paladox) Oh, i have upgraded everything to 2.16. [22:19:45] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Reedy) >>! In T37497#4860878, @Paladox wrote: > Oh, i have upgraded everything to 2.16. Well, start with the plugin there... And see what happens [22:33:36] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Paladox) I asked luca weather the GitHub plugin supported ldap (not just oauth). It does not see https://groups.google.com/forum/#!topic/repo-di... [22:35:20] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Reedy) >>! In T37497#4860902, @Paladox wrote: > I asked luca weather the GitHub plugin supported ldap (not just oauth). It does not see https://... [22:42:26] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Reedy) FWIW, ideal end goal would be two way comment syncing between PR, and auto closing of the github issue when merged (or abandoned) [22:46:08] 10Gerrit, 10Developer-Advocacy, 10Developer-Wishlist (2017): Implement a way to bring GitHub pull requests into gerrit - https://phabricator.wikimedia.org/T37497 (10Paladox) >>! In T37497#4860904, @Reedy wrote: >>>! In T37497#4860902, @Paladox wrote: >> I asked luca weather the GitHub plugin supported ldap (... [23:02:21] 10Gerrit, 10Operations, 10Traffic, 10Patch-For-Review: Enable avatars in gerrit - https://phabricator.wikimedia.org/T191183 (10mmodell) If gerrit only shows 16x16 images, I would argue that it's not even worth doing. At that size, avatars will be difficult to distinguish and that will minimize any benefit... [23:07:09] so, gerrit new UI has this one problem in its diff view compared to the old UI ... [23:08:02] the old UI had an option to hide all whitespace changes .. which is good for ocde refactoring patches that affect indentation. [23:08:06] the new UI is just noise. [23:09:15] Look at https://gerrit.wikimedia.org/r/#/c/mediawiki/services/parsoid/+/482352/4/lib/html2wt/DOMDiff.js in the old UI & new UI ... in the old UI, you need to have the relevant diff view option enabled. [23:09:26] anyone know if this feature is coming to the new UI? [23:15:11] paladox: ^ [23:15:28] * paladox looks [23:16:22] subbu so you want ignore whitespace option? [23:16:31] this is implemented from gerrit 2.16+ [23:17:11] yes [23:17:16] ok and what are we on right now? [23:18:09] 2.15 [23:19:00] https://phabricator.wikimedia.org/T200739 [23:19:52] thanks! [23:22:14] your welcome :) [23:38:49] anybody knows what access logstash-beta.wmflabs.org requires? [23:42:50] * greg-g think "I should have a !chromeuser keyword" [23:42:56] SMalyshev: "The site says: “Logstash (ssh deployment-deploy01.deployment-prep.eqiad.wmflabs sudo cat /root/secrets.txt)”" [23:43:16] Chrome ignores the message that the http auth request sends ^ [23:43:34] greg-g: thanks! [23:43:53] It is a nice way to organically know who uses Chrome :P [23:44:16] greg-g: To a first approximation, everyone. [23:44:26] sadly. [23:44:49] yep, there's basically two engines left alive... [23:45:12] * greg-g is slicing up the survey for the open source working group right now, which is kind of on topic [23:50:59] 10Gerrit, 10Operations, 10Traffic, 10Patch-For-Review: Enable avatars in gerrit - https://phabricator.wikimedia.org/T191183 (10Paladox) Gerrit does not show 16x16, depends on where you are in the interface, the image is larger on the settings page, but only a bit smaller on the change screen. See https://g...