[00:07:15] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [00:07:15] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [00:11:26] thcipriani: hey are you doing a swat now? [00:11:26] thcipriani: hey are you doing a swat now? [00:11:40] jdlrobson: yes indeed [00:11:40] jdlrobson: yes indeed [00:11:57] any changes on the beta cluster today or yesterday that might have caused a spike in JS https://phabricator.wikimedia.org/T210811 ? [00:11:57] any changes on the beta cluster today or yesterday that might have caused a spike in JS https://phabricator.wikimedia.org/T210811 ? [00:12:00] e.g. beta cluster only config? [00:12:00] e.g. beta cluster only config? [00:13:04] in particular this graph spike: https://grafana.wikimedia.org/dashboard/db/mobile-2g?orgId=1&panelId=69&fullscreen [00:13:04] in particular this graph spike: https://grafana.wikimedia.org/dashboard/db/mobile-2g?orgId=1&panelId=69&fullscreen [00:17:24] hrm, there was beta-cluster only config yesterday IIRC [00:17:24] hrm, there was beta-cluster only config yesterday IIRC [00:17:36] im trying to get some clues with what might have changed [00:17:36] im trying to get some clues with what might have changed [00:18:15] this one in evening swat yesterday is the only beta-only config change I've seen this week afaicr: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/476027/ [00:18:15] this one in evening swat yesterday is the only beta-only config change I've seen this week afaicr: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/476027/ [00:19:32] ahhh that might explain it. [00:19:32] ahhh that might explain it. [00:19:38] thank you :) [00:19:38] thank you :) [00:20:13] sure thing :) [00:20:13] sure thing :) [00:21:11] 10MediaWiki-Codesniffer: Remove Generic.PHP.DeprecatedFunctions.Deprecated from 19.x branch - https://phabricator.wikimedia.org/T210812 (10bd808) [00:21:11] 10MediaWiki-Codesniffer: Remove Generic.PHP.DeprecatedFunctions.Deprecated from 19.x branch - https://phabricator.wikimedia.org/T210812 (10bd808) [00:27:16] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [00:27:16] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [00:27:26] (03CR) 10Thcipriani: "> I am not sure ZUUL_COMMIT is suitable for publishing. If one CR+2 a" [integration/config] - 10https://gerrit.wikimedia.org/r/476593 (https://phabricator.wikimedia.org/T209088) (owner: 10Thcipriani) [00:27:26] (03CR) 10Thcipriani: "> I am not sure ZUUL_COMMIT is suitable for publishing. If one CR+2 a" [integration/config] - 10https://gerrit.wikimedia.org/r/476593 (https://phabricator.wikimedia.org/T209088) (owner: 10Thcipriani) [00:27:40] (03PS1) 10BryanDavis: Disable 'Generic.PHP.DeprecatedFunctions' sniff [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) [00:27:40] (03PS1) 10BryanDavis: Disable 'Generic.PHP.DeprecatedFunctions' sniff [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) [01:06:58] (03CR) 10Legoktm: [C: 032] "Thanks :) I'll tag a new release for 19.x whenever we do the next standard release" [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) (owner: 10BryanDavis) [01:06:58] (03CR) 10Legoktm: [C: 032] "Thanks :) I'll tag a new release for 19.x whenever we do the next standard release" [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) (owner: 10BryanDavis) [01:08:03] (03Merged) 10jenkins-bot: Disable 'Generic.PHP.DeprecatedFunctions' sniff [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) (owner: 10BryanDavis) [01:08:04] (03Merged) 10jenkins-bot: Disable 'Generic.PHP.DeprecatedFunctions' sniff [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) (owner: 10BryanDavis) [01:08:35] (03CR) 10jenkins-bot: Disable 'Generic.PHP.DeprecatedFunctions' sniff [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) (owner: 10BryanDavis) [01:08:35] (03CR) 10jenkins-bot: Disable 'Generic.PHP.DeprecatedFunctions' sniff [tools/codesniffer] (19.x) - 10https://gerrit.wikimedia.org/r/476788 (https://phabricator.wikimedia.org/T201524) (owner: 10BryanDavis) [01:30:41] 10MediaWiki-Codesniffer, 10Patch-For-Review: Remove Generic.PHP.DeprecatedFunctions.Deprecated from 19.x branch - https://phabricator.wikimedia.org/T210812 (10Legoktm) 05Open>03Resolved a:03bd808 [01:30:41] 10MediaWiki-Codesniffer, 10Patch-For-Review: Remove Generic.PHP.DeprecatedFunctions.Deprecated from 19.x branch - https://phabricator.wikimedia.org/T210812 (10Legoktm) 05Open>03Resolved a:03bd808 [03:33:08] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-IEG-grant-review: Migrate Differential repo rWIEG back to Gerrit wikimedia/iegreview.git - https://phabricator.wikimedia.org/T210820 (10bd808) [03:33:08] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-IEG-grant-review: Migrate Differential repo rWIEG back to Gerrit wikimedia/iegreview.git - https://phabricator.wikimedia.org/T210820 (10bd808) [08:08:37] marxarelli: afaics beta prometheus hasn't been told to pull in metrics from mysql-exporter [08:08:37] marxarelli: afaics beta prometheus hasn't been told to pull in metrics from mysql-exporter [08:09:01] i.e. https://beta-prometheus.wmflabs.org/beta/targets doesn't have a mysql job [08:09:01] i.e. https://beta-prometheus.wmflabs.org/beta/targets doesn't have a mysql job [08:21:09] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-IEG-grant-review: Migrate Differential repo rWIEG back to Gerrit wikimedia/iegreview.git - https://phabricator.wikimedia.org/T210820 (10hashar) [08:21:09] 10Gerrit, 10Release-Engineering-Team, 10Wikimedia-IEG-grant-review: Migrate Differential repo rWIEG back to Gerrit wikimedia/iegreview.git - https://phabricator.wikimedia.org/T210820 (10hashar) [08:21:14] 10Gerrit, 10Phabricator, 10Release-Engineering-Team (Backlog): Stop using Differential for code review - https://phabricator.wikimedia.org/T191182 (10hashar) [08:21:14] 10Gerrit, 10Phabricator, 10Release-Engineering-Team (Backlog): Stop using Differential for code review - https://phabricator.wikimedia.org/T191182 (10hashar) [08:40:06] 10Release-Engineering-Team (Backlog), 10Scoring-platform-team, 10Wikibase-Containers, 10Wikidata, and 2 others: Stretch in docker registry forces ascii encoding - https://phabricator.wikimedia.org/T210260 (10hashar) Whaou thank you Alexandros for the details. The world of locales puzzles me everytime I hav... [08:40:06] 10Release-Engineering-Team (Backlog), 10Scoring-platform-team, 10Wikibase-Containers, 10Wikidata, and 2 others: Stretch in docker registry forces ascii encoding - https://phabricator.wikimedia.org/T210260 (10hashar) Whaou thank you Alexandros for the details. The world of locales puzzles me everytime I hav... [08:42:44] 10Continuous-Integration-Config, 10Analytics: Add CI to all analytics/* repositories and archive obsolete ones - https://phabricator.wikimedia.org/T180301 (10hashar) [08:42:44] 10Continuous-Integration-Config, 10Analytics: Add CI to all analytics/* repositories and archive obsolete ones - https://phabricator.wikimedia.org/T180301 (10hashar) [08:46:58] (03PS1) 10Hashar: analytics/aqs: add npm test with NodeJS 6 [integration/config] - 10https://gerrit.wikimedia.org/r/476811 (https://phabricator.wikimedia.org/T209711) [08:46:58] (03PS1) 10Hashar: analytics/aqs: add npm test with NodeJS 6 [integration/config] - 10https://gerrit.wikimedia.org/r/476811 (https://phabricator.wikimedia.org/T209711) [10:09:17] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476823 [10:09:17] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476823 [10:09:19] (03CR) 10QChris: [V: 032 C: 032] Allow “Gerrit Managers” to import history [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476823 (owner: 10QChris) [10:09:19] (03CR) 10QChris: [V: 032 C: 032] Allow “Gerrit Managers” to import history [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476823 (owner: 10QChris) [10:09:39] (03PS1) 10QChris: Import done. Revoke import grants [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476824 [10:09:39] (03PS1) 10QChris: Import done. Revoke import grants [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476824 [10:09:41] (03CR) 10QChris: [V: 032 C: 032] Import done. Revoke import grants [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476824 (owner: 10QChris) [10:09:41] (03CR) 10QChris: [V: 032 C: 032] Import done. Revoke import grants [research/article-recommender/deploy] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/476824 (owner: 10QChris) [10:17:14] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [10:17:14] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [10:27:15] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [10:27:15] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [10:37:13] I'm afraid the "delete page-move revision failure" bug gets popular: https://phabricator.wikimedia.org/T210739 [10:37:13] I'm afraid the "delete page-move revision failure" bug gets popular: https://phabricator.wikimedia.org/T210739 [12:09:18] 10Release-Engineering-Team (Backlog), 10Scoring-platform-team, 10Wikibase-Containers, 10Wikidata, and 2 others: Stretch in docker registry forces ascii encoding - https://phabricator.wikimedia.org/T210260 (10akosiaris) I did just do a quick check on `wikimedia-stretch` image for this ` $ docker run --rm -... [12:09:18] 10Release-Engineering-Team (Backlog), 10Scoring-platform-team, 10Wikibase-Containers, 10Wikidata, and 2 others: Stretch in docker registry forces ascii encoding - https://phabricator.wikimedia.org/T210260 (10akosiaris) I did just do a quick check on `wikimedia-stretch` image for this ` $ docker run --rm -... [12:59:04] (03CR) 10Hashar: [C: 032] analytics/aqs: add npm test with NodeJS 6 [integration/config] - 10https://gerrit.wikimedia.org/r/476811 (https://phabricator.wikimedia.org/T209711) (owner: 10Hashar) [12:59:04] (03CR) 10Hashar: [C: 032] analytics/aqs: add npm test with NodeJS 6 [integration/config] - 10https://gerrit.wikimedia.org/r/476811 (https://phabricator.wikimedia.org/T209711) (owner: 10Hashar) [13:00:42] (03Merged) 10jenkins-bot: analytics/aqs: add npm test with NodeJS 6 [integration/config] - 10https://gerrit.wikimedia.org/r/476811 (https://phabricator.wikimedia.org/T209711) (owner: 10Hashar) [13:00:42] (03Merged) 10jenkins-bot: analytics/aqs: add npm test with NodeJS 6 [integration/config] - 10https://gerrit.wikimedia.org/r/476811 (https://phabricator.wikimedia.org/T209711) (owner: 10Hashar) [13:01:40] 10Beta-Cluster-Infrastructure, 10Wikidata: Wikibase dispatching broken in beta? - https://phabricator.wikimedia.org/T210839 (10Krenair) p:05Triage>03High [13:01:40] 10Beta-Cluster-Infrastructure, 10Wikidata: Wikibase dispatching broken in beta? - https://phabricator.wikimedia.org/T210839 (10Krenair) p:05Triage>03High [13:02:31] marxarelli, ^ that may be relevant [13:02:31] marxarelli, ^ that may be relevant [13:08:28] 10Continuous-Integration-Config, 10Analytics: Add CI to all analytics/* repositories and archive obsolete ones - https://phabricator.wikimedia.org/T180301 (10hashar) [13:08:28] 10Continuous-Integration-Config, 10Analytics: Add CI to all analytics/* repositories and archive obsolete ones - https://phabricator.wikimedia.org/T180301 (10hashar) [13:15:17] hashar: I thought I would be able to get away with the nyan cat reporter :D [13:15:17] hashar: I thought I would be able to get away with the nyan cat reporter :D [13:15:37] #stillLivingIn2012 [13:15:37] #stillLivingIn2012 [13:18:30] fdans: hello :) [13:18:30] fdans: hello :) [13:18:49] fdans: yeah well it causes the test output to be rather long, but it is a matter of taste I guess :) At least the 'npm test' command pass! [13:18:49] fdans: yeah well it causes the test output to be rather long, but it is a matter of taste I guess :) At least the 'npm test' command pass! [14:36:37] 10Release-Engineering-Team (Backlog), 10Scoring-platform-team, 10Wikibase-Containers, 10Wikidata, and 2 others: Stretch in docker registry forces ascii encoding - https://phabricator.wikimedia.org/T210260 (10hashar) >>! In T210260#4788689, @akosiaris wrote: > ... > so support for C.UTF-8 already exists in... [14:36:37] 10Release-Engineering-Team (Backlog), 10Scoring-platform-team, 10Wikibase-Containers, 10Wikidata, and 2 others: Stretch in docker registry forces ascii encoding - https://phabricator.wikimedia.org/T210260 (10hashar) >>! In T210260#4788689, @akosiaris wrote: > ... > so support for C.UTF-8 already exists in... [14:39:59] 10MediaWiki-Codesniffer, 10PHP 7.3 support: MediaWiki codesniffer fails on php7.3: PHP Fatal error: Uncaught PHP_CodeSniffer\Exceptions\RuntimeException: "continue" targeting switch is equivalent to "break". - https://phabricator.wikimedia.org/T208234 (10Lucas_Werkmeister_WMDE) [14:39:59] 10MediaWiki-Codesniffer, 10PHP 7.3 support: MediaWiki codesniffer fails on php7.3: PHP Fatal error: Uncaught PHP_CodeSniffer\Exceptions\RuntimeException: "continue" targeting switch is equivalent to "break". - https://phabricator.wikimedia.org/T208234 (10Lucas_Werkmeister_WMDE) [15:11:57] hashar: would jenkins act on a newly created repository, I should I manually mark it as verified? [15:11:57] hashar: would jenkins act on a newly created repository, I should I manually mark it as verified? [15:19:29] 10Continuous-Integration-Infrastructure: Depends-On should not work across branches - https://phabricator.wikimedia.org/T210685 (10hashar) **TLDR** Zuul can not make a difference since a change-id can refer to multiple changes. That ends up with nasty side effect. The issue is addressed in Zuul v3 since January... [15:19:29] 10Continuous-Integration-Infrastructure: Depends-On should not work across branches - https://phabricator.wikimedia.org/T210685 (10hashar) **TLDR** Zuul can not make a difference since a change-id can refer to multiple changes. That ends up with nasty side effect. The issue is addressed in Zuul v3 since January... [15:20:02] 10Continuous-Integration-Infrastructure: Depends-On should not work across branches - https://phabricator.wikimedia.org/T210685 (10hashar) 05Open>03stalled Thank you to have taken the effort to fill the bug. Per above, the issue is solved in Zuul v3 so that is pending upgrade :/ [15:20:02] 10Continuous-Integration-Infrastructure: Depends-On should not work across branches - https://phabricator.wikimedia.org/T210685 (10hashar) 05Open>03stalled Thank you to have taken the effort to fill the bug. Per above, the issue is solved in Zuul v3 so that is pending upgrade :/ [15:20:16] 10Continuous-Integration-Infrastructure, 10Zuul: Depends-On should not work across branches - https://phabricator.wikimedia.org/T210685 (10hashar) [15:20:16] 10Continuous-Integration-Infrastructure, 10Zuul: Depends-On should not work across branches - https://phabricator.wikimedia.org/T210685 (10hashar) [15:22:38] Platonides: new repositories have to be registed in the CI system via integration/config.git in zuul/layout.yaml [15:22:38] Platonides: new repositories have to be registed in the CI system via integration/config.git in zuul/layout.yaml [15:22:47] Platonides: that is where we determine which jobs should be triggered :) [15:22:47] Platonides: that is where we determine which jobs should be triggered :) [15:23:05] * Platonides verifies manually [15:23:05] * Platonides verifies manually [15:23:37] Platonides: come on :))) [15:23:38] Platonides: come on :))) [15:23:41] Platonides: what is the repo? [15:23:41] Platonides: what is the repo? [15:23:50] mediawiki/extensions/PwnedPasswords [15:23:50] mediawiki/extensions/PwnedPasswords [15:26:07] (03PS1) 10MarcoAurelio: [PwnedPasswords] Setup CI for new repo [integration/config] - 10https://gerrit.wikimedia.org/r/476873 [15:26:07] (03PS1) 10MarcoAurelio: [PwnedPasswords] Setup CI for new repo [integration/config] - 10https://gerrit.wikimedia.org/r/476873 [15:26:45] ^^ :) [15:26:45] ^^ :) [15:27:37] (03CR) 10Hashar: [C: 04-1] "Seems you forgot to git add zuul/layout.yaml :)" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:27:37] (03CR) 10Hashar: [C: 04-1] "Seems you forgot to git add zuul/layout.yaml :)" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:27:53] (03PS2) 10MarcoAurelio: [PwnedPasswords] Setup CI for new repo [integration/config] - 10https://gerrit.wikimedia.org/r/476873 [15:27:53] (03PS2) 10MarcoAurelio: [PwnedPasswords] Setup CI for new repo [integration/config] - 10https://gerrit.wikimedia.org/r/476873 [15:28:18] (03CR) 10Hashar: [C: 032] "Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:28:18] (03CR) 10Hashar: [C: 032] "Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:28:25] (03CR) 10MarcoAurelio: "> Seems you forgot to git add zuul/layout.yaml :)" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:28:26] (03CR) 10MarcoAurelio: "> Seems you forgot to git add zuul/layout.yaml :)" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:29:18] (03CR) 10MarcoAurelio: "> Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:29:18] (03CR) 10MarcoAurelio: "> Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:29:59] (03Merged) 10jenkins-bot: [PwnedPasswords] Setup CI for new repo [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:30:00] (03Merged) 10jenkins-bot: [PwnedPasswords] Setup CI for new repo [integration/config] - 10https://gerrit.wikimedia.org/r/476873 (owner: 10MarcoAurelio) [15:31:08] and deployed [15:31:08] and deployed [15:31:10] Platonides: done [15:31:10] Platonides: done [15:33:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): contint1001 build cleanup - https://phabricator.wikimedia.org/T209123 (10hashar) 05Open>03Resolved a:03hashar ` $ du -d1 -m /srv/jenkins/builds|sort -n|tail -n25 3886 /srv/jenkins/builds/mediawiki-core-code-coverage-docker 4380... [15:33:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): contint1001 build cleanup - https://phabricator.wikimedia.org/T209123 (10hashar) 05Open>03Resolved a:03hashar ` $ du -d1 -m /srv/jenkins/builds|sort -n|tail -n25 3886 /srv/jenkins/builds/mediawiki-core-code-coverage-docker 4380... [15:33:37] hashar: do you have time today to talk through https://gerrit.wikimedia.org/r/c/integration/config/+/475470, if not could we schedule something next week or the week after? [15:33:38] hashar: do you have time today to talk through https://gerrit.wikimedia.org/r/c/integration/config/+/475470, if not could we schedule something next week or the week after? [15:45:19] kostajh: I lost track of the scanner effort sorry [15:45:19] kostajh: I lost track of the scanner effort sorry [15:45:32] bI have een running the mediawiki train deployment this week [15:45:32] bI have een running the mediawiki train deployment this week [15:45:43] at least the docker container should be ready [15:45:44] at least the docker container should be ready [15:50:23] kostajh: I am not there next week and I believe I will be in a rush the week after [15:50:23] kostajh: I am not there next week and I believe I will be in a rush the week after [15:52:37] hashar: ok. is there anyone else that could help us (the codehealth metrics group) with this? [15:52:37] hashar: ok. is there anyone else that could help us (the codehealth metrics group) with this? [15:53:35] (03CR) 10Hashar: Add configuration for running PHP code analysis on SonarQube (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [15:53:36] (03CR) 10Hashar: Add configuration for running PHP code analysis on SonarQube (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/475470 (https://phabricator.wikimedia.org/T207046) (owner: 10Kosta Harlan) [15:54:18] kostajh: I am meeting with zeljkof and jrbranaa next week so probably we will talk aobut the sonar scaner [15:54:18] kostajh: I am meeting with zeljkof and jrbranaa next week so probably we will talk aobut the sonar scaner [15:54:28] I have no idea what it is doing though [15:54:28] I have no idea what it is doing though [15:54:38] do you have any candidate repository to run that new job against? [15:54:38] do you have any candidate repository to run that new job against? [15:54:40] hashar: ok cool. I'll be around so just ping me if you have time. [15:54:41] hashar: ok cool. I'll be around so just ping me if you have time. [15:54:54] hashar: I can create a patch that adds a sonar-project.properties file to a repo [15:54:54] hashar: I can create a patch that adds a sonar-project.properties file to a repo [15:55:21] do I specify "Depends-On" with the config patch in 475470 or is it triggered in a different way? [15:55:21] do I specify "Depends-On" with the config patch in 475470 or is it triggered in a different way? [15:55:57] your change adding sonar-project.properties could potentially refer to the CI patch [15:55:57] your change adding sonar-project.properties could potentially refer to the CI patch [15:56:12] the Depends-On: will prevent the change from being merged until the CI config is completed and merged [15:56:12] the Depends-On: will prevent the change from being merged until the CI config is completed and merged [15:56:21] but it probably does not matter much [15:56:21] but it probably does not matter much [15:56:44] k [15:56:44] k [15:56:46] that would not magically run the job being defined in the integration/config change. The change has to be merged and deployed [15:56:46] that would not magically run the job being defined in the integration/config change. The change has to be merged and deployed [15:56:50] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10herron) Gerrit logs are being shipped now via a rsyslog imfile to the kafka -> logstash pipeline. There i... [15:56:50] 10Gerrit, 10Release-Engineering-Team (Backlog), 10Wikimedia-Logstash, 10Patch-For-Review, 10Technical-Debt: Look into shoving gerrit logs into logstash - https://phabricator.wikimedia.org/T141324 (10herron) Gerrit logs are being shipped now via a rsyslog imfile to the kafka -> logstash pipeline. There i... [15:56:55] then [15:56:55] then [15:57:02] I dont know what the sonar scaner is doing [15:57:02] I dont know what the sonar scaner is doing [15:58:15] 10Gerrit: Add Urbanecm back to wikimedia-cz-events group - https://phabricator.wikimedia.org/T210461 (10hashar) 05Open>03Resolved a:03hashar Done https://gerrit.wikimedia.org/r/#/admin/groups/1536,members :) [15:58:15] 10Gerrit: Add Urbanecm back to wikimedia-cz-events group - https://phabricator.wikimedia.org/T210461 (10hashar) 05Open>03Resolved a:03hashar Done https://gerrit.wikimedia.org/r/#/admin/groups/1536,members :) [15:58:18] hashar: the sonar-scanner docker image wraps the sonar-scanner executable https://docs.sonarqube.org/display/SCAN/Analyzing+with+SonarQube+Scanner. It takes the source code, and its configuration in the sonar-project.properties file, and pushes it to a SonarQube server for analysis. [15:58:18] hashar: the sonar-scanner docker image wraps the sonar-scanner executable https://docs.sonarqube.org/display/SCAN/Analyzing+with+SonarQube+Scanner. It takes the source code, and its configuration in the sonar-project.properties file, and pushes it to a SonarQube server for analysis. [15:58:43] hashar: in the first iteration, that will be sonarcloud.io. Eventually this would be a WMF hosted SonarQube instance. But for now we are just doing proof of concept [15:58:43] hashar: in the first iteration, that will be sonarcloud.io. Eventually this would be a WMF hosted SonarQube instance. But for now we are just doing proof of concept [15:59:13] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Upstream, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) I have missed the opportunity to polish up the tests for the upstre... [15:59:13] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Upstream, 10Zuul: Zuul get confused when querying a change that yields two entries - https://phabricator.wikimedia.org/T198968 (10hashar) I have missed the opportunity to polish up the tests for the upstre... [15:59:29] hashar: the managed instance of SonarQube at SonarCloud.io then runs a bunch of code analysis and produces a report. The last step of our proof of concept will be getting the report URL and posting as a comment in gerrit. [15:59:29] hashar: the managed instance of SonarQube at SonarCloud.io then runs a bunch of code analysis and produces a report. The last step of our proof of concept will be getting the report URL and posting as a comment in gerrit. [16:00:02] you could use robot comments i guess for ^^ [16:00:02] you could use robot comments i guess for ^^ [16:00:10] hashar: SonarQube can post a webhook to an endpoint when the report is ready (ideal, but more work for us to set up) or else we'd have some kind of polling to check when the report is ready [16:00:10] hashar: SonarQube can post a webhook to an endpoint when the report is ready (ideal, but more work for us to set up) or else we'd have some kind of polling to check when the report is ready [16:00:37] hashar: best of all would be to use the existing sonarqube-gerrit extension which handles all the hard stuff for us, but that is too much commitment for right now :) [16:00:37] hashar: best of all would be to use the existing sonarqube-gerrit extension which handles all the hard stuff for us, but that is too much commitment for right now :) [16:00:50] yeah well [16:00:50] yeah well [16:00:55] and maybe we will drop Jenkins entirely :) [16:00:55] and maybe we will drop Jenkins entirely :) [16:01:02] at least [16:01:02] at least [16:01:20] you have the docker container ready, so probably you can start polishing up the POC locally and reusing the containers [16:01:20] you have the docker container ready, so probably you can start polishing up the POC locally and reusing the containers [16:01:40] I am pretty sure jrbranaa and zeljkof will talk to me about that Sonar intiative next week [16:01:40] I am pretty sure jrbranaa and zeljkof will talk to me about that Sonar intiative next week [16:04:14] 10Release-Engineering-Team (Kanban), 10docker-pkg, 10Patch-For-Review: docker-pkg should attempt to pull dependent images from the registry - https://phabricator.wikimedia.org/T200720 (10hashar) When a containers is already available locally, docker-pkg skips building it, so one always have to bump the chang... [16:04:14] 10Release-Engineering-Team (Kanban), 10docker-pkg, 10Patch-For-Review: docker-pkg should attempt to pull dependent images from the registry - https://phabricator.wikimedia.org/T200720 (10hashar) When a containers is already available locally, docker-pkg skips building it, so one always have to bump the chang... [16:06:48] 10Gerrit, 10Release-Engineering-Team, 10Patch-For-Review: Upgrade to Gerrit 2.16 - https://phabricator.wikimedia.org/T200739 (10Paladox) [16:06:48] 10Gerrit, 10Release-Engineering-Team, 10Patch-For-Review: Upgrade to Gerrit 2.16 - https://phabricator.wikimedia.org/T200739 (10Paladox) [16:10:44] hashar: drop Jenkins entirely? [16:10:44] hashar: drop Jenkins entirely? [16:11:16] hashar: we have done the POC locally, it's the wiring together with the existing Jenkins jobs (or creating a new one per your last comment in gerrit) that's the tricky bit :) [16:11:16] hashar: we have done the POC locally, it's the wiring together with the existing Jenkins jobs (or creating a new one per your last comment in gerrit) that's the tricky bit :) [16:14:47] kostajh: we need to overhaul the CI infra, potentially stop using jenkins for most use cases [16:14:47] kostajh: we need to overhaul the CI infra, potentially stop using jenkins for most use cases [16:14:54] but nothing sure, it is to be discussed next week [16:14:54] but nothing sure, it is to be discussed next week [16:15:07] for the POC, can you craft a change that adds the sonar config file? [16:15:07] for the POC, can you craft a change that adds the sonar config file? [16:15:14] hashar: oh, interesting! [16:15:14] hashar: oh, interesting! [16:15:18] yes I will do it [16:15:19] yes I will do it [16:15:22] and from there, maybe we will have some free time to pair it with zlejko/jean-rené [16:15:22] and from there, maybe we will have some free time to pair it with zlejko/jean-rené [16:15:24] ;) [16:15:24] ;) [16:15:48] and sorry, I went with a long backlog for the last two weeks. I am not even done yet :/ [16:15:48] and sorry, I went with a long backlog for the last two weeks. I am not even done yet :/ [16:18:06] hashar: no worries at all! I appreciate all your time & help [16:18:06] hashar: no worries at all! I appreciate all your time & help [16:21:52] kostajh: thanks for the time spend on polishing up the docker container jjb etc... Eventually that will be deployed and report :) [16:21:52] kostajh: thanks for the time spend on polishing up the docker container jjb etc... Eventually that will be deployed and report :) [16:21:54] I am out! [16:21:54] I am out! [16:21:57] be back later [16:21:57] be back later [16:33:15] https://storage.googleapis.com/gerrit-talks/summit/2018/Gerrit-2.16-3.0-and-Beyond.pdf [16:33:15] https://storage.googleapis.com/gerrit-talks/summit/2018/Gerrit-2.16-3.0-and-Beyond.pdf [16:41:33] * Platonides waves and goes away for the weekend [16:41:33] * Platonides waves and goes away for the weekend [16:44:07] Does anyone know when 1.32 stable will be released? [16:44:07] Does anyone know when 1.32 stable will be released? [16:44:34] The wiki page states November 2018, but tomorrow it's December. [16:44:34] The wiki page states November 2018, but tomorrow it's December. [16:58:50] Krenair: i don't see any entries in your replag log that indicate lag [16:58:51] Krenair: i don't see any entries in your replag log that indicate lag [16:59:07] marxarelli, yep I looked earlier and didn't see any [16:59:07] marxarelli, yep I looked earlier and didn't see any [16:59:09] it could be intermittent i suppose [16:59:09] it could be intermittent i suppose [16:59:14] it is only recording every minute, so yeah... :/ [16:59:14] it is only recording every minute, so yeah... :/ [17:48:36] 10Continuous-Integration-Config, 10MediaWiki-extensions-Scribunto, 10Wikidata, 10Patch-For-Review: Scribunto test “LuaStandalone: SecurityTests[1]: CVE-2014-5461” failing in Wikibase CI builds - https://phabricator.wikimedia.org/T210634 (10Lucas_Werkmeister_WMDE) The change adding the test was reverted in... [17:48:36] 10Continuous-Integration-Config, 10MediaWiki-extensions-Scribunto, 10Wikidata, 10Patch-For-Review: Scribunto test “LuaStandalone: SecurityTests[1]: CVE-2014-5461” failing in Wikibase CI builds - https://phabricator.wikimedia.org/T210634 (10Lucas_Werkmeister_WMDE) The change adding the test was reverted in... [17:57:39] Krenair: looks like there's a maintenance script for getting replication lag, and it has a `--report` option that logs to graphite :) [17:57:39] Krenair: looks like there's a maintenance script for getting replication lag, and it has a `--report` option that logs to graphite :) [17:58:02] cool [17:58:02] cool [17:58:10] i'm setting that up to run every 5 seconds or so [17:58:10] i'm setting that up to run every 5 seconds or so [17:58:47] `getLagTimes.php` [17:58:47] `getLagTimes.php` [18:01:28] we should really get the mysql prometheus exporter working in beta, but this is useful in the meantime [18:01:28] we should really get the mysql prometheus exporter working in beta, but this is useful in the meantime [18:22:35] 10Continuous-Integration-Config, 10JavaScript, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11): JS Linting: Drop `dot-notation` keyword over-ride from all repos; no longer needed - https://phabricator.wikimedia.org/T210552 (10Jdforrester-WMF) [18:22:35] 10Continuous-Integration-Config, 10JavaScript, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11): JS Linting: Drop `dot-notation` keyword over-ride from all repos; no longer needed - https://phabricator.wikimedia.org/T210552 (10Jdforrester-WMF) [18:23:23] 10Continuous-Integration-Config, 10JavaScript, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11): JS Linting: Drop `dot-notation` keyword over-ride from all repos; no longer needed - https://phabricator.wikimedia.org/T210552 (10Jdforrester-WMF) Only remaining repo to fix is #Popups, but the totally non-standard cod... [18:23:23] 10Continuous-Integration-Config, 10JavaScript, 10MW-1.33-notes (1.33.0-wmf.8; 2018-12-11): JS Linting: Drop `dot-notation` keyword over-ride from all repos; no longer needed - https://phabricator.wikimedia.org/T210552 (10Jdforrester-WMF) Only remaining repo to fix is #Popups, but the totally non-standard cod... [18:25:40] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Browser-Tests, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q2), 10User-zeljkofilipin: Wikimedia\Rdbms\LoadBalancer::pickReaderIndex: all replica DBs lagged. Switch to read-only m... - https://phabricator.wikimedia.org/T210557 [18:25:40] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Kanban), 10Browser-Tests, 10Readers-Web-Backlog (Readers-Web-Kanbanana-Board-2018-19-Q2), 10User-zeljkofilipin: Wikimedia\Rdbms\LoadBalancer::pickReaderIndex: all replica DBs lagged. Switch to read-only m... - https://phabricator.wikimedia.org/T210557 [18:43:41] 10Continuous-Integration-Config, 10MediaWiki-extensions-Scribunto, 10Wikidata, 10Patch-For-Review: Scribunto test “LuaStandalone: SecurityTests[1]: CVE-2014-5461” failing in Wikibase CI builds - https://phabricator.wikimedia.org/T210634 (10Anomie) 05Open>03Resolved a:03Lucas_Werkmeister_WMDE >>! In T... [18:43:41] 10Continuous-Integration-Config, 10MediaWiki-extensions-Scribunto, 10Wikidata, 10Patch-For-Review: Scribunto test “LuaStandalone: SecurityTests[1]: CVE-2014-5461” failing in Wikibase CI builds - https://phabricator.wikimedia.org/T210634 (10Anomie) 05Open>03Resolved a:03Lucas_Werkmeister_WMDE >>! In T... [18:51:12] twentyafterfour: as our resident phabricator expert do you happen to know how i set "availability" on my username? [18:51:12] twentyafterfour: as our resident phabricator expert do you happen to know how i set "availability" on my username? [18:51:17] googling is not helping me today [18:51:17] googling is not helping me today [18:51:38] jdlrobson he's on vacation (judging from his phab profile) [18:51:38] jdlrobson he's on vacation (judging from his phab profile) [18:52:46] jdlrobson: I can guide you, it's easy [18:52:46] jdlrobson: I can guide you, it's easy [18:52:54] haha the irony! thanks Hauskatze [18:52:54] haha the irony! thanks Hauskatze [18:53:24] jdlrobson: https://phabricator.wikimedia.org/calendar/event/edit/form/44/ [18:53:24] jdlrobson: https://phabricator.wikimedia.org/calendar/event/edit/form/44/ [19:25:36] exactly what i needed! thanks Hauskatze [19:25:36] exactly what i needed! thanks Hauskatze [19:26:34] :) [19:26:34] :) [19:27:03] jdlrobson: once you create the event, at the top right corner of the screen you'll find an "avalaibility" button that you can set to busy or away [19:27:03] jdlrobson: once you create the event, at the top right corner of the screen you'll find an "avalaibility" button that you can set to busy or away [19:27:34] hurrah! [19:27:34] hurrah! [19:50:08] 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate the Integration cloud project to eqiad1-r - https://phabricator.wikimedia.org/T208803 (10Andrew) I would like to move integration-puppetmaster01 and webperformance sometime soon. Any objection? [19:50:09] 10Release-Engineering-Team (Kanban), 10Cloud-Services, 10Epic, 10Patch-For-Review: Migrate the Integration cloud project to eqiad1-r - https://phabricator.wikimedia.org/T208803 (10Andrew) I would like to move integration-puppetmaster01 and webperformance sometime soon. Any objection? [19:57:46] PROBLEM - Host saucelabs-03 is DOWN: CRITICAL - Host Unreachable (10.68.23.100) [19:57:46] PROBLEM - Host saucelabs-03 is DOWN: CRITICAL - Host Unreachable (10.68.23.100) [21:17:37] greg-g: o/ Do you know who manages the Wikimedia Github account? I used to be able to create repositories there, but I cannot anymore. [21:17:37] greg-g: o/ Do you know who manages the Wikimedia Github account? I used to be able to create repositories there, but I cannot anymore. [21:18:24] There's a lot of different owners of that org [21:18:24] There's a lot of different owners of that org [21:18:33] what's your github username bmansurov ? [21:18:33] what's your github username bmansurov ? [21:18:45] Krenair: oh hi, it's kodchi [21:18:46] Krenair: oh hi, it's kodchi [21:21:22] Project beta-update-databases-eqiad build #30148: 04FAILURE in 1 min 21 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30148/ [21:21:22] Project beta-update-databases-eqiad build #30148: 04FAILURE in 1 min 21 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30148/ [21:21:23] bmansurov, congratulations you're now an owner. try not to break anything and don't disable 2FA on your github account please [21:21:23] bmansurov, congratulations you're now an owner. try not to break anything and don't disable 2FA on your github account please [21:21:52] Krenair: thanks! Would you happen to know why my rights were changed? [21:21:52] Krenair: thanks! Would you happen to know why my rights were changed? [21:22:30] no [21:22:30] no [21:22:42] guess it happened longer ago than the audit log goes back [21:22:43] guess it happened longer ago than the audit log goes back [21:22:55] Krenair: OK, thanks [21:22:55] Krenair: OK, thanks [21:23:40] if you had 2FA disabled at some point it's possible someone just looked at whether you'd used your rights for anything and just downgraded you to member [21:23:40] if you had 2FA disabled at some point it's possible someone just looked at whether you'd used your rights for anything and just downgraded you to member [21:24:16] Krenair: makes sense. It was disabled at some point. [21:24:16] Krenair: makes sense. It was disabled at some point. [21:24:22] other than that dunno why [21:24:22] other than that dunno why [22:21:26] Yippee, build fixed! [22:21:26] Yippee, build fixed! [22:21:27] Project beta-update-databases-eqiad build #30149: 09FIXED in 1 min 26 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30149/ [22:21:27] Project beta-update-databases-eqiad build #30149: 09FIXED in 1 min 26 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/30149/ [22:32:49] Project beta-scap-eqiad build #229366: 04FAILURE in 12 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/229366/ [22:32:49] Project beta-scap-eqiad build #229366: 04FAILURE in 12 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/229366/ [22:32:54] !log removing deployment-redis0{5,6} since I can't ssh in, and they don't seem to have any puppet roles applied [22:32:54] !log removing deployment-redis0{5,6} since I can't ssh in, and they don't seem to have any puppet roles applied [22:32:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:32:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:33:27] 10Beta-Cluster-Infrastructure, 10Puppet, 10Tracking: Deployment-prep hosts with puppet errors (tracking) - https://phabricator.wikimedia.org/T132259 (10Krenair) [22:33:27] 10Beta-Cluster-Infrastructure, 10Puppet, 10Tracking: Deployment-prep hosts with puppet errors (tracking) - https://phabricator.wikimedia.org/T132259 (10Krenair) [22:33:34] 10Beta-Cluster-Infrastructure, 10Operations, 10media-storage, 10Patch-For-Review, 10Puppet: Puppet broken on deployment-ms-be0[34] with evaluation error in swift module - https://phabricator.wikimedia.org/T184236 (10Krenair) 05Open>03Resolved [22:33:34] 10Beta-Cluster-Infrastructure, 10Operations, 10media-storage, 10Patch-For-Review, 10Puppet: Puppet broken on deployment-ms-be0[34] with evaluation error in swift module - https://phabricator.wikimedia.org/T184236 (10Krenair) 05Open>03Resolved [22:48:29] Yippee, build fixed! [22:48:29] Yippee, build fixed! [22:48:29] Project beta-scap-eqiad build #229367: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/229367/ [22:48:29] Project beta-scap-eqiad build #229367: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/229367/ [22:51:24] Project beta-scap-eqiad build #229368: 15ABORTED in 1 min 57 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/229368/ [22:51:24] Project beta-scap-eqiad build #229368: 15ABORTED in 1 min 57 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/229368/ [22:51:34] ^ me [22:51:34] ^ me