[00:02:37] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (201909), 10CirrusSearch, 10Discovery-Search: Unit tests in mediawiki-config repo don't pass under PHP72, only HHVM - https://phabricator.wikimedia.org/T232691 (10Jdforrester-WMF) [00:03:23] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [00:13:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [00:16:45] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (201909): Unit tests in mediawiki-config repo don't pass under PHP72, only HHVM - https://phabricator.wikimedia.org/T232691 (10Jdforrester-WMF) Not the CirrusSearch tests, just the DbconfigTest ones. [00:21:55] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (201909), 10Patch-For-Review: Unit tests in mediawiki-config repo don't pass under PHP72, only HHVM - https://phabricator.wikimedia.org/T232691 (10Jdforrester-WMF) Antoine, you wrote these tests back in 2012; did we ever test them on real PHP?... [00:26:57] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (201909): Unit tests in mediawiki-config repo don't pass under PHP72, only HHVM - https://phabricator.wikimedia.org/T232691 (10Jdforrester-WMF) p:05Triage→03High [01:03:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [01:35:11] 10Phabricator (Upstream), 10Upstream: Herald changes shown in user feed - https://phabricator.wikimedia.org/T130881 (10epriestley) I believe this is resolved by . Note that Herald actions may still appear in some feeds, but Herald //changing subscribers// no longer will.... [02:13:23] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [04:13:24] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [05:20:27] PROBLEM - Free space - all mounts on deployment-deploy01 is CRITICAL: CRITICAL: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) [05:25:22] RECOVERY - Free space - all mounts on deployment-deploy01 is OK: OK: All targets OK [05:41:21] PROBLEM - Free space - all mounts on deployment-deploy01 is CRITICAL: CRITICAL: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) [05:46:23] RECOVERY - Free space - all mounts on deployment-deploy01 is OK: OK: All targets OK [05:57:24] PROBLEM - Free space - all mounts on deployment-deploy01 is CRITICAL: CRITICAL: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) [06:13:23] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [06:28:49] 10Phabricator: Phabricator Maniphest showing "Cancelar suscripción" in English user interface - https://phabricator.wikimedia.org/T232702 (10MZMcBride) [06:56:23] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:14:30] Project beta-scap-eqiad build #266629: 04FAILURE in 4.6 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/266629/ [07:26:31] Yippee, build fixed! [07:26:31] Project beta-scap-eqiad build #266630: 09FIXED in 2 min 5 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/266630/ [07:49:22] RECOVERY - Free space - all mounts on deployment-deploy01 is OK: OK: All targets OK [08:00:04] Project mwcore-phpunit-coverage-master build #168: 04STILL FAILING in 5 hr 0 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/168/ [08:05:59] 5 hours ... [08:09:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Test-Coverage: mwcore-phpunit-coverage-master times out after 5 hours - https://phabricator.wikimedia.org/T232706 (10hashar) [08:12:17] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Test-Coverage: mwcore-phpunit-coverage-master times out after 5 hours - https://phabricator.wikimedia.org/T232706 (10hashar) [08:13:23] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [08:14:08] !log Marking integration-slave-docker-1043 offline , triggering mwcore-phpunit-coverage-master again # T232706 [08:14:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:14:11] T232706: mwcore-phpunit-coverage-master times out after 5 hours - https://phabricator.wikimedia.org/T232706 [08:41:16] 10Release-Engineering-Team, 10MediaWiki-Documentation, 10Operations, 10Security-Team, 10Documentation: Wikimedia Documentation Broken - https://phabricator.wikimedia.org/T232704 (10jcrespo) [08:47:20] 10Release-Engineering-Team, 10MediaWiki-Documentation, 10Operations, 10Security-Team, 10Documentation: Wikimedia Documentation Broken - https://phabricator.wikimedia.org/T232704 (10JaydenKieran) Looks like @Rxy has a revert patch here: https://gerrit.wikimedia.org/r/c/operations/puppet/+/535987/ [08:51:38] 10Release-Engineering-Team, 10MediaWiki-Documentation, 10Operations, 10Security-Team, 10Documentation: Wikimedia Documentation Broken - https://phabricator.wikimedia.org/T232704 (10jcrespo) [09:20:53] 10Phabricator: Phabricator Maniphest showing "Cancelar suscripción" in English user interface - https://phabricator.wikimedia.org/T232702 (10Peachey88) Working fine for me, Can you confirm what language you have selected in your user settings? [09:46:30] 10Phabricator: Phabricator Maniphest showing "Cancelar suscripción" in English user interface - https://phabricator.wikimedia.org/T232702 (10Aklapper) 05Open→03Stalled [10:13:25] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [10:17:23] 10Phabricator: Phabricator Maniphest showing "Cancelar suscripción" in English user interface - https://phabricator.wikimedia.org/T232702 (10Nikerabbit) FYI https://translatewiki.net/w/i.php?title=Special:SearchTranslations&match=all&query=Cancelar+suscripci%C3%B3n&group=phabricator&grouppath=phabricator Transl... [10:34:02] 10Phabricator: Username with diaeresis can log on Phabricator - https://phabricator.wikimedia.org/T232721 (10Trizek-WMF) [10:35:00] TIL "diaeresis". [10:40:00] 10Project-Admins, 10International-Developer-Events: Wikimedia Technical Conference 2019 Project request - https://phabricator.wikimedia.org/T232681 (10Aklapper) [10:45:08] 10Phabricator: Username with diaeresis can't log on Phabricator - https://phabricator.wikimedia.org/T232721 (10Trizek-WMF) [10:47:44] 10Project-Admins, 10International-Developer-Events: Wikimedia Technical Conference 2019 Project request - https://phabricator.wikimedia.org/T232681 (10Aklapper) 05Open→03Resolved Requested public project #techconf2019 has been created: https://phabricator.wikimedia.org/project/view/4276/ @Rfarrand: You ca... [10:53:46] 10Phabricator: Username with diaeresis can't log on Phabricator - https://phabricator.wikimedia.org/T232721 (10Aklapper) This does not seem to be about login but about account registration. Similar to {T179126}. We could adjust the `translation.override` section in https://phabricator.wikimedia.org/source/oper... [10:54:45] 10Phabricator: Error message not explicit that you cannot create a Phabricator account when username includes diaeresis - https://phabricator.wikimedia.org/T232721 (10Aklapper) [10:59:12] 10Phabricator: Error message not explicit that you cannot create a Phabricator account when username includes diaeresis - https://phabricator.wikimedia.org/T232721 (10Trizek-WMF) The expected outcome from this user would be to be allowed to use his username, not to have a better message. I used log-in, since t... [11:30:02] 10Phabricator: Allow Phabricator username which include diaeresis - https://phabricator.wikimedia.org/T232721 (10Aklapper) [11:30:21] 10Phabricator: Allow Phabricator username which include diaeresis - https://phabricator.wikimedia.org/T232721 (10Aklapper) If the intention is to support non-ASCII letters than this is a duplicate of declined {T375}. See https://secure.phabricator.com/T6003 for the reasons. [11:30:39] 10Phabricator: Allow Phabricator username which include diaeresis - https://phabricator.wikimedia.org/T232721 (10Aklapper) [11:30:46] 10Phabricator, 10Phabricator (Upstream), 10Legalpad, 10Upstream: Aligning Phabricator account restrictions with Wikimedia's - https://phabricator.wikimedia.org/T375 (10Aklapper) [11:53:28] 10Release-Engineering-Team, 10Product-Analytics, 10Repository-Admins: Create a repository and user for Product Analytics Oozie jobs? - https://phabricator.wikimedia.org/T230743 (10Aklapper) @mforns: Can you please reply to the previous comment? Thanks! (Also, what is a "user" in which specific system?) [11:56:17] Yippee, build fixed! [11:56:17] Project mwcore-phpunit-coverage-master build #169: 09FIXED in 3 hr 41 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/169/ [11:59:29] Hey folks, we have a contractor that needs access to deployment-prep for testing purposes; they'll be running test MediaWiki maintenance scripts and such [11:59:39] where 'we' is I guess wikidata but in any case [12:01:03] the user wikitech name is https://wikitech.wikimedia.org/wiki/User:Igor_Kim and I have no idea of the process, I couldn't really find a good description on wikitech for how to get the person access [12:01:20] I haven't a way to verify the user is who they say they are but they seem legit [12:03:33] as far as I’m aware there’s not much process to it beyond filing a Phabricator task with #release-engineering-team and #beta-cluster-infrastructure [12:03:41] my own request was pretty informal at the time, apparently https://phabricator.wikimedia.org/T188427 [12:04:55] Lucas_WMDE: apergos: I don't know whther we have any specific policy beside the WMCS / labs one [12:05:26] ok let me ask the person to do this [12:05:30] so yeah [12:05:37] Step 1: a task in phabricator :-] [12:05:59] if they are indeed a contractor, I guess they can get endorsement by someone we can trust enough [12:06:11] eg any wmf/wmde folks sounds like a good enough stamp to me [12:06:18] and then add them to deployment-prep [12:06:31] I am passing that along now :-) [12:07:06] :] [12:13:24] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [12:14:43] (03CR) 10Thiemo Kreuz (WMDE): "I find it helpful to be able to document parameters and return types as `mixed|null`. Yes, technically this is redundant. However, I would" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/498472 (https://phabricator.wikimedia.org/T218324) (owner: 10Legoktm) [12:22:30] 10Phabricator, 10Phabricator (Upstream), 10Legalpad, 10Upstream: Aligning Phabricator account restrictions with Wikimedia's - https://phabricator.wikimedia.org/T375 (10Trizek-WMF) Reading Phabricator team's reply https://secure.phabricator.com/T6003, I've spotted >If WMF wants to allow these names, you ca... [12:29:22] apergos: ping g.reg in the task once its created [12:29:39] I shall do so; I've asked the person to drop me a link once it's there [12:29:42] ty! [12:37:01] 10Phabricator, 10Phabricator (Upstream), 10Legalpad, 10Upstream: Aligning Phabricator account restrictions with Wikimedia's - https://phabricator.wikimedia.org/T375 (10Aklapper) > Has it been considered? Not that I know, and not that I am aware of someone who has volunteered yet to maintain that downstream... [12:50:20] 10Phabricator, 10Release-Engineering-Team-TODO (201909), 10Wikimedia-Logstash, 10observability, and 2 others: Deploy phatality into kibana - https://phabricator.wikimedia.org/T230752 (10fgiunchedi) Very nice @mmodell ! [12:54:11] 10Phabricator, 10Release-Engineering-Team-TODO (201909), 10Wikimedia-Logstash, 10observability, and 2 others: Deploy phatality into kibana - https://phabricator.wikimedia.org/T230752 (10mmodell) The way I deployed it in beta is fairly straightforward - I copied the zip file with the plugin code over (with... [13:00:08] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Requesting access to wmcs beta cluster for igorkim78 - https://phabricator.wikimedia.org/T232739 (10Igorkim78) [13:06:54] hashar: last time I checked, access to beta cluster was fairly informal (I just added whoever was the last person). Is that still the case? Can I just add igor to deployment-prep (see above) [13:07:50] he is not in here but he could be asked to join [13:08:55] Greetings! [13:10:57] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Requesting access to wmcs beta cluster for igorkim78 - https://phabricator.wikimedia.org/T232739 (10ArielGlenn) Pretty sure you don't need all that checklist. Can whoever does the grant clean up the description to just leave whatever's necessary? Thank... [13:11:08] and he's here [13:11:41] gehel: hi yeah [13:11:55] and the ticket is there ^^ [13:11:56] gehel: well if he is a contractor just be bold I guess and refer to whatever phab task [13:11:59] if there is one already [13:12:00] ah [13:12:17] i guess we just need a "godfather" [13:12:21] ok, I'll take it over, clean the phab task and give the access [13:12:38] and all the common sense of: do not like users ips :D [13:12:40] I believe the main task is https://phabricator.wikimedia.org/T221917 [13:12:45] use a different password on deployment-prep etc [13:13:06] oh [13:13:08] hi igor_kim [13:13:26] and I guess you will eentually need production access at some point [13:13:37] so that T232739 might prove helpful later on [13:13:38] T232739: Requesting access to wmcs beta cluster for igorkim78 - https://phabricator.wikimedia.org/T232739 [13:13:59] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Requesting access to wmcs beta cluster for igorkim78 - https://phabricator.wikimedia.org/T232739 (10Gehel) [13:15:20] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Requesting access to wmcs beta cluster for igorkim78 - https://phabricator.wikimedia.org/T232739 (10Gehel) 05Open→03Resolved a:03Gehel As discussed on IRC, I can vouch for @Igorkim78, he is a contractor with us and already has access to the `wiki... [13:16:02] so gehel while you are here, the plan is to get set up for testing structured data on the beta instance of commons, this is going to take some work [13:16:32] I've been working on a script for batch uploading on the test commons side, and I guess there's need for the query service to be set up if that's something you folks can do [13:16:51] 10Phabricator: Not able to edit Phabricator task T218184: ERR_SPDY_PROTOCOL_ERROR - https://phabricator.wikimedia.org/T232478 (10KartikMistry) It looks like that this issue has been resolved and I'm able to edit description of T218184 now! [13:17:59] we already have a commons query service on WMCS [13:18:03] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Requesting access to wmcs beta cluster for igorkim78 - https://phabricator.wikimedia.org/T232739 (10hashar) +1 :-] [13:18:24] Stas put that in place, we're trying to keep this work rolling [13:18:40] and ofc, we lost some knowledge that we know need to re-create [13:22:16] oh there is one? awesome [13:22:26] I looked for a likely ip but didn't find it [13:23:45] http://sdcquery.wmflabs.org/ [13:24:30] the instance is sdcquery.wikidata-query.eqiad.wmflabs [13:24:37] sweet! [13:24:43] igor_kim: ^^ [13:24:57] that's the blazegraph part [13:25:19] the part where we are stuck is knowing where to get a dumps of structured data from commons [13:25:26] oh, cool, I didn’t know that [13:25:57] Lucas_WMDE: don't get you hopes up too much :) it's not live updated yet and is more a proof of concept than anything else [13:26:03] but feel free to play with it! [13:26:39] JS of the UI not working is a known problem [13:26:41] ? [13:26:43] apergos: I was assuming that you had run a one-off dump for commons on production and provided it to Stas, but it looks like I was wrong [13:26:56] Lucas_WMDE: not known to me [13:27:10] should I create a task? [13:27:13] sure! [13:27:23] Mathew is working on scripts to deploy sdqs into k8s cluster, but for now it is sdcquery.wmflabs.org which is deployed manually by Stas [13:27:29] no [13:27:37] Stas ran a one off as a test of performance [13:27:51] not really surprising though, we were mostly trying to get SPARQL endpoint working [13:28:01] apergos: any idea where he ran it from? [13:28:05] and I don't want to do that in prod again until we're ready to roll (for obviousl reasons) [13:28:12] 10Phabricator, 10Project-Admins, 10Growth-Team (Current Sprint): Add GrowthExperiments to tasks tagged as GrowthExperiments-* - https://phabricator.wikimedia.org/T230831 (10mmodell) @aklapper: I got it to work by using the numeric project id numbers: `sudo /srv/phab/phabricator/bin/move_project --subproject... [13:28:14] * gehel has no idea how dumps work [13:28:21] I can certainly see what the equivalent looks like in beta [13:28:45] igor_kim: we will decorelate the k8s part from CQS [13:28:51] that's why I want to get some serious data in there, right now as I understand it there's next to nothing [13:29:20] apergos: Oh, I now understand better! [13:30:04] so at the moment, getting a dump from beta will be mostly useless, the one we had came from Stas running it on production, but we need to address the perf issues before running another one on prod [13:30:19] apergos: is there anything we can do to help ? [13:30:28] so first off there is the one ticket [13:30:37] 10Phabricator, 10Project-Admins, 10Growth-Team (Current Sprint): Add GrowthExperiments to tasks tagged as GrowthExperiments-* - https://phabricator.wikimedia.org/T230831 (10mmodell) a:05mmodell→03Aklapper @aklapper: I didn't continue any further because I don't know precisely how far along you were in th... [13:31:11] sec, lemme find that [13:31:16] T230856 [13:31:17] T230856: RDF dump performance for SDC - https://phabricator.wikimedia.org/T230856 [13:31:57] no, this one: [13:32:00] https://phabricator.wikimedia.org/T222497 [13:32:21] apparently because of many layers of abstraction this is going to be a PITA to fix up but it needs to happen [13:34:09] so T222497 is a blocker for T230856? [13:34:15] T222497: dumpRDF for MediaInfo entities loads each page individually - https://phabricator.wikimedia.org/T222497 [13:34:29] I would consider it so, because it's not just about 'how long does this take to run' [13:34:41] yep, understood [13:34:41] it's about efficiency of the queries and the overhead to the db servers [13:35:00] but I want to understand better exactly what is happening, I'll be able to do that via some local testing on laptop [13:35:12] (I turn on logging of all db queries in my local mysql instance) [13:35:41] anyways, right now I'm into 'finish up script to load up some test commons images + structured data' [13:35:53] then do that locally and try some dumping to see what we're doing [13:35:56] and then same on beta [13:36:04] from there we should be able to fgure out next steps [13:36:16] cool! thanks a lot for the work and to help us figure out where we stand! [13:36:31] can we help in any way? [13:38:25] um hmmm [13:39:52] can you find out if there's any way through the mw api to provide structured data for an existing image, or at the time of upload? [13:40:19] I'm going to need that piece, or else a maintenance script (which doesn't have to be committed, it just has to run on beta :-P) [13:40:38] I can autogenerate a pile of tiny images plus data for them [13:41:08] I do need to look at the upload piece, that was next on my plate, to see if I want to use a maint script for that (maybe better) or the api [13:41:21] I have no idea about that, but I can try to find someone who does! [13:42:09] actually, Lucas_WMDE, would you know who knows about the mw api and SDoC ^ [13:44:16] I don’t know if there’s a way to do it at upload times [13:44:41] but afterwards, you would use wbeditentities with ids=M to add captions / statements [13:44:58] * cormacparle waves [13:45:08] somebody asking about SDoC and api calls? [13:45:14] can't see scrollback [13:45:24] apergos> can you find out if there's any way through the mw api to provide structured data for an existing image, or at the time of upload? [13:45:34] apergos> I'm going to need that piece, or else a maintenance script (which doesn't have to be committed, it just has to run on beta :-P) [13:45:37] me me meeeee [13:45:52] as far as I can tell, UploadWizard doesn’t support structured data at upload time either, it adds it separately immediately afterwards [13:45:54] e. g. https://commons.wikimedia.org/w/index.php?title=File:Add_to_Commons_Descriptive_Claims_-_Caroline_Zhang.png&action=history [13:45:57] I'd prefer (if we can custom order :-P) [13:46:07] generate a bunch of images on disk (can do) [13:46:18] generate a file with a bunch of data fields (can do) [13:46:22] yeah Lucas is right - UploadWizard just calls wbsetclaim [13:46:26] maintenance batch upload (exists I think) [13:46:36] maintenance batch update structured data (???) [13:46:43] * gehel is going to disappear, need to get kids from daycare [13:46:48] yeah I will not be using upload wizard for these [13:48:27] apergos: one option to batch update structured data (statements only, not captions) might be AC/DC https://commons.wikimedia.org/wiki/Help:Gadget-ACDC [13:48:44] I haven’t tested it on Beta Commons but I usually develop it on Test Commons so it should be reasonably wiki-agnostic [13:49:01] a command line script would probably be more useful for you, though [13:49:20] gee I was going to look at the js but it's gross [13:49:25] yeah prefer [13:49:39] it’s babelified, the original source code is hopefully less gross ;) [13:49:40] if there isn't one I can probably slug away at it, this was more of a fact finding question than a 'please write me one' [13:49:41] but yeah [13:51:30] ah there is the github url [13:51:36] well that might give me some ideas too [13:55:13] acdc.js from github is standalone-able on modern browsers, the Babel stuff is just for compatibility with IE11 etc [13:55:40] (gosh that script has grown already…) [13:55:45] heh [13:59:28] apergos: checked and yes it's wbsetclaim that sets statements in the SDC UI [13:59:38] hm ok [14:00:50] what's the repo for MediaInfo anyways? [14:00:59] guess I should clone it and poke around [14:01:10] WikibaseMediaInfo [14:01:31] https://www.mediawiki.org/wiki/Extension:WikibaseMediaInfo/en [14:01:44] ah there it is, I thought I already had a copy [14:02:24] no maintenance scripts? at all? [14:03:21] ok I'm gonna just defer that for right now and concentrate on the upload bit for today :-) [14:13:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [14:23:01] so cormacparle and gehel here's a thing then that I would Like To Have (tm): a way to set / get various structured data statements via the MW api. we're going to want this one way or another anways [14:23:18] I mean I could write something but it would be horrid and wrong [14:27:38] You mean like specific properties hardcoded into the API? (hi, yes, I've stalkworded MediaInfo) [14:31:24] no, I mean that the api should let you specify a piece of data and a format and a property name and let you shovel it in if the back end config (mediainfo) permits [14:31:42] it should not be 'you can only do this via the ui' [14:32:31] Maybe I'm missing context or requisite caffeine, one moment [14:36:37] my fuzzy understanding of Media.Info is surely not helping either [14:38:04] I appreciate the effort but no worries :P [14:39:41] apergos: As far as I understand what you're looking for is a way to set/get statements in *bulk*? [14:39:48] yes indeed [14:39:50] OK [14:39:51] 10Release-Engineering-Team, 10Product-Analytics, 10Repository-Admins: Create a repository and user for Product Analytics Oozie jobs? - https://phabricator.wikimedia.org/T230743 (10mforns) @Aklapper @greg > Can you please reply to the previous comment? Thanks! (Also, what is a "user" in which specific syst... [14:39:53] That was the missing bit [14:40:08] let's say I have a pile of images from a collection for bulk upload [14:40:14] apergos: I suspect the way Wikibase is structured will make that slow, if not impossible [14:40:16] sorry, was in a 1-1 there ... back now [14:40:17] and I have at least for some groups of them, captions, [14:40:19] maybe even depicts [14:40:24] or whatever else we come up with [14:40:25] Each change to a statement is a revision [14:41:01] just as there's a mechanism for bulk upload from the command line or uploads via the api or damn near everything else form the api [14:41:05] so they can be scripted [14:41:08] there oughta be for these [14:41:17] Yeah I wouldn't mind having it [14:41:29] I just don't know how it'll work with Wikibase [14:41:37] I would expect (as the naive user that I am) that there would be some level of abstraction between media info and wikibase [14:41:49] so that you can't specify any random property name and format [14:41:53] Only a thin one really [14:42:00] but there's some sort of limitation based on a config somewhere [14:42:28] we don't want people to be able to dump any kind of crud into the db [14:43:07] but really that's all the thoughts I hve about it [14:43:53] commons MediaInfo is federated, which means all properties and items come from wikidata [14:44:28] 10Release-Engineering-Team-TODO (201909), 10ORES, 10Repository-Admins, 10Scoring-platform-team (Current): Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10MarcoAurelio) I'll try with `phab` as shell, and K19; and report back. [14:44:38] sure, but they are tied to a pediainfo id right? which is somehow connected to a media page id [14:44:52] that's more than wikibase provides [14:44:57] and we want to preserve/use that [14:45:41] s/pediainfo/mediainfo/ dratted m->p thing! [14:45:58] PediaInfo will get you on some kind of a list, I'm sure [14:46:01] 10Release-Engineering-Team, 10Product-Analytics, 10Repository-Admins: Create a repository and user for Product Analytics Oozie jobs? - https://phabricator.wikimedia.org/T230743 (10mforns) @kzimmerman Can you Product Analytics please, as Greg suggests, request a repository in Gerrit to store your team's Oozi... [14:46:08] :P [14:46:24] MediaInfo id is just the page id with an M in front of it [14:46:26] too late, on one for $other_things [14:46:49] except that we have the undelete issue, but whatever, skipping right over that for now... [14:47:16] yeah, let's pretend that isn't happening [14:47:19] * cormacparle whistles [14:47:24] yup [14:47:59] so is there a task where any of this is being discussed (api/cli access)? [14:48:08] specifically for mediainfo thingies [14:48:12] nope [14:48:17] not that I'm aware of [14:48:37] uh. [14:48:40] oh dear :-D [14:50:08] 10Release-Engineering-Team-TODO (201909), 10ORES, 10Repository-Admins, 10Scoring-platform-team (Current): Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10MarcoAurelio) >>! In T232661#5487934, @MarcoAurelio wrote: > I'll try with `phab` as shell, and K19; and report back... [14:57:25] thcipriani, paladox : so ores/ores.git is now up to date again via SSH and K19, using ssh://phab@... (yesterday we tried [Pp]habricator; which was not the LDAP name, thus failed). [15:03:22] is gerrit down? [15:03:35] back up [15:06:50] down for me [15:06:58] err_timeout [15:07:00] reloading [15:07:15] Code Review - Error [15:07:15] Server Unavailable [15:07:15] 0 [15:19:44] hrm [15:20:06] gerrit is up for me, I don't see anything too strange happening in monitoring on graphana [15:20:15] https://grafana.wikimedia.org/d/Bw2mQ3iWz/gerrit-javamelody?orgId=1 [15:21:15] er grafana, rather (I blame phab for that typo) [15:21:24] it's up for me again [15:21:29] perhaps a temp issue [15:25:58] network issues due to router upgrades thcipriani? [15:27:07] Reedy: ah, didn't realize that was happening, that seems likely since gerrit usually complains pretty loudly in various places in the typical case. [15:27:20] I can't say for sure... but if everything else looks ok... [15:27:31] core routers are being swapped and stuff [15:27:55] 10Phabricator, 10Project-Admins, 10Growth-Team (Current Sprint): Convert GrowthExperiments-* project to subprojects of GrowthExperiments - https://phabricator.wikimedia.org/T230831 (10Aklapper) [15:32:54] 10Phabricator, 10Project-Admins, 10Growth-Team (Current Sprint): Convert GrowthExperiments-* project to subprojects of GrowthExperiments - https://phabricator.wikimedia.org/T230831 (10Aklapper) 05Open→03Resolved Thanks everyone! I converted the rest of the projects, so we should be done here. > One warn... [15:36:23] 10Release-Engineering-Team-TODO (201909): Evaluate GitLab PoC CI system - https://phabricator.wikimedia.org/T229257 (10LarsWirzenius) 05Open→03Resolved [15:39:45] apergos: do you need us to do raise a ticket? [15:40:02] (meeting) [15:40:07] kk [15:42:32] hashar: thanks [15:53:21] is there a good way to cancel gate-and-submit builds? [15:53:39] the *fourth* change currently in gate-and-submit fixes a CI issue, and I think all three changes above it will fail due to that issue [15:53:51] !log Phabricator: Switched articlequality, drafttopic, draftquality and editquality Diffusion (ORES project) to mirror to Gerrit via SSH/K19 refs. T232661 [15:53:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:53:54] T232661: Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 [15:53:58] but the failure is in the Database group, so it will take a damn long time until those builds die on their own [15:54:29] Lucas_WMDE: I don't think you can cancel it unless you kill the job directly in the server [15:54:36] :/ [15:55:24] 'test' jobs get killed when uploading a new PS or rebasing it [15:55:36] but gate-and-submit... I don't think even removing +2 helps [15:56:13] Try rebasing the "broken" patches maybe? [15:56:26] That should hopefully cancel tha g&s [15:56:55] one hasn’t even started running yet, I can at least rebase that one [15:57:05] see if that re-enqueues it at the end [15:57:16] Yeah that's what I was hoping [15:57:28] But it should work for the ones already running, too [15:59:52] I’ll leave ContentTranslation alone, not sure if that one would fail anyways [16:00:13] (I saw some Wikibase in the build output, but the quibble-*php*-docker jobs succeeded) [16:01:44] okay, the WikibaseLexeme change is building now, yay [16:01:50] thanks Daimona [16:03:29] Lucas_WMDE: does this mean I have to re-+2 the patch you rebased? [16:03:39] I thought the +2 would survive the rebase [16:03:47] but it looks like the gate-and-submit didn’t restart [16:03:49] I can also +2 it [16:03:58] ok cool [16:08:15] 10Phabricator (Upstream), 10Upstream: "Custom Policy" value in "Policy Details" could provide more information what exactly it means - https://phabricator.wikimedia.org/T211498 (10epriestley) This is referenced upstream by (and, earlier, by PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [16:13:43] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team-TODO (201909), 10Release Pipeline: Gerrit/Argo CI proof of concept - https://phabricator.wikimedia.org/T229246 (10dduvall) [16:17:25] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team-TODO (201909), 10Release Pipeline: Gerrit/Argo CI proof of concept - https://phabricator.wikimedia.org/T229246 (10dduvall) [16:18:09] 10Phabricator (Upstream), 10Upstream: Add custom policy to access denied message - https://phabricator.wikimedia.org/T231734 (10epriestley) This is referenced upstream by and "resolved" upstream by . This change does not do what th... [16:24:19] cormacparle: I don't know if there should be a ticket but it would be nice to have a place to collect these conversations [16:26:46] ok [16:27:03] my dinner is ready now, will talk more about this tomorrow [16:27:32] 10Phabricator: Phabricator Maniphest showing "Cancelar suscripción" in English user interface - https://phabricator.wikimedia.org/T232702 (10MZMcBride) >>! In T232702#5486954, @Peachey88 wrote: > Working fine for me, Can you confirm what language you have selected in your user settings? My language got changed... [16:29:52] sure thing, enjoy! [16:33:22] 10MediaWiki-Releasing, 10Release-Engineering-Team-TODO (201909), 10MW-1.34-notes, 10MW-1.34-release, 10Patch-For-Review: Configure CI to support REL1_34 - https://phabricator.wikimedia.org/T232025 (10Jdforrester-WMF) a:03Jdforrester-WMF [16:34:01] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909): Move CI selenium/qunit tests of mediawiki repository to a standalone job - https://phabricator.wikimedia.org/T232759 (10hashar) [16:34:37] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909): Move CI selenium/qunit tests of mediawiki repository to a standalone job - https://phabricator.wikimedia.org/T232759 (10hashar) [16:34:39] 10Continuous-Integration-Config, 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, and 5 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10hashar) [16:35:20] 10Continuous-Integration-Config, 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MediaWiki-Core-Testing, and 5 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10hashar) For Selenium/Qunit, we should be... [16:36:33] 10Continuous-Integration-Infrastructure, 10Developer Productivity, 10MediaWiki-Core-Testing, 10Browser-Tests, 10Patch-For-Review: Consider moving browser based tests (Selenium and QUnit) to a non-voting pipeline - https://phabricator.wikimedia.org/T225248 (10hashar) The QUnit tests should definitely be t... [16:45:04] Daimona: thank you for the review on https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/536222/2/includes/libs/rdbms/lbfactory/LBFactoryMulti.php :) [16:45:59] Yay, I'm looking at it [16:47:48] hashar: Fine for me, I guess we need to ask SRE per phab [17:03:35] paladox: yea. so i am not sure about buster for gerrit on gerrit1001 [17:03:41] oh? [17:03:44] i see both sides of the story [17:03:54] on one hand yes, buster is stable and we don't want to redo the same work [17:04:02] yup [17:04:15] on the other hand, testing a new distro on the new master first seems a bit wrong [17:04:28] and normally would keep them the same when doing a mere hardware expanson [17:04:29] yeh [17:04:33] that normally has nothing to do with it [17:04:42] and not a huge fan of doing a lot of "while at it" unrelated changes [17:04:48] ok [17:05:23] so when i say "not sure" i mean it literally [17:05:30] not as a euphemism for "no" "p [17:05:33] heh [17:06:38] paladox: we should try the role with buster in cloud VPS [17:06:51] i mean.. upgrade the labs gerrit [17:06:53] ok [17:07:03] i can upgrade gerrit-test5 [17:07:15] sounds good. would like to know which other puppet errors we get if any [17:07:24] before seeing that in prod when just trying to upgrade RAM [17:07:38] paladox: i might have to revert the LDAP change by request [17:07:49] the request is that we use global ldap settings [17:07:55] and not introduce a new parameter [17:08:22] mutante oh? [17:08:27] global ldap settings? [17:08:38] "ldap_config" [17:08:48] Hash $ldap_config = lookup('ldap', Hash, hash, {}), [17:08:58] ldap_server => $ldap_config['ro-server'], [17:09:05] supposed to use that and the ro-servers [17:09:26] assuming it works with readonly servers [17:09:56] it's because there has been an effort to make everything use the central settings and new ro replicas [17:10:26] i was told you can also change this in Horizon [17:10:33] Yeh, but the cloud hasen't told me if it is ok to use that :) they only said not to use the prod ldap server. [17:14:02] paladox: i will get back on that after clarifying with moritz [17:14:07] ok [17:26:56] paladox: i wonder what happens for you when you login on releases-jenkins [17:27:46] are you "missing the Overall/Read permission" too ? [17:32:03] Yeh, logging on there does not work for me [17:32:11] at least not when i last did it for chad [17:32:47] paladox: you mean you cant login at all or you can login but then see the error about missing the read permission? [17:32:54] i get the latter [17:33:25] i see an error i think [17:33:57] could you try one more time please [17:35:20] ok [17:35:56] i get "paladox is missing the Overall/Read permissio" [17:36:00] *"paladox is missing the Overall/Read permission" [17:37:20] paladox: ok, thanks. same here [17:37:28] * mutante looks for a user with that permission [17:39:37] thcipriani: maybe you could confirm really quick it works normal ^ ? [17:40:18] switched to TLS between caching layer and backend [17:40:19] * thcipriani reads [17:40:57] thcipriani: TLDR: just login on releases-jenkins and tell me if it looks normal :) and separately if it's expected we should not have that read permission [17:41:14] which i am fine with ..more curious [17:41:48] oh, yeah, no one has permissions there except a handful of releng folks :) [17:42:01] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO: CI for mediawiki-config should check out git submodules - https://phabricator.wikimedia.org/T232764 (10Jdforrester-WMF) [17:42:02] alright [17:42:07] (was reading way more scrollback than I needed to, evidently :)) [17:42:21] yea, all i really want is confirm i did not break anything [17:44:24] yep, I can login, all looks fine, thanks for checking [17:45:30] so what's happening now: Apache Traffic Server speaks TLS to Envoy running locally on releases1001 for TLS termination.. that then to Apache and Apache proxies to jenkins on 8080 [17:45:51] cool, thx [17:46:18] just one more checkbox on https://phabricator.wikimedia.org/T210411 [17:59:48] 10Release-Engineering-Team, 10MinervaNeue, 10Readers-Web-Backlog: Need RelEng help: selenium-daily-beta-Minerva and MobileFrontend has failed for 6 days - https://phabricator.wikimedia.org/T232708 (10Jdlrobson) [18:02:04] 10Continuous-Integration-Config: Zuul should always run gate-and-submit-i18n - https://phabricator.wikimedia.org/T232766 (10Zoranzoki21) [18:02:19] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO: CI for mediawiki-config should check out git submodules - https://phabricator.wikimedia.org/T232764 (10Jdforrester-WMF) FWICT we're using `ci-src-setup-simple` which should recurse into submodules unless `GIT_NO_SUBMODULES` is set, which it isn'... [18:05:50] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO: CI for mediawiki-config should check out git submodules - https://phabricator.wikimedia.org/T232764 (10Jdforrester-WMF) 05Open→03Invalid Never mind. [18:12:15] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (201909): CI mediawiki/core run times have increased since July 26th - https://phabricator.wikimedia.org/T232626 (10Jdforrester-WMF) [18:13:06] 10Continuous-Integration-Config: Zuul should always run gate-and-submit-l10n - https://phabricator.wikimedia.org/T232766 (10Zoranzoki21) [18:13:22] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [18:13:26] 10Release-Engineering-Team, 10MinervaNeue, 10Readers-Web-Backlog: Need RelEng help: selenium-daily-beta-Minerva and MobileFrontend has failed for 6 days - https://phabricator.wikimedia.org/T232708 (10Jdlrobson) Looking into this the tests are all false positive. From the limited log information I get for the... [18:25:15] maintenance-disconnect-full-disks build 106727 integration-slave-jessie-1002 (/srv: 95%): OFFLINE due to disk space [18:26:31] 10Release-Engineering-Team (Unit & Int & System Tooling), 10Release-Engineering-Team-TODO, 10MinervaNeue, 10Readers-Web-Backlog: Need RelEng help: selenium-daily-beta-Minerva and MobileFrontend has failed for 6 days - https://phabricator.wikimedia.org/T232708 (10greg) [18:33:32] 10Release-Engineering-Team-TODO (201909), 10ORES, 10Repository-Admins, 10Scoring-platform-team (Current): Update k18 password in phab diffusion - https://phabricator.wikimedia.org/T232661 (10Halfak) 05Open→03Resolved Looks like this is working for us. Thanks @MarcoAurelio et al.! [18:33:37] thcipriani fyi we need gerrit 2.16+ for buster. [18:33:41] (https://gerrit-review.googlesource.com/c/gerrit/+/203911) [18:40:14] maintenance-disconnect-full-disks build 106730 integration-slave-jessie-1002: OFFLINE due to disk space [18:43:52] thcipriani: will Gerrit 2.15.x work with java 11 is what we wanted to find out. we'll try to upgrade the labs instance [18:44:13] gerrit 2.15 sadly won't support java 11 [18:44:23] support for it was only added in gerrit 2.16_ [18:44:26] *+ [18:44:27] there are explicit warnings against that in various docs [18:44:44] IIRC I tried that once and there were some library functions that had changed [18:45:59] thcipriani was that under 2.15? [18:46:00] sigh. there was hope that the big changes could mean they fixed issues we have [18:46:58] paladox: yeah, 2.15 under java 11 [18:47:07] yup [18:47:14] gerrit 2.16 will work [18:47:21] thcipriani see https://gerrit-review.googlesource.com/c/gerrit/+/203911 :) [18:47:28] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (201909): Unit tests in mediawiki-config repo don't pass under PHP72, only HHVM - https://phabricator.wikimedia.org/T232691 (10Krinkle) ##### CirussSearch test warnings It is by a lot of luck and errors cancelling each other out that this test i... [18:56:44] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (201909): Unit tests in mediawiki-config repo don't pass under PHP72, only HHVM - https://phabricator.wikimedia.org/T232691 (10Krinkle) I tried to hot-fix it by adding tolerance for this undefined variable: `lang=diff - $shards = $wgConf->settin... [19:05:17] maintenance-disconnect-full-disks build 106735 integration-slave-jessie-1002: OFFLINE due to disk space [19:28:22] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [19:38:13] (03PS1) 10Umherirrender: Add @property to work with UnusedUseStatementSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/536326 [19:45:30] paladox: take a look at hieradata/role/common/gerrit.yaml then inside there gerrit::jetty::replication . see how we replicate to github and the "replica" (line 40) [19:45:46] yup [19:45:48] oh [19:45:52] there is "url" on line 41 [19:45:58] there is a hardcoded server name [19:46:07] we need to find out if we can even add 2 URLs ? [19:46:26] https://github.com/wikimedia/puppet/blob/production/hieradata/role/common/gerrit.yaml#L40 [19:49:04] so you say gerrit supports 2 URLs?:) [19:50:21] So, gerrit's replication plugin supports multiple urls [19:50:31] only problem is i doin't think yaml supports the same key [19:50:32] twice+ [19:51:56] it has to be change to [19:51:59] urls: [19:52:01] - [19:52:01] - [19:52:11] like projects: on line 37 above [19:52:26] and then used accordingly in puppet [20:06:05] (03PS1) 10Umherirrender: [PageNotice] Run seccheck job [integration/config] - 10https://gerrit.wikimedia.org/r/536336 [20:16:50] 10Release-Engineering-Team (Code Health), 10MediaWiki-extensions-General, 10Code-Health, 10Discovery-Search (Current work), 10Patch-For-Review: Migrate CirrusSearch MediaWikiIntegrationTestCase tests to MediaWikiUnitTestCase - https://phabricator.wikimedia.org/T232589 (10EBernhardson) [20:17:24] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10CirrusSearch, and 2 others: selenium-daily-beta-CirrusSearch is broken - https://phabricator.wikimedia.org/T232495 (10EBernhardson) [20:20:14] maintenance-disconnect-full-disks build 106750 integration-slave-jessie-1002: OFFLINE due to disk space [20:29:32] (03CR) 10Jforrester: [C: 03+2] [PageNotice] Run seccheck job [integration/config] - 10https://gerrit.wikimedia.org/r/536336 (owner: 10Umherirrender) [20:31:16] (03Merged) 10jenkins-bot: [PageNotice] Run seccheck job [integration/config] - 10https://gerrit.wikimedia.org/r/536336 (owner: 10Umherirrender) [20:31:36] !log Zuul: Add seccheck to PageNotice [20:31:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:33:57] mutante ah [20:33:59] i see [20:34:02] let's do that! [20:34:49] paladox: this? https://gerrit.wikimedia.org/r/c/operations/puppet/+/536344 [20:35:09] mutante the array for url [20:35:16] url: - <> - <> [20:35:20] but yup! [20:35:28] paladox: oh, yea. i was already at the next issue with puppet :) [20:35:39] since i got on the VM now [20:36:05] :) [20:36:22] i also noticed there is openjdk-11-jdk-headless [20:37:57] on cobalt we have installed 8-jdk, 8-jre and jre-headless [20:38:10] and 7-jre-headless [20:38:29] 7-jre-headless is installed? [20:40:48] no, it was once installed and just the config remained which wasnt purged [20:40:58] hence it showed up in the list but status rc [20:41:03] oh [20:43:54] Warning: /Stage[main]/Gerrit::Proxy/Httpd::Site[gerrit.git.wmflabs.org] [20:44:09] paladox: interesting how it uses gerrit.git though we are in the different project now? [20:44:14] copy/paste hiera? [20:44:24] yeh, copy pasted [20:44:32] so that we could see what errors we would get [20:45:08] that breaks stuff with acme-setup and maybe more [20:45:12] maintenance-disconnect-full-disks build 106755 integration-slave-jessie-1002: OFFLINE due to disk space [20:45:22] that normally matched the actual hostname [20:45:32] Error: '/usr/local/sbin/acme-setup -i gerrit -s gerrit.git.wmflabs.org --key-user ... [20:45:35] yup [20:47:29] yea, like you said already .. N: Unable to locate package libmysql-java [20:48:34] paladox: libmariadb-java - Java database driver for MariaDB and MySQL [20:48:38] yeh [20:50:44] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO, 10Cleanup, 10Maps, and 2 others: Delete (rather than archive) the maps/kartotherian and maps/tilerator repos - https://phabricator.wikimedia.org/T228483 (10MSantos) Not sure when it happened, but maps/kartotherian/package i... [20:51:36] (03CR) 10Jforrester: [C: 03+2] layout: [mediawiki-config] Drop operations-mw-config-hhvm-composer-test-docker [integration/config] - 10https://gerrit.wikimedia.org/r/535717 (owner: 10Jforrester) [20:53:04] mutante yup [20:53:13] we won't need it for gerrit 2.16. [20:53:32] (03Merged) 10jenkins-bot: layout: [mediawiki-config] Drop operations-mw-config-hhvm-composer-test-docker [integration/config] - 10https://gerrit.wikimedia.org/r/535717 (owner: 10Jforrester) [20:53:52] paladox: ah, right. yea. but what is first [20:54:04] i guess buster now [20:54:05] !log Zuul: Drop operations-mw-config-hhvm-composer-test-docker, the PHP72 one suffices [20:54:07] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:54:17] mutante i think we should get gerrit1001 into prod so gerrit has more resources. [20:54:24] Then upgrade to gerrit 2.16 [20:54:28] then try and do buster later [20:54:30] that is exactly why i wanted that second thing in a separate change btw [20:54:38] please comment it on gerrit too [20:54:52] the part about not needing mariadb i mean [20:54:58] ok [21:10:12] maintenance-disconnect-full-disks build 106760 integration-slave-jessie-1002: OFFLINE due to disk space [21:35:14] maintenance-disconnect-full-disks build 106765 integration-slave-jessie-1002: OFFLINE due to disk space [21:35:57] Looks like zuul is going to support http only! [21:37:01] https://gerrit-review.googlesource.com/c/plugins/rename-project/+/236553 \o/ [21:45:38] !log Temporarily taking deployment-deploy01 offline as CI is stuck [21:45:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:58:59] 10Release-Engineering-Team (Deployment services), 10Patch-For-Review, 10Release, 10Train Deployments: 1.34.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T220747 (10hashar) For now, the train is blocked on T232613, some php7.2 issue to the best I can tell. Though it is possible will rule... [22:00:13] maintenance-disconnect-full-disks build 106770 integration-slave-jessie-1002: OFFLINE due to disk space [22:15:52] !log integration-slave-jessie-1002: apt-get clean [22:15:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:16:28] !log Pooling back integration-slave-jessie-1002 in Jenkins ( /srv was 95% full ) [22:16:30] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:18:53] !log integration-slave-jessie-1002: rm /srv/pbuilder/build/* /srv/pbuilder/aptcache/*/* [22:19:03] !log integration-slave-jessie-1002: rm /srv/pbuilder/build/* /srv/pbuilder/aptcache/*/* [22:19:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:07:21] (03PS1) 10Jforrester: Install 6.11.0 [integration/npm] - 10https://gerrit.wikimedia.org/r/536374 [23:10:13] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (201909), 10Jenkins: integration-config-zuul-layout-validate-docker takes too long in Jenkins due to huge output - https://phabricator.wikimedia.org/T232287 (10hashar) That specific job is f... [23:19:05] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-CentralAuth: [betalabs] Cannot create a new user account - https://phabricator.wikimedia.org/T232796 (10Etonkovidova) [23:28:44] 10Beta-Cluster-Infrastructure: Migrate deployment-prep away from Debian Jessie to Debian Stretch/Buster - https://phabricator.wikimedia.org/T218729 (10Krenair) [23:32:53] (03PS6) 10Jforrester: layout: Define pipelines for REL1_34 [integration/config] - 10https://gerrit.wikimedia.org/r/534228 (https://phabricator.wikimedia.org/T232025) [23:35:00] (03CR) 10Jforrester: [C: 03+2] layout: Define pipelines for REL1_34 [integration/config] - 10https://gerrit.wikimedia.org/r/534228 (https://phabricator.wikimedia.org/T232025) (owner: 10Jforrester) [23:36:33] (03Merged) 10jenkins-bot: layout: Define pipelines for REL1_34 [integration/config] - 10https://gerrit.wikimedia.org/r/534228 (https://phabricator.wikimedia.org/T232025) (owner: 10Jforrester) [23:37:16] !log Zuul: Define pipelines for REL1_34 T232025 [23:37:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:37:19] T232025: Configure CI to support REL1_34 - https://phabricator.wikimedia.org/T232025 [23:38:05] 10MediaWiki-Releasing, 10Release-Engineering-Team-TODO (201909), 10Core Platform Team, 10MW-1.34-notes, 10MW-1.34-release: Branch REL1_34 for MediaWiki and deployed extensions - https://phabricator.wikimedia.org/T232024 (10Jdforrester-WMF) [23:38:08] 10MediaWiki-Releasing, 10Release-Engineering-Team-TODO (201909), 10MW-1.34-notes, 10MW-1.34-release, 10Patch-For-Review: Configure CI to support REL1_34 - https://phabricator.wikimedia.org/T232025 (10Jdforrester-WMF) 05Open→03Resolved [23:38:21] (03PS8) 10Jforrester: [DNM] layout: Drop php70 and php71 from quibble jobs for master and REL1_34 [integration/config] - 10https://gerrit.wikimedia.org/r/534229 [23:39:07] (03PS2) 10Jforrester: [DNM] layout: Drop HHVM jobs from -wmf branches [integration/config] - 10https://gerrit.wikimedia.org/r/534520 (https://phabricator.wikimedia.org/T176370) [23:39:15] 10Phabricator: Phabricator Maniphest showing "Cancelar suscripción" in English user interface - https://phabricator.wikimedia.org/T232702 (10epriestley) There's technically a transaction history on Settings, but it's not useful today since the stories don't render properly (only @MzMcBride will be able to see an... [23:39:17] (03PS2) 10Jforrester: [DNM] layout: Drop HHVM testing from all quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/534521 (https://phabricator.wikimedia.org/T192166) [23:39:25] (03PS2) 10Jforrester: layout: Collapse -nohhvm jobs into their base as we've dropped that [integration/config] - 10https://gerrit.wikimedia.org/r/534522 [23:41:37] (03CR) 10jerkins-bot: [V: 04-1] layout: Collapse -nohhvm jobs into their base as we've dropped that [integration/config] - 10https://gerrit.wikimedia.org/r/534522 (owner: 10Jforrester) [23:42:16] (03CR) 10jerkins-bot: [V: 04-1] [DNM] layout: Drop HHVM testing from all quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/534521 (https://phabricator.wikimedia.org/T192166) (owner: 10Jforrester)