[14:10:14] jzerebecki: addshore: Krinkle|detached: about to start. Sorry been late [14:10:22] o/ [14:10:28] legoktm: the whole releng team is joining in [14:10:28] all busy connecting [14:10:28] 0/ [14:10:29] yay [14:10:32] o/ [14:10:44] +bath room :D [14:10:48] o/ [14:15:03] guess we just need zeljkok and dan now [14:25:59] ok [14:25:59] starting now [14:25:59] #startmeeting CI Weekly meeting triage [14:25:59] Meeting started Tue May 19 14:07:45 2015 UTC and is due to finish in 60 minutes. The chair is hashar. Information about MeetBot at http://wiki.debian.org/MeetBot. [14:25:59] Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. [14:25:59] The meeting name has been set to 'ci_weekly_meeting_triage' [14:25:59] welcome ! [14:25:59] o/ [14:25:59] shoot, I changed the /topic at a bad time [14:26:00] legoktm: addshore jzerebecki thcipriani greg-g [14:26:00] so this meeting is unusual [14:26:00] Question: What is CI? [14:26:02] the whole releng team is at on offsite [14:26:02] harej: ho that is Continuous Integration [14:26:02] Thank you. [14:26:06] harej: all the part running tests for devs. Feel free to join and discuss [14:26:06] harej: https://en.wikipedia.org/wiki/Continuous_integration [14:26:07] #link https://www.mediawiki.org/wiki/Continuous_integration/Meetings/2015-05-19 Agenda [14:26:07] lets do the action retrospective [14:26:07] #topic Actions restrospective [14:26:08] #link https://github.com/wikimedia/composer-merge-plugin/issues/18 composer merge of autloader [14:26:08] legoktm: that one was for you :-} [14:26:10] apparently jeroen de dauw proposed a patch [14:26:10] that recursively merge the composer autoload settings [14:26:10] Jeroen submitted a patch which I've reviewed [14:26:10] so it is unblocked ? [14:26:10] not yet, patch still needs work [14:26:10] or does it need unaffordable cycles on your side ? [14:26:10] ok [14:26:10] #link https://github.com/wikimedia/composer-merge-plugin/pull/29 patch [14:26:10] but it is on good track? [14:26:11] I think so [14:26:11] ok [14:26:13] legoktm: so I am going to write it out of the actionables for this meeting [14:26:16] and assume it is going to land and unlocked the use of composer for wikidata [14:26:17] next? [14:26:19] #link https://phabricator.wikimedia.org/T98865 Grant Zuul deploy rights to Jan Zerebecki [14:26:19] jzerebecki: still blocked on ops to +2 the change apparently [14:26:21] #info blocked on ops to +2 https://phabricator.wikimedia.org/T98961 [14:26:21] I guess one can pokes ops [14:26:21] I think today is the 4th day? so it should be good now [14:26:22] yup [14:26:22] anyone willing to poke ops about it ? [14:26:23] ok will do [14:26:23] :P [14:26:23] #action Antoine to poke ops so that jzerebecki has +2 on zuul machine https://gerrit.wikimedia.org/r/#/c/210692/ [14:26:24] #topic Releng attending!!! [14:26:24] welcome releng team :-} [14:26:24] we are at an offsite [14:26:25] so the whole wmf releng team is here in the same room. Demoing triage [14:26:25] \o/ [14:26:25] -:} [14:26:25] weee [14:26:26] o/ [14:26:26] and etonkovi_ and rummana ;) [14:26:26] Timo not around so I will skip the Zuul pending patches topic [14:26:26] #topic Config in progress [14:26:26] #link https://phabricator.wikimedia.org/tag/continuous-integration-config/ CI config workboard [14:26:26] in progress column [14:26:26] https://phabricator.wikimedia.org/T62720 Jenkins should run tests for the Wikipedia app before merge [14:26:26] to be synced with mobile team in Lyon [14:26:27] we have a meeting on Saturday with them [14:26:27] need a pair !! :-D [14:26:27] thcipriani: ^d marxarelli zeljkof ? [14:26:27] Saturday at 1pm one hour long [14:29:18] discussing in the room. Will get it during dinner. [14:29:18] context : [14:29:19] android app is all about running their gradle / whatever test suite [14:29:19] for IOS we need mac mini / Xcode / Setup jenkins [14:29:20] all over they are looking at how they can work with us [14:29:20] marxarelli: ^ :D [14:29:20] meeting being about establishing clear responsibilities between each teams [14:29:21] to be discussed during dinner [14:29:21] i'm game to join the conversion. seems like we'll need ops participation as well [14:29:21] hashar: I would also like to attend the meeting [14:29:21] great [14:29:21] #agreed zeljkof and marxarelli to join in antoine at the meeting [14:29:22] next in progress [14:29:22] #link https://phabricator.wikimedia.org/T92871 Parsoid patches don't update Beta Cluster automatically -- only deploy repo patches seem to update that code [14:29:22] #info pending decision on Parsoid side [14:29:22] so that is blocked on them [14:29:23] I updated https://phabricator.wikimedia.org/T90303#1296255 a few minutes ago with what Krinkle and I talked about a few days ago [14:29:23] on how to use composer for mediawiki core tests [14:29:24] #link https://phabricator.wikimedia.org/T90303#1296255 Fetch dependencies using composer instead of cloning mediawiki/vendor for non-wmf branches [14:29:24] legoktm: maybe we can discuss it this week-end ? [14:29:24] I must say I haven't actively looked at it / figured out which dependencies to bring in [14:29:26] yep :) [14:30:24] mind setting up such meeting reaching out people? [14:30:37] or maybe there is already a session about dependencies for dev/wmf branches? [14:30:48] maybe it can be solved in half an hour of discussions [14:32:11] trying to figure out some candidate here [14:32:38] as I see it [14:32:57] we need a clear commitment as to what we want to test so that developers don't end up being surprised [14:33:12] vocal concensus: master [14:33:27] i was going to run it by bd808 and then just do it :P [14:33:40] * greg-g nods [14:33:41] good [14:33:42] :) [14:34:31] ok [14:34:43] so legoktm you make the choice right with bd808 approval ? [14:34:59] yep [14:35:15] #agreed legoktm to make the choice for https://phabricator.wikimedia.org/T90303#1296255 and pass it via bd808 for approval [14:35:24] legoktm: make sure to update the task :} [14:36:03] jzerebecki: addshore anything config related to bring up ? [14:36:09] i.e. new jobs / new repos setup etc ? [14:37:13] * addshore is still busy with other things currently and havn't caught up with the CI changes in general :) [14:37:23] yeah I can understand [14:37:24] https://phabricator.wikimedia.org/T99413 "PHP Warning: Module 'apc' already loaded in Unknown on line 0 on zend slaves" [14:37:26] ton of changes happened [14:37:51] legoktm: you want to prefix it with #link to have meetbot catch it :-} [14:38:40] #link https://phabricator.wikimedia.org/T99413 "PHP Warning: Module 'apc' already loaded in Unknown on line 0 on zend slaves" [14:38:43] I'm sure the hackathon will give me a chance to catch up on the other bits I have missed [14:38:50] I don't think it's breaking anything, but it's annoying :P [14:38:56] yeah [14:39:00] we had that previously [14:39:06] I think we ended up removing php_apc package [14:39:12] or maybe disabling it via php.ini [14:39:45] so just annoying? I guess it is low priority and can sit in the backlog until someone is willing to grab it [14:40:58] moved it down [14:41:07] #topic CI infra https://phabricator.wikimedia.org/tag/continuous-integration-infrastructure/ [14:41:17] (we are already in infra though :D ) [14:41:46] last week was only 3 days for me and I had a bunch of administrative tasks to handle [14:42:10] CI isolation I can update it though [14:42:30] #info CI isolation blocked on creating the image. Antoine underestimated the amount of work needed [14:42:46] it seems it is mostly working [14:43:17] I am struggling to find a good way to create the images to boot instances from. Have to discuss it with rest of team / hackathon attendees [14:43:48] ok [14:43:52] looking at Done column [14:43:57] (of https://phabricator.wikimedia.org/tag/continuous-integration-infrastructure/?order=priority ) [14:44:06] #link https://phabricator.wikimedia.org/T97257 Failed to create a temp file in beta-code-update-eqiad (Full deployment-bastion:/tmp) [14:44:28] done on our side, pending deployment-tooling apparently [14:45:14] All the in-progress tasks are mostly assigned to me. Need to update all of them [14:45:34] #agree Antoine to update all assigned tasks on https://phabricator.wikimedia.org/tag/continuous-integration-infrastructure/?order=priority "in-progress" column [14:45:47] legoktm: any infra work you want to bring up? [14:46:31] I haven't had much time to work on https://phabricator.wikimedia.org/T96690 lately (Have extensions with dependencies use the shared mwext-testextension-* job) [14:46:51] but the infrastructure is in place, we just need to convert the remaining jobs to use the custom zuul parameter instead of separate jobs [14:48:18] thcipriani is going to close the done task https://phabricator.wikimedia.org/T97257 ! :-} [14:48:48] legoktm: haven't looked at that one either :-((( [14:48:57] #link https://phabricator.wikimedia.org/T96690 Have extensions with dependencies use the shared mwext-testextension-* job [14:49:33] legoktm: so one of the problem is that extensions might be conflicting with each others [14:49:44] such as ones using parser hooks to alter the content of parser tests [14:49:49] which is scary :/ [14:49:54] so that needs to be done carefully [14:50:05] also old REL branch will certainly end up being broken [14:50:08] oh, I'm not putting them in the mediawiki-extensions- combined job [14:50:19] ahah [14:50:23] I think I should have used "generic" instead of "shared" [14:50:25] I am stupid [14:50:46] so we're moving the dependencies out of jjb and into zuul [14:50:55] +3 [14:51:02] seems much easier to maintain update this way [14:51:09] so zuul would pass the extensions to be tested with it ? [14:51:18] then an update would just about to reload zuul right? [14:51:47] yes :D [14:51:55] sounds fun [14:52:08] https://github.com/wikimedia/integration-config/blob/master/zuul/ext_dependencies.py#L3 [14:52:12] could you summarize the current situation and the list of actions that needs to be done ? [14:52:28] oh [14:52:53] #info Infrastructure for using generic jobs for extensions with dependencies is in place, just need to finish converting the rest of the extensions to use it [14:53:22] could we potentially extract those dependencies from extension.json or the exts composer.json ? [14:54:22] in the future yes! [14:54:55] ok [14:55:37] so I am not sure it makes sense to move the dependency list from Jenkins job to Zuul and then back to a slave script that extract them out of extensions [14:55:44] can we move the dependency setup to a slave script ? [14:56:24] potentially from a yaml file in integration/config [14:56:34] might point being to avoid adding that logic in zuul [14:56:52] I think it should stay in the integration/config repo, anywhere else would be confusing [14:58:34] yup [14:58:47] I originally had it in a yaml file, but couldn't figure out some weird path issues, so I ended up just putting it in the python file [14:58:58] yeah [14:59:01] not a big deal [14:59:07] it is all deployed already and working right ? [14:59:23] yes! [14:59:27] we can factor that list out of zuul eventually [14:59:41] sold ? [15:00:10] :D [15:00:15] #agreed move extension dependencies list out of Zuul python functions to a flat yaml file + add a slave script fetching it and setting up the deps. To be investigated. [15:00:28] I guess we can talk about it during the hackathon :} [15:00:34] legoktm: anything else or should we close? [15:00:42] you might want to take your breakfast now hehe [15:00:52] that's it from me [15:01:14] anyone wanna bring up something? [15:05:14] legoktm: thank you !! [15:05:15] #endmeeting [15:05:16] Meeting ended Tue May 19 15:05:15 2015 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) [15:05:16] Minutes: https://tools.wmflabs.org/meetbot/wikimedia-office/2015/wikimedia-office.2015-05-19-14.07.html [15:05:16] Minutes (text): https://tools.wmflabs.org/meetbot/wikimedia-office/2015/wikimedia-office.2015-05-19-14.07.txt [15:05:16] Minutes (wiki): https://tools.wmflabs.org/meetbot/wikimedia-office/2015/wikimedia-office.2015-05-19-14.07.wiki [15:05:16] Log: https://tools.wmflabs.org/meetbot/wikimedia-office/2015/wikimedia-office.2015-05-19-14.07.log.html