[08:44:10] (03PS1) 10Kosta Harlan: BrowserTests: Rework npm parallel install using ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 [08:46:47] (03CR) 10Kosta Harlan: Parallelism as a command object (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [08:47:57] (03CR) 10jerkins-bot: [V: 04-1] BrowserTests: Rework npm parallel install using ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [08:50:57] (03PS2) 10Kosta Harlan: BrowserTests: Rework npm parallel install using ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 [09:52:57] (03Restored) 10Kosta Harlan: [DNM] Add more dependencies to full run to check build time [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 (owner: 10Kosta Harlan) [09:53:04] (03PS5) 10Kosta Harlan: [DNM] Add more dependencies to full run to check build time [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 [09:53:38] (03PS6) 10Kosta Harlan: [DNM] Add more dependencies to full run to check build time [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 [10:00:16] (03PS7) 10Kosta Harlan: [DNM] Add more dependencies to full run to check build time [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 [10:03:29] (03CR) 10jerkins-bot: [V: 04-1] [DNM] Add more dependencies to full run to check build time [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 (owner: 10Kosta Harlan) [10:07:42] (03PS8) 10Kosta Harlan: [DNM] Add more dependencies to full run to check ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 [10:13:03] (03CR) 10jerkins-bot: [V: 04-1] [DNM] Add more dependencies to full run to check ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 (owner: 10Kosta Harlan) [10:21:31] (03PS19) 10Kosta Harlan: Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 (owner: 10Awight) [10:21:33] (03PS3) 10Kosta Harlan: BrowserTests: Rework npm parallel install using ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 [10:21:36] (03PS9) 10Kosta Harlan: [DNM] Add more dependencies to full run to check ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 [10:21:39] (03PS1) 10Kosta Harlan: ParallelCommand: Fallback to default of two workers [integration/quibble] - 10https://gerrit.wikimedia.org/r/754873 [10:23:01] (03CR) 10Kosta Harlan: Parallelism as a command object (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [10:27:30] (03CR) 10jerkins-bot: [V: 04-1] [DNM] Add more dependencies to full run to check ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 (owner: 10Kosta Harlan) [10:31:26] (03PS2) 10Kosta Harlan: ParallelCommand: Fallback to default of two workers [integration/quibble] - 10https://gerrit.wikimedia.org/r/754873 [10:31:30] (03PS20) 10Kosta Harlan: Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 (owner: 10Awight) [10:31:36] (03PS4) 10Kosta Harlan: BrowserTests: Rework npm parallel install using ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 [10:31:42] (03PS10) 10Kosta Harlan: [DNM] Add more dependencies to full run to check ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 [10:37:33] (03CR) 10jerkins-bot: [V: 04-1] [DNM] Add more dependencies to full run to check ParallelCommand [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 (owner: 10Kosta Harlan) [10:42:57] (03CR) 10Kosta Harlan: "I'm not sure why this doesn't work. Locally I see e.g." [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 (owner: 10Kosta Harlan) [10:52:06] (03CR) 10Kosta Harlan: "I still get errors when running the unit tests on macOS, though: https://gitlab.wikimedia.org/-/snippets/12" [integration/quibble] - 10https://gerrit.wikimedia.org/r/754873 (owner: 10Kosta Harlan) [12:26:36] kostajh: Do you have os.cpu_count() ? [12:44:28] awight: yes [12:45:20] but maybe affinity is better for CI? https://stackoverflow.com/questions/64189176/os-sched-getaffinity0-vs-os-cpu-count [12:45:32] I don't like the error you linked, either... [12:47:03] kostajh: I've been wondering about that, too. [12:47:07] I found, > By default the affinity is set to all cores [12:47:55] and os.cpu_count is supposed to return the number of virtual cores, not physical, so I think it will report the ideal number of workers as long as nothing messes with the core affinity in CI. [12:48:33] s/I found/in the helpful SO answer you linked/ ;-) [12:48:43] also, > Note that despite the fact the docs here speak of "process", setting affinity really is a per-thread thing [12:49:58] looks like a thread would have to set sched_setaffinity in order for getaffinity to give a surprising result. [12:51:41] (03CR) 10Awight: [C: 03+1] ParallelCommand: Fallback to default of two workers (032 comments) [integration/quibble] - 10https://gerrit.wikimedia.org/r/754873 (owner: 10Kosta Harlan) [12:53:35] (03CR) 10Awight: Parallelism as a command object (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [12:55:54] (03CR) 10Awight: Parallelism as a command object (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [13:00:38] (03PS51) 10Awight: Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [13:01:43] (03CR) 10Kosta Harlan: [C: 03+1] Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [13:02:09] (03CR) 10Awight: "PS 51: fall back to serial execution if cpu count is unavailable. Use more stable os.cpu_count API." [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [13:15:34] I made a pseudorandom choice... [13:56:02] (03CR) 10Awight: "What about running the NpmInstall in the same thread as each browser test? This avoids some of the inefficiency you pointed out, of fanni" [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [13:56:31] (03CR) 10Awight: "Should include a test." [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [13:57:10] (03CR) 10Awight: BrowserTests: Rework npm parallel install using ParallelCommand (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [14:32:10] (03CR) 10Awight: [DNM] Add more dependencies to full run to check ParallelCommand (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/738066 (owner: 10Kosta Harlan) [14:32:46] (03CR) 10Awight: BrowserTests: Rework npm parallel install using ParallelCommand (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [14:44:44] (03CR) 10Kosta Harlan: BrowserTests: Rework npm parallel install using ParallelCommand (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [14:46:26] (03CR) 10Awight: BrowserTests: Rework npm parallel install using ParallelCommand (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [14:52:57] (03CR) 10Kosta Harlan: BrowserTests: Rework npm parallel install using ParallelCommand (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/754866 (owner: 10Kosta Harlan) [15:27:08] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), and 2 others: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10Lucas_Werkmeister_WMDE)