[03:01:27] https://twitter.com/Rosiestep/status/1093978368695914496 [03:01:31] mmm, feedback loops [03:24:03] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 1081 MB (5% inode=92%); [04:54:03] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 1043 MB (5% inode=92%); [06:04:57] 10ORES, 10Scoring-platform-team: Implement sentinel for ORES production Redis - https://phabricator.wikimedia.org/T122676 (10Joe) Personally speaking, I think the real blocker is proper resourcing for doing this work, which isn't something we can do as a side job. Using redis-sentinel while maintaining our ope... [06:24:06] PROBLEM - check disk on ORES-web02.Experimental is WARNING: DISK WARNING - free space: / 1005 MB (5% inode=92%); [06:26:02] RECOVERY - check disk on ORES-web02.Experimental is OK: DISK OK [10:18:09] o/ [10:18:22] I'm trying to build a test helm chart for ores [10:18:27] let's see how it goes [12:02:16] Can't do it, it's too complex for me. Going pure kubernetes for now :D [12:23:45] https://github.com/wikimedia/ores/pull/317 [12:23:51] (Documentation) [12:25:32] I need to leave, will be back soon [12:27:48] wikimedia/ores#1289 (docker_readme - 187edd8 : Amir Sarabadani): The build passed. https://travis-ci.org/wikimedia/ores/builds/497012496 [14:38:27] o/ [14:38:44] hi halfak [14:39:02] o/ Zppix :) [14:39:23] halfak: what can i break for you guys today? [14:39:35] heh. I think I'm mostly writing today. [14:39:45] halfak: lol ok [17:01:18] harej, looks like it is just you and me for the retro today. Shall we skip it? [17:03:48] Woops! Looks like I forgot to invite anyone anyway :) [17:03:58] Must have made that meeting while side-tracked. [17:04:39] So yeah, ignore me. Looks like we'll retro again in a couple of weeks. Sound OK? [17:04:45] (I'll be AFK next Friday) [17:06:39] 10ORES, 10Scoring-platform-team, 10Operations: [Discuss] ORES without celery - https://phabricator.wikimedia.org/T216838 (10Halfak) [17:08:23] 10ORES, 10Scoring-platform-team: Implement sentinel for ORES production Redis - https://phabricator.wikimedia.org/T122676 (10Halfak) > submitting jobs from changeprop to an uWSGI endpoint directly Aren't we doing this already? > rearchitect ORES completely to avoid the use of celery I'm not sure I understan... [17:08:39] halfak: yes that sounds okay. there was no retro on my calendar [17:08:59] Right. Invited are now out, but nevermind the one for today. Sorry for the confusion. [17:09:03] *invites [17:09:10] * harej hums to himself... "there was no retro on my calendar / late night when you need my love..." [19:08:00] Switching locations. Back in 40 [19:54:48] back [20:29:41] (03CR) 10Hashar: [C: 03+1] "recheck" [extensions/JADE] - 10https://gerrit.wikimedia.org/r/490989 (owner: 10Umherirrender) [20:33:43] (03CR) 10jerkins-bot: [V: 04-1] build: Set private: true in package.json [extensions/JADE] - 10https://gerrit.wikimedia.org/r/490989 (owner: 10Umherirrender) [22:11:27] Alright. Time for me to hit the road. The topic embeddings proposal is almost done. The only remaining parts are implementation discussions. I need to do a bit of reading this weekend about how to index into dense vectors. [22:11:30] o/