[01:45:45] halfak: yt? [01:46:01] unofficially, yes. What's up? [01:46:36] datasets/wikimedia_wikis.tsv --query=sql/editor_months.sql [01:46:47] how many concurrenct connections is that likely to use? [01:47:26] or rather, whatever launches those on stat1003 [01:48:11] I only needs to use one connection at a time. It should create one connection per slice and re-use it. [01:48:22] there are currently ~250 sleeping research connections to -store [01:48:46] Oh. that's not me. that script is reading the s[1-7] slaves because I need that fancy archive index. [01:48:54] i've raised max_connections temporarily [01:49:16] hmm [01:49:23] python 3241 halfak 257u IPv4 48131274 0t0 TCP stat1003.wikimedia.org:52352->dbstore1002.eqiad.wmnet:mysql (ESTABLISHED) [01:49:30] 3241 pts/6 S+ 41:33 /home/halfak/env/3/bin/python -tt -c from mae import query_wikis; query_wikis.main(); datasets/wikimedia_wikis.tsv --query=sql/editor_months.sql [01:49:35] sure? [01:49:37] * halfak is confirming. [01:49:49] Oh wait. Did someone change the DNS? [01:50:02] s3-analytics-slave is switched over, yes [01:50:06] (and the indexes exist) [01:50:08] There was an email about that I responded to right away with the updated index ticket. [01:50:13] ^ [01:50:15] Oh. Should be OK then. [01:50:19] yep [01:50:33] so is that many concurrent connections expeted? i should plan for it? [01:50:53] Nope [01:51:06] Are you sure that all of the connections are from that one process? [01:52:14] yes [01:52:33] on stat1003, run: lsof -i tcp | grep mysql [01:52:52] all from process 3241 [01:53:08] maybe not closing connections properly? [01:53:37] It's not supposed to close 'em. Looks like it's not sharing them properly though. [01:53:55] :) [01:54:15] So, this has been running for a few days without issue. Anything happen recently? [01:54:25] the DNS switch [01:54:33] -store had a lower max_connections [01:54:41] only reason i noticed [01:54:53] Cleared. [01:54:56] it's not a showstopper [01:55:02] jusy would be nice to know why [01:57:29] halfak: actually, i lied. s2-analytics-slave switched recently; s3 was switch a while ago because the old slave was crashing regularly [01:57:58] may have nothing to do with this [01:59:42] Yeah. Not 100% on the issue. My best guess is that I have a bug in memoization for keeping the connection. Regardless, I don't need to hold onto the connection, so I'm just going to close it after every query. [01:59:59] Once dbstore is ready, I can do this all from one connection. [02:00:05] cool [02:00:08] thanks! ;) [02:00:17] Yeah. Thanks for letting me know. [02:01:07] springle, Say, did you ever get the little wooden robot from andrewbogott? [02:01:22] hehe yeah [02:01:39] great :) [02:01:47] it was odd to be handed that in the middle of athens without warning [02:02:47] It's not often you get to connect with someone on the other side of the planet. [02:02:59] If you were on this content, I would have bought you a beer instead. [02:03:36] Or maybe both. :D [02:03:36] :D [02:04:11] it's in cube form on my desk, when not involved in some dolls game in the kids' room [02:05:31] Alright. I'm off. First thing tomorrow: figure out how to re-run this script so I only gather what I don't have already. Have a good one. :) [02:05:39] gn [13:34:33] [travis-ci] wikimedia/mediawiki-extensions-EventLogging#208 (wmf/1.24wmf8 - 3d0a016 : Reedy): The build passed. [13:34:33] [travis-ci] Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/commit/3d0a016a4c8e [13:34:33] [travis-ci] Build details : http://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/26853826 [16:07:06] (PS3) Nuria: Fix invalid users display for invalid cohort [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/136434 (owner: Milimetric) [16:12:00] (CR) Nuria: [C: 2] Fix invalid users display for invalid cohort [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/136434 (owner: Milimetric) [16:12:06] (Merged) jenkins-bot: Fix invalid users display for invalid cohort [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/136434 (owner: Milimetric) [16:38:31] ottomata: https://gerrit.wikimedia.org/r/#/c/137696/ ? (1-line typo fix) [16:38:59] +1ed [16:39:07] ottomata: danke [16:39:13] yup [17:13:53] (PS2) Nuria: Reorganize UI for report creation [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/137306 (https://bugzilla.wikimedia.org/66017) (owner: Milimetric) [17:15:43] (CR) Nuria: "Looks much better, I have changed screen a bit so message fits better" [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/137306 (https://bugzilla.wikimedia.org/66017) (owner: Milimetric) [17:18:22] (CR) Nuria: [C: 2] Reorganize UI for report creation [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/137306 (https://bugzilla.wikimedia.org/66017) (owner: Milimetric) [17:18:29] (Merged) jenkins-bot: Reorganize UI for report creation [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/137306 (https://bugzilla.wikimedia.org/66017) (owner: Milimetric) [17:24:16] (PS5) Nuria: Add Newly Registered Users metric [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/136431 (https://bugzilla.wikimedia.org/65944) (owner: Milimetric) [17:46:56] (PS6) Nuria: Add Newly Registered Users metric [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/136431 (https://bugzilla.wikimedia.org/65944) (owner: Milimetric) [17:47:17] (CR) Nuria: [C: 2] Add Newly Registered Users metric [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/136431 (https://bugzilla.wikimedia.org/65944) (owner: Milimetric) [17:47:55] (Merged) jenkins-bot: Add Newly Registered Users metric [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/136431 (https://bugzilla.wikimedia.org/65944) (owner: Milimetric) [19:36:21] (PS3) AndyRussG: WIP Create a cohort from campaign membership [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight) [19:36:29] (CR) jenkins-bot: [V: -1] WIP Create a cohort from campaign membership [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight) [19:48:44] Ack! Permissions just went crazy on stat3. [19:48:52] ottomata, something going on? [19:50:02] hmm... seems to be OK now. [19:50:20] uhh? [19:50:22] ha, ok...? [19:50:37] Yeah. I just had all of my open buffers notify me of a change on disk. [19:50:59] When I did ls -l, I saw userID and groupID rather than names. [19:51:02] Now I see names again. [19:51:43] Anyway. Seems to be fine now. -.o.- [19:56:18] Hmm... I just had a file I was editing zeroed. I'm going to switch editors and see what happens. [20:37:31] where do I find the mapping between eventlogging types and mysql types? [21:00:54] specifically, I am trying to find out what type I should be using to log large integers [21:01:02] like a uuid