[00:10:00] I don't think Ryan_Lane is around at the moment, Wikinaut [00:24:13] RECOVERY Total processes is now: OK on parsoid-spof.pmtpa.wmflabs 10.4.0.33 output: PROCS OK: 145 processes [00:39:44] RECOVERY Free ram is now: OK on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: OK: 25% free memory [01:09:42] PROBLEM Total processes is now: WARNING on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS WARNING: 172 processes [01:12:52] PROBLEM Free ram is now: WARNING on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: Warning: 17% free memory [01:14:42] RECOVERY Total processes is now: OK on bots-salebot.pmtpa.wmflabs 10.4.0.163 output: PROCS OK: 96 processes [01:52:05] Ryan_Lane: I am ready with E:OpenID but have now this gerrit problem http://dpaste.org/dhrQE/ [01:52:11] can you pls. help me ? [02:26:36] Ryan_Lane: git clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions/OpenID.git [02:26:45] ôops [02:26:47] ^ oops [02:27:06] THIS WAS WRONG Ryan_Lane: git clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions/OpenID.git [02:27:27] I meant https://gerrit.wikimedia.org/r/46198 [03:29:33] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 17% free memory [04:37:53] RECOVERY Free ram is now: OK on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: OK: 25% free memory [04:39:33] RECOVERY Free ram is now: OK on bots-4.pmtpa.wmflabs 10.4.0.64 output: OK: 21% free memory [04:41:24] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [04:45:52] PROBLEM Free ram is now: WARNING on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: Warning: 17% free memory [04:49:32] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [05:01:53] PROBLEM Free ram is now: WARNING on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: Warning: 13% free memory [05:42:33] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 19% free memory [06:28:26] PROBLEM Total processes is now: WARNING on parsoid-roundtrip4-8core.pmtpa.wmflabs 10.4.0.39 output: PROCS WARNING: 152 processes [06:32:13] PROBLEM Total processes is now: WARNING on parsoid-spof.pmtpa.wmflabs 10.4.0.33 output: PROCS WARNING: 151 processes [06:32:26] !log bots installed python-twisted on bots-4 [06:32:27] Logged the message, Master [06:33:33] RECOVERY Total processes is now: OK on parsoid-roundtrip4-8core.pmtpa.wmflabs 10.4.0.39 output: PROCS OK: 148 processes [06:34:36] !log bots installed sqlite on bots-4 [06:34:37] Logged the message, Master [06:34:57] !log bots installed sqlite3 on bots-4 [06:34:58] Logged the message, Master [06:36:53] RECOVERY Free ram is now: OK on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: OK: 29% free memory [06:37:13] RECOVERY Total processes is now: OK on parsoid-spof.pmtpa.wmflabs 10.4.0.33 output: PROCS OK: 145 processes [08:37:33] RECOVERY Free ram is now: OK on bots-4.pmtpa.wmflabs 10.4.0.64 output: OK: 20% free memory [08:39:33] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [08:40:53] RECOVERY Free ram is now: OK on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: OK: 25% free memory [08:52:33] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [08:53:53] PROBLEM Free ram is now: WARNING on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: Warning: 17% free memory [09:00:32] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 18% free memory [11:42:50] hey hashar, hope your family's ok now? [11:43:09] MaxSem: yeah much better :-] [11:43:13] MaxSem: I got varnish instance working [11:43:18] will talk about it after lunch :- ] [11:43:20] I ammm out [12:37:33] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [12:40:38] back [12:54:57] hi hashar [12:54:59] how is your family? [12:59:36] hashar, whee [13:03:52] PROBLEM Free ram is now: CRITICAL on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: Critical: 4% free memory [13:05:24] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [13:23:52] PROBLEM Current Load is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: Connection refused by host [13:24:32] PROBLEM Disk Space is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: Connection refused by host [13:25:12] PROBLEM Free ram is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: Connection refused by host [13:28:52] RECOVERY Current Load is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: OK - load average: 0.21, 0.70, 0.48 [13:29:32] RECOVERY Disk Space is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: DISK OK [13:30:12] RECOVERY Free ram is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: OK: 94% free memory [13:33:52] PROBLEM Free ram is now: WARNING on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: Warning: 9% free memory [13:40:23] PROBLEM dpkg-check is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: DPKG CRITICAL dpkg reports broken packages [13:45:22] RECOVERY dpkg-check is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.149 output: All packages OK [13:46:39] hashar, how do I deploy the change that enables MobileFrontend to Labs? [13:48:13] oh [13:48:21] MaxSem: sorry forgot to ping you post lunch [13:48:29] MaxSem: is the change in operations/mediawiki-config ? [13:49:00] that repo has a master branch for master [13:49:11] and a "newdeploy" feature branch [13:49:19] which was/is intended for git-deploy [13:49:25] and that new deploy is on beta right now :-D [13:50:02] so I should merge it to newdeploy and sync? [13:50:21] well [13:50:27] that new deploy branch is a mess [13:50:34] maybe should rebase it [13:50:50] but that is full of conflicts :/ [13:52:52] hmm [13:52:56] MaxSem: to master branch [13:53:02] I will switch beta back to master [13:54:14] mmm, I actually see only 2 rebase conflicts rebasing it on top of master [13:54:31] warning: Cannot merge binary files: wikiversions.cdb (HEAD vs. Updating wikiversions) [13:54:32] rhrmzermer [13:55:00] ryan added wikiversions.cdb to the db hehe [13:55:30] or sam [13:55:59] crazy stuff [13:56:38] ever heard of the spaghetti syndrome? You try to remove one pasta (i.e. a bug), the rest of the plate follow (more bugs !!) [13:58:07] Hello hashar! I just invited you for two small code reviews for puppet stuff. They're tiny but it would be cool to get them reviewed during European work hours. So I#d be glad if you could look at them! [13:59:53] !g I42cf5338911b85dfb194445e5bada77e0e8d10b7 [13:59:53] https://gerrit.wikimedia.org/r/#q,I42cf5338911b85dfb194445e5bada77e0e8d10b7,n,z [14:00:05] Silke_WMDE: ops will deal with them I guess :-] [14:00:13] Silke_WMDE: I can't merge changes in puppet :-] [14:00:17] oh [14:00:18] I see [14:01:40] And a question to all: Has anyone set up a labs instance as a reverse proxy or used this instance proxy stuff? [14:02:02] I found https://labsconsole.wikimedia.org/wiki/Proxy bit it's too short to help me. ;) [14:02:25] The thing is that I have more instances with wikis than IP addresses. [14:03:14] Is there more documentation anywhere? [14:10:49] Silke_WMDE: never used myself [14:11:00] i think it is something like: http://instance-name.instanceproxy.wmflabs.org/ [14:11:09] well what the labsconsole says [14:11:10] hmm [14:11:20] I am not very helpful :-] [14:11:44] yes, that page says "It works" in an apache way of putting things. But then I don't know what to do with it. [14:16:49] MaxSem: so yeah that wikiversions.cdb file is a bit messy grbbmlb [15:03:53] RECOVERY Free ram is now: OK on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: OK: 22% free memory [15:15:52] PROBLEM Free ram is now: WARNING on aggregator1.pmtpa.wmflabs 10.4.0.79 output: Warning: 19% free memory [15:28:23] PROBLEM dpkg-check is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: Connection refused by host [15:28:53] PROBLEM Current Load is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: Connection refused by host [15:29:33] PROBLEM Disk Space is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: Connection refused by host [15:29:43] PROBLEM Total processes is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: Connection refused by host [15:30:12] PROBLEM Free ram is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: Connection refused by host [15:33:22] RECOVERY dpkg-check is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: All packages OK [15:33:52] RECOVERY Current Load is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: OK - load average: 0.30, 0.79, 0.52 [15:34:34] RECOVERY Disk Space is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: DISK OK [15:34:42] RECOVERY Total processes is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: PROCS OK: 90 processes [15:35:14] RECOVERY Free ram is now: OK on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: OK: 94% free memory [15:36:44] PROBLEM Free ram is now: WARNING on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: Warning: 16% free memory [15:41:22] PROBLEM dpkg-check is now: CRITICAL on wikidata-heclient.pmtpa.wmflabs 10.4.0.176 output: DPKG CRITICAL dpkg reports broken packages [15:55:33] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 4% free memory [16:00:32] PROBLEM Free ram is now: WARNING on bots-4.pmtpa.wmflabs 10.4.0.64 output: Warning: 6% free memory [16:40:32] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [17:03:32] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [17:40:24] Silke_WMDE: At the moment you can use .instance-proxy.wmflabs.org [17:40:59] The proxy is running on a labs instance though so don't send it too much traffic :) Mike is in the process of setting things up so we can have a proxy on a production box. [17:45:32] PROBLEM Free ram is now: CRITICAL on bots-4.pmtpa.wmflabs 10.4.0.64 output: Critical: 5% free memory [19:58:23] Ryan_Lane: ping [19:58:30] ? [19:58:50] hi, have you seen, E:OpenID ready for ! [19:59:04] http://openid-wiki.instance-proxy.wmflabs.org/wiki/Main_Page [19:59:33] https://gerrit.wikimedia.org/r/#/c/46198/ [20:00:07] http://openid-wiki.instance-proxy.wmflabs.org/srv/mediawiki/skins/common/images/wiki.png [20:01:03] generic OpenID = http://openid-wiki.instance-proxy.wmflabs.org/wiki/Special:OpenIDServer/id (which brings then the login form, as requested by you ...) [20:06:23] Ryan_Lane: and his is a minor issue (enhancement) https://bugzilla.wikimedia.org/show_bug.cgi?id=44416 which I will try to fix tonight [20:09:16] Wikinaut: can you create an account for me on that wiki? [20:09:18] I can't test [20:09:29] it doesn't allow account creations [20:09:43] yes. which e-mail [20:09:48] ? [20:09:55] rlane@wikimedia.org [20:10:52] BTW, I think I have set it up to allow account creation w/ OpenID (but you dont have to), I'll create an account by mail [20:11:05] it doesn't allow it [20:11:14] only for accounts that already exist [20:15:07] hm. this is working oddly [20:15:47] let me try an application where the login is forced [20:22:32] Ryan_Lane: let me know your exact problem [20:22:42] You need to have an account [20:22:43] I'm testing to make sure it's actually a problem :) [20:22:54] the login itself is working [20:23:01] yes [20:23:07] but it's that my username that was set was weird [20:23:11] on the consumer side [20:23:18] it may have been a wordpress issue, though [20:23:27] and I wasn't forcing openid [20:23:48] you need to use this http://openid-wiki.instance-proxy.wmflabs.org/wiki/Special:OpenIDServer/id [20:23:51] yeah [20:23:53] I did [20:23:53] PROBLEM Current Load is now: CRITICAL on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: Connection refused by host [20:23:59] as I said, login was fine [20:24:13] but it set my username to http://openid-wiki.instance-proxy.wmflabs.org/wiki/Special:OpenIDServer/id on the consumer side [20:24:23] that is correct [20:24:33] no it isn't ;) [20:24:33] PROBLEM Disk Space is now: CRITICAL on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: Connection refused by host [20:24:35] see https://bugzilla.wikimedia.org/show_bug.cgi?id=44416 [20:24:41] otherwise every user would have that url [20:24:45] nonon [20:24:49] wait [20:24:50] please [20:24:52] and listen [20:24:54] now [20:25:07] I'll fix this tonight [20:25:09] and: [20:25:14] PROBLEM Free ram is now: CRITICAL on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: Connection refused by host [20:25:15] set up content on your user page [20:25:22] one character is enough [20:25:24] THEN [20:25:43] use http://openid-wiki.instance-proxy.wmflabs.org/wiki/User:Ryan_Lane as OpenID [20:26:00] there's got to be some way around that requirement [20:26:08] I do know, that you do not want this [20:26:22] I'll fix the 44416 tonight [20:26:28] but basically, it works [20:26:33] see google [20:26:44] PROBLEM Total processes is now: CRITICAL on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: Connection refused by host [20:26:46] the do NOT have a specific OpenID which has the username in it [20:26:57] they only offer a hash [20:27:29] may be safer becuase no one can "try" to hack Google OpenIDs [20:27:53] all openID authents with google start via ..../id [20:28:09] (but this is not our problem) [20:28:17] * Ryan_Lane nods [20:28:22] right. it may not be an issue at all [20:28:29] I need to so testing, which is what I mentioned :) [20:28:33] give me "the night" [20:28:50] and tomorrow, I hope, that be able to restamp the OpenID [20:28:54] RECOVERY Current Load is now: OK on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: OK - load average: 0.44, 0.88, 0.56 [20:29:11] as described in th 44416 [20:29:35] RECOVERY Disk Space is now: OK on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: DISK OK [20:29:37] I use the current version already in my production wikis [20:29:49] hope, you like the Logo [20:30:12] RECOVERY Free ram is now: OK on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: OK: 91% free memory [20:30:15] goto http://openid-wiki.instance-proxy.wmflabs.org/wiki/Special:OpenIDConvert [20:30:24] this is usually the page for a CONSUMER wiki [20:30:42] the logo not for the mass roll-out version [20:30:52] RECOVERY Free ram is now: OK on aggregator1.pmtpa.wmflabs 10.4.0.79 output: OK: 86% free memory [20:30:56] because it does not make sense [20:31:42] RECOVERY Total processes is now: OK on rt-testing1.pmtpa.wmflabs 10.4.0.149 output: PROCS OK: 83 processes [20:38:24] RECOVERY Free ram is now: OK on sube.pmtpa.wmflabs 10.4.0.245 output: OK: 22% free memory [20:41:44] RECOVERY Free ram is now: OK on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: OK: 25% free memory [20:49:53] PROBLEM Free ram is now: WARNING on wordpressbeta-precise.pmtpa.wmflabs 10.4.0.215 output: Warning: 17% free memory [20:54:44] PROBLEM Current Load is now: WARNING on parsoid-roundtrip7-8core.pmtpa.wmflabs 10.4.1.26 output: WARNING - load average: 6.57, 6.45, 5.64 [20:54:54] PROBLEM Free ram is now: WARNING on mediawiki-bugfix-kozuch.pmtpa.wmflabs 10.4.0.26 output: Warning: 13% free memory [21:11:25] PROBLEM Free ram is now: WARNING on sube.pmtpa.wmflabs 10.4.0.245 output: Warning: 14% free memory [21:12:45] <^demon> Ryan_Lane: You can nuke some svn stuff from high orbit: https://gerrit.wikimedia.org/r/#/c/45564/ [21:42:43] PROBLEM Free ram is now: WARNING on dumps-bot1.pmtpa.wmflabs 10.4.0.4 output: Warning: 19% free memory [22:02:52] RECOVERY Free ram is now: OK on dumps-bot1.pmtpa.wmflabs 10.4.0.4 output: OK: 27% free memory [22:16:42] PROBLEM dpkg-check is now: CRITICAL on build1.pmtpa.wmflabs 10.4.0.184 output: DPKG CRITICAL dpkg reports broken packages [22:48:42] RECOVERY Free ram is now: OK on abogott-request-tracker.pmtpa.wmflabs 10.4.1.48 output: OK: 34% free memory [23:16:43] RECOVERY dpkg-check is now: OK on build1.pmtpa.wmflabs 10.4.0.184 output: All packages OK [23:26:47] PROBLEM Free ram is now: WARNING on abogott-request-tracker.pmtpa.wmflabs 10.4.1.48 output: Warning: 9% free memory [23:43:54] PROBLEM Current Load is now: CRITICAL on proposals-01.pmtpa.wmflabs 10.4.0.188 output: Connection refused by host [23:44:34] PROBLEM Disk Space is now: CRITICAL on proposals-01.pmtpa.wmflabs 10.4.0.188 output: Connection refused by host [23:44:44] PROBLEM Current Load is now: WARNING on ve-roundtrip2.pmtpa.wmflabs 10.4.0.162 output: WARNING - load average: 5.91, 6.19, 5.38 [23:45:14] PROBLEM Free ram is now: CRITICAL on proposals-01.pmtpa.wmflabs 10.4.0.188 output: Connection refused by host [23:46:44] PROBLEM Total processes is now: CRITICAL on proposals-01.pmtpa.wmflabs 10.4.0.188 output: Connection refused by host [23:47:24] PROBLEM dpkg-check is now: CRITICAL on proposals-01.pmtpa.wmflabs 10.4.0.188 output: Connection refused by host [23:48:54] RECOVERY Current Load is now: OK on proposals-01.pmtpa.wmflabs 10.4.0.188 output: OK - load average: 0.75, 0.99, 0.57 [23:49:14] PROBLEM Current Load is now: WARNING on bots-sql1.pmtpa.wmflabs 10.4.0.52 output: WARNING - load average: 16.20, 13.77, 7.69 [23:49:34] RECOVERY Disk Space is now: OK on proposals-01.pmtpa.wmflabs 10.4.0.188 output: DISK OK [23:50:22] RECOVERY Free ram is now: OK on proposals-01.pmtpa.wmflabs 10.4.0.188 output: OK: 91% free memory [23:51:42] RECOVERY Total processes is now: OK on proposals-01.pmtpa.wmflabs 10.4.0.188 output: PROCS OK: 83 processes [23:52:22] RECOVERY dpkg-check is now: OK on proposals-01.pmtpa.wmflabs 10.4.0.188 output: All packages OK [23:54:42] RECOVERY Current Load is now: OK on ve-roundtrip2.pmtpa.wmflabs 10.4.0.162 output: OK - load average: 2.29, 4.08, 4.92