[00:22:51] 06Labs, 10Labs-Infrastructure, 10Icinga, 10Monitoring, 06Operations: labtestcontrol2001 should not make Icinga page us - https://phabricator.wikimedia.org/T120047#2829483 (10Dzahn) 05Open>03Resolved @volans This should resolve it, i enabled the notifications again, for the services on these hosts and... [00:23:39] 06Labs, 10Labs-Infrastructure, 10Icinga, 10Monitoring, 06Operations: labtestcontrol2001 should not make Icinga page us - https://phabricator.wikimedia.org/T120047#2829485 (10Dzahn) @chasemp we might see labtest* notifications again in email and IRC but not via SMS [00:28:54] 06Labs, 10Labs-Infrastructure: set apt to Wikimedia mirror instead of http://nova.clouds.archive.ubuntu.com/ubuntu/ - https://phabricator.wikimedia.org/T68121#2829490 (10scfc) I tested this twice with `toollabs::node::compute::general` and `toollabs::compute` (ignoring errors & Co.) with the default `sources.l... [00:53:27] Anyone know where the source code is for whatever table/view generates watchlist_count ? [02:30:34] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Armyboy2 was modified, changed by Armyboy2 link https://wikitech.wikimedia.org/w/index.php?diff=1037874 edit summary: [02:36:03] 06Labs, 10DBA: Querying the logging table on labs is slow - https://phabricator.wikimedia.org/T131266#2829625 (10MZMcBride) >>! In T131266#2272853, @MZMcBride wrote: > Something is funky with the views for `logging` and `logging_userindex` specifically, it seems. I rediscovered this issue over the weekend. `... [03:42:18] PROBLEM - Puppet run on tools-worker-1001 is CRITICAL: CRITICAL: 33.33% of data above the critical threshold [0.0] [03:44:22] PROBLEM - Puppet run on tools-prometheus-01 is CRITICAL: CRITICAL: 60.00% of data above the critical threshold [0.0] [03:53:24] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 2 others: Developing community norms for vital bots and tools - https://phabricator.wikimedia.org/T149312#2829675 (10bd808) @Qgil I'm guessing that my 4 tokens + 1 comment is a pretty weak argument for a main room topic at this stage? [04:17:16] RECOVERY - Puppet run on tools-worker-1001 is OK: OK: Less than 1.00% above the threshold [0.0] [04:19:18] RECOVERY - Puppet run on tools-prometheus-01 is OK: OK: Less than 1.00% above the threshold [0.0] [04:51:59] (03CR) 10BryanDavis: [C: 032] Allow OAuth authentication for anon users [labs/striker] - 10https://gerrit.wikimedia.org/r/313137 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:52:52] (03CR) 10BryanDavis: [C: 032] Add account creation initial screen [labs/striker] - 10https://gerrit.wikimedia.org/r/313138 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:53:12] (03Merged) 10jenkins-bot: Allow OAuth authentication for anon users [labs/striker] - 10https://gerrit.wikimedia.org/r/313137 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:53:56] (03Merged) 10jenkins-bot: Add account creation initial screen [labs/striker] - 10https://gerrit.wikimedia.org/r/313138 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:55:46] (03CR) 10BryanDavis: [C: 032] Collect data needed to create a new LDAP account [labs/striker] - 10https://gerrit.wikimedia.org/r/313139 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:56:24] (03CR) 10BryanDavis: [C: 032] Add check for unique sul account, username, and shell account [labs/striker] - 10https://gerrit.wikimedia.org/r/313140 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:56:53] (03Merged) 10jenkins-bot: Collect data needed to create a new LDAP account [labs/striker] - 10https://gerrit.wikimedia.org/r/313139 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:57:41] (03Merged) 10jenkins-bot: Add check for unique sul account, username, and shell account [labs/striker] - 10https://gerrit.wikimedia.org/r/313140 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:57:43] (03CR) 10BryanDavis: [C: 032] Add confirmation step to account creation wizard [labs/striker] - 10https://gerrit.wikimedia.org/r/313141 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [04:58:29] (03Merged) 10jenkins-bot: Add confirmation step to account creation wizard [labs/striker] - 10https://gerrit.wikimedia.org/r/313141 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [05:24:46] !log tools.jouncebot Testing cherry-pick of https://gerrit.wikimedia.org/r/#/c/322037 [05:24:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.jouncebot/SAL [06:43:58] 06Labs, 10Labs-Infrastructure, 10DBA, 10Datasets-General-or-Unknown, 13Patch-For-Review: Provision db1095 with at least 1 shard, sanitize and test slave-side triggers - https://phabricator.wikimedia.org/T150802#2829736 (10Marostegui) The replication for both threads had no issues during the night so what... [06:48:53] PROBLEM - Puppet run on tools-exec-gift is CRITICAL: CRITICAL: 55.56% of data above the critical threshold [0.0] [06:53:22] (03CR) 10Legoktm: "Is it possible to keep the non-minified files in the source repo, and then move the minification and source-mapification as a build step?" [labs/striker] - 10https://gerrit.wikimedia.org/r/313142 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [07:23:54] RECOVERY - Puppet run on tools-exec-gift is OK: OK: Less than 1.00% above the threshold [0.0] [07:31:16] 06Labs, 10Labs-Infrastructure, 10DBA: Migrate existing labs users from the old servers, if possible using roles and start maintaining users on the new database servers, too - https://phabricator.wikimedia.org/T149933#2829832 (10jcrespo) Yes, I wanted to set something like 10 max connections for the web reque... [08:58:43] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 2 others: Developing community norms for vital bots and tools - https://phabricator.wikimedia.org/T149312#2829944 (10Niharika) Don't forget 7 subscribers! :) [09:27:20] 06Labs, 06Operations, 10wikitech.wikimedia.org: Can't login wikitech - https://phabricator.wikimedia.org/T144805#2829987 (10Shizhao) no, still can't login, "Please enter verification code from your mobile app" [09:27:47] 06Labs, 06Operations, 10wikitech.wikimedia.org: Can't login wikitech - https://phabricator.wikimedia.org/T144805#2829990 (10Shizhao) 05Resolved>03Open [10:48:10] 06Labs, 10Tool-Labs, 06Community-Tech-Tool-Labs, 06Developer-Relations, and 2 others: Developing community norms for vital bots and tools - https://phabricator.wikimedia.org/T149312#2830209 (10Qgil) If unsure, we can keep it "on track" for now. @bd808 what is important is that you start prioritizing propos... [11:09:22] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Magul was created, changed by Magul link https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Access_Request/Magul edit summary: Created page with "{{Tools Access Request |Justification=Mainly to debug issues in Tools instalation of shared Pywikibot (see e.g.: https://phabricator.wikimedia.org/T151850) |Completed=false |U..." [12:05:22] (03PS1) 10Jcrespo: Add fake maintainviews passwords for puppet compilation [labs/private] - 10https://gerrit.wikimedia.org/r/324148 [12:05:59] (03CR) 10Jcrespo: [C: 032 V: 032] Add fake maintainviews passwords for puppet compilation [labs/private] - 10https://gerrit.wikimedia.org/r/324148 (owner: 10Jcrespo) [12:08:59] PROBLEM - Puppet run on tools-exec-1403 is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [13:23:30] 06Labs, 10Labs-Infrastructure, 10DBA, 10Datasets-General-or-Unknown, 13Patch-For-Review: Provision db1095 with at least 1 shard, sanitize and test slave-side triggers - https://phabricator.wikimedia.org/T150802#2830561 (10jcrespo) >>! In T150802#2829736, @Marostegui wrote: > @jcrespo thanks for the detai... [13:24:47] 06Labs, 06Operations, 10wikitech.wikimedia.org: Can't login wikitech - https://phabricator.wikimedia.org/T144805#2830569 (10Reedy) This is why people shouldn't pile on with "me too" requests on the same bug for the same thing when it directly affects their account [13:28:01] 06Labs, 10DBA: Prepare and check storage layer for new fi.wikivoyage.org - https://phabricator.wikimedia.org/T151756#2830575 (10jcrespo) Standing by until the database is actually created: ``` $ mysql --socket=/tmp/mysql.s3.sock fiwikivoyage ERROR 1049 (42000): Unknown database 'fiwikivoyage' ``` [13:28:06] 06Labs, 06Operations, 10wikitech.wikimedia.org: Can't login wikitech - https://phabricator.wikimedia.org/T144805#2830577 (10Reedy) 05Open>03Resolved [13:43:20] !log updating jouncebot so it properly reclaim its nick ( T150916 https://gerrit.wikimedia.org/r/#/c/324025/ ) [13:43:29] Unknown project "updating" [13:43:29] T150916: Jouncebot: Add functionality to change Nick from Jouncebot_ to Jouncebot automatically - https://phabricator.wikimedia.org/T150916 [13:43:36] !log tools updating jouncebot so it properly reclaim its nick ( T150916 https://gerrit.wikimedia.org/r/#/c/324025/ ) [13:43:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [13:50:58] 10Tool-Labs-tools-Pageviews: Change date format in Pageviews tool (and related tools) to YYYY-MM-DD - https://phabricator.wikimedia.org/T151875#2830641 (10Wittylama) [14:16:27] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Armyboy2 was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=1041434 edit summary: [14:20:32] Change on 12wikitech.wikimedia.org a page Nova Resource:Tools/Access Request/Magul was modified, changed by Tim Landscheidt link https://wikitech.wikimedia.org/w/index.php?diff=1041469 edit summary: [15:13:58] 06Labs, 10Labs-Infrastructure, 05Continuous-Integration-Scaling, 13Patch-For-Review: Bump quota of Nodepool instances (contintcloud tenant) - https://phabricator.wikimedia.org/T133911#2830989 (10hashar) 05Open>03Resolved a:03hashar Nodepool loaded the new configuration and the OpenStack quota have be... [15:13:59] 06Labs, 07Tracking: Existing Labs project quota increase requests (Tracking) - https://phabricator.wikimedia.org/T140904#2830994 (10hashar) [15:26:09] 06Labs, 06Operations: Kill the labtest $realm - https://phabricator.wikimedia.org/T148717#2831044 (10chasemp) a:03Andrew [15:27:25] 10Tool-Labs-tools-Pageviews: Allow Langviews tool to track multiple articles, with reference to its Wikidata Q number - https://phabricator.wikimedia.org/T151888#2831047 (10Wittylama) [15:43:59] RECOVERY - Puppet run on tools-exec-1403 is OK: OK: Less than 1.00% above the threshold [0.0] [15:58:23] RECOVERY - Host tools-secgroup-test-102 is UP: PING OK - Packet loss = 0%, RTA = 0.35 ms [16:03:24] PROBLEM - Host tools-secgroup-test-102 is DOWN: CRITICAL - Host Unreachable (10.68.21.170) [16:09:57] PROBLEM - Puppet run on tools-exec-1403 is CRITICAL: CRITICAL: 50.00% of data above the critical threshold [0.0] [16:10:12] 06Labs, 10Labs-Infrastructure, 10DBA, 10Datasets-General-or-Unknown, 13Patch-For-Review: Provision db1095 with at least 1 shard, sanitize and test slave-side triggers - https://phabricator.wikimedia.org/T150802#2831241 (10jcrespo) This now "just works" (TM)- no need for passwords, hosts or anything: ```... [16:13:50] 10Tool-Labs-tools-Pageviews: Change date format in Pageviews tool (and related tools) to YYYY-MM-DD - https://phabricator.wikimedia.org/T151875#2831248 (10MusikAnimal) @Wittylama The date format should go off of your computer and/or browser settings, which I assume you have set to US English. You can force ISO 8... [16:14:57] milimetric: would you mind re-sending your email to labs-l rather than labs-announce? I try to keep discussion off of -announce to keep it low traffic. [16:15:06] oh, you sent it to both [16:15:14] nevermind, I'll just discard the one to -announce [16:15:22] sorry, didn't see -announce in the cc [16:15:44] np [16:16:54] 06Labs, 10Labs-Infrastructure, 10DBA, 10Datasets-General-or-Unknown, 13Patch-For-Review: Provision db1095 with at least 1 shard, sanitize and test slave-side triggers - https://phabricator.wikimedia.org/T150802#2831261 (10Marostegui) >>! In T150802#2831241, @jcrespo wrote: > This now "just works" (TM)- n... [16:17:44] RECOVERY - Host tools-secgroup-test-103 is UP: PING OK - Packet loss = 0%, RTA = 1.86 ms [16:18:27] 10Tool-Labs-tools-Pageviews: Change date format in Pageviews tool (and related tools) to YYYY-MM-DD - https://phabricator.wikimedia.org/T151875#2831262 (10Wittylama) Thank you very much. Yes - that does work. Oddly though, my computer is NOT set to US english standard - it is DD/MM/YYYY. But that's not your pro... [16:20:39] PROBLEM - Host tools-secgroup-test-103 is DOWN: CRITICAL - Host Unreachable (10.68.21.22) [16:21:17] 06Labs, 10Labs-Infrastructure, 10DBA, 10Datasets-General-or-Unknown, 13Patch-For-Review: Provision db1095 with at least 1 shard, sanitize and test slave-side triggers - https://phabricator.wikimedia.org/T150802#2831274 (10jcrespo) Note wiki list are already locally there, too. To get a list of public wik... [16:24:41] RECOVERY - Host secgroup-lag-102 is UP: PING OK - Packet loss = 0%, RTA = 6.48 ms [16:25:03] 06Labs, 10Labs-Infrastructure, 10DBA, 10Datasets-General-or-Unknown, 13Patch-For-Review: Provision db1095 with at least 1 shard, sanitize and test slave-side triggers - https://phabricator.wikimedia.org/T150802#2831293 (10Marostegui) The following queries in `enwiki` gave no records so the first iteratio... [16:33:18] PROBLEM - Host secgroup-lag-102 is DOWN: CRITICAL - Host Unreachable (10.68.17.218) [16:35:25] (03CR) 10BryanDavis: "> Is it possible to keep the non-minified files in the source repo," [labs/striker] - 10https://gerrit.wikimedia.org/r/313142 (https://phabricator.wikimedia.org/T144710) (owner: 10BryanDavis) [17:02:23] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831420 (10bd808) [17:03:45] 06Labs, 10Labs-Infrastructure: Redirecting to a page on beta labs doesn't work - https://phabricator.wikimedia.org/T151894#2831435 (10bmansurov) [17:05:20] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831454 (10Andrew) Works for me [17:19:57] RECOVERY - Puppet run on tools-exec-1403 is OK: OK: Less than 1.00% above the threshold [0.0] [17:26:09] trying to learn how to use wikimedia labs. in the help pages i see that once in bastion i have to type ssh [17:26:19] what's ? [17:28:43] You should do $ ssh -i ~/.ssh/id_rsa username@login.tools.wmflabs.org [17:29:03] thanks, I did ssh -A epantaleo@bastion.wmflabs.org [17:29:09] 10Tool-Labs-tools-Pageviews: Change date format in Pageviews tool (and related tools) to YYYY-MM-DD - https://phabricator.wikimedia.org/T151875#2831526 (10MusikAnimal) 05Open>03Invalid @Wittylama Here is a tiny script to tell you what language your browser is set to: https://jsfiddle.net/og7kpuk4/ If it is n... [17:29:44] then on bastion I should do [17:29:47] ssh your-instance.eqiad.wmflabs [17:30:07] not sure what your-instance is [17:30:17] Where is the help pages you follows? [17:30:27] https://wikitech.wikimedia.org/wiki/Help:Tool_Labs#Quick_start ? [17:30:41] https://wikitech.wikimedia.org/wiki/Help:Access [17:31:01] acess to Wikimedia labs [17:31:07] access to Wikimedia labs [17:31:55] Oh, so you are not looking into accessing "Tool Labs"? [17:32:01] no [17:33:30] 10Tool-Labs-tools-Pageviews: Allow Langviews to accept a Wikidata item - https://phabricator.wikimedia.org/T151898#2831533 (10MusikAnimal) [17:33:44] 10Tool-Labs-tools-Pageviews: Allow Langviews tool to track multiple articles, with reference to its Wikidata Q number - https://phabricator.wikimedia.org/T151888#2831047 (10MusikAnimal) Allowing user to enter a wikidata item is a very fine idea! That I will take care of first (T151898), then later I'll explore a... [17:34:32] 10Tool-Labs-tools-Pageviews: Allow Langviews to accept a Wikidata item - https://phabricator.wikimedia.org/T151898#2831533 (10MusikAnimal) [17:34:57] Check out the following documentation: https://wikitech.wikimedia.org/wiki/Help:Getting_Started#Join_Projects [17:35:31] I have my own project, just started yesterday [17:35:36] it's called etytree [17:35:47] i guess i need to create an instance not sure [17:36:07] https://wikitech.wikimedia.org/wiki/Help:Instances [17:36:13] oh found this page right now! [17:41:50] Great, good luck! [17:42:35] Epantaleo: so, what are you hoping to accomplish? [17:42:51] i'm trying to start uploading some files [17:43:10] then compile some code [17:43:31] i did ssh -A epantaleo@bastion.wmflabs.org [17:43:44] and then i'm supposed to do ssh your-instance.eqiad.wmflabs [17:44:02] what is your-instance? [17:44:10] am i suposed to start an instance? [17:44:56] What documentation are you following? [17:45:34] https://wikitech.wikimedia.org/wiki/Help:Access [17:45:49] #Accessing instances using agent forwarding [17:46:20] Is your local machine running windows? [17:46:29] no macos [17:46:35] ok [17:47:03] So two things. I'd advise you to use the ProxyCommand access method [17:47:14] which is why it says (recommended) by the title :) [17:47:45] i tried and got an error, i'll try again [17:47:55] But — I'm concerned by your question about whether or not to create an instance. That makes me think that someone blindly pointed you at a doc page but that you don't actually have a goal in mind [17:48:27] ok [17:48:39] where should i look? [17:48:44] Everything on that page is about accessing instances in your project. Since you don't have any instances in your project they definitely will not do anything [17:49:08] um… let me find your phab ticket and try to figure out what you want to do [17:52:56] if it can help i can point you to this link https://phabricator.wikimedia.org/T151762 [17:53:12] Epantaleo: so, you requested a labs project. A labs project is a container for virtual machines. [17:53:26] The fact that you requested the project leads me to assume that you have need for a VM or two. Is that right? [17:53:39] yes [17:53:43] You definitely can't access them until they exist [17:53:53] sure [17:54:11] Generally you would manage your VMs on horizon or wikitech. You have an account set up there with 2fa, right? [17:54:20] 2fa? [17:54:43] I have a wikitech account [17:55:07] you need to enable two-facter authentication in order to do any project management [17:55:15] It's an account feature, let me see if I can find a link... [17:55:51] Ah, here we go, "enable two-factor authentication on Wikitech by visiting 'Preferences->User Profile' and clicking 'Enable two-factor authentication'" [17:55:54] thanks. also what's the mx amount of RAM I can use? [17:56:01] ok [17:56:20] Epantaleo: default project quotas are visible once you're able to actually log in to Horizon :) [17:56:33] 2fa will use your smartphone as a secondary auth device. [17:56:47] I think there are how-to docs on that 'enable' page [17:56:54] and can you point me to the right doc pages where I can find how to proceed after I do 2fa? [17:57:05] you'll just visit horizon.wikimedia.org [17:57:06] and log in [17:57:11] and you should have a project management panel [17:57:19] to create VMs and such [17:57:26] it should be fairly self-explanatory [17:58:21] sorry i didn't find those instructions [17:58:25] i'll do that now [17:58:31] about 2fa you mean? [17:58:35] yes [17:58:51] ah, it's ok, things are in transition so there are multiple ways of doing things [18:03:27] 06Labs, 10Labs-Infrastructure, 10DBA, 10Datasets-General-or-Unknown, 13Patch-For-Review: Provision db1095 with at least 1 shard, sanitize and test slave-side triggers - https://phabricator.wikimedia.org/T150802#2831764 (10Marostegui) The server caught up and I can see new records coming in and being sani... [18:12:15] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831420 (10scfc) (For combatting spammers, "contentadmin" is sufficient. "admin" on wikitech has different implications; I don't doubt that @MarcoAurelio is trustworthy, just wanted to point ou... [18:12:21] andrewboggot to login to horizon i'm usin my wikitech username, password + 2fa credential but get invalid credentials [18:13:09] andrewboggot: to login to horizon i'm usin my wikitech username, password + 2fa credential but get invalid credentials [18:13:20] Epantaleo: do they work to log in to wikitech? [18:13:25] yes [18:13:34] hm, ok [18:13:39] let me see what's happening... [18:13:45] thanks [18:14:32] Just to confirm… the second factor is a 6-digit number that updates every minute on your phone, right? [18:14:51] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831420 (10Krenair) With the current admins I don't think we need to give oversight to anyone, and I think this request only needs contentadmin [18:15:01] yes [18:19:43] Epantaleo: can you try Horizon again? [18:19:50] It'll probably do the same thing but I'm watching the log output [18:20:32] i'm trying [18:21:06] failed again? [18:21:12] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831854 (10bd808) > I don't think we need to give oversight to anyone This part I disagree with. I was actually very surprised to see that we don't have anyone with the oversight role right now.... [18:21:35] yes [18:21:35] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831857 (10chasemp) I don't have any reason to think @MarcoAurelio is untrustworthy :) But I do subscribe to the idea of least privilege necessary, and I would expect @krenair and @scfc to be q... [18:21:40] failing [18:21:48] andrewbogott: wasn't there some time drift allowance difference between the two or is that fixed? [18:22:04] chasemp: it should be fixed. Anyway, it's not getting as far as checking the second factor [18:22:16] ah yes ok then [18:22:26] Epantaleo: to reconfirm, you've tried logging out of wikitech and back in with the second factor, and it works? [18:22:32] (I don't need you to do that now, just making sure) [18:22:45] correct [18:23:11] huh, ok [18:24:26] is this the right place to ask things about the tool labs too? [18:24:50] sure [18:25:46] i'll be back in 5 min [18:26:09] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831865 (10bd808) contentadmin seems uncontested, so I have added @MarcoAurelio to that group. [18:30:16] Epantaleo: I'm not positive but it looks to me like horizon is rejecting your password and not your second factor [18:32:35] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831938 (10Krenair) Yeah, okay, oversight too. Probably only grantable via shell, I'll do it when I get home assuming no objections [18:34:30] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831955 (10bd808) 05Open>03Resolved >>! In T151893#2831938, @Krenair wrote: > Yeah, okay, oversight too. Probably only grantable via shell, I'll do it when I get home assuming no objections... [18:35:10] hmm [18:38:37] Any non-ascii stuff in your password? [18:38:42] Accents, emojis? [18:38:44] no [18:38:58] capitals numbers and letters [18:39:11] It's also vaguely possible that there's something about epantaleo vs Epantaleo but I would expect to have heard about that by now if it was a problem [18:40:18] sorry, sounds difficult to sort out [18:42:38] 06Labs, 10wikitech.wikimedia.org, 15User-bd808: Sysop for MarcoAurelio - https://phabricator.wikimedia.org/T151893#2831987 (10MarcoAurelio) Hello everyone. I'm flattered for your support and I'd like to thank Bryan for this kind nomination. If it was any doubt, the main purpose for me to request access is to... [18:44:25] Epantaleo: well, anyway, you can create your VM from wikitech instead, that should get you unblocked for now [18:44:40] Just clock on 'manage instances' in the sidebar [18:44:47] and make sure your project is selected in the filter [18:45:45] when I do that I get There were no Nova credentials found for your user account. Please ask a Nova administrator to create credentials for you. [18:46:58] also i'm learing how to use tools-bastion [18:47:25] when i try to comile my code with maven I get "[ERROR] Error occurred during initialization of VM [18:47:26] [ERROR] java.lang.OutOfMemoryError: unable to create new native thread" [18:47:35] now I'm trying to compile using qsub [18:47:47] but i get an error, it doesn't find mvn [18:47:49] Epantaleo: when exactly do you see the 'no Nova credentials' page? [18:47:54] When you first log in? [18:48:13] when I do 'manage instances' [18:53:09] when I submit the job I get Error: Could not create the Java Virtual Machine. [18:53:09] Error: A fatal exception has occurred. Program will exit. [18:53:09] Warning: JAVA_HOME environment variable is not set. [18:53:10] Error occurred during initialization of VM [18:53:10] Could not reserve enough space for object heap [18:53:53] Yeah, the bastions aren't really set up to do hard work locally [18:54:23] even with qsub? [18:54:28] Epantaleo: do you have a second browser that you could try both wikitech and horizon on? [18:54:36] sure [18:54:40] No, qsub is the right way to do it, that should dispatch to a bigger host [18:54:59] that's when i get that error [18:55:00] I think there is an open bug somewhere about mvn and the job grid [18:55:04] with qsub [18:58:39] I used safari and got the same error [18:59:26] is java installed on the grid? [19:10:39] Epantaleo: could you try the horizon login one more time? (I'm testing an experimental patch) [19:11:30] doesn't work [19:11:41] ok [19:13:53] is maven installed on the grid? [19:14:21] Epantaleo: I created a VM in your project named etytree-1.etytree.eqiad.wmflabs [19:14:29] (Because I have no idea what's going on with your login and I need to eat lunch) [19:14:36] Let me know if you need one with more ram [19:15:13] I would need a lot of ram actually but let's talk when you come back :) [19:15:28] enjoy your lunch and thanks for your help [19:21:35] I had an idea, changed my password... [19:21:51] I only changed on number in the password to a different number and now it works [19:21:53] ... [19:22:26] i did that because I couldn't even do ssh etytree-1.etytree.eqiad.wmflabs [19:22:54] it was saying Permission denied (publickey,keyboard-interactive). [19:23:07] but I could definitely log into Wikitech [19:23:18] anyways, now its solved :S [19:31:49] andrewbogott: can I get more ram? [19:32:15] Hah, ok [19:32:34] um… more ram than that VM has, or more ram than your current quota? [19:32:37] in my current set up I have 32 giga of ram [19:32:45] i mean [19:32:49] in my local set up [19:32:55] i would need at least that [19:34:07] i need to set up a virtuoso dbms for a database of 3giga [19:34:25] and queries are slow if I don't have enough ram [19:34:37] in my local setup queries can be slow already [19:36:18] and you'd want all that RAM in a single VM, right? [19:36:31] yes [19:37:19] can I also have a public ip to be able to query the db from outside? [19:38:03] for quota changes we'll need you to file documentation as a subtask of https://phabricator.wikimedia.org/T140904 [19:38:19] I guess I could do everything from here but then - sorry I'm not very familiar with this - then can I have here a page for visualizations that I can access from outside? [19:38:25] basically for the front end [19:38:34] Mention that you want all the ram on a single instance [19:38:50] And — are you sure the queries can't be optimized to use less ram? It surprises me that you need 10x as much ram as the entire database just to run a query... [19:39:10] I need something like this tools.wmflabs.org/etytree/ [19:39:10] If you're just running a web service on the VM you can set up a proxy in horizon. [19:39:28] ok [19:39:57] I think so [19:40:09] it's a graph database [19:43:43] do you think I can start setting things up and then ask for more RAM or that complicates the all procedure for me? [19:43:58] *whole [19:44:40] andrewbogott: would I need to redo the setup for everything? [19:45:22] you'll need to recreate the VM entirely, we can't resize in place. [19:46:05] hmm... and there is no way of saving everything and exporting it? [19:48:34] I'm not sure what you have in mind [19:48:39] you can certainly copy files between instances [19:48:44] or puppetize your setup if you want [19:51:13] canyou point me to some documentation to understand how puppetizing works? [19:51:20] thanks alot for your help! [19:51:39] :) [19:54:36] I don't know how current this is, but there are some puppet docs (mostly about our internal use) here [19:54:37] https://wikitech.wikimedia.org/wiki/Puppet_coding [19:55:04] To use it properly you'd need to get puppet code reviewed and merged by WMF operations which is not always worth the trouble [19:55:18] Alternatively you can set up a local puppetmaster and use that to manage the other VMs in your cluster [19:55:29] It may well be overkill for your purposes, I'm not sure [19:56:06] ok thanks [19:56:44] last question: how long does it take to get more RAM? [19:56:50] :) [19:59:08] We generally review quota requests during our Monday meeting [19:59:26] ok [20:10:27] (03PS1) 10Andrew Bogott: Add new dummy file for the puppet compiler [labs/private] - 10https://gerrit.wikimedia.org/r/324258 [20:10:49] (03CR) 10Andrew Bogott: [C: 032 V: 032] Add new dummy file for the puppet compiler [labs/private] - 10https://gerrit.wikimedia.org/r/324258 (owner: 10Andrew Bogott) [20:12:38] do i have access to wikimedia dumps from wikimedia labs? [20:14:55] It may be possible to access, I'm not sure [20:18:10] Epantaleo: /public/dumps on any tools host and in some projects [20:18:20] is a (day old?) ro copy [20:18:38] I need access from a project [20:18:43] How can I do that? [20:18:52] my project etytree [20:23:29] file a task and we can figure it out Epantaleo [20:23:36] cc me [20:24:03] ok, it will be my first task :) will try thanks [20:28:48] I think I did that https://phabricator.wikimedia.org/T151933 [20:32:37] 06Labs: accessing Wiktionary dumps from etytree project - https://phabricator.wikimedia.org/T151933#2832612 (10chasemp) p:05Triage>03Normal a:03chasemp [20:32:44] Epantaleo: sure I'll look at it this week [20:33:06] thanks! [20:47:21] 06Labs, 10Labs-Infrastructure: Redirecting to a page on beta labs doesn't work - https://phabricator.wikimedia.org/T151894#2831435 (10Jdlrobson) Related (probably the same issue): T151937 [20:51:39] for now can I increase the RAM? [20:51:55] I get Exception in thread "main" java.lang.OutOfMemoryError: Java heap space [20:52:02] when I try to indec the Wiktionary dump [20:52:07] *index [20:52:20] which means I cannot do anythign [20:53:11] I'm working with the whole English wiktionary dataset [20:54:51] two things: 1 there has to be a way to work on this without loading the entire thing into memory? I know of such use cases in Python at least, and 2 it's another ticket to grow beyond the quota limits but you'll have to have some projected RAM allocation [20:54:55] Epantaleo: ^ [20:56:36] the thing is I'm not suing my software to create the index [20:57:25] wht do you mean by "you will have to have some projected RAM allocation", does it mean I have to have an idea of how much RAM I need? [20:57:32] yes [20:57:34] (sorry for my bad English) [20:57:38] no worries [20:58:25] I can see how much I use to run that command locally here [21:25:02] chasemp: found an option in the tool to use less memory, thanks for pointing it out [22:46:16] 06Labs, 06Operations, 13Patch-For-Review: Kill the labtest $realm - https://phabricator.wikimedia.org/T148717#2833365 (10faidon) These are great to see ­­­— many thanks to both of you! [22:48:16] 06Labs: accessing Wiktionary dumps from etytree project - https://phabricator.wikimedia.org/T151933#2833379 (10chasemp) next puppet run should satisfy this, let me know if not :) [22:51:21] 06Labs, 06Operations, 13Patch-For-Review: Kill the labtest $realm - https://phabricator.wikimedia.org/T148717#2833390 (10Andrew) 05Open>03Resolved I've removed all the labtest realm checks. [22:55:12] 06Labs, 10Monitoring, 06Operations: Setting up grafana should also setup Anonymous read-only access for the default org - https://phabricator.wikimedia.org/T143556#2833406 (10fgiunchedi) [23:42:37] 06Labs, 10Tool-Labs, 06WMF-Legal: Install unrar on Tool Labs - https://phabricator.wikimedia.org/T151794#2833593 (10Platonides) But is full decompression needed? Just an unrar -l would be enough to confirm that there's an extra file added, wouldn't it?