[06:35:53] (03CR) 10Krinkle: "(first commit I see in this repo) Does this have tests?" [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/388858 (owner: 10Legoktm) [15:03:37] Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @addshore & @Christoph_Jauera_(WMDE) - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [16:03:52] Technical Advice IRC meeting starting now in channel #wikimedia-tech, hosts: @addshore & @Christoph_Jauera_(WMDE) - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting [16:22:34] were there any changes in vagrant user setup recently? I'm getting tons of permission errors on my vagrant install [16:26:40] SMalyshev: not that I'm aware of. Are you having troubles on a Cloud VPS VM or your local laptop? [16:26:48] local image [16:27:14] constant permission errors when trying composer update, provision, etc. [16:27:41] looks like something wrong with shared drive space [16:28:18] *nod* that does sound like a mount problem [16:29:06] I saw something about a bug in a new version of either vagrant or virtualbox... [16:29:38] https://www.mediawiki.org/w/index.php?title=MediaWiki-Vagrant&diff=2600366&oldid=2594948 [16:29:46] "The latest VirtualBox (5.2.0) does not work with the latest Vagrant (2.0.0). Please install VirtualBox 5.1.30." [16:31:14] I have 5.0 [16:31:32] 5.0.26 [16:43:42] some other random problem then unfortunately [16:44:52] bd808: who should own shard drive on vagrant side? [16:46:05] my /vagrant has vagrant:www-data ownership [16:46:19] I use the vbox shares and not NFS [16:46:27] aha... because I had vagrant_share user owning it... something must have changed [16:46:34] I can't remember if that makes a difference or not [16:46:38] I'll try to reprovision [16:47:57] I think that vagrant_share:vagrant_share is the owner if you are mounting into the VM via NFS [16:48:12] (03PS1) 10Arturo Borrero Gonzalez: passwords: add labs key for arturo [labs/private] - 10https://gerrit.wikimedia.org/r/390027 [16:48:16] bd808: did you ever encounter problem of hhvm locking up after install? [16:48:55] basically if you install hhvm it tries to run systemctl start hhvm or something like that and that locks up [16:49:16] that doesn't sounds good :/ [16:49:41] yes. completely blocks provision, sing dpkg can't install anything [16:49:47] I don't remember seeing that behavior, but I haven't built a new VM for quite a while [16:50:16] I live in the land of Python and OpenStack these days [16:50:25] bd808: I need to look at it again, but my of my tools needs MyISAM database since IIRC its the only one that support r-indexes / geometry [16:50:35] that's what was happening to me, I had to completely block hhvm service, fortunately I use php to debug, but something seems to be broken :( [16:50:46] it is possible it's my vagrant VM of course.... [16:51:59] systemctl start hhvm.service is just hanging there, doing nothing, forever [16:52:25] SMalyshev: do you know what hhvm package version that is? [16:52:51] it looks like I have 3.18.5+dfsg-1+wmf1 [16:53:38] hhvm/jessie-wikimedia,now 3.18.5+dfsg-1+wmf1 amd64 [installed] [16:55:05] weird [16:55:45] that package has been in our apt for quite a while. Seems like I would have heard something by know if the problem was endemic [16:56:27] I wonder if its something like your VM's /var/run being full and that blocking the startup [16:57:08] ok new thing now: UnexpectedValueException: The stream or file "/vagrant/logs/mediawiki-wikidatawiki-debug.log" could not be opened: failed to open stream: Permission denied in /vagrant/mediawiki/vendor/monolog/monolog/src/Monolog/Handler/StreamHandler.php on line 107 [16:57:25] that's mount permission issues [16:57:49] drwxr-xr-x 1 www-data www-data 1870 Nov 8 03:10 /vagrant/logs/ [16:57:55] is this not correct? [16:58:06] that looks right [16:58:08] that worked yesterday :( I run unit tests all the time [16:58:28] did something change in how I supposed to run tests? [16:58:56] I do php tests/phpunit/phpunit.php --wiki=wikidatawiki extensions/WikidataBuildResources/extensions/Wikibase/repo/tests/phpunit/includes/Search/Elastic/EntitySearchElasticTest.php [16:59:01] that used to work [16:59:21] does /vagrant/logs/mediawiki-wikidatawiki-debug.log exist? [16:59:29] yes [16:59:38] who owns it? [16:59:45] www-data [17:00:13] oh.. and you are trying to run tests as the vagrant user? [17:00:22] yes, always did so [17:00:31] used to work just fine [17:00:47] that should always cause permissions issues with logs ... [17:01:00] so what should I do instead? [17:01:48] my alias for running tests is: sudo -u www-data /vagrant/mediawiki/tests/phpunit/phpunit.php --wiki=wiki --colors --strict --verbose --debug [17:01:55] I've been running it like that since forever and everything was fine... until couple of days ago I started having weird permissions errors when doing composer updates, etc. I've reprovisioned it and now this :( [17:02:06] oops there is a php5 in there too [17:02:43] sudo -u www-data php5 /vagrant/mediawiki/tests/phpunit/phpunit.php --wiki=wiki --colors --strict --verbose --debug [17:03:05] but I need different wikis :( [17:03:22] thats just the --wiki=wiki part [17:03:42] hmm ok will try that. But why did it work just fine yesterday? [17:04:19] I *think* that the NFS mount setup tries to collapse all the permissions to a single user [17:04:34] the virtualbox setup doesn't [17:04:53] I think I has been using nfs before [17:05:07] I ran away from using NFS mounts years ago because of random problems [17:05:08] but I have no idea, how can I check? [17:05:12] but others have been fine wit them [17:05:46] run `mount | grep /vagrant` and look at the mount type [17:06:11] "type vboxsf" if it is using native virtualbox shares [17:06:13] vagrant-logs on /vagrant/logs type vboxsf (rw,nodev,relatime) [17:06:16] hmm [17:06:32] SMalyshev: what's your host os? [17:06:45] I think I may have an idea of what happened [17:06:58] this is new, it didn't have separate mount for logs before [17:07:03] bd808: macos [17:08:05] SMalyshev: did you recently update your mw-vagrant clone? [17:08:13] This change bit you I bet -- https://phabricator.wikimedia.org/rMWVA66aa4c4abbddf900ceb33d823095f42bd221160d [17:08:36] it has been landed for a long time, but maybe you just caught it? [17:08:37] yes, because I started having permission errors all over the place, so I decided maybe I need to update something [17:08:46] the of course it became worse [17:10:07] ok, thanks, I'll try with this... this may be the difference [17:10:17] if `vagrant config --get nfs_shares` on your host says `false` then you may want to run `vagrant config nfs_shares on` to go back to NFS [17:16:01] bd808: ok NFS works but now /vagrant is owned by vagrant_share:dialout [17:16:10] I suspect it is wrong [17:16:42] SMalyshev: no, I think that is correct for NFS [17:16:44] it brings the same user id from host system :( [17:16:55] but won't that lead to permission problems again? [17:17:18] the nfs setup does uid folding [17:17:38] so you see weird looking ownership inside the container [17:17:57] because it is using the uid:gid of your user on the host [17:18:16] ok on the plus side phpunit runs again [17:19:28] hmm don't see permission errors yet... but it may be because I've already updated everything [17:19:28] (03CR) 10Legoktm: "Nope :( I was planning to just try it out during the next run and see how it goes." [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/388858 (owner: 10Legoktm) [17:19:29] will watch for it [17:19:30] bd808: thanks for your help! [17:19:50] yw [18:21:39] (03CR) 10Jforrester: [C: 031] Improve "composer fix" setting [labs/libraryupgrader] - 10https://gerrit.wikimedia.org/r/388858 (owner: 10Legoktm) [18:34:23] (03PS9) 10Lokal Profil: Restructure missing_commonscat_links [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/380060 (https://phabricator.wikimedia.org/T176528) [18:36:26] (03CR) 10jerkins-bot: [V: 04-1] Restructure missing_commonscat_links [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/380060 (https://phabricator.wikimedia.org/T176528) (owner: 10Lokal Profil) [18:49:16] (03PS1) 10Lokal Profil: Allow non-ascii template names [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390064 (https://phabricator.wikimedia.org/T180068) [18:52:02] (03PS10) 10Lokal Profil: Restructure missing_commonscat_links [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/380060 (https://phabricator.wikimedia.org/T176528) [18:53:19] (03CR) 10jerkins-bot: [V: 04-1] Restructure missing_commonscat_links [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/380060 (https://phabricator.wikimedia.org/T176528) (owner: 10Lokal Profil) [18:53:51] (03CR) 10Lokal Profil: "Very tempted to introduce `from __future__ import unicode_literals` across the whole erfgoedbot directory once there are fewer open patche" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390064 (https://phabricator.wikimedia.org/T180068) (owner: 10Lokal Profil) [18:58:09] !log wikilabels 753d4eb is going to staging [18:58:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [18:59:40] hehe, it gives out 500 [19:15:34] !log wikilabels 564afa5 is going staging [19:15:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [19:18:29] !log wikilabels 564afa5 is going to production [19:18:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikilabels/SAL [20:51:09] !log testlabs Running stress-ng test on labvirt1015stresstest* vms for T171473 [20:51:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Testlabs/SAL [20:51:12] T171473: labvirt1015 crashes - https://phabricator.wikimedia.org/T171473 [21:43:43] (03PS1) 10Lokal Profil: Stop categorization job during database update [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390142 [21:47:56] (03PS2) 10Lokal Profil: Stop categorization job during database update [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390142 [21:51:45] (03CR) 10Lokal Profil: "I changed the jsub command to make use of the known path variables." [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390142 (owner: 10Lokal Profil) [21:56:40] Forgive my sql ignorance but how would i go about having a query display the username of a user along with edit counts within quarry i can get the usernames but not editcount numbers [21:59:35] (03PS11) 10Lokal Profil: Restructure missing_commonscat_links [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/380060 (https://phabricator.wikimedia.org/T176528) [22:56:05] Zppix: can you add some commas to your question? I have trouble understanding it [23:02:59] Forgive my sql ignorance, but how would i go about having a query that displays, the username of a user along with edit counts, within quarry, i can get the usernames but not editcount numbers [23:03:05] zhuyifei1999_: ^ [23:03:38] um you have two methods [23:04:16] one is count the number of revisions (including deleted) associated with the user id [23:05:18] for the other method, I'm pretty sure there is edit count stored in a table, and that should be the user table [23:05:33] But how would i do that [23:05:43] what's your current query? [23:06:32] zhuyifei1999_: https://quarry.wmflabs.org/query/22719 [23:07:13] you can select two columns [23:07:28] you don't need 'as u' [23:08:07] Ok so how would i select two i tried before and got an error [23:08:39] select column_a, column_b from table [23:09:29] Is what i did right? [23:10:55] ? [23:11:17] The way i modified the query [23:12:12] it's running [23:12:19] and yes [23:12:40] you can add a 'limit 10' to see samples [23:15:43] I have an error with the samples no matter the < > sign i still get same results [23:16:07] Nevermind [23:39:03] (03PS1) 10Lokal Profil: Make statistics table for unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390169 [23:39:33] (03PS2) 10Lokal Profil: Make statistics table for unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390169 [23:40:42] (03CR) 10jerkins-bot: [V: 04-1] Make statistics table for unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390169 (owner: 10Lokal Profil) [23:40:52] (03CR) 10Lokal Profil: "Once deployed https://commons.wikimedia.org/wiki/Commons:Monuments_database/Unknown_fields would be updated to show the table instead of t" [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390169 (owner: 10Lokal Profil) [23:43:49] (03PS3) 10Lokal Profil: Make statistics table for unknown fields [labs/tools/heritage] - 10https://gerrit.wikimedia.org/r/390169