You might find it easier to manage those permissions with gitolite if you want to restrict the users to just git access, and to just some repos.