I agree. Sometimes, as the boss, you're going to have to be "that guy," but it's also your job to do just that. A few things I think that you can do to make things a little easier though:
1/ Build trust. To do this, be reliable (when TMs ask you for things like resources, time off, etc) be sure...