Should I kill Mr. House or go on with the quest? (Fallout: New Vegas)?

Alright, well I was going to work for Mr. House and I was for awhile. But he told me to go kill the Brotherhood of Steel. Instead, I joined them and now I don't want to kill them. But Mr. House is forcing me kill them or I can't go on. He's being kind of a dick right now, and I kinda wanna kill him instead. So I'm thinking about doing the quest with Yes Man (the robot) that lets you take over yourself. Should I do this? Or should I keep working for Mr. House?