Google Voice

I am thinking that I should start giving out my google voice number from now on. But something just stops me from doing that. I don't want google to be able to listen my phone conversations also. As if email, calendar, orkut, reader and gtalk was not enough.