I am an obsessive garage cleaner - my wife and the neighbors make fun of me. I remember that my father was the same way, and now when I'm out there unearthing things in the garage, I realize I am becoming my dad!
People don't necessarily take power from you for themselves. It just means they are operating at a lower attention level and you got pulled down by it. You are not sufficiently strong enough to be with someone and be unaffected.