No one can manage you if you don't give them permission to do so. But if you are interested in accomplishing as much as you are capable of, then I believe there are good reasons to grant that permission.
Everyone has an opinion of who you are and what your relationship is about, things that you've done or didn't do in your relationship - and it's just all crap, really. Things that are written about it are all crap.