Question on the Tathagathagarbha

I heard a very interesting lecture on the Tathatgatagarbha, and how one way to look at enlightenment is as the realization that you're that Tathagata that is within you, or the one on which you are "projected", as it were. And it left me with a little confused. Wouldn't that simply mean I had exchanged one self for another? Wouldn't this also be a form of identifying with a fixed object? A form of attachment?