I'm with OldTrees. If anything, this card is slightly UP. Trading a card for another card is an even exchange; sacrificing a pillar in the process makes it something you have to build your deck around, not something that you do casually.
That said, I like the idea.