This is something you can do.
You make your arena deck lose a bit, so that it's just out of the arena. (like rank 501-550). Then, eventually, since the the lowest rating possible for arena is variable, your deck will be back in circulation. Of course, it will probably still be very low ranked, and I'm not sure about higher ranked ones.