Ok, card updated.
No longer does spell damage. I'm going with having the damage to owner treated like voodoo doll damage instead.
That should keep people from trying to wriggle out of the damage (as it should be).
...Like the saying goes: If you play with fire you are going to get burned.