You can move it with one command, and move it back with another. The first move (away) could prompt from direction (angle) and distance. Then it will move the object(s) selected, and store the information in the entity's extension dictionary. Then when you use the move back command all you have to do is pick the object(s) and it will know what to do.
I do the same thing, no code as of yet, but sounds like it could be a good thing. Maybe when I have time I will see what I can come up with.
/thinking out loud