Is there a way to specify an activity that Skillz will return to upon exiting?

Not at this time.  Skillz will currently return to the last Activity that was active.  Each Activity will need to check if a match is in progress and handle both cases appropriately.