There was a heaviness on set, because it’s like, ‘Are we too far away from this?'” James Marsden told Decider.