Maybe it isn't the best time for Susan to come back, but he doesn't know that until he's already walked in, Stanley in his hands, and hears her last comment. He looks confused, although perhaps tinged with a bit of hurt.

"Why would either of us have to leave, I don't want to live somewhere without Lauren."