Raylan's 'home' for years has been a single motel room, one that was frequently broken into, shot up or taken over by LEO's.. Usually from said shooting. But those issues weren't here and that allowed him to find a little more security under the rooves that he'd taken to as his own. They were safe, as safe as they could be considering where they all were.

The great Equalizer.

"Because you're part of my house. You're important and how you feel about it is too, no matter the reasons or nuances. Because I don't want to come home only to drive you off by bein' there. Bein' arrogant isn't worth that."