So think about it. Do you know where all your friends live? Probably. What about acquaintances? What about co-workers, doctors, nurses, or the paperboy? Clegg's living room was well known as the threesomes were there all the time. Occasionally we'd see Compo's living room But there was no reason to see Foggy's house, Blamire's house or Truly's house. The correct attire conveyed the fact that each one lived somewhere and had no worries.
Now for Crusher. He always showed up at the Café wearing suitable clothing, which served to indicate that he lived somewhere, but his living quarters were not germane to the story line. Nobody gathered there, his character was established through Ivy and the Café, and his attire indicated that he did live somewhere. If we want to hazard a guess, I would say he had just a room somewhere. Whether it was a rented room in someone's house or upstairs at the Café, it was probably just a room as he still would have had most of his stuff at his family's house.