I think this is a revealing moment. A moment that truly reveals Howard's paranoia. A moment that tells us what is in his head when he ponders what people think of him. And the fact that no one wanted to sit near his ass tells a lot too. It tells us that he's a total dick behind the scenes. An exclusionary, elitist, egocentric dick. No wonder he wants to go hid in a McMansion over a sinkhole with a bowling trophy for a wife. He brings it on himself.