Sabi is the color of the poem. It does not necessarily refer to the poem that describes a lonely scene. If a man goes to war wearing stout armor or to a party dressed up in gay clothes, and if this man happens to be an old man, there is something lonely about him. Sabi is something like that.