Window boxes have a certain reputation. They’re quaint, they’re cottage-core, they’re fussy. And while there are reasons for these preconceptions, there’s a lot more to the window box than all that.

Cold weather doesn’t have to mean empty, sad-looking window boxes. Even when flowers are done and the garden’s asleep, you can keep those boxes looking pulled together with plants and fillers that don ...