A six-story Alexandria office building ripe for expansion and conversion to nearly 200 apartments has hit the market.