I have long loved Pittsburgh-based Caketrain, publisher of books and a literary magazine. Which is why I was (and am) crestfallen when they went on hiatus a few years back.
One of my favourite aspects of the press is the beautiful and odd artwork that they use for their publications. More importantly, the actual writing is diverse and pleasingly bizarre.
I highly recommend delving into their back-catalogue. They have published poetry, novels and short stories.