I am highly recommending Auctioneer. It has an “ItemSuggest” feature that will suggest whether to auction or vendoring an item (or disenchanting if you have that profession). It takes auction deposit into consideration.
Right now on the server I play on classic almost everything sell at better price at a vendor. That will probably change as soon as more gold is in circulation.