This expression probably originated when "accounting" would be understood in the Biblical sense -- that is, accounting for your life at the pearly gates. The common (but inaccurate) understanding is that in the Christian afterlife, your good and bad deeds are looked at and your admission into Heaven is granted or denied based on those deeds. Personal taste, however, is not a deciding factor.
The implication in context is that while the speaker may not approve of the subject's fashion sense, home decor, or CD collection, they understand that such things are a matter of preference and not a basis for judgement.