VTC are private unless the question is closed. Yet multiple mods here have no problem publicly blasting this information. Why is this happening? http://chat.stackexchange.com/transcript/message/36186597#36186597
Well, the short answer here is he didn't.
No, really - he asked you, "how character attribute analysis is trivia now?" - no mention of close voting, or even the question to which the comment referred.
Now, given you'd just voted to close a particular question as trivia, the context would've been obvious to you... But not necessarily anyone else. In fact, neither one of you revealed either critical bit of context in public until this post (although you hinted at it a few hours later by leaving a public comment on the question calling it "trivia").
Beyond that... Keep in mind that moderators can instantly make all close votes public information by closing the question, so there's no real point to requiring them to keep them private if they don't do that. If you don't want people to know you'd voted to close, then don't vote to close - that's the only sure way.
OTOH, if you're voting to close questions that you don't think should be closed, arguably you're abusing the system, so... Stop doing that.