"Cup of tea" is also used as an
expression to describe a personal preference such as an
activity that one particularly likes/dislikes (in which case "not my cup of tea" is naturally more
appropriate) engaging in.
An example:
"Playing golf is not my cup of tea so I'll spend the afternoon painting an infinitely long grey line on an infintely long canvas but I'll join you for a drink later."