In Ancient Greek:
"hoi" = "the" (nominative plural, masculine to agree with "polloi")
"polloi" = "many" (masculine noun, nominative plural)
By implication, to use the phrase "the hoi polloi" is to mark yourself as one of them. Hoi aristoi (the few) know that it translates to "the many".