A computer system on a network that is allows one or more users to login, and utilize its resources. Typically, a host will be an endpoint on the network; in other words, it will typically not be a router. In the OSI reference model, a host is a box on which application layer functions are performed.
In the TCP/IP world (the Internet, more or less), a host should conform to the Host Requirements document, STD 3.