Some materials exhibit a magnetization which is proportional to the applied magnetic field in which the material is placed. These materials are said to be paramagnetic and follow Curie's law:
M = CB/T
Where M is the magneticization, C is Curie's Constant, B is the applied magnetic field, and T is the temperature.
Atoms' electrons have a property called spin which creates an intrinsic magnetic moment. In addition the orbit of electrons can be viewed as tiny electric current loops. In most materials the total magnetic moment caused by the orbit term and the spin term cancel but in paramagnetic materials, the cancelation is incomplete.
As Curie's law indicates, in an external magnetic field these little atomic magnets will line up with the field. Curie's law is incomplete because it fails to predict what will happen when most of the little magnets are lined up (after everything is lined up, increasing the external field will not increase the total magnetization) so Curie's Constant really should be expressed as a function of how much of the material is already lined up.
Paramagnetic materials in magnetic fields will act like magnets but when the field is removed, thermal motion will mess up the magnetic alignment. In general paramagnetic effects are small (magnetic susceptibility of the order of 10-3 to 10-5).
Ferromagnetic materials above the Curie temperature become paramagnetic.