Because we are restricted to potential functions which are positive it is convenient to express them as exponentials.
The original RBM had binary visible and hidden nodes. They were showned to be universal approximators of discrete distributions. It was also shown that adding hidden units yields strictly improved modelling power.