A bus is a connection between components inside a computer. The connection is made up of a set of wires and each wire can only carry 1 bit at a time. So a bus can have 32 or 64 different lines, hence we get 32 bit buses and 64 bit busses.
There are many different kinds of bus including ISA, EISA, MCA and the local bus standards PCI and VL-Bus.