To run on the nodes, use
mpirun -np X -h ~/tmp/bhosts foobar
where X is the number of MPI ranks you'd like to use. You may need to edit ~/tmp/bhosts to get proper load balancing. Only programs specially designed to use MPI will run in parallel, otherwise you'll end up running X separate instances of the same program, which is normally not very useful.