I have a multimeter. What exactly should i be testing and what should it show
I would set the meter to DC voltage and put the leads directly on the battery terminals to check battery voltage. With the the meter connected, note the battery voltage. It should be approximately 12.6V if fully charged. If it is much below 12V it is either dead (needs charged) or bad.
If the battery voltage is good, with the meter still connected, have someone attempt to crank the engine and see what the voltage does. If it barely drops but the engine doesn't crank, it could be an issue with one of the cables or connections. If it drops below 9 volts and the engine doesn't crank, the battery is bad.
If the battery voltage is good, and doesn't drop much while attempting to crank the engine, you can use the meter to test the cables. First, connect the meter's negative lead directly to the battery negative terminal and connect the positive lead of the meter to the engine block somewhere (clean, bare metal). With the meter still set to check DC voltage you should have zero volts. With the leads still connected this way attempt to crank the engine again and see what the meter shows for DC voltage. It should still be relatively low, under a volt. If you see 5-12V DC when attempting to start with the meter connected to the negative battery terminal and the engine block, then you have a bad ground.
You can test the positive cable in a similar way, but it is a little more difficult because you have to go between the positive battery terminal and the positive connection on the starter.
Post up if you have any questions about any of this.