EVERYONE Needs a MultiMeter: 18 Steps (with Pictures)
The meter will read 12 to 13 volts, but you want to know what the voltage reading is when the battery is under a load. Have someone turn the key while you watch the meter. If the meter reading drops to around 9 volts or less, you need to charge the battery and see if that solves the problem.