As stated here, , if your checking your sockets to find if you have voltage present, you want your multi meter set to check volts DC.
As stated previously, to check your bulb filaments to see if they are good, set the multimeter on ohms. You are looking for continuity tween the base (shell)...