"Would this require that I compile MAME to turn the Debugger ON?"
yes
actually, you'll have to add a new 'driver' to it as well to get the memory map set up and the proms loaded.