Being that this is a JK, I would start by removing your front shaft and see if the sound is still there when driving. If not, do the opposite - pull the rear shaft, drive around in FWD and see if the noise is gone. If so, might be something like a pinion bearing going bad.