Guilty Conscious - The correct usage of the phrase would be guilty conscience.