A group of former Internal Revenue Service leaders discussed the state of the IRS at an AICPA tax conference after a wave of departures and layoffs.