Returning to corporate America to work for The Man has one big downside.