As jobs vanished, immigrants left California. The question is how many