This is often due to performing a refresh when one of the job log panes is visible, either stdout or stderr. When you refresh with one of these panes visible, not only is the GUI pulling the job data, but it has to re-read the job logs, which can be quite substantial.
Your best bet is to be on the "Job Properties" pane when doing a refresh.