Apple Mail w/ IMAP just sucks

Apple Mail has been locking up my system consistently when either receiving/syncing operations occur w/ IMAP mail. It's hard to trigger it but eventually I'll try to pull up a new message and.. bam. For it its just limited to IMAP, ...