It's hard to describe but easy to observe the difference. I'd put it like confidence is believing you're correct and arrogance is believing no one else could be right.