Plenty of downsides to balance out the high pay and the excitement of working with big transactions. The hours and level of stress take a heavy, heavy toll on many people.