Physical Danger
For the most part, when you're doing your job, the danger has already passed. Typically, counseling is best done in comfortable, private, secluded places with one-on-one or small group therapy. No one's going to expect you to be on hand in the middle of a hurricane; during the aftermath is when you'll be out performing your necessary services.
Sometimes you'll counsel people who're predisposed to certain mental or emotional conditions; especially if you work with mental health clinics, veterans hospitals, or with inmates and former convicts. Active listening comes in handy here, because you can realize when someone may be letting their anger get the best of them. Remember, your safety comes first. You can't help a client if you're laid up in the hospital yourself.