Let's face it—exclamation points are fun! They can add enthusiasm to your writing and perk up a bored reader! They can convey strong feelings, like surprise, panic, or a sense of urgency!
But they can also get old really quickly!
It's perfectly fine to use these marks of excitement in your writing, but make sure you do so appropriately and sparingly. Both bad timing and overuse can make you sound fake, which isn't good for establishing credibility with your reader.