You may not have a choice as to when you travel. After all, people travel during peak season because it fits with their schedule.
If you are relegated to traveling during peak season or not at all, by all means travel! Just plan ahead:
If you are traveling in a popular destination during peak season, try to blend in. Pay attention to the rhythm the locals set -- when they eat, if they take a break, etc. Also, avoid your most touristy clothing. You may avoid hustlers and other bothers by looking like a local.