It's not hard. Here's a small list of people more down on his luck than Peter:
-- Hulk/Bruce Banner
-- Captain America
-- Daredevil
-- The entire mutant community
-- Frank Castle
Gibbon's life does make Peter's entire high school world look like the best time ever however.