It is downright absurd to think that Falcon isn't a talented h2h combatant. The earliest stories featuring the Falcon show him being trained personally by Steve Rogers. Falcon has received extensive hand to hand training since he started his career as a superhero. He's not as good as Steve, but he's still good enough that he was a SHIELD agent and regularly sparred with Steve and Bucky.