Cap is on the elevator first, then gets joined by the agents, starting with Crossbones and two others. That right there is enough to make it very hard for Matt to get away. But even if Matt surprises them with their backs turned, he still has the problem of being on a high floor of a fortress filled with hundreds of skilled, armed and highly organized enemies.