Pigeons have higher wing loading than peregrines (less mass per wing surface) and are able to turn sharper. If both birds start from rest, the pigeon will be able to out fly the peregrine with higher acceleration and sharper turning radius.
I used to raise racing pigeons in Arizona and once watched a full on dual between one peregrine falcon and about 12 of my pigeons. I assumed I would lose at least one pigeon but I didn’t.
If you ever get a chance to see that you will have new respect for pigeons because as shown in the video they are absolutely superb flyers and they instinctively group up and are very maneuvering, especially racing pigeons. I think the only way a peregrine falcon can really get a pigeons is