A 9 mm has less recoil than a 45 ACP which has less recoil than a 40 or 357 Magnum.
Trigger control is critical. So are stance, balance, weight distribution, breathing, and focus. However, before I shoot a pistol, I'll bench it and see where it hits. Sometimes, it takes sighting the pistol.
At what distance are you shooting? I find my 1911s to be the easiest pistols to shoot. I have an Ed Brown Special Forces, Coonan 357 Magnum 1911, Detonics Combat Master and Mars Armament T.H.U.G. At 7 and 10 yards, I can create a hole with 7 rounds.
I can shoot my Coonan and EB out to 50 and 75 yard 8-10" plates. I don't use match ammo, just Federals or Hornady 230 grains for 45 ACP and the 357 Magnum is 158 grain FMJ.
Critical fundamentals are important and the 1911 needs a high grip. Then, there's error correction.