At the risk of sounding like a Ruger cheerleader, I have a 22/45, a Mk3, and a Single Six. I also use a TC Contender a lot, but the Contender and Revolver don't fit in with your question, so going to ignore those, even though I use them all about equally. Between the 22/45 and the Mk3, the Mk3 shoots slightly better, but that's mostly due to being the 5.5" target model with adjustable sights while my 22/45 is the 4.5" threaded with fixed sights. Now I'm talking 1/2" larger groups with the 22/45 at 50 yards, so it is a VERY slight difference, and doesn't make any difference at all while hunting. I use the 22/45 suppressed, and it gets used for everything from squirrel to hogs, so a lot of use.
As to your having looked at the Browning Buckmark, a friend of mine uses one of those and it is also an excellent pistol. I prefer the way my Rugers fit my hand, but I can't swap barrels at will like he can, and that could be an important consideration for you. His Browning also shoots just as well as my Rugers do, and I have been tempted to pick one up. Still might if I can quit spending my money on revolvers.
I haven't had a chance to shoot a Victory, but shot a 22A years ago that was an excellent gun too. So all the rambling aside, if I was starting over, I would probably just buy whatever feels best in my hand. You've narrowed the field down to some excellent options, and I don't think you can really go wrong with any of the ones you're looking at.