I can see your dilemma. For where your at it makes sense.
The DNR won't give me a ticket for using a 357max, where as they would a 35 Rem. As long as pistol caliber rifles are still allowed in MI limited firearms zone. It's true you can't use any bullet, but there are enough bullet choices out there that finding one for deer isn't an issue. I've got quite a few of the excellent speer 180gr FN which should be able to get up to 2200fps to 2300fps with a 20" barrel, or 180gr xtp, 180gr rem, or since basically you're at 35rem speed any of the 200gr or lighter bullets meant for it will work. There's tons of information on the Mike Bellm site http://www.bellmtcs.com/store/index.php?cid=121
I've had good luck with Hornady 180ssp bullets at around 2150fps in a 16" barrel on deer out to 142yds, but couldn't use them in leveraction since they're pointy.
MAKE AMERICA GREAT AGAIN! STEEL FOR TANKS NOT FENCES!!!