When you say the Kimbers are hard to shoot, is that just due to their light weight? Just a matter of steadying it? Felt recoil? Both? Or are you saying the stocks are not good, or something else? I saw in another post that someone recommended the stock they use in one of their models, so it seems like they have good stocks (at least some of them).
If it's just a matter of a lighter gun being harder to shoot, at what weight do you think that becomes less of an issue? The lightest deer-capable rifle I've shot was probably 7.5 lbs. For me, it's a trade off -- if practical accuracy goes up considerably with a 6.5 or 7 pound rifle as opposed to say a 5-something pound rifle, I may just opt for the practical accuracy. On the other hand, I'm not adverse to building skill that can replace ounces.
For example, I decided that I'd go the tarp route for my three-season backpacking shelter. It took a lot more elbow grease to learn various knots and tarp pitches than it would have just to learn how to pitch a tent, but the result is I have a more versatile (though not as warm) shelter system that is over a pound lighter than even ultralight backpacking tents. On other things, however, I choose to carry more weight than any self-respecting ultralight backpacker would ever carry. For example, most ultralighters carry some skeleton of a first aid kit (or maybe not even a skeleton), but I carry a real kit since I consider it to be a potential life (or at least trip) saving item. So, it's just a case-by-case Goldy Locks sort of thing for me.