I would lap those Talley rings for two reasons. First, the Talley rings that I've used looked like the ring surfaces were extruded, not machined. I could clearly see the extrusion marks. When I lapped them I could see that they were not perfectly round. Here's a photo of a pair of Talley rings half way through the lapping process. They're mounted on a Weatherby MkV. These rings needed to be lapped quite a bit to make the surfaces round. They were aligned fairly well before I started, too.
This eccentricity in the rings reduces the surface contact area, or stresses and deforms the scope tube, or both. It can cause the scope to slip, the point of aim to change with temperature, and leave ring marks on the tube. So, to answer the OP's first question, I always lap Talley lightweight rings.
Second, Swaro Z5 scopes have a parallax adjustment knob on the turret housing that moves a focus lens back and forth inside the scope tube just in front of the turret housing. That's right where the front ring grabs the tube. You can see the sliding inner lens tube if you look into the objective with a small light. The sliding inner tube must fit precisely inside the scope tube, or else the focus knob will be stiff, the inner tube will bind, or the point of aim will not hold.
If the front ring is not round, it will deform the scope tube, which can put stress on the sliding lens tube. Now add the effect of shock and recoil. Over time, the parallax adjustment could become worn at the stress points, causing the lens tube to become loose. That could lead to a point of impact that changes with temperature or focus setting, or shot to shot.
Some of these problems can take a while to become noticeable. All of this can be avoided by lapping the rings.