I do the same, but that's what wears out the tool you show (around the indicated area, below). What we are suggesting here is to
not use that tool to
depress the tappet. But use a lever (pry-bar, spoon) to depress it, then use the tool you show to
hold it there while you change the shim with your tweezers. The spoon/lever is wedged between the cam lobe and the center of the shim and levered to pry it down. That saves the other tool from doing the heavy work.
View attachment 10716
I've even seen where the edges of the tappet buckets look a tad "nackered", I suspect from using the first tool to compress them...and possibly the tool slipping off the edge of the bucket (especially happens as the tool wears out).
Frankly I need to change my habit of just using the one tool to depress and hold the tappet, and start using two tools as described.