It's not the actual stop but what's in it.
There is a nylon bushing of sorts, then a little rubber plug, then a very small washer.
When I reinsert it goes as follows:
Little washer, rubber plug, then the bushing.
This time I coated the outside of the bushing with silicone sealant before reinserting it back into the stop.
I then put silicone in the hole to keep rubber plug and washer from popping out again.