Well first the turbo. No turbo will last forever, and lifespan is a combination of build tolerances (some just come out of the factory better than others), wear from use, and wear from damage.
Letting foreign objects such as dust particles or water or oil hit the turbo while it's spinning wear down the blades a tiny, tiny amount. Too small to see or feel. This causes the turbo to wobble a little but turbos come out of the factory like that too. The difference is how much wobble it has, but the layer of oil that the bearings are floating on absorbs most of this energy. IMO, the overall effect is so small that it makes no real difference in lifespan.
What really kills a turbo is overheating, poor oil and lubication, and large foreign objects hitting it. These will cause enough wobble that it can't be absorbed by the layer of oil that the bearings are floating on and will cause excess wear or bearing damage. Overheating will damage the metal, and excess carbon buildup can also clog the turbo. That's why it's good to rev the engine hard every once in a while once the engine is fully warmed up. This heat cycles the turbo which burns and blows out carbon buildup.
Engines last a long time but again, differences in build quality, lubrication, cold starts, and buildup all affect engine life.
Now modding. These reduce engine and turbo life BUT to such a small degree that I doubt it is noticeable within the normal lifespan of the engine. The turbo is a bit more sensitive to higher pressures but the engine will be fine as long as you stay within reasonable limits. For example, running excess boost will stress the turbo, running excess boost can stress the head gasket, etc. Enough people have modded their cars so that chips or nozzles or larger turbos within reasonable limits, won't cause excess wear.
So maybe instead of getting 500,000 miles you might get 450,000 miles out of the engine. Also remember that if you use the additional power 80% of the time and track the car often, it's subjected to much higher wear than if you use the car for daily driving and use the additional power 5% of the time, which is what almost all people do with street driven cars, then this also makes the wear differences negligible.