Here are a few basic points that should straighten things out:
Smoke is unburned fuel.
All diesels normally run very lean, but unlike gas engines, if they get close to 14:1 ratio, they are pouring smoke by that point.
Your TDI can run fine smokey and with no smoke, since it's already running very lean, lean is normal. Too lean and you can start to get a misfire.
The best level is such that your EGT is under control and to your preference. Most people don't want smoke under normal driving but some smoke under WOT is normal.