What's the interest in keeping it to style - for a comp? If so check out the guidelines. You can download them here:
AABC Style Guidelines Page
If you are entering a comp, and your beer comes out clearer, you can still enter it as a Weizen - it's just not a Hefeweizen, it's a KristalWeizen (Clear/Crystal Wheat). So if your beer winds up super clear and you're entering it - just make sure it's not in the Hefe category or you might get the infamous 'not to style' in your notes that come back.
Hefeweizen style is normally cloudy. Pour any Weihanstephaner Hefe or Shofferhofer Hefeweizen or other leading imports and you'll see. I guess part of this is from the yeast, but the rest is from it not being filtered or clarified. So no whirlfloc would be totally fine and would mean your beer will indeed wind up truer to style. It's not going to affect the flavour any with or without one. Many people when doing wheat kits actually add wheat flour to cloud them up for competition so cloudiness is actually encouraged in this style when you get to official guidelines.
Also the yank's version of Weizens - American Wheats, often use whirlflocs in their recipes too. But they're a style that breaks with German convention anyhow. For most traditional Hefe's recipes there's no need to use whirlflocs or filter IMHO, unless you like it that way.
Hopper.