It does affect the IBU's as the hops are still isomerising so will bitter the wort further, there are techniques to avoid this. The other consideration is the continuance of DMS production as the wort slowly cools.
It's well worth getting an immersion chiller to prevent the production of DMS...