Thanks for the replies.
By the comments posted my tea ball is too small and I should be leaving the hops in for the entire boil.
I dont do a secondary racking and I dont really want to just dump the hops in, (my past experience with straining has been messy) so a sock/stocking it will be.