If they are floating gather the bits up with a tissue from the surface of the water and completely remove them. If they keep coming back look further up line for the source.
I had the exact same issue after I moved into a home that the previous owner never cleaned the tank. I just scrubbed it out and I was shocked how much dirt/mildew came off. It’s clean now with none of that floating whittle sediment. Never had the issue again.