Looks like it's not from the towel. In that case, I propose they're from something else.

If you're wearing something white or white-ish right now, anything at all, could you come over here and we'll try to check the material against these fibers? At the very least, we should be able to tell if the color is the exact same, and probably at least narrow down who's wearing something with the right width of fibers.