How did “fandom” come to be ociated with fans of science fiction?

SF fandom goes back many years. Many members of the community dispense with the "SF" and merely refer to their subculture as fandom. It's not specific, but everyone seems to understand the word refers specifically to SF fandom.