Muggle

In J. K. Rowling's Harry Potter series, a muggle is anyone who is not magical. Muggles may have children with magical abilities. There is some prejudice among some of the wizardly community against both muggles and wizards and witches whose parents are muggles.

Fans may or may not be muggles — most of them certainly are. The term for a nonfan is mundane.