I'm working with the American Time Use Survey now for my gender paper. It records time use for a sub sample of the CPS on a bazillion different activities. There are a bunch of sports related stuff that you can list time spent either doing or watching.
One option is "watching people working out". Weird.
For some reason, it seems even weirder that in a longitudinal sample of 124,517 people responding to the ATUS between 2003 and 2011, only one woman spent time watching other people work out.
She lives in California.