You sample only from tokens that could possibly result in a valid production for the grammar. It's an inference-only thing.