There's an awesome library that goes by the name of Polyvox that does exactly this. It's worth a look if you're interested in voxel-y things.