DynamicState assumes the time map is fully populated and stores only its size (which is the only property it cares about).