The segment count for included and excluded segments in the segment builder is cached, so they might not show the actual count of users, someone needs to recalculate it first.
Recalculating the number of users in a segment can be done manually either in the segments overview, or in the list of segments in the account:
This does not effect the dispatches, because there we check in realtime if someone is matching the conditions or not.