valid bit
A yes/no flag on each cache slot saying whether it holds real data yet; at start-up every slot is empty.
Each cache line carries a valid bit; a lookup hits only if the line is valid and its tag matches. Lines start invalid, and invalidation (for example by another core's write, Chapter 34) clears the bit.
See also