Only some processes may have restricted addresses. This is attached to each page table entry (PTE) as a valid bit. When accessing memory, OS checks against this bit.