@ heschong,
What I meant was, if we would like to get a notification when the device leaves the network it happens only when Notification is set to always and grace period is completed. If you go under settings, there is an option to customize the notifications.