It’s not normal to turn off a device as it will forget where it got to with various sequence counters.
However to allow us to do this whilst testing, we can turn off the Frame Counter checks which will likely be your problem - when you turn the device back on, it starts sending at 1, which takes many more sends before it gets to the last number the server received, only then will it be accepting the uplinks.
See ABP node stopped working -> Fixed by creating new ABP.. Why? :) - the quick win is to reset frame counters on the device overview page or to just turn them off on the settings page.