I can not tell, as I have not stopped from exercising XD
How long has passed since you are not training at that level? Have you totally stopped doing any endurance sport?
what you are doing now may be enough to keep that low HR levels, even without the intensity/volume required for your previous level and may be you have moved from (ie) 41 to 43, an actual increase, but not significantive.
Just an opinion.