intermittent network connection disrupting VoIP

I'm having issues with the LTE disrupting my network while the provider is still active. Some of the  VoIP phones are showing that they are registured but the hosted server shows them unregistured. When I remove the LTE from the loop everything returns to normal and all phones registure. I'm have set the NAT to 20 seconds and port 5060. Any suggestions.