Can't ping registered DDNS Hostname with internal client connected to a VPN

I have my router's DDNS setup to regsiter a hostname with NO-IP.com.  I can successfully ping it.  When an internal Windows 10 client then connects to a VPN, I am no longer able to ping it.  As soon as I disconnect it, the ping then works again.

I would expect it to still work since the router still has the same public IP address and is still registered with NO-IP.  Does anyone know if this should work or am I missing something?