two MS510TXPP switches seeing pack drops

We have 2x MS510TXPP either end of a cat6a link between 2 buildings.  We have had complaints of internet loss when using this.  We have done some basic ping testing and can see the connection between the 2 switches can drop, sometimes for over a minute.  We have 2 separate cables for this link, and we have used both and get similar results. We are using the ethernet 10GB port.  We have changed the port speed down to 5GB and still get the same results.  There doesnt seem to be a pattern to the issue.