As we all know, any new technology can be a pain to get right. With our solution and our deployment of our SharePoint farms we are running off Network Appliance hardware. We even had Microsoft certify that this is an accepted solution and gave it their blessing.

Our developers were having major troubles deploying their migration package to our Staging environment. They were getting very slow access time, and even timeouts, we're talking 10 minutes to upload one page. This put a major kink into our plans to deploy the new code and content to this environment. This started last week, so we put together a swat team to try and diagnose these issues.

Keys to the solution is diagnosing these issues:

SharePoint Itself
Active Directory
Firewalls
Network Connectivity
Sql
Network Appliance Hardware
Server Hardware (HP Blades)
Physical Drives & Spindles
Migration Tool (Uses SharePoint API's)
Server Trusts
A bunch of other small pieces of the pie.

As you can see from the above list there are many different items that we would need to check to verify there are no issues in that particular system.

The interesting thing is that as we go through the list everything checks out. So as I'm working with Microsoft we run PSSD and capture data from the Sql server to the NetApp.  NetApp ran another tool on their end. Come to find out we were getting massive reads but little to no writes. The network I/O was off the chart.

Come to find out the card on the Sql server was set to 1500mtu while the NetApp was running Jumbo 9000mtu. We re-cabled and switched our NIC cards on the SQL box to Jumbo.  Problem Solved.

It just comes to show that the smalled things can cause some of the biggest headaches.