Hi, I have an issue currently where I am trying to Migrate guests VM's from one 2012 10 node cluster to a new 2012 R2 10 Node Cluster. The setup is as follows :-
- Cluster 1 > SP-VHCCA
- Using CSV volumes.
- Server 2012.
- 8 Nics in 4 teams :
- Host , Live Migration, Private Cluster, guest NIC
- Cluster 2 > SP-VHCEA
- Using SMB 3.0 Shares storage from a SOFS Cluster
- 2012R2
- 6 Nics in 3 Teams
- Host, Live Migration & private Cluster , Guest NIC
- Migration Settings are using Credssp
- I have Setup Delegation , but set it too . Trust this computer for delegation to any service (Kerberos Only)
- Whether this matters or not because I am using Credssp
The Strange thing is this issue seems random, I have has some machines Live Migrate fine, and some fail, the ones that fail always fail. for example I have a SQL Server SV-SQL09 with one IDE VHDX and one SCSI disk, this always fails to migrate.
Migration works fine when the guests are off.
The migration Starts fine, the folder is created on the Share, and it copies over both VHDX files ok. its at the next steps it always fails. So I am a bit Stuck, not sure what's going on if some work and some fail. !!
My initial thought's is some Network Timing issue as the process is being controlled via SCVMM. I have recently upgraded to SCVMM 2012 R2, and have some other issues with hosts randomly going into needs attention when all the status shows fine winrm is fine too. any help or pointers would be greatly appreciated.
ERROR on SCVMM 2012 R2 :-
Error (12700)
VMM cannot complete the host operation on the SP-VHCC02.astonmartin.int server because of the error: Virtual machine migration operation for 'SV-SQL09' failed at migration destination 'SP-VHCE01.astonmartin.int'. (Virtual machine ID D04D2ECF-E345-480E-9A89-43C443BFA202)
Failed to receive data for a Virtual Machine migration: This operation returned because the timeout period expired. (0x800705B4).
Unknown error (0x8000)
Recommended Action
Resolve the host issue and then try the operation again.
Error on Destination Server :-
Log Name: Microsoft-Windows-Hyper-V-Worker-Admin
Source: Microsoft-Windows-Hyper-V-Worker
Date: 12/12/2013 16:13:37
Event ID: 22040
Task Category: None
Level: Error
Keywords:
User: NT VIRTUAL MACHINE\D04D2ECF-E345-480E-9A89-43C443BFA202
Computer: SP-VHCE01.astonmartin.int
Description:
Failed to receive data for a Virtual Machine migration: This operation returned because the timeout period expired. (0x800705B4).
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Microsoft-Windows-Hyper-V-Worker" Guid="{51DDFA29-D5C8-4803-BE4B-2ECB715570FE}" />
<EventID>22040</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>0</Task>
<Opcode>0</Opcode>
<Keywords>0x8000000000000000</Keywords>
<TimeCreated SystemTime="2013-12-12T16:13:37.390522800Z" />
<EventRecordID>381</EventRecordID>
<Correlation ActivityID="{30313436-3631-0014-68C1-36F84DF7CE01}" />
<Execution ProcessID="2780" ThreadID="9164" />
<Channel>Microsoft-Windows-Hyper-V-Worker-Admin</Channel>
<Computer>SP-VHCE01.astonmartin.int</Computer>
<Security UserID="S-1-5-83-1-3494719183-1208935237-3292760474-44220227" />
</System>
<UserData>
<VmlEventLog xmlns:auto-ns2="http://schemas.microsoft.com/win/2004/08/events" xmlns="http://www.microsoft.com/Windows/Virtualization/Events">
<ErrorMessage>%%2147943860</ErrorMessage>
<ErrorCode>0x800705B4</ErrorCode>
</VmlEventLog>
</UserData>
</Event>
3 Errors on Source Server
ERROR 1 :-
Log Name: Microsoft-Windows-Hyper-V-VMMS-Admin
Source: Microsoft-Windows-Hyper-V-VMMS
Date: 12/12/2013 16:15:14
Event ID: 21026
Task Category: None
Level: Error
Keywords:
User: SYSTEM
Computer: SP-VHCC02.astonmartin.int
Description:
Virtual machine migration operation for 'SV-SQL09' failed at migration destination 'SP-VHCE01.astonmartin.int'. (Virtual machine ID D04D2ECF-E345-480E-9A89-43C443BFA202)
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Microsoft-Windows-Hyper-V-VMMS" Guid="{6066F867-7CA1-4418-85FD-36E3F9C0600C}" />
<EventID>21026</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>0</Task>
<Opcode>0</Opcode>
<Keywords>0x4000000000000000</Keywords>
<TimeCreated SystemTime="2013-12-12T16:15:14.761364700Z" />
<EventRecordID>3859</EventRecordID>
<Correlation />
<Execution ProcessID="2876" ThreadID="10940" />
<Channel>Microsoft-Windows-Hyper-V-VMMS-Admin</Channel>
<Computer>SP-VHCC02.astonmartin.int</Computer>
<Security UserID="S-1-5-18" />
</System>
<UserData>
<VmlEventLog xmlns:auto-ns2="http://schemas.microsoft.com/win/2004/08/events" xmlns="http://www.microsoft.com/Windows/Virtualization/Events">
<VmName>SV-SQL09</VmName>
<VmId>D04D2ECF-E345-480E-9A89-43C443BFA202</VmId>
<Parameter0>SP-VHCE01.astonmartin.int</Parameter0>
</VmlEventLog>
</UserData>
</Event>
Error 2 :-
Log Name: Microsoft-Windows-Hyper-V-VMMS-Admin
Source: Microsoft-Windows-Hyper-V-VMMS
Date: 12/12/2013 16:15:18
Event ID: 16300
Task Category: None
Level: Error
Keywords:
User: SYSTEM
Computer: SP-VHCC02.astonmartin.int
Description:
Cannot load a virtual machine configuration: Cannot create a file when that file already exists. (0x800700B7). (Virtual machine ID D04D2ECF-E345-480E-9A89-43C443BFA202)
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Microsoft-Windows-Hyper-V-VMMS" Guid="{6066F867-7CA1-4418-85FD-36E3F9C0600C}" />
<EventID>16300</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>0</Task>
<Opcode>0</Opcode>
<Keywords>0x4000000000000000</Keywords>
<TimeCreated SystemTime="2013-12-12T16:15:18.761900600Z" />
<EventRecordID>3860</EventRecordID>
<Correlation />
<Execution ProcessID="2876" ThreadID="15740" />
<Channel>Microsoft-Windows-Hyper-V-VMMS-Admin</Channel>
<Computer>SP-VHCC02.astonmartin.int</Computer>
<Security UserID="S-1-5-18" />
</System>
<UserData>
<VmlEventLog xmlns:auto-ns2="http://schemas.microsoft.com/win/2004/08/events" xmlns="http://www.microsoft.com/Windows/Virtualization/Events">
<VmName>
</VmName>
<VmId>D04D2ECF-E345-480E-9A89-43C443BFA202</VmId>
<ErrorMessage>%%2147942583</ErrorMessage>
<ErrorCode>0x800700B7</ErrorCode>
</VmlEventLog>
</UserData>
</Event>
ERROR 3 :-
Log Name: Microsoft-Windows-Hyper-V-VMMS-Admin
Source: Microsoft-Windows-Hyper-V-VMMS
Date: 12/12/2013 16:15:19
Event ID: 19050
Task Category: None
Level: Error
Keywords:
User: SYSTEM
Computer: SP-VHCC02.astonmartin.int
Description:
'SV-SQL09' failed to perform the operation. The virtual machine is not in a valid state to perform the operation. (Virtual machine ID D04D2ECF-E345-480E-9A89-43C443BFA202)
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Microsoft-Windows-Hyper-V-VMMS" Guid="{6066F867-7CA1-4418-85FD-36E3F9C0600C}" />
<EventID>19050</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>0</Task>
<Opcode>0</Opcode>
<Keywords>0x4000000000000000</Keywords>
<TimeCreated SystemTime="2013-12-12T16:15:19.046940300Z" />
<EventRecordID>3861</EventRecordID>
<Correlation />
<Execution ProcessID="2876" ThreadID="13060" />
<Channel>Microsoft-Windows-Hyper-V-VMMS-Admin</Channel>
<Computer>SP-VHCC02.astonmartin.int</Computer>
<Security UserID="S-1-5-18" />
</System>
<UserData>
<VmlEventLog xmlns:auto-ns2="http://schemas.microsoft.com/win/2004/08/events" xmlns="http://www.microsoft.com/Windows/Virtualization/Events">
<VmName>SV-SQL09</VmName>
<VmId>D04D2ECF-E345-480E-9A89-43C443BFA202</VmId>
</VmlEventLog>
</UserData>
</Event>