Shutdown and Startup order when using the VMware vCloud Suite

One of my customers had to move his Datacenter from Wing A to Wing B in the same office campus , thanks to the Real Estate and Workspace Services department, which provided a larger and better space for us.

The customer recently had Professional Services design their Private Cloud and were almost close to 150 VMs and this was a huge task for the Cloud Management team which had a lone soldier wearing multiple hats and a Head of the Department. They are a R&D Shop serving Virtual Machines to their users who use it from the complete SDLC lifecycle perspective for their software products.

After much alerts and reminders the time had come when we had to start the shutdown and startup of our gear.

This is a distributed environment of vRA along with the other components of the vCloud Suite. vRA Appliances, IaaS Web Servers, IaaS App Servers and the vRealize Orchestrators were load balanced using 2 vCNS Edge Devices which act as the Load Balancers using the IP_HASH Load Balancing Algorithm.

Ok, apart from the people moving the Datacenter gear, we made sure our Networking and Storage was setup as it was in the Wing A DC in our Wing B(new) DC. Thanks to the those Networking and Storage Admins.

These are the steps which the Cloud Admin followed:
0 – ASK YOURSELF ARE YOU SATISFIED WITH THE BACKUPS TAKEN FOR THIS.
1. Shutdown all Workload VMs(Ask users to Shut down their VMs from the vRA Portal OR SHUTDOWN VM’s FROM the Managed Machines TAB in case Users forget to power off). DO NOT UNREGISTER THEM.
2. Run Data Collection in vRA for all attributes(state,performance,inventory) – MAKE SURE IT IS SUCCESSFUL. This is so that the state of the VMs in vRA DB and the state of the VMs in vCenter DB is same – THIS IS IMPORTANT
3. Shut Down vRealize Operations.
4. Shut Down vRealize Hyperic.
5. Shut Down Infrastructure Navigator.
6. Shut Down VMware vRealize Appliance Node 01(They take care of the vRA Portal and the Postgres DB)
7. Shut Down VMware vRealize Appliance Node 02(They take care of the vRA Portal and the Postgres DB)
8. Shut Down vRA Identity Appliance
9. Shut Down IaaS Web Server VM Node 01(This is the IaaS Web Tier, corresponding to the Infrastructure Tab)
10. Shut Down IaaS Web Server VM Node 02(This is the IaaS Web Tier, corresponding to the Infrastructure Tab)
11. Shut Down IaaS App Server VM Node 01(This is IaaS App Tier and the Manager Service)
12. Shut Down IaaS App Server VM Node 02(This is IaaS App Tier and the Manager Service)
13. Shut Down DEM Orchestrator Node 01(This contains the IaaS DEM Worker and the Proxy Agents)
14. Shut Down DEM Orchestrator Node 02(This contains the IaaS DEM Worker and the Proxy Agents)
15. Shut Down vRO Appliance Node 01(This is configured as an Endpoint in the Customer’s setup)
16. Shut Down vRO Appliance Node 02(This is configured as an Endpoint in the Customer’s setup)
17. Shut Down vCNS Edge Load Balancer 1
18. Shut Down vCNS Edge Load Balancer 2
19. Shut Down vCNS Manager
20. Shut Down vRealize Business Standard
21. Shut Down vCenter Server
22. Shut Down Database Server hosting all the Databases ( I know this is one SPOF, the customer is going to have SQL Clustering done for it)

Ok, so that was easy!

Now lets go to the Startup Order.

1. Have a positive frame of mind( You can do this!)
2. Startup the Database Server hosting all the Databases. Make sure the Database is up and running successfully.
3. Start the vCenter Server
4. Start the vCNS Manager
5. Start the vCNS Edge Load Balancer 1
6. Start the vCNS Edge Load Balancer 2
7. Start the vRA Identity Appliance
8. Provide a delay of 10 Minutes.
9. Start the VMware vRealize Appliance Node 01
10. Start the VMware vRealize Appliance Node 02
11. Give a Delay of 10 Minutes and check if all the Services on the vRA Admin Portal state as REGISTERED, Of Course the IaaS Service will be failed, since we have not started it yet)
12. Start the IaaS App Server VM Node 01(This is IaaS App Tier and the Manager Service)
13. Start the IaaS App Server VM Node 02(This is IaaS App Tier and the Manager Service)
14. Start the IaaS Web Server VM Node 01(This is the IaaS Web Tier, corresponding to the Infrastructure Tab)
15. Start the IaaS Web Server VM Node 02(This is the IaaS Web Tier, corresponding to the Infrastructure Tab)
16. Start the DEM Orchestrator Node 01(This contains the IaaS DEM Worker and the Proxy Agents)
17. Start the DEM Orchestrator Node 02(This contains the IaaS DEM Worker and the Proxy Agents)
18. Start the vRO Appliance Node 01
19. Start the vRO Appliance Node 02
20. Start vRealize Business Standard
21. Give a delay of 10 minutes, check if the portal is up and running and you can see all the tabs functioning
22. Start vRealize Operations Manager
23. Start vRealize Hyperic
24. Start Infrastructure Navigator
25. POWER ON WORKLOAD VMs from the Managed Machines TAB in vRA & NOT FROM the vCENTER Server. Take a wave approach of starting 10 VMs at a time.
26. Do a Data Collection and make sure it is Successful for all the attributes( State, Performance & Inventory)

There you go. You deserve a Chilled one!

Cheers,
>vRevealed<

Advertisements