I have an issue with cman. It works but weekly this fails and seems to be running.
Clustat / pvecm nodes / pvecm status shows all nodes inquorum with no problems but cman service itself cannot be stopped or restarted.
Stopping cluster:
Stopping dlm_controld...
[FAILED]
If i run a command to remove and node from the cluster i get an error: cluster no quorum.... but all cli references say its quorate and all nodes are online.
Rebooting the node will bring the node back onto the cluster as long as i reboot all nodes which cman service is not able to be stopped or restarted.
######
I have been able to bring 4 nodes online of 12... the 4 nodes which are green when i run clustat / pvecm status / pvecm nodes only show connectivity with the nodes that are online. The other nodes show as offline.
On the nodes that cman will not restart, when running clustat / pvecm status / pvecm nodes still shows all nodes as being online. If i reboot a node where cman will not stop or restart... it comes online and joins the cluster of nodes which cman is restart-able.
######
Easy solution to make this issue easier to spot out.
If clustat / pvecm status / pvecm nodes has a timestamp from when it was last updated /refreshed we can easily spot this issue out. I can see that on the nodes that cman is not restart-able it seems that this update is 3 days old which is when the cluster first went down.
The current time stamp shows when the command was run to see the cluster status. I am requesting another timestamp from when this information was received / updated. If this last updated time stamp is so old well know that cman / corosync service is running into issues... even tho they show as running & responding to commands
root@poxmox5:~# clustat
Cluster Status for FL-Cluster @ Thu Apr 11 16:29:53 2013
Last Updated: Apr 09 10:02:16 2013
Member Status: Quorate
Member Name ID Status
------ ---- ---- ------
proxmox11 1 Online
proxmox2 2 Online
proxmox3a 3 Online
proxmox4 4 Online
poxmox5 5 Online, Local
proxmox6 6 Online
proxmox7 7 Online
proxmox8 8 Online
proxmox9a 9 Online
Proxmox10 10 Online
proxmox12 11 Online
This is in regards to weekly issue i have that spirit has been helping walk me thru. Still no solution has been provided.
http://forum.proxmox.com/threads/133...-all-nodes-red
Clustat / pvecm nodes / pvecm status shows all nodes inquorum with no problems but cman service itself cannot be stopped or restarted.
Stopping cluster:
Stopping dlm_controld...
[FAILED]
If i run a command to remove and node from the cluster i get an error: cluster no quorum.... but all cli references say its quorate and all nodes are online.
Rebooting the node will bring the node back onto the cluster as long as i reboot all nodes which cman service is not able to be stopped or restarted.
######
I have been able to bring 4 nodes online of 12... the 4 nodes which are green when i run clustat / pvecm status / pvecm nodes only show connectivity with the nodes that are online. The other nodes show as offline.
On the nodes that cman will not restart, when running clustat / pvecm status / pvecm nodes still shows all nodes as being online. If i reboot a node where cman will not stop or restart... it comes online and joins the cluster of nodes which cman is restart-able.
######
Easy solution to make this issue easier to spot out.
If clustat / pvecm status / pvecm nodes has a timestamp from when it was last updated /refreshed we can easily spot this issue out. I can see that on the nodes that cman is not restart-able it seems that this update is 3 days old which is when the cluster first went down.
The current time stamp shows when the command was run to see the cluster status. I am requesting another timestamp from when this information was received / updated. If this last updated time stamp is so old well know that cman / corosync service is running into issues... even tho they show as running & responding to commands
root@poxmox5:~# clustat
Cluster Status for FL-Cluster @ Thu Apr 11 16:29:53 2013
Last Updated: Apr 09 10:02:16 2013
Member Status: Quorate
Member Name ID Status
------ ---- ---- ------
proxmox11 1 Online
proxmox2 2 Online
proxmox3a 3 Online
proxmox4 4 Online
poxmox5 5 Online, Local
proxmox6 6 Online
proxmox7 7 Online
proxmox8 8 Online
proxmox9a 9 Online
Proxmox10 10 Online
proxmox12 11 Online
This is in regards to weekly issue i have that spirit has been helping walk me thru. Still no solution has been provided.
http://forum.proxmox.com/threads/133...-all-nodes-red