Node red after pmxcfs error

Hi Folks!

I have 2 nodes installed with PVE 2.3 for few days. All was fine until this morning. One of the node became red (the second installed node).

I've found this in sylog (plenty) in both node.

Mar 12 15:38:53 aweb-vs003 pmxcfs[8352]: [status] crit: cpg_send_message failed: 9

I restarted cman and rebooted the red node. I restarted cman on the second node too. No change. Still red.

Until the reboot, I no longer have the pmxcfs error but the node stay red.

Any idea?


Here is the version.

pve-manager: 2.3-13 (pve-manager/2.3/7946f1f1)
running kernel: 2.6.32-18-pve
proxmox-ve-2.6.32: 2.3-88
pve-kernel-2.6.32-18-pve: 2.6.32-88
lvm2: 2.02.95-1pve2
clvm: 2.02.95-1pve2
corosync-pve: 1.4.4-4
openais-pve: 1.1.4-2
libqb: 0.10.1-2
redhat-cluster-pve: 3.1.93-2
resource-agents-pve: 3.9.2-3
fence-agents-pve: 3.1.9-1
pve-cluster: 1.0-36
qemu-server: 2.3-18
pve-firmware: 1.0-21
libpve-common-perl: 1.0-48
libpve-access-control: 1.0-26
libpve-storage-perl: 2.3-6
vncterm: 1.0-3
vzctl: 4.0-1pve2
vzprocps: 2.0.11-2
vzquota: 3.1-1
pve-qemu-kvm: 1.4-8
ksm-control-daemon: 1.1-1