corosync: OOM killed after some days with 100%CPU, cluster nodes isolated ("Quorate")

January 23, 2025, 12:33 am

≫ Next: Sync based on prune settings

≪ Previous: iperf3 retries on VMs

$

0

0

Hi,

I have an almost idle test cluster with 12 nodes (pve-7.4). With an uptime of a year or so without issues, last week I noticed in web GUI, that only the local node information showed up. I logged in and saw on three randomly picked nodes that corosync had 100%CPU, apparently busy-loop over some network error; the log showed many "Retransmit List:" entries. Today I planned to take a look. The load is gone, as corosyncs have been out-of-memory-killed and nodes are "Flags...

Read more

---

Sync based on prune settings

January 23, 2025, 12:38 am

≫ Next: WebGUI not displaying storage, but not only please help

≪ Previous: corosync: OOM killed after some days with 100%CPU, cluster nodes isolated ("Quorate")

$

0

0

I have a secondary PBS on an offsite location. It has less disk space then currently used on the main PBS. However, I only want to keep the last 3 months on there. I think this should reduce the size of the overall backup to make it fit.

When a sync job executes, it looks at the last available backup for the current vm it's syncing and then start syncing the next in line even if this backup should not be there based on the prune settings. Therefor, it keeps just syncing one backup (the next...

Read more

WebGUI not displaying storage, but not only please help

January 23, 2025, 12:41 am

≫ Next: Can't get LACP 802.3ad bond working with Proxmox bridge

≪ Previous: Sync based on prune settings

$

0

0

Hi
I got weird situation. Cluster suddenly stopped displaying storage (only local is showing), not showing any users and I can't migrate vm's around.
Cluster had beforehand nfs mounted, backup server and iSCSI. When I'm logged to console I can see that multipath is showing all targets available, and pvs showing correctly iscsi storage:

Code:

PV                 VG         Fmt  Attr PSize    PFree 
/dev/mapper/mpatha VG-sa01hol lvm2 a--   <10.28t  <5.65t
/dev/sda3          pve        lvm2 a--...

Read more

Can't get LACP 802.3ad bond working with Proxmox bridge

January 23, 2025, 12:42 am

≫ Next: Warm site network configuration

≪ Previous: WebGUI not displaying storage, but not only please help

$

0

0

Hi,

Fixed: Need to have >1 interface in the LACP bond before it'll work with vmbr0. Yes I know a single interface defeats the purpose of LACP but the LACP bond works fine with a single interface UNTIL it is added to vmbr0 as a bridge port.

-----

Until today I had the standard Linux bridge vmbr0 with eth2 as the only bridge port - that worked fine.

I now have a use case where I need an LACP 802.3ad bond between my main PVE host and my switch so I configured an active 802.3ad LAG port on...

Read more

Warm site network configuration

January 23, 2025, 12:42 am

≫ Next: Several VLANs on one NIC for VM-Guests

≪ Previous: Can't get LACP 802.3ad bond working with Proxmox bridge

$

0

0

BLUF: How do I configure the network for a warm site when the restored VM will have the IP address for the site that failed?

I'm going through all the SDN configuration options trying to figure out how I would be able to configure a Warm site without doing some sort of post processing for each VM to configure it for the subnet used at the warm site.

I've got two sites that I am using for my scenario site 1 is allocated the subnet 10.1.x.x/16; site 2 is allocated the subnet 10.2.x.x/16...

Read more

Several VLANs on one NIC for VM-Guests

January 23, 2025, 12:46 am

≫ Next: close #1543: allow lxc low-level update via api

≪ Previous: Warm site network configuration

$

0

0

Hi all,

am new to Proxmox and wondering how I can setup several VLANs for one guest-VM.
This guest VM will be used as proxy and firewall between several networks.

So, the server itself has two hardware interfaces. Interface 1 is used as the mangement network port
Interface 2 shall be used for guest-VMs sitting on several different VLANs

The server is connected via two hardware network cables to a Netgear switch.
On the switch, interface 1 is configured to auto-tag all incoming networks...

Read more

close #1543: allow lxc low-level update via api

January 23, 2025, 12:47 am

≫ Next: Repeating tasks

≪ Previous: Several VLANs on one NIC for VM-Guests

$

0

0

Hello,

I'm trying to fully automate my homelab with Proxmox and infra as code with Pulumi.

A missing feature is to allow the modification of low-level lxc settings via the API, as spotted in #1543.
Today, the GET config endpoint returns the current low-level configuration but don't allow to edit it (PUT).

I've read developers are to communicate via the mailing-list and sign the Contributor License Agreement. But before enrolling myself in a complex process (if it is?), I'd like to...

Read more

Repeating tasks

January 23, 2025, 12:47 am

≫ Next: At my wits' end re: random freezing

≪ Previous: close #1543: allow lxc low-level update via api

$

0

0

Tasks that should work once every night start to work around 22:00 at night and continue until around 01:00 at night by repeating every 2-3 minutes, so many report mails are generated and delivered. The problem has been going on since 9 January. How can I fix this?

---

At my wits' end re: random freezing

January 23, 2025, 12:56 am

≫ Next: Migration of LXC failing with stale volume

≪ Previous: Repeating tasks

$

0

0

I installed Proxmox VE 8.3.2 on my old Dell Inspiron 5675 since last week and it randomly freezes every few hours. The longest uptime it has is over 12 hours and the shortest was a little over 10 minutes after reset. I've read almost every single "random freeze" post on the forum and reddit but nothing helped. Really frustrating and would appreciate any pointers.

To start, here's the computer spec:
CPU: Ryzen 1700x
GPU: Radeon RX 580
Memory: 32G DIMM 2666mhz
Storage: 4 1TB HDD in...

Read more

Migration of LXC failing with stale volume

January 23, 2025, 12:57 am

≫ Next: Packet loss issue at VLAN SDN VNet.

≪ Previous: At my wits' end re: random freezing

$

0

0

I am trying to migrate an LXC from a 3 node cluster to a single node setup. I tried two different LXC and I get the same error with no real details what failed. Does it support LXC migration? Both ends are on 'storage' which as both ZFS. I was just testing, so the LXC it not running and I unchecked the 'delete source'.

I had some previous fails but found out that you can't migrate if the LXC has replication in the source cluster. So removed replication jobs for the LXC and tried again...

Read more

Packet loss issue at VLAN SDN VNet.

January 23, 2025, 12:57 am

≫ Next: Proxmox mit HA VM, wie Packages / Updates nur zu einer bestimmten Uhrzeit machen

≪ Previous: Migration of LXC failing with stale volume

$

0

0

Hello,
I have a problem that I'm using VLAN SDN zones and at almost every VNet it looks good. But one VNet has a problem with packet loss (ping between VMs at same VLAN at same / diferrent nodes).

I have a stack with 4 nodes, connected via 2x 25Gbps LACP (DACs to nexus 9300 series).

This is result of long time ping:

Code:

--- XXX ping statistics ---
3260 packets transmitted, 2694 received, 17.362% packet loss, time 3335487ms
rtt min/avg/max/mdev = 0.095/0.193/0.464/0.037 ms

It looks that...

Read more

Proxmox mit HA VM, wie Packages / Updates nur zu einer bestimmten Uhrzeit machen

January 23, 2025, 1:03 am

≫ Next: What do I need?

≪ Previous: Packet loss issue at VLAN SDN VNet.

$

0

0

Guten Abend zusammen,

bin neu auf dem Gebiet Proxmox. Habe hier eine HA VM am laufen, läuft auch sehr gut.

ABER:
Nachts macht mein System Updates und dies möchte ich aber nicht, weil dann beim Boot / wenn diese fertig sind, geht meim HUE Bewegungsmelder am Flur mit eben dem Licht an.
Wie kann ich diese dann auf eine bestimmte Uhrzeit legen, z.B. 0700 Uhr in der früh?
Anbei ein Bild, was ich meine wegen den Packages Updates:

Vielen Dank euch für eure Hilfe

What do I need?

January 23, 2025, 1:04 am

≫ Next: Proxmox api "Resources"

≪ Previous: Proxmox mit HA VM, wie Packages / Updates nur zu einer bestimmten Uhrzeit machen

$

0

0

I'll ignore all the folk that say you shouldn't be doing that. WE ALL NEED TO LEARN

So here's the thing I'm trying to set Proxmox up with a Modules garden WHMCS module but I can't get my head around how outside access is achieved AUTOMATICALLY, I've searched Youtube and read a couple of tutorials but still can't find the answer, they all relate to nginx proxy manager (which is not appropriate as id have to log in each time find the VM IP and reverse proxy in nginx which clients wouldn't...

Read more

Proxmox api "Resources"

January 23, 2025, 1:13 am

≫ Next: NMI Watchdog BUG: soft lockup proxmox backup

≪ Previous: What do I need?

$

0

0

Hi!
in the web there is a display of the summed resources of the cluster




I studied the api documentation and did not find the final entry point to this data, maybe I was looking badly?
I am interested in exactly the data that is on the screenshot
I know how to get them with a script, but it will be complicated and will have to go through each node of the cluster, but here everything is already ready, how can I get this data with a request?

NMI Watchdog BUG: soft lockup proxmox backup

January 23, 2025, 1:15 am

≫ Next: Issue after last update

≪ Previous: Proxmox api "Resources"

$

0

0

Hi everyone,

I'm experiencing an issue with one of my VMs when performing a backup using Proxmox Backup Server.

The backup process starts without any problems, but after approximately 10 GB of data has been copied, the VM enters a "CPU Stuck" state. This causes the VM to become unresponsive, effectively killing the server.



It's important to note that this issue only occurs when I initiate a backup for this particular VM.

Additional context:

• I have other nodes with...

Read more

---

Issue after last update

January 23, 2025, 1:27 am

≫ Next: How can I configure login to the user quarantine by account name instead of email?

≪ Previous: NMI Watchdog BUG: soft lockup proxmox backup

$

0

0

Hi,

We have an installation in a cluster with two nodes, and after updating the master node, the delivery in this node has stop working showing this error:

smg postfix/error[1003]: 9918A49F51: to=<xxxxxxx@yyyyyy.com>, relay=none, delay=1.7, delays=1.7/0/0/0, dsn=4.4.1, status=deferred (delivery temporarily suspended: connect to 127.0.0.1[127.0.0.1]:10024: Connection refused)

Click to expand...

The messages are queued in deferred mail.

We checked the pmg-smtp-filter service and is running, the...

Read more

How can I configure login to the user quarantine by account name instead of email?

January 23, 2025, 1:30 am

≫ Next: HOWTO: Scripts to make cloudbase work like cloudinit for your windows based instances

≪ Previous: Issue after last update

$

0

0

Hello,

I have Proxmox Mail Gateway deployed, which is synchronized with FreeIPA. Users can access their quarantine, but to log in, they need to enter their Primary E-mail and password.

Is it possible to change this so that they can log in using their account name and password instead?

For example, currently, for a user test_user_nev to log in to their quarantine, they need to enter their email address test_user_nev@examplemail.test and password. This is inconvenient for...

Read more

HOWTO: Scripts to make cloudbase work like cloudinit for your windows based instances

January 23, 2025, 1:37 am

≫ Next: Ideen für den Anfang mit Proxmox

≪ Previous: How can I configure login to the user quarantine by account name instead of email?

$

0

0

Hi,

we are a small compagny ( Geco-iT ) from France that strongly relies on Proxmox PVE every day and as we find proxmox more and more powerfull, we want to give back to the community by providing some of our tools for PVE.

We made tools to use cloudbase on windows like cloudinit on linux instances !

CloudBase is an open-source project provided by Cloudbase Solutions to enable initialization of a new instance on Windows machines. The purpose is to be the equivalent of the...

Read more

Ideen für den Anfang mit Proxmox

January 23, 2025, 1:50 am

≫ Next: Numa Settings for dual socket Dell R630 with 2x E5-2667 V4

≪ Previous: HOWTO: Scripts to make cloudbase work like cloudinit for your windows based instances

$

0

0

Hallo, ich bin Dennis und komme aus der Nähe von Koblenz.
Ich habe mir ein Projekt vorgenommen und dazu hier im Forum auch schon einiges gelesen. Leider bin ich durch das lesen hier eher verunsichert und dachte mir, ich frage mal nach einem Feedback für das was ich so geplant habe.

Hardware (schon beschafft und im Testrun):
Mainboard: Gigabyte MC12-LE0
RAM: 2 x 16 GB SAMSUNG UDIMM DDR4 mit ECC
CPU: AMD Ryzen 4650G PRO
PCIe: LSI 9300-8i in HBA / IT Mode geflashed
1x 256 GB M2 SSD
2x 500 GB...

Read more

Numa Settings for dual socket Dell R630 with 2x E5-2667 V4

January 23, 2025, 2:04 am

≫ Next: Problem with Active Directory Service

≪ Previous: Ideen für den Anfang mit Proxmox

$

0

0

So i am using opnsense as a vm. With multiple rounds of testing i seem to be getting the best download speeds when using cpu affinity and only 4 cores. I pinned this vm to cores 1,3 ,5 and 7 since these are on numa node 1, the same node that the nic i am passing through is directly connected to. For some reason when pinning more then 4 cores it seems they do not boost as high and i loose speed. This is another question i have. My main question for this thread is whether i should enable the...

Read more