cLVM is driving me nuts
Posted: 2019/05/09 20:08:48
Hi Everyone,
First I'd like to thank you guys for having such an awesome forum, I've never had to post before as a result. But this time I can't find a solution anywhere.
I have 2 identical servers; hardware, package versions, everything. I followed this guide to setup GFS2
https://access.redhat.com/documentation ... samba-haaa
However, after the last step only the node I was working on successfully mounted it. The other said.
After some digging I found the issue is the system didn't create the volume group device because of an
I checked and changed the lvm.conf locking mechanism to 3 on all machines, still nothing.
I tried killing clvmd and stonith restarted the node as it should.
I can successfully move the mount point between them, but not mount it together so I'm sure it's a locking issue. I just can't find anything wrong to fix it.
Any help would be most appreciated.
Messages log
vgshow
section of lvm.conf
First I'd like to thank you guys for having such an awesome forum, I've never had to post before as a result. But this time I can't find a solution anywhere.
I have 2 identical servers; hardware, package versions, everything. I followed this guide to setup GFS2
https://access.redhat.com/documentation ... samba-haaa
However, after the last step only the node I was working on successfully mounted it. The other said
Code: Select all
Couldn't find device
After some digging I found the issue is the system didn't create the volume group device because of an
Code: Select all
Error: locking on node2: volume is busy on another node
I tried killing clvmd and stonith restarted the node as it should.
I can successfully move the mount point between them, but not mount it together so I'm sure it's a locking issue. I just can't find anything wrong to fix it.
Any help would be most appreciated.
Messages log
Code: Select all
May 9 15:34:33 csn2 clvm(clvmd)[8349]: INFO: Error locking on node 2: Volume is busy on another node 0 logical volume(s) in volume group "clustered_vg" now active
May 9 15:34:33 csn2 Filesystem(fs)[8572]: INFO: Running start for /dev/clustered_vg/kvm_gfs on /var/lib/libvirt/images
May 9 15:34:33 csn2 Filesystem(fs)[8572]: ERROR: Couldn't find device [/dev/clustered_vg/kvm_gfs]. Expected /dev/??? to exist
May 9 15:34:33 csn2 lrmd[7888]: notice: fs_start_0:8572:stderr [ ocf-exit-reason:Couldn't find device [/dev/clustered_vg/kvm_gfs]. Expected /dev/??? to exist ]
May 9 15:34:33 csn2 crmd[7892]: notice: csn2-gfs-fs_start_0:31 [ ocf-exit-reason:Couldn't find device [/dev/clustered_vg/kvm_gfs]. Expected /dev/??? to exist\n ]
May 9 15:34:34 csn2 Filesystem(fs)[8654]: WARNING: Couldn't find device [/dev/clustered_vg/kvm_gfs]. Expected /dev/??? to exist
May 9 15:34:34 csn2 Filesystem(fs)[8654]: INFO: Running stop for /dev/clustered_vg/kvm_gfs on /var/lib/libvirt/images
May 9 15:34:34 csn2 lrmd[7888]: notice: fs_stop_0:8654:stderr [ blockdev: cannot open /dev/clustered_vg/kvm_gfs: No such file or directory ]
Code: Select all
# vgdisplay
--- Volume group ---
VG Name clustered_vg
System ID
Format lvm2
Metadata Areas 6
Metadata Sequence No 3
VG Access read/write
VG Status resizable
Clustered yes
Shared no
MAX LV 0
Cur LV 1
Open LV 0 (this is 1 on whatever machine has the mount)
Max PV 0
Cur PV 6
Act PV 6
Code: Select all
locking_type = 3
# Configuration option global/wait_for_locks.
# When disabled, fail if a lock request would block.
wait_for_locks = 1
# Configuration option global/fallback_to_clustered_locking.
# Attempt to use built-in cluster locking if locking_type 2 fails.
# If using external locking (type 2) and initialisation fails, with
# this enabled, an attempt will be made to use the built-in clustered
# locking. Disable this if using a customised locking_library.
fallback_to_clustered_locking = 1