My Foo Is Strong

Setup SAN disk for use in a Linux Veritas cluster

For this particular exercise we’re going to go through the entire process of provisioning disk for use in a VCS cluster. We will use EMC Symmetrix disk zoned and masked to a RHEL 4u6 host as the foundation.

1. Get the disk(s) presented to the host observing that it’s visible down multiple paths.

   # inq -showvol Inquiry utility, Version V7.3-771 (Rev 0.0) (SIL Version V6.3.0.0 (Edit Level 771) Copyright (C) by EMC Corporation, all rights reserved. For help type inq -h.   ----------------------------------------------------------------------------- DEVICE :VEND :PROD :REV :SER NUM :Volume :CAP(kb) ----------------------------------------------------------------------------- /dev/sda :EMC :SYMMETRIX :5771 :0123456789 : 00617: 2880 /dev/sdb :EMC :SYMMETRIX :5771 :0123456789 : 00204: 35654400 /dev/sdc :EMC :SYMMETRIX :5771 :0123456789 : 00206: 35654400 /dev/sdd :EMC :SYMMETRIX :5771 :0123456789 : 00208: 35654400 /dev/sde :EMC :SYMMETRIX :5771 :0123456789 : 0020A: 35654400 /dev/sdf :EMC :SYMMETRIX :5771 :0123456789 : 0020C: 35654400 /dev/sdg :EMC :SYMMETRIX :5771 :0123456789 : 0020E: 35654400 /dev/sdh :EMC :SYMMETRIX :5771 :0123456789 : 00210: 35654400 /dev/sdi :EMC :SYMMETRIX :5771 :0123456789 : 00212: 35654400 /dev/sdj :EMC :SYMMETRIX :5771 :0123456789 : 00214: 35654400 /dev/sdk :EMC :SYMMETRIX :5771 :0123456789 : 00263: 35654400 /dev/sdl :EMC :SYMMETRIX :5771 :0123456789 : 00265: 35654400 /dev/sdm :EMC :SYMMETRIX :5771 :0123456789 : 00267: 35654400 /dev/sdn :EMC :SYMMETRIX :5771 :0123456789 : 00269: 35654400 /dev/sdo :EMC :SYMMETRIX :5771 :0123456789 : 0026B: 35654400 /dev/sdp :EMC :SYMMETRIX :5771 :0123456789 : 00617: 2880 /dev/sdq :EMC :SYMMETRIX :5771 :0123456789 : 00204: 35654400 /dev/sdr :EMC :SYMMETRIX :5771 :0123456789 : 00206: 35654400 /dev/sds :EMC :SYMMETRIX :5771 :0123456789 : 00208: 35654400 /dev/sdt :EMC :SYMMETRIX :5771 :0123456789 : 0020A: 35654400 /dev/sdu :EMC :SYMMETRIX :5771 :0123456789 : 0020C: 35654400 /dev/sdv :EMC :SYMMETRIX :5771 :0123456789 : 0020E: 35654400 /dev/sdw :EMC :SYMMETRIX :5771 :0123456789 : 00210: 35654400 /dev/sdx :EMC :SYMMETRIX :5771 :0123456789 : 00212: 35654400 /dev/sdy :EMC :SYMMETRIX :5771 :0123456789 : 00214: 35654400 /dev/sdz :EMC :SYMMETRIX :5771 :0123456789 : 00263: 35654400 /dev/sdaa :EMC :SYMMETRIX :5771 :0123456789 : 00265: 35654400 /dev/sdab :EMC :SYMMETRIX :5771 :0123456789 : 00267: 35654400 /dev/sdac :EMC :SYMMETRIX :5771 :0123456789 : 00269: 35654400 /dev/sdad :EMC :SYMMETRIX :5771 :0123456789 : 0026B: 35654400

2. See what disks Veritas can see.
   vxdisk -o alldgs list
3. Initialize the disk for the first time. This needs to be repeated for each individual disk.
   /etc/vx/bin/vxdisksetup -i DEVICE format=cdsdisk
4. See if the intialize worked correctly. 

   # vxdisk -o alldgs list DEVICE TYPE DISK GROUP STATUS EMC0_0 auto:cdsdisk - (dg_grp) online EMC0_1 auto:cdsdisk - (dg_grp) online EMC0_2 auto:cdsdisk - (dg_grp) online EMC0_3 auto:cdsdisk - (dg_grp) online EMC0_4 auto:cdsdisk - (dg_grp) online EMC0_5 auto:cdsdisk - (dg_grp) online EMC0_6 auto:cdsdisk - (dg_grp) online EMC0_7 auto:cdsdisk - (dg_grp) online EMC0_8 auto:cdsdisk - (dg_grp) online EMC0_9 auto:cdsdisk - (dg_grp) online EMC0_10 auto:cdsdisk - (dg_grp) online EMC0_11 auto:cdsdisk - (dg_grp) online   EMC0_12 auto:cdsdisk - (dg_grp) online EMC0_13 auto:cdsdisk - (dg_grp) online cciss/c0d0 auto:none - - online invalid

   All device(s) (e.g. EMC0_n) now show as online.

5. Create the disk group.
   vxdg init dg_name dg_internal_name01=DEVICE
   The dg_name is the name of your disk group while dg_internal_name01 is the name of the first disk. In our case dg_internal_name01=EMC0_0.
6. Add any additional disk to the disk group.
   vxdg -g dg_name adddisk dg_internal_name02=EMC0_n+1
   Note that EMC0_n+1 is the next free disk that you are attempting to add. So dg_internal_name02=EMC0_1 (remember we started with EMC0_0).
7. To create the volume
   vxassist -g dg_name make lv_name [size] dg_internal_nameN
   Repeat as necessary.
8. Finally, create the file system
   mkfs -t vxfs /dev/vx/rdsk/dg_name/lv_name

At this point the volumes are now available to be defined as a mount resource in VCS.

09. December 2008 by Jason
Categories: Linux, SAN | Tags: CentOS, emc, RHEL, vcs, vx | Leave a comment