Sheepdog on EL6 - Revision history

Digimer at 05:21, 24 November 2011

2011-11-24T05:21:06Z

← Older revision		Revision as of 05:21, 24 November 2011
Line 17:		Line 17:
	totem {		totem {
	version: 2		version: 2
	secauth: on		secauth: off
	threads: 0		threads: 0
	# Note, fail_recv_const is only needed if you're		# Note, fail_recv_const is only needed if you're
Line 48:		Line 48:
	mode: disabled		mode: disabled
	}		}
	~~</source>~~

	~~On one machine, in the first terminal run;~~

	~~<source lang="bash">~~
	~~corosync-keygen~~
	~~</source>~~

	This will ask for entropy. Typing at the keyboard is tedious, so open a second terminal to the node and then do other things (download files, <span class="code">dd</span> something, etc). Once complete, you will have <span class="code">/etc/corosync/authkey</span>. Pull this to all other nodes.

	~~<source lang="bash">~~
	~~rsync -av root@an-node03:/etc/corosync/authkey /etc/corosync/~~
	</source>		</source>

Line 153:		Line 141:
	= Using Sheepdog =		= Using Sheepdog =

	You need a "store" directory. I use <span class="code">/sheepdog</span> formatted on <span class="code">/dev/sda5</span> as an <span class="code">[[ext4]]</span> partition.		You need a "store" directory. At this point in development, the <span class="code">/etc/init.d/sheepdog</span> initialization script is hard coded to use <span class="code">/var/lib/sheepdog</span>, so that is what we will use. I formatted this partition on <span class="code">/dev/sda5</span> as an <span class="code">[[ext4]]</span> partition.

	<source lang="bash">		<source lang="bash">
	mkfs.ext4 /dev/sda5		mkfs.ext4 /dev/sda5
	mkdir /sheepdog		mkdir /var/lib/sheepdog
	tune2fs -l /dev/sda5 \| grep "Filesystem UUID" \| sed -e "s/^Filesystem UUID:\s\(.\)/UUID=\L\1\E\t\/sheepdog\text4\tdefaults,user_xattr\t1 3/" >> /etc/fstab		tune2fs -l /dev/sda5 \| grep "Filesystem UUID" \| sed -e "s/^Filesystem UUID:\s\(.\)/UUID=\L\1\E\t\/var/lib/sheepdog\text4\tdefaults,user_xattr\t1 3/" >> /etc/fstab
	mount /sheepdog		mount /var/lib/sheepdog
	mount		mount
	</source>		</source>
Line 171:		Line 159:
	none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)		none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
	sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)		sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
	/dev/sda5 on /sheepdog type ext4 (rw,user_xattr)		/dev/sda5 on /var/lib/sheepdog type ext4 (rw,user_xattr)
	</source>		</source>

Line 179:		Line 167:

	<source lang="bash">		<source lang="bash">
	sheep /sheepdog		sheep /var/lib/sheepdog
	</source>		</source>

Digimer: /* Using Sheepdog */

2011-11-24T01:30:05Z

Using Sheepdog

← Older revision		Revision as of 01:30, 24 November 2011
Line 180:		Line 180:
	<source lang="bash">		<source lang="bash">
	sheep /sheepdog		sheep /sheepdog
			</source>

			You can verify which nodes are in the sheepdog cluster using the following command;

			<source lang="bash">
	</source>		</source>

Digimer: /* Using Sheepdog */

2011-11-23T03:44:19Z

Using Sheepdog

← Older revision		Revision as of 03:44, 23 November 2011
Line 176:		Line 176:
	Note the <span class="code">(rw,user_xattr)</span>, this is important.		Note the <span class="code">(rw,user_xattr)</span>, this is important.

	Now create the store.		Now create the store on all nodes.

			<source lang="bash">
			sheep /sheepdog
			</source>

			Tell it to create five copies.

			<source lang="bash">
			</source>

Digimer at 03:36, 23 November 2011

2011-11-23T03:36:41Z

@@ Line 17: / Line 17: @@
 totem {
    version: 2
-   secauth: off
+   secauth: on
    threads: 0
    # Note, fail_recv_const is only needed if you're
@@ Line 62: / Line 62: @@
 </source>
 <source lang="bash">
 </source>
 = Install =
@@ Line 144: / Line 179: @@
 {{footer}}

Digimer at 03:28, 23 November 2011

2011-11-23T03:28:30Z

@@ Line 4: / Line 4: @@
 Installing, configuring and using Sheepdog in [[EL6]].
 = Install =
@@ Line 12: / Line 75: @@
 <source lang="bash">
-yum -y install corosynclib-devel subversion nss-devel zlib-devel
+yum -y install nss-devel zlib-devel
 </source>
@@ Line 18: / Line 81: @@
 <source lang="bash">
 cd ~
-yum -y remove corosync
+git clone git://github.com/corosync/corosync.git
-svn co http://svn.fedorahosted.org/svn/corosync/branches/flatiron
+cd corosync
-cd flatiron
+git checkout -b flatiron origin/flatiron
 ./autogen.sh
-./configure
+./configure --enable-nss
 make install
 cd ~
@@ Line 78: / Line 142: @@
 Now create the store.
 {{footer}}

Digimer: /* Base Cluster Config */

2011-11-23T02:12:50Z

Base Cluster Config

← Older revision		Revision as of 02:12, 23 November 2011
Line 80:		Line 80:

	= Base Cluster Config =		= Base Cluster Config =

			{{note\|1=Replace <span class="code">bindnetaddr</span>'s value with the [[IP]] address of the interface you want the cluster communication on ([[BCN]], generally).}}

	<source lang="bash">		<source lang="bash">
	vim /etc/~~cluster~~/~~cluster~~.~~com~~		vim /etc/corosync/corosync.conf
	</source>		</source>
	<source lang="xml">		<source lang="xml">
Line 98:		Line 100:
	interface {		interface {
	ringnumber: 0		ringnumber: 0
	bindnetaddr: ~~-YOUR IP HERE-~~		bindnetaddr: 192.168.3.{3..7}
	mcastaddr: 226.94.1.1		mcastaddr: 226.94.1.1
	mcastport: 5405		mcastport: 5405

Digimer: /* Install */

2011-11-23T02:05:52Z

Install

← Older revision		Revision as of 02:05, 23 November 2011
Line 32:		Line 32:
	<source lang="bash">		<source lang="bash">
	cd ~		cd ~
	yum remove libvirt		yum -y remove libvirt
	git clone git://git.sv.gnu.org/qemu.git		git clone git://git.sv.gnu.org/qemu.git
	cd qemu		cd qemu
Line 40:		Line 40:
	</source>		</source>

	Sheepdog;		Sheepdog (we don't build the RPMs for missing dependencies reasons);

	<source lang="bash">		<source lang="bash">
Line 48:		Line 48:
	./autogen.sh		./autogen.sh
	./configure		./configure
	make ~~rpm~~		make install
	rpm -ivh x86_64/sheepdog-0.*
	cd ~		cd ~
	</source>		</source>

			= Using Sheepdog =

			You need a "store" directory. I use <span class="code">/sheepdog</span> formatted on <span class="code">/dev/sda5</span> as an <span class="code">[[ext4]]</span> partition.

			<source lang="bash">
			mkfs.ext4 /dev/sda5
			mkdir /sheepdog
			tune2fs -l /dev/sda5 \| grep "Filesystem UUID" \| sed -e "s/^Filesystem UUID:\s\(.\)/UUID=\L\1\E\t\/sheepdog\text4\tdefaults,user_xattr\t1 3/" >> /etc/fstab
			mount /sheepdog
			mount
			</source>
			<source lang="text">
			/dev/sda2 on / type ext3 (rw)
			proc on /proc type proc (rw)
			sysfs on /sys type sysfs (rw)
			devpts on /dev/pts type devpts (rw,gid=5,mode=620)
			tmpfs on /dev/shm type tmpfs (rw)
			/dev/sda1 on /boot type ext3 (rw)
			none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
			sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
			/dev/sda5 on /sheepdog type ext4 (rw,user_xattr)
			</source>

			Note the <span class="code">(rw,user_xattr)</span>, this is important.

			Now create the store.

	= Base Cluster Config =		= Base Cluster Config =

Digimer: Created page with "{{howto_header}} {{warning|1=This is essentially just a compilation of notes I made while playing with [http://www.osrg.net/sheepdog/ NTT's Sheepdog]. It may or may not become a..."

2011-11-22T05:03:40Z

Created page with "{{howto_header}} {{warning|1=This is essentially just a compilation of notes I made while playing with [http://www.osrg.net/sheepdog/ NTT's Sheepdog]. It may or may not become a..."

Páàjì titun

{{howto_header}}

{{warning|1=This is essentially just a compilation of notes I made while playing with [http://www.osrg.net/sheepdog/ NTT's Sheepdog]. It may or may not become a complete tutorial someday.}}

Installing, configuring and using Sheepdog in [[EL6]].

= Install =

Done as <span class="code">root</span> (ya, I know...) on [[CentOS]] 6.0;

Install dependencies;

<source lang="bash">
yum -y install corosynclib-devel subversion nss-devel zlib-devel
</source>

Corosync from source;

<source lang="bash">
cd ~
yum -y remove corosync
svn co http://svn.fedorahosted.org/svn/corosync/branches/flatiron
cd flatiron
./autogen.sh
./configure
make install
cd ~
</source>

QEMU (needs >= v0.13);

<source lang="bash">
cd ~
yum remove libvirt
git clone git://git.sv.gnu.org/qemu.git
cd qemu
./configure
make install
cd ~
</source>

Sheepdog;

<source lang="bash">
cd ~
git clone git://github.com/collie/sheepdog.git
cd sheepdog
./autogen.sh
./configure
make rpm
rpm -ivh x86_64/sheepdog-0.*
cd ~
</source>

= Base Cluster Config =

<source lang="bash">
vim /etc/cluster/cluster.com
</source>
<source lang="xml">
# Please read the corosync.conf 5 manual page
compatibility: whitetank
totem {
version: 2
secauth: off
threads: 0
# Note, fail_recv_const is only needed if you're
# having problems with corosync crashing under
# heavy sheepdog traffic. This crash is due to
# delayed/resent/misordered multicast packets.
# fail_recv_const: 5000
interface {
ringnumber: 0
bindnetaddr: -YOUR IP HERE-
mcastaddr: 226.94.1.1
mcastport: 5405
}
}
logging {
fileline: off
to_stderr: no
to_logfile: yes
to_syslog: yes
# the pathname of the log file
logfile: /var/log/cluster/corosync.log
debug: off
timestamp: on
logger_subsys {
subsys: AMF
debug: off
}
}
amf {
mode: disabled
}
</source>

{{footer}}