Distributed-Parallel Storage System (DPSS) Installation

Lawrence Berkeley National Laboratory, Data Intensive Distributed Computing Project


This page contains instructions for installing the DPSS version 2.5.x system software.

First, make sure your system is running the correct OS. The following OS's are currently supported: Solaris (and Solaris x86) 2.6 and higher, Irix 6.2 and higher, FreeBSD 2.2.8 or higher, and Linux 2.2 or higher. For Solaris, be sure to install the lastest "cluster patch" too (available from http://sunsolve.sun.com ).

Next find a disk with enough space for the installation. The DPSS binaries need about 125 MB, plus the DPSS lookup tables need about 2 MB for each 1 GB of DPSS disk. For example, for a DPSS with 64 GB of disk, you need 128 MB for lookup tables.

Then download the appropriate DPSS binaries

Instructions for using a 3ware RAID controller with the DPSS are here .


Installation steps:

There is a new installation script, dpss_install , but it has not been well tested. Use at your own risk! Be sure to edit the following definitions in the dpss_install script: DPSSHOME, DPSS_USER, HAVE_TAR, HAVE_TCPD, TCPD

If you prefer to do things by hand, the steps performed by this script are below.


Determine where the DPSS will be installed (e.g: /usr/local/DPSS), and create the following directories:

	/usr/local/DPSS/bin
	/usr/local/DPSS/logs
	/usr/local/DPSS/db

If you will be writing DPSS clients, also create:

	/usr/local/DPSS/lib
	/usr/local/DPSS/include

You'll probably want to make all these directories writable by yourself, instead of root. None of these files need to owned by root.

Next, add these lines to the file /etc/inetd.conf

# DPSS programs
  iscribe stream      tcp nowait root /usr/local/DPSS/bin/scribe scribe
  iss_start stream    tcp nowait root /usr/local/DPSS/bin/dpss_control dpss_control start
  iss_stop stream     tcp nowait root /usr/local/DPSS/bin/dpss_control dpss_control stop
  dsm_start stream    tcp nowait root /usr/local/DPSS/bin/dpss_control dpss_control dsm_start
  dsm_stop stream     tcp nowait root /usr/local/DPSS/bin/dpss_control dpss_control dsm_stop
  serv_start stream   tcp nowait root /usr/local/DPSS/bin/dpss_control dpss_control dpss_serv_restart
  JAT_restart stream tcp nowait  root  /usr/local/DPSS/bin/dpss_control dpss_control JAT_restart
  JAM_restart stream tcp nowait  root  /usr/local/DPSS/bin/dpss_control dpss_control JAM_restart
  dpss_transd stream tcp nowait  root  /usr/local/DPSS/bin/dpss_transd dpss_transd 

# network agent uses netperf
  netperf stream tcp nowait root /usr/local/DPSS/bin/netserver netserver

# DPSS needs these enabled too
  echo    stream  tcp     nowait  root    internal
  echo    dgram   udp     wait    root    internal
  discard stream  tcp     nowait  root    internal
  discard dgram   udp     wait    root    internal

Next, add these lines to the file /etc/services

	
# DPSS service ports
	imaster       14832/tcp
	iserver       14833/tcp
	iscribe       14834/tcp
# DPSS control ports
	nlm_restart   14990/tcp
	nld_restart   14991/tcp
	JAT_restart   14992/tcp
	JAM_restart   14993/tcp
	iss_httpd     14994/tcp
	serv_start    14995/tcp
	dsm_start     14996/tcp
	dsm_stop      14997/tcp
	iss_start     14998/tcp
	iss_stop      14999/tcp
        dpss_transd   15002/tcp
# netperf ports
	netperf         12865/tcp
	netperf         12865/udp

and then restart the "inetd" processes on your system. If you don't understand how to do this, then you probably shouldn't be installing the DPSS yourself. :)

The DPSS sends certain types of messsages to syslog. You might want to change the "/etc/syslog.conf" file to put these messages on a single host in a special file. This is how we do it at LBNL:

On the DPSS server hosts (be sure to use a tab instead of spaces in this file!):

  # dont put DPSS (local*) messages in syslog
  *.debug;mail.none;user.none;local1.none;local0.none     /var/log/syslog
  #
  # send all DPSS messages to the masterhost
  # status/debug messages
  local0.debug    @master.magic.net
  # NetLogger Messages
  local1.debug    @master.magic.net

Then on the master host:

  # dont put DPSS (local*) messages in syslog
  *.debug;mail.none;user.none;local1.none;local0.none     /var/log/syslog
  #
  # status/debug messages
  local0.debug    /usr/local/DPSS/logs/dpss.syslog
  # NetLogger Messages
  local1.debug    /usr/local/DPSS/logs/dpss.netlogger

Next, move the downloaded TAR file of DPSS binaries into /usr/local/DPSS/bin, and uncompress and un-tar the file.


These are the instructions for installing the DPSS the easy way. We recommend using added security by using TCP wrappers, and by not running the DPSS servers as root. See the Secure Installation instruction page for more information.


It is recommended that both the DPSS servers are started at boot time. An executable shell script called S99DPSS , put in the directory /etc/rc2.d (Solaris and IRIX) or /sbin/init.d (OSF1) or /etc/rc.d/init.d (Linux) will do this.

The next step is to Configure the DPSS .


COPYRIGHT NOTICE: Distributed Parallel Storage System and DPSS/ISS are Copyright © 1994 by Lawrence Berkeley Laboratory


This page is the resonsiblity of Brian L. Tierney. (BLTierney@lbl.gov). Support Credits are here. This document and its uses are subject to LBL's disclaimers and legal notices.

Credits: The research and development of the Distributed Systems Department i s funded by the U.S. Dept. of Energy, Office of Science, Office of Advanced Scie ntific Computing Research, Mathematical, Information, and Computational Sciences Division

If there is a problem with this page please, e-mail webmaster@www-itg.lbl.gov.


This page last modified: Thursday, 04-May-2000 17:16:46 PDT