Distributed-Parallel Storage System (DPSS) Configuration

Lawrence Berkeley National Laboratory, Data Intensive Distributed Computing Project


This page contains instructions for configuring the DPSS system software.

First, add the DPSS binaries directory to your path, and set the following environment variables:

   setenv DPSSHOME /usr/local/DPSS
   setenv DPSSHOST hostname of system running dpss_mast and dsm
   set path =($DPSSHOME/bin $path)

Then copy dpss_control.template to /usr/local/DPSS/bin/dpss_control, and edit that file, setting the variables DPSSHOME your system. DPSSHOME is the location of your DPSS tree (e.g: /usr/local/DPSS or /home/dpss). Also set the START_MASTER variable to yes if you are running a DPSS master process on this host. (Its fine to run a master and server on the same host, just be sure you have at least 64 MB Ram minimum)

Next, partition your disks for DPSS usage. Be sure to to create a small partition at the start of the disk that is unused, otherwise you'll overwrite the disk superblock, and trash your entire disk. For Solaris use the format command, and for Linux use the fdisk command. NB: for linux, make sure that you first create an empty dos partition at the front, or it won't read the disk. An easy way to partition it is to use cdisk This a sample disk partition layout for a Solaris system , and here is one for a Linux system .

Next create a hardware configuration file.

Coming soon! An LDAP version of the hardware database interface. Here is the prototype.

In the meantime, just use vi or emacs to create a file called "iss.hw.db", in the directory: $DPSSHOME/db.

This file has the following format:

 Server: server-name:server port: amount of RAM to use (MB):TCP window size: Server up flag: Server Default write 
 Interfaces:
   host name: speed (MBytes/sec): Interface Up flag:
   host name2: speed (MBytes/sec): Interface Up flag:
 Disks:
   raw disk name: disk size (MB): disk speed (KB/s): available flag: disk group (use 0 for now):
   raw disk name2: disk size (MB): disk speed (KB/s): available flag: disk group (use 0 for now):
 End

Notes:
RAM: its best to not use mmore than 50% of the actual host memory. Anything between 32M and 64M seems to work well.
server port: use 14835 unless you are trying to run 2 server on the same host.
TCP window size: size of the DPSS server TCP send buffer. This value should be your maximum estimated bandwidth delay product, in bytes.
Default write field: 1 if this server should be used by default when writing to the DPSS.

For example:

  Server: lbl-server3:14835:32:256000:1:1:
  Interfaces:
  dpss3-atm.lbl.gov:20:1:
  dpss-3.lbl.magic.net:20:1:
  Disks:
  /dev/rdsk/c0t0d0s1:4000:5000:1:0:
  /dev/rdsk/c0t1d0s1:4000:5000:1:0:
  /dev/rdsk/c1t0d0s1:4000:5000:1:0:
  /dev/rdsk/c1t1d0s1:4000:5000:1:0:
  End

There should be one entry like this for each DPSS server and master. (If the master and server are the same host, only 1 entry is needed). All fields must be separated by a colon. For a sample file see iss.hw.db . You should probably add all possible interface names for each system. The DPSS will try all interfaces, and select the fastest one automatically.

Use the raw disk device name for the disk names (ie: /dev/rdsk/c1t3d0s1 for Solaris, or /dev/rrz25b for OSF), and be sure to include the partition as part of the disk name.

Then run hwdb2ascii to make sure that the iss.hw.db file has no errors, and then run the program bldb_init -i to initialize the block data base file.

Next start the DPSS and the DSM, as described on the DPSS operation page.

You are now ready to load data onto the DPSS. The simplest programs for reading/writing to the dpss are dpss_get and dpss_put .

To load Magic project / Image Pyramid data, see the Pyramid Data Loading Instructions Page .

You might also, for debugging, want to configure 2 servers on the same host.


COPYRIGHT NOTICE: Distributed Parallel Storage System and DPSS/ISS are Copyright © 1994 by Lawrence Berkeley Laboratory


This page is the resonsiblity of Brian L. Tierney. (BLTierney@lbl.gov). Support Credits are here. This document and its uses are subject to LBL's disclaimers and legal notices.

Credits: The research and development of the Distributed Systems Department i s funded by the U.S. Dept. of Energy, Office of Science, Office of Advanced Scie ntific Computing Research, Mathematical, Information, and Computational Sciences Division

If there is a problem with this page please, e-mail webmaster@www-itg.lbl.gov.


This page last modified: Thursday, 04-May-2000 17:16:46 PDT