The Distributed Parallel Storage Server (DPSS) Current "To Do" List

Lawrence Berkeley National Laboratory, Data Intensive Distributed Computing Project


This page contains a list of pending DPSS enhancement, and who is assinged to do it:
 
 

High Priority  Items
Assigned To
Fix DSM to key on Name, not set ID Jason
ability to do multiple data sockets per DPSS server Dan/Jason
dpss_transfer daemon performance enhancements:  threaded "copy_blocks" routine, only send partial block maps to the daemons, and do this in parallel,  option to run dpss_transd at either the source or the destination Dan/Brian T
speed up DpssOpen() call: currently way too slow (maybe new DSM will fix this) Jason
new client lib routing: dpssOpenNextFile();   use all existing sockets, but open different set ID Jason
clean up command line args to dpss_serv: pacing off by default, remove -i flag Jason
Fix Replicate mode: need to put replicate flag into the BlockMap header Jason
write dpssFstat() return info about a file: creation, modification, and  last acess times (wait till finish new DSM) Dan
DpssFlush() routine needed Dan
port DPSS client libs to the IBM SP Jason
add check for env NETLOGGER_DEST in NetloggerOpen, and add NetLoggerOpen() to dpssOpen() Dan
dpssLSeek() in write mode: currenly only works for 64K multiples; needs to work for all offsets 
(need to check if offset for current write is within the same block as the previous write, and if not write the previous block: ie: call dpssFlush)
Dan
change KB to MB in the iss.hw.db file to provide total DPSS space > 2.2 TB (better solution: make size a 64bit value) Brian T
dpssGetAttr()/ dpssSetAttr() for several items: ie: TCP buffer, #streams/server, protocol, # threads. All attrs are strings Brian T
replace master control channel with globus-IO; and possibly data channels too (This will provide globus authentication for the control channel) Jason

 
 
Other Items
Assigned To
asynchronous versions of dpssWrite() call Jason
merge Brian Toonen's DPSS install scripts into the DPSS distribution Jason
add NetLogger to dpss_transfer Dan/student
dpssFcntl() routine needed: for file locking Dan
add  O_RDWR mode to do DpssOpen()  ( actually: pvt_issfsOpenFile call) Dan
low level allocation calls like issBuildAllocInfo() still only 32bit; fix to use 64bit file sizes (all values are KB, so max DPSS file size is currently 2 TB, so this should not be a problem for a while) Dan
dpss_status should also check status of servers somehow Jason


This page is the resonsiblity of Brian L. Tierney. (BLTierney@lbl.gov). Support Credits are here.
This document and its uses are subject to LBL's disclaimers and legal notices.