The Data Intensive Distributed Computing Research Group (DIDC) 
(NOTE: Obsolete Web page! For current projects see the new DSD web page )
Lawrence Berkeley National Laboratory
Distributed Systems Department
Computational Research Division
Emerging scientific applications such as the Large Hadron Collider (LHC) at CERN and the Nasa EOS satellites are producing tremendous amounts of data. The Data Intensive Distributed Computing Research Group at LBNL is doing research on mechanisms and services to  efficiently move,  select, and manage huge data sets in a distributed, or Data Grid environment. We are also working on tools for monitoring and analyzing distributed system performance, which we call the Distributed Monitoring Framework (DMF). These projects are supported by the US Department of Energy MICS office, the National Collaboratories Program, and the Network Research program.
Current Projects:

Distributed Monitoring Framework (DMF)
Net100 Project:
   - LBNL Net100 page
   - NTAF page
Self Configuring Network Monitoring  

DMF Components:
 -  NetLogger Toolkit: end-to-end instrumentation and analyses
 -  Enable Network Monitoring Service
 -  pyGMA (GGF Grid Monitoring Architecture implementation)
-  Network Characterization Service (includes pipechar and netest)

Publications and Useful Links:

DIDC Publications (Papers and Talks)
TCP Tuning Guide for wide area distributed applications
We are part of or working closely with the following projects

Particle Physics Data Grid (PPDG)
EU DataGrid
The Globus Project
Internet2 End-to-End Performance Initiative
EU DataTAG Project, Work Package 2
GLobal Grid Forum (GGF) Participation: Members of DIDC are co-chairing the following GGF groups:
        Network Measurements WG
       Network Measurements for Application RG
       Grid Performance Working Group
        Discovery and Monitoring Event Descriptions WG

Past Projects:

The Distributed Parallel Storage System (DPSS)
Java Agents for Monitoring and Management(JAMM)
The DARPA Magic Gigabit Network Testbed Project
   The China Clipper Project
   The ENABLE Project
   The Matisse Project

Group Members:
   Brian L. Tierney (Group Leader) 
   Dan Gunter
   Jin Guojun   
   Jason R. Lee
   Martin Stoufer
Administrative Assistants:
       Gizella Kapus
       Jo Anne Yonemura
    Vibha Virmani


Job Opportunities:

  • No openings at the moment, but we always are looking for graduate students with programming experience who can commit to 1-2 years of work. Send resumes to
  • LBNL Open Positions ( How to Apply ) (Currently no open positions in this group)

Search DIDC using Google™

Search WWW Search

Privacy and Security Notice

Private DIDC info
Private DS Dept info
SysAdmin info

This page is the responsibility of Brian L. Tierney. ( Support Credits identify the funding sources and the organizational context of the work described in this document.
Disclaimers and Legal Notices apply to this document and its uses, and access to and uses of the system on which it resides at LBL. Like any Web page, it may be linked with pages and systems beyond LBL jurisdiction. Their contents and uses are the responsibility of their authors and administrators.

Credits: The research and development of the Distributed Systems Department is funded by the U.S. Dept. of Energy, Office of Science, Office of Advanced Scientific Computing Research, Mathematical, Information, and Computational Sciences Division

If there is a problem with this page please, e-mail


This page last modified: Wednesday, 19-Jul-2006 15:56:39 PDT