Grid Computing at DESY

[Home]

[Monitor]

[Grid@DESY] [Certs & VOs] [VOMS] [User Guide] [FAQ] [Install Guides] [Admin Guide]

[Talks & Conferences]

[Glossary] [Documentation] [Links]

In order to ensure response in case of problems, use the Global Grid User Support GGUS and/or your VO support rather than private e-mail contacts or internal mailing lists.

The DESY Grid Testbed (EDG 1.4)

In remembrance of our colleague and friend Ralf Gerhards (1959-2003).

The DESY Grid Testbed was switched off on 24 June 2004. It was the first complete DESY Grid installation and served to study installation details as well the usage of Grids. Refer to DESY Grid Testbed2 for further studies.

A Grid Testbed based on European DataGrid (EDG) software version 1.4 is currently being set up by an open group of people of the IT group and DESY's experimental groups. It incorporates roughly a dozen SuSE Linux PCs which have been donated by various groups. The project was initiated by H1 and IT and is joined by ZEUS.

The main goal of the Grid Testbed is to study the feasibility to deploy EDG software at DESY and to gain experience of how to operate a Grid site. A special focus eas put on running Grid software under DESY Linux which is based on S.u.S.E.. The Grid Testbed set-up is independent of any experiment specific software settings.

Experiment software will be brought to the Grid Testbed in a second phase, the so-called prototype phase.

Based on the Grid Testbed experiences it is planned to build a dedicated system for Monte Carlo production for H1 on dedicated hardware (H1GRID).

The activities are planned to be finished until beginning of 2004 and migrate towards EGEE at DESY.

This is the DESY Grid Testbed web page. The project was initiated by H1 and IT. It is run by an open group of persons of the IT group and the experimental groups.
A talk Grids@DESY (Andreas Gellrich, DESY IT Group) was given in the DESY Computing Seminar on Monday, 27 October 2003. It covers in great detail the Grid Testbed developments.

Contents

• Introduction
• Grid Testbed Talks and papers
• The Testbed
• Technical Documentation and HOWTOs
  • EDG 1.4 installation on DESY Linux 4
• Minutes (Intranet only)
• UK Contacs
• Mailing List
• Links

[top]

Introduction

DESY IT maintains a newsgroup and a mailing list for the DESY Grid testbed activities:

• newsgroup: desy.grid.testbed

Please contact Andreas Gellrich (-2732) for further details. Also refer to the DESY IT Grid web page.

The Grid Testbed project incorporates three phases:

• In the first phase a testbed is set up to study basic features of a EDG-like Grid. This contains the installation of all relevant Grid elements on SuSE Linux-based PCs. Main focus will be put on Grid software rather than on experiment specific software. It is not intended to use the testbed hardware as a production system.
• The second phase will comprise a protoype system HEP applications, e.g. H1 Monte Carlo generation, HERA-B applications, etc.
• The third phases is dedicated to bring H1 Monte Carlo generation into production on dedicated hardware (H1GRID).

Last grid-dev meeting: 16 Apr 2004, 15.00h, 1c/343

[top]

Grid Testbed Talks and papers

• A. Gellrich (DESY IT Group): Grids@DESY - Investigating Grid middleware to be used at DESY
  (Technical Seminar, November 11, 2003, DESY, Zeuthen, Germany).
• M. Vorobiev (DESY H1): H1 Grid project
  (Internal H1 Meeting, October 31, 2003, DESY, Hamburg, Germany)
• Jacek Nowak (DESY H1): EDG 1.4 RPM package installation on DESY Linux 4 (SuSe 7.2) machines (Abstract, talk, paper).
  (The 3rd Cracow Grid Workshop 27-29 October 2003, Cracow, Poland.)
• A. Gellrich (DESY IT Group): Grids@DESY
  (EDV Seminar, October 27, 2003, DESY, Hamburg, Germany).
• I. Iglesias (U Vigo, Spain): A Brief Review on File Management in DataGrid
  (Grid Testbed Meeting, August 1, 2003, DESY, Hamburg, Germany).

[top]

The Testbed

The current set-up of the testbed contains a handfull of Linux PCs donated by H1 and HERA-B.

[Ganglia Testbed cluster view]

Hostname	Node Type	Hardware
grid001	RC	dual PII/266MHz, 128MB, 4GB SCSI + 30GB SCSI
grid002	SE	dual PII/266MHz, 128MB, 4GB SCSI + 30GB SCSI
grid003	UI	dual PII/266MHz, 128MB, 4GB SCSI + 30GB SCSI
grid004		dual PII/266MHz, 128MB, 1GB SCSI + 2GB SCSI + 4GB SCSI
grid005		PII/266MHz, 256MB, 9GB SCSI
grid006	RB	dual PIII/550MHz, 512MB, 9.1GB SCSI
grid007	CE	PIII/450MHz, 192MB, 20GB IDE
grid008	WN	PIII/450MHz, 128MB, 20GB IDE
grid009	BDII	PIII/450MHz, 128MB, 20GB IDE
grid010		PIII/450MHz, 192MB, 20GB + 22GB IDE

Grid Elements

• The User Interface (UI) is grid003.
• The Computing Element (CE) contains a gatekeeper running on grid007 and a Worker Node (WN) running on grid008.
• The Storage Element (SE) runs on grid002
• The Resource Broker (RB) runs on grid006
• The Replica Catalog (RC) runs on grid001
• The Information Index (BDII) runs on grid009.
• VO services come form the DESY LDAP server ldap.desy.de.

[top]

Technical Documentation

Installation procedures:

• EDG 1.4 installation on DESY Linux 4

Certification:

• Grid Certification at DESY (Andreas Gellrich)

Technical descriptions:

• Ports and Processes (Andreas Gellrich)

User HOWTOs:

• Sample Commands (Andreas Gellrich)

More Details:

• Miscellaneous (Andreas Gellrich)
• GridFTP (Andreas Gellrich)
• EDG Job Submission Details (Andreas Gellrich)
• Operating the Grid Elements (Andreas Gellrich)
• Get It Running (Andreas Gellrich)
• Data Management Mechanism Description (Maxim Vorobiev)

Further techincal details:

• Recompilation and installing of perl packages (Jacek Nowak)
• First (failed) attempt to install EDG (Jacek Nowak)
• Attempt of EDG installation over SuSe (old) (Max Vorobiev)
• Command history of job submission tests with Dave Kant (Jacek Nowak)
• Summary of DESY Grid Technical Session June 26/27 2003 (Dave Kant)

[top]

Minutes

We maintain minutes of the grid-dev meetings.

[top]

UK Contacts

[top]

The Grid testbed developers

The following persons participate in the DESY Grid Testbed developments:

DESY Hamburg

DESY Zeuthen

Queen Mary University of London

University of Dortmund

[top]=

Links

• DESY IT Grid Page
• WP Website
  • Grid Work Scheduling WP1 (LB, RB, JSS, II, )
  • Grid Data Management WP2
  • Grid Monitoring Services WP3
  • Fabric Management WP4
  • Mass Storage Management WP5
  • Testbeds WP6
  • Network WP7
  • HEP Applications WP8
  • Earth Observation Applications WP9
  • Biology applications WP10
• Ganglia

[top]

---

Last modified: Thu Jan 20 16:09:28 MET 2005

by the DESY Grid Team: http://grid.desy.de/

---