Data-Management
For an overview of available filesystems, their potential use and other details please visit storage infrastructure. These pages briefly summarize the rules applying, availability and remote access options.
GPFS HOME |
who can use: | Everyone with access to Maxwell. |
How to use it: | home-directories will be generated automatically when connecting to the maxwell cluster the first time |
limitations: | The quota is 30GB. Due to space limitations, this quota cannot be increased. /software/tools/bin/my-quota shows the current values for your account. |
Security: | Snapshots are available from /home/.snapshots/. It keeps versions dating back up to 7 days. There are no backups. |
Persistence: | Home directories will be permanently deleted some time after an account has expired. Home directories will not be archived. |
Export: | Home directories will not be exported. Use sshfs, scp, rclone, rsync, ... to make files available elsewhere |
DUST (GPFS) |
who can use: | All groups - WITHOUT group dedicated GPFS space. Please consult the DUST storage page |
How to use it: | Please consult the DUST storage page |
limitations: | Default quota 250G, but can be larger if needed. Please consult the DUST storage page |
Security: | NONE. A lost/deleted file is lost forever. |
Persistence: | Directories and files in DUST will be permanently deleted some time after an account has expired. |
Export: | DUST directories will not be exported. Use sshfs, scp, rclone, rsync, ... to make files available elsewhere |
DESY BeeGFS - TO BE RETIRED SOON |
who can use: | Everyone with access to Maxwell. |
How to use it: | Avoid using it. It's being retired soon. Use DUST or group dedicated GPFS space instead. |
limitations: | No quota. In short time: no limitation. For duration > 1 week try to keep volumes < 10TB. We will inform users about excessive usage. |
Security: | NONE. A lost/deleted file is lost forever. |
Persistence: | Directories and files in BeeGFS will be permanently deleted some time after an account has expired. |
Export: | BeeGFS directories will not be exported. Use sshfs, scp, rclone, rsync, ... to make files available elsewhere |
- Space in dCache, CSSB, EuXFEL/Petra-3/CFEL GPFS, AFS is subject to group policies. Get in touch with the corresponding admins for further information.
- Maxwell login nodes, such as max-wgs, max- display can only access Maxwell subnets, but not internal subnets. No direct access to e.g. windows desktops. To copy data to or from Maxwell, you must initiate this from your desktop or setup a tunnel/proxy.