Bringing HPC clusters into Science Mesh

8 pages•Published: August 9, 2023

Holger Angenent, Daniel Müller and Raimund Vogl

Abstract

Data transfers to and from High Performance Computing (HPC) clusters are a rather well established mechanism since standard Linux file transfer tools like scp and rsync can be used. Nowadays, users are not always familiar with these command-line based mechanisms and prefer more user friendly, and web based solutions. In this article we present a system to use the protocols of enterprise file sync and share systems (EFSS) for data transfers utilizing components of Science Mesh. In addition, this offers a technique to transfer data between different HPC sites without the need for commercial software or exposing the rather vulnerable port 22 to the outside world.

Keyphrases: cloud, enterprise file sync and share, high perfromance computing, science mesh

In: Jean-François Desnos and Martín López Nores (editors). Proceedings of European University Information Systems Congress 2023, vol 95, pages 249-256.

Links:	https://easychair.org/publications/paper/2PHk
	https://doi.org/10.29007/gfjd

BibTeX entry

@inproceedings{EUNIS2023:Bringing_HPC_clusters_into,
  author    = {Holger Angenent and Daniel Müller and Raimund Vogl},
  title     = {Bringing HPC clusters into Science Mesh},
  booktitle = {Proceedings of European University Information Systems Congress 2023},
  editor    = {Jean-François Desnos and Martín López Nores},
  series    = {EPiC Series in Computing},
  volume    = {95},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2398-7340},
  url       = {/publications/paper/2PHk},
  doi       = {10.29007/gfjd},
  pages     = {249-256},
  year      = {2023}}

Download PDF Open PDF in browser