Public cloud use in a hybrid HPC environment remains a challenge: compute is easy, but data access comes with complications. Storage vendors have implemented various approaches to the problem of bursting data to the cloud. Some use global namespaces to stretch the filesystem others use snapshots and others shared repositories.
In this talk we explore these different approaches: their strengths, weaknesses and scenarios where they best apply.
Citation: Admin, eRNZ (2025). Quantum simulation at Pawsey Supercomputing Research Centre. eResearch NZ. Presentation. https://doi.org/10.6084/m9.figshare.28537583.v1
ABOUT THE AUTHORS
Adrian Torrie, of Ngāti Porou descent, is a skilled solutions architect with broad experience building and maintaining data systems from the ground up. He has broad skills across all IT domains, with specific depth in automating data analytics/machine learning/artificial intelligence solutions in hybrid environments, along with the necessary skills for training others in this specialty. Adrian’s last role had a primary focus of enabling self-service, via Platform Engineering, for Data Scientists and Data Engineers, allowing rapid iteration of models and their release. He excels in delivering secure solutions for large scale, high performance computational requirements using modern automation approaches.
https://www.linkedin.com/in/adriantorrie/
For more information about the eResearch NZ/eRangahau Aotearoa conference, visit:
https://eresearchnz.co.nz/
