PhD Position F/M Modeling and Simulation of Exascale Storage Systems
Télécharger l'offre au format PDF
Le descriptif de l’offre ci-dessous est en Anglais
Type de contrat : CDD
Niveau de diplôme exigé : Bac + 5 ou équivalent
Autre diplôme apprécié : Master's degree
Fonction : Doctorant
A propos du centre ou de la direction fonctionnelle
The Inria Rennes - Bretagne Atlantique Centre is one of Inria's eight centres and has more than thirty research teams. The Inria Center is a major and recognized player in the field of digital sciences. It is at the heart of a rich R&D and innovation ecosystem: highly innovative PMEs, large industrial groups, competitiveness clusters, research and higher education players, laboratories of excellence, technological research institute, etc.
Contexte et atouts du poste
Context
This thesis is placed in the context of NumPEx (https://numpex.fr/), a key national project whose goal is to co-design the software stack for the exascale era and prepare applications accordingly. This thesis will be co-supervised by Inria and CEA, respectively the Inria center at the University of Rennes and the CEA center at Bruyères-Le-Châtel, near Paris. Beyond the supervision, collaborations within NumPEx with the different partners of the consortium are to be expected.
PhD Advisors
Location and Mobility
The thesis, co-supervised by Inria and CEA, will be hosted by the KerData team at the Inria research center of Rennes and will include regular visits at the CEA Center of Bruyères-le-Châtel. Rennes is the capital city of Britanny, in the western part of France. It is easy to reach thanks to the high-speed train line to Paris. Rennes is a dynamic, lively city and a major center for higher education and research: 25% of its population are students.
This thesis will also include collaborations with international partners, especially from the US.
The KerData team in a nutshell for candidates
Mission confiée
Introduction
Nowadays, there are many scientific fields such as radio-astronomy or weather forecast for example where the need for computing power and data processing capacity goes beyond what current machines can provide. For these workloads, the resources required are such that supercomputers capable of reaching the exascale become necessary. To date, only a few machines such as Frontier at Oak Ridge National Laboratory (USA) have this capability, but in the coming months, new systems will be deployed. However, the efficient use of these systems raises new challenges, especially regarding data management.
Indeed, even though High-Performance Computing (HPC) systems are increasingly powerful, there has been a relative decline in I/O bandwidth. Over the past ten years, the ratio of I/O bandwidth to computing power of the top three supercomputers has been divided by 10 (see Figure below) while in some scientific computing centers the volume of data stored has been multiplied by 41 [1]. This tends to accentuate congestion and performance variability on often centralized storage systems [2,3]. To mitigate that, new levels of storage have been added to recently deployed supercomputers, increasing their complexity. Harnessing this additional storage capacity is an active research topic but little has been done about how to efficiently provision it [4,5].
Thesis proposal
Dealing with this high degree of storage heterogeneity is a real challenge for scientific workflows and applications. This PhD thesis proposes to model and simulate heterogeneous storage systems in order to study their behavior, predict their performance and propose innovative algorithmic approaches for better resource utilization.
Principales activités
One of the aims of this thesis is to make better use of storage resources for scientific applications and workflows that are destined to run on exascale supercomputers. Initially, storage systems such as Lustre and DAOS will be studied, modeled and simulated in an existing WRENCH-based [6] simulator, called StorAlloc [5], developed in the team. This study will shed light on the criteria influencing the performance of these systems. Secondly, advanced resource allocation algorithms will be proposed, implemented and evaluated in the simulator to overcome the limitations of existing methods (e.g. Lustre uses the disks of its storage system in a simple round-robin manner). Multiple criteria can be taken into account in those algorithms such as contention or energy. Tools developed by the CEA, including the Robinhood policy engine [7] and the outcomes from the IO-SEA European Project [8] will also be used to validate these contributions on real systems. For this work, a strong emphasis will be put on international collaborations, especially with the University of Manoa (HI, USA), and on national partnership such as with the French SKA team providing a relevant use-case for this work. The candidate will also have the opportunity to be hosted for 3-6 month internships abroad to strengthen the international visibility of his/her work and benefit from the expertise of other researchers in the field.
References
[1] GK. Lockwood, D. Hazen, Q. Koziol, RS. Canon, K. Antypas, and J. Balewski. "Storage 2020: A Vision for the Future of HPC Storage". In: Report: LBNL-2001072. Lawrence Berkeley National Laboratory, 2017.
[2] O. Yildiz, M. Dorier, S. Ibrahim, R. Ross, and G. Antoniu. "On the Root Causes of Cross-Application I/O Interference in HPC Storage Systems". In: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 2016, pp. 750–759
[3] F. Tessier, V. Vishwanath. "Reproducibility and Variability of I/O Performance on BG/Q: Lessons Learned from a Data Aggregation Algorithm". United States: N. p., 2017. Web. doi:10.2172/1414287
[4] F. Tessier, M. Martinasso, M. Chesi, M. Klein, M. Gila. "Dynamic Provisioning of Storage Resources: A Case Study with Burst Buffers". In: IPDPSW 2020 - IEEE International Parallel and Distributed Processing Symposium Workshops, May 2020, New Orleans, United States.
[5] J. Monniot, F. Tessier, M. Robert, G. Antoniu. "StorAlloc: A Simulator for Job Scheduling on Heterogeneous Storage Resources". In: HeteroPar 2022, Aug 2022, Glasgow, United Kingdom.
[6] H. Casanova, R. Ferreira da Silva, R. Tanaka, S. Pandey, G. Jethwani, W. Koch, S. Albrecht, J. Oeth, and F. Suter. "Developing Accurate and Scalable Simulators of Production Workflow Management Systems with WRENCH". In: Future Generation Computer Systems, vol. 112, p. 162-175, 2020.
[7] https://github.com/cea-hpc/robinhood
[8] https://iosea-project.eu/
Compétences
Avantages
Rémunération
monthly gross salary amounting to 2051 euros for the first and second years and 2158 euros for the third year
Informations générales
Consignes pour postuler
Please submit online : your resume, cover letter and letters of recommendation eventually
For more information, please contact francois.tessier@inria.fr
Sécurité défense :
Ce poste est susceptible d’être affecté dans une zone à régime restrictif (ZRR), telle que définie dans le décret n°2011-1425 relatif à la protection du potentiel scientifique et technique de la nation (PPST). L’autorisation d’accès à une zone est délivrée par le chef d’établissement, après avis ministériel favorable, tel que défini dans l’arrêté du 03 juillet 2012, relatif à la PPST. Un avis ministériel défavorable pour un poste affecté dans une ZRR aurait pour conséquence l’annulation du recrutement.
Politique de recrutement :
Dans le cadre de sa politique diversité, tous les postes Inria sont accessibles aux personnes en situation de handicap.
Contacts
L'essentiel pour réussir
The candidate will have to show motivation, autonomy and an ability to initiate links between the research activities carried out at INRIA and at the CEA center.
A propos d'Inria
Inria est l’institut national de recherche dédié aux sciences et technologies du numérique. Il emploie 2600 personnes. Ses 215 équipes-projets agiles, en général communes avec des partenaires académiques, impliquent plus de 3900 scientifiques pour relever les défis du numérique, souvent à l’interface d’autres disciplines. L’institut fait appel à de nombreux talents dans plus d’une quarantaine de métiers différents. 900 personnels d’appui à la recherche et à l’innovation contribuent à faire émerger et grandir des projets scientifiques ou entrepreneuriaux qui impactent le monde. Inria travaille avec de nombreuses entreprises et a accompagné la création de plus de 200 start-up. L'institut s'efforce ainsi de répondre aux enjeux de la transformation numérique de la science, de la société et de l’économie.
Academic Europe, the European career network for Academics, Researchers and Scientists
