Uchuu-BigData@CESGA
The Uchuu-BigData platform uses the BDICESGA infrastructure at CESGA. It provides quick access to ready-to-use Big Data solutions, and enables users to take advantage of modern tools for data processing covering a wide range of use cases that include processing large volumes of information in a parallel, processing high velocity streams of data in real-time or near real-time, or processing heterogeneous data from different sources (structured and unstructured). There is no need to learn how to deploy complex big data services, users can just connect and start using them. BDICESGA provides a scalable infrastructure which capacity can grow with demand adding additional resources. Currently it provides,
- Storage: 816TB
- Aggregated I/O throughtput 30GB/s
- Aggregated RAM: 2432GB
- 912 vcores
- 10GbE connectivity between all nodes
The Uchuu-BigData@CESGA platform allows the users to develop their own analysis codes and run tasks by launching a Jupyter notebook (or direct SSH access). At present only Uchuu Halo Catalogs are available, more products will be digested soon.
We provide a simple Jupyter notebook that will allow the users to play with the Uchuu halos on their own laptops.
This experience will provide a good sense of developing your own work on Uchuu-BigData@CESGA. For large scale analysis, advanced users are welcome to apply for access.
The Uchuu-BigData platform uses the BDICESGA infrastructure at CESGA. It provides quick access to ready-to-use Big Data solutions, and enables users to take advantage of modern tools for data processing covering a wide range of use cases that include processing large volumes of information in a parallel, processing high velocity streams of data in real-time or near real-time, or processing heterogeneous data from different sources (structured and unstructured). There is no need to learn how to deploy complex big data services, users can just connect and start using them. BDICESGA provides a scalable infrastructure which capacity can grow with demand adding additional resources. Currently it provides,
- Storage: 816TB
- Aggregated I/O throughtput 30GB/s
- Aggregated RAM: 2432GB
- 912 vcores
- 10GbE connectivity between all nodes
The Uchuu-BigData@CESGA platform allows the users to develop their own analysis codes and run tasks by launching a Jupyter notebook (or direct SSH access). At present only Uchuu Halo Catalogs are available, more products will be digested soon.
We provide a simple Jupyter notebook that will allow the users to play with the Uchuu halos on their own laptops.
This experience will provide a good sense of developing your own work on Uchuu-BigData@CESGA. For large scale analysis, advanced users are welcome to apply for access.