Magpie contains a number of scripts for running big data software in HPC environments. It currently supports running over the parallel file system Lustre and running over any generic network filesystem. There is scheduler/resource manager support for Slurm, Moab, Torque, and LSF.
This release includes:
- New submission script type “sbatchmpirun”
- Experimental support for Tensorflow
- Support for additional versions of Spark and Hadoop
Learn more:
