CloudyCluster creates an HPC environment in the Public Cloud that is similar to on premise HPC systems. To provide elasticity in the cloud, we have developed a meta-scheduler. The CCQ meta-scheduler enables jobs to control elastic launching and deleting of instances as required. These can be diverse instance types including preemptible and standard as required by the individual jobs.
To support the SGCI Cloudify Gateways solicitation https://sciencegateways.org/cloudify2019 we will be adding new simplified HPC Job Submission APIs for CCQ to the next release of CloudyCluster targeted for the SC19 timeframe.