If your landscape is primarily ETL and Batch jobs, the job per cluster paradigm (shown below) works.
DataProc Pricing
- Pricing consists of Cluster Size and Duration of Run
Pricing formula is: $0.010 * # of vCPUs * hourly duration
- Dataproc clusters are billed in one-second clock-time increments
- Scaling and autoscaling clusters. When VMs are added to the cluster, those machines are charged for the period of time that they are active. When machines are deleted, they are no longer billed.
- Dataproc pricing is in addition to the Compute Engine per-instance pricefor each virtual machine