Hello all, i want to try the hybrid deployment to orchestrate databricks jobs but i have some doubts about the pricing, is this the channel to ask?
j
Joe
04/11/2023, 12:56 PM
hey @Jhonatan Sossa yep this is the place how can we help with your pricing ?
j
Jhonatan Sossa
04/11/2023, 1:28 PM
Hi @Joe, I am going to have jobs running all day and I know the hybrid pricing is 0.03 per compute minute but my compute is going to be running on a cluster of databricks. what would the Dagster billing be or what does it depend on (I am going to deploy the agent on AWS).
j
Joe
04/11/2023, 1:45 PM
yes for hybrid dagster will bill for the step duration (excluding resource initialization) of your job runs. So in the situation where every day you have a fan-out job that has 5 steps that each run for an hour you will be charged for 5hrs of usage a day. https://dagster.io/pricing
if you have long running jobs that are idling refactoring them to use sensors will help reduce your billed usage