https://dagster.io/ logo
#ask-ai
Title
# ask-ai
j

James Colvin

02/29/2024, 5:32 PM
What are the hardware recommendations for running the Dagster agent on-premise?
s

Scout

02/29/2024, 5:32 PM
The documentation does not provide specific hardware recommendations for running a Dagster agent on-premise. However, it does mention that when running the local agent in production, you should ensure that you have a supervisor to automatically restart the agent process if it crashes and a system in place to alert you or automatically restart if the VM or container dies. The local agent's ability to run jobs is limited by the capacity of the single node on which it’s running, so you should consider the resource requirements of the jobs that the agent will execute. For more detailed or specific hardware recommendations, you might want to consider the resource requirements of your particular use case, including the complexity and volume of the jobs you plan to run with Dagster. It's also a good practice to monitor the performance and resource usage of your agent to make informed decisions about scaling your hardware appropriately. If you have a high volume of jobs or jobs that are resource-intensive, you will need to ensure that your hardware can handle the load.
t

Tim Castillo

02/29/2024, 5:35 PM
@Dagster Bot discussion What are the hardware requirements for running open source Dagster?
d

Dagster Bot

02/29/2024, 5:35 PM
Question in the thread has been surfaced to GitHub Discussions for future discoverability: https://github.com/dagster-io/dagster/discussions/20157
2 Views