Channels
dagster-de
integration-airbyte
topic-async-execution
local-japan
dagster-cube
community-freelance
dagster-wandb
dagster-feedback
community-machine-learning
integration-bigquery
dagster-university
ask-community
dagster-dask
integration-snowflake
dagster-releases
integration-dbt
faq-read-me-before-posting
tools
feature-insights
feature-pipes
project-flexible-range-backfills
data-platform-design
community-events
dagster-serverless
dagster-noteable
introductions
integration-airflow
dagster-cloud
random
dagster-spatial
ask-ai
announcements
github-discussions
豆瓣酱帮
dagstereo
deployment-ecs
deployment-kubernetes
jobs
community-showcase
feature-asset-checks
Powered by
#data-platform-design
Title
# data-platform-design
d
Daniel Mosesson
12/05/2022, 6:34 PM
How do people handle dynamic partitioning (each new file coming in causes a sensor to fire, and then produce a graph, ultimately resulting in a number of assets getting updated)
➕ 1
o
owen
12/06/2022, 10:10 PM
Hi
@Daniel Mosesson
! Right now, there's not a built-in solution for this (although we're working on it!), but I talk through a potential workaround on this thread:
https://dagster.slack.com/archives/C01U954MEER/p1670360446324169
11 Views
Post