Channels
dagster-de
dagster-cube
gigs-freelance
dagster-wandb
dagster-machine-learning
dagster-bigquery
tools
dagster-dask
dagster-snowflake
dagster-releases
data-platform-design
events
dagster-serverless
dagster-noteable
introductions
dagster-airflow
dagster-cloud
random
dagster-dbt
faq-read-me-before-posting
dagster-airbyte
dagster-spatial
dagster-support
announcements
github-discussions
豆瓣酱帮
dagster-feedback
dagstereo
dagster-ecs
dagster-kubernetes
jobs
dagster-showcase
Powered by
Title
g
geoHeil
03/06/2022, 4:23 PM
Does Dagster have something like an SFTP sensor i.e. like
https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.GetFTP/
for NiFi?
https://docs.dagster.io/_apidocs/libraries/dagster-ssh
seems to be quite bare-bones for connectivity - but not a sensor
a
Alex Kerney
03/07/2022, 2:20 PM
Here is a FTP sensor that I’ve created using the built in FTP library. However, if I wasn’t dealing with a cranky old non-standard FTP server, I would use fsspec and/or Universal Pathlib to abstract away the custom parsing that I had to do here.
FTP sensor.cpp
g
geoHeil
03/07/2022, 3:24 PM
thx
2 Views
#dagster-support
Join Slack