https://dagster.io/ logo
Title
g

geoHeil

03/06/2022, 4:23 PM
Does Dagster have something like an SFTP sensor i.e. like https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.GetFTP/ for NiFi? https://docs.dagster.io/_apidocs/libraries/dagster-ssh seems to be quite bare-bones for connectivity - but not a sensor
a

Alex Kerney

03/07/2022, 2:20 PM
Here is a FTP sensor that I’ve created using the built in FTP library. However, if I wasn’t dealing with a cranky old non-standard FTP server, I would use fsspec and/or Universal Pathlib to abstract away the custom parsing that I had to do here.
g

geoHeil

03/07/2022, 3:24 PM
thx