Join Slack
Powered by
Does Dagster have something like an SFTP sensor i....
# ask-community
g
geoHeil
03/06/2022, 4:23 PM
Does Dagster have something like an SFTP sensor i.e. like
https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.GetFTP/
for NiFi?
https://docs.dagster.io/_apidocs/libraries/dagster-ssh
seems to be quite bare-bones for connectivity - but not a sensor
a
Alex Kerney
03/07/2022, 2:20 PM
Here is a FTP sensor that I’ve created using the built in FTP library. However, if I wasn’t dealing with a cranky old non-standard FTP server, I would use fsspec and/or Universal Pathlib to abstract away the custom parsing that I had to do here.
FTP sensor.cpp
g
geoHeil
03/07/2022, 3:24 PM
thx
31
Views
Open in Slack
Previous
Next