19913d85-f662-4518-a9a1-7adc1793dfd4.png){kind=small}
How can I send the logs from the containers throug...
# ask-communityg
George Pearse
04/04/2022, 1:35 PMHow can I send the logs from the containers through to a log store like Kibana?
j
johann
04/04/2022, 4:50 PMDagster doesn’t currently have 1st class support for ELK stack, but it’s something on our radar
johann
04/04/2022, 4:53 PMHow do you have Dagster deployed? If it’s something like K8s, you would just be able to use the native ELK integration and all the Dagster containers would have their logs uploaded by the filebeat agents
g
George Pearse
04/04/2022, 6:05 PMCheers @johann was wondering if something could be done at the K8s level, that is how it's deployed
j
johann
04/04/2022, 9:19 PMYeah we’re thinking about ways in which we can integrate better, for example showing a link in Dagit to the relevant page in Kibana
❤️ 2
g
George Pearse
04/06/2022, 8:20 AMHey @johann Kibana's not currently on the same K8 cluster as Dagster, we run it on a standalone instance, does that change how I can shift the logs accross?
George Pearse
04/06/2022, 9:47 AMTbh it'd be great if there was an option to just have them available in dagit, at least for errors. Definitely noticed that leaps and bounds of progress have been made in terms of displaying relevant errors there from an infra perspective.
George Pearse
04/06/2022, 11:09 AMI actually can see this via the UI, so thanks a lot for that!
j
johann
04/06/2022, 12:29 PMFor just showing logs in Dagit- we currently offer to upload them to S3 or similar blob storages, and can render them in Dagit from there https://docs.dagster.io/deployment/dagster-instance#compute-log-storage
✅ 1
5 Views