Sai Gopinath
03/07/2023, 9:24 PMdatabricks_pyspark_step_launcher
. The error is
Response from server:
{ 'error_code': 'RESOURCE_DOES_NOT_EXIST',
'message': 'No file or directory exists on path '
'/dagster_staging/xxxxxxxxxxxxxxxxxxxxxxxx/pyspark_commands_1/stdout.'} when attempting to load stdout logs for step pyspark_commands_1. Check the databricks console for more info.
after Uploading Databricks configuration to DBFS, main file, dagster job etc.
i checked the s3 location where dbfs is mounted and files are present
can anyone please look into this and provide some suggestions?
Thank you