Jake Kagan
07/24/2023, 4:04 PM# importing the parquet file data into redshift --- need to abstract away the table creation schema **later
@op(required_resource_keys={'rsrc_redshift_qry_runner'},
config_schema={'bucket': str, 'file_path': str, 'file_name': str, 'file_format': str, 'table_full_path': str})
def op_redshift_copier(context, from_s3):
f'''
populates {TABLE_NAME}
:param context:
:param from_s3:
:return:
'''
this won't work because it's considered a string once i add the formattingrex
07/24/2023, 6:57 PM__doc__
https://stackoverflow.com/questions/4056983/how-do-i-programmatically-set-the-docstringJake Kagan
07/24/2023, 6:59 PM__doc__
directly that was my problem