how do i get the entire content of the column using the debugger output and a dataframe?

logger.debug(no_nulls_df.head())

i can’t seem to set the pandas options: pd.set_option(‘display.width’, 1000)

tested it on my end.

pd.set_option("display.max_colwidth", 1000)

should work. here’s what i ran:

from dagster import op, job, repository
import pandas as pd


@op
def my_op():
    pd.set_option("display.max_colwidth", 1000)
    df = pd.DataFrame(
        {
            "col1": [
                "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aenean interdum purus nec ipsum eleifend, ac ullamcorper leo placerat. Mauris non nunc dui. Nulla at libero ut tellus sodales mollis sit amet vitae nisi. Duis vestibulum tristique justo at consectetur. Suspendisse tincidunt nisi nec felis accumsan, quis placerat neque varius. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Proin vitae velit ut massa lobortis euismod vitae vel nisl. Quisque varius dapibus dolor non scelerisque. Maecenas a commodo ligula, nec commodo ex. Vestibulum a odio gravida, venenatis massa ut, hendrerit tortor. In euismod libero massa, id dictum felis mollis ut.",
                2,
            ],
        }
    )
    print(df)


@job
def my_job():
    my_op()


@repository
def my_repo():
    return [my_job]

ok. so use print instead of debug in the logger. i’ll try that

ah i haven’t tried with logger. but set

max_colwidth

instead

width

worked for me.