Happy new year all just wanted to drop in my xmas project wh

Question

Happy new year all just wanted to drop in my xmas project which may be relevant to everyone containerising their pipelines <https github com treebeardtech whaler|Whaler> is a visual disk usage analyser for docker images It lets you see all the junk you may be inadvertently hauling around in your image which may be costing you time and money

mrdavidlaing · Answer

Awesome Can you post a screenshot of a dagster image

Alex Remedios · Answer

slightly smiling face < mrdavidlaing> ```FROM python 3 7 slim RUN pip install dagster``` ```docker build t dag whaler image dag ``` You can find a 14MB pip cache chilling in there amongst other goodies obviously this is not dagster s fault though

mrdavidlaing · Answer

Looks like there is a 34MB pip cache in the default dagster image `whaler image= dagster k8s example latest `

mrdavidlaing · Answer

< Alex Remedios> Would you be interested in collaborating on building a lighter dagster image If we found something workable perhaps we could submit a PR upstream

mrdavidlaing · Answer

I think this is a source Dockerfile <https github com dagster io dagster blob master python modules automation automation docker images k8s example Dockerfile>

Alex Remedios · Answer

sure that sounds like a good challenge What base image and version are you using

mrdavidlaing · Answer

I think the `dagster k8s example` image starts with `python 3 7 slim`

mrdavidlaing · Answer

I m wondering whether a good place to start is by using the Docker Builder Pattern to run all the intermediate steps ending with one that deletes a bunch of unnecessary files as revealed by whaler

Alex Remedios · Answer

yes that is a must

Alex Remedios · Answer

i m compiling a list of possible deletions

Alex Remedios · Answer

do you have some test cases I actually haven t used dagster for anything substantial yet e it may be easier starting from nothing using <https github com GoogleContainerTools distroless examples with docker|distroless>

mrdavidlaing · Answer

Nothing comprehensive Idea Let s start a GitHub issue and pull in some of the dagster team for advise Perhaps we can leverage some of the existing build test infrastructure via a PR

Alex Remedios · Answer

sure i ll cut one < mrdavidlaing>

mrdavidlaing · Answer

thankyou Lets move the conversation over to the PR