Todd de Quincey
01/14/2023, 3:32 PMbuild_fivetran_assets
function and noticed that there isn’t the ability to pass in the group_name
to the assets. So I created this small (forked) PR which I was planning to submit to Dagster OSS.
However, after battling with trying to setup the local environment for over an hour, I’ve given up. Which is quite unfortunate.
Is there a technical reason why the dev environment isn’t dockerised?
Side note, can the changes that I have on this forked branch be implemented?daniel
01/14/2023, 4:00 PMTodd de Quincey
01/14/2023, 4:01 PMdaniel
01/14/2023, 4:03 PMTodd de Quincey
01/14/2023, 4:04 PMdaniel
01/14/2023, 4:07 PMTodd de Quincey
01/14/2023, 4:09 PMPhilippe Laflamme
01/15/2023, 10:20 PMgrpcio
I was finally able to get it to work on native m1 thanks to this thread using poetry
and this entry under [tool.poetry.dependencies]
in pyproject.toml
grpcio = [
{ version = "^1.51.1", markers = "sys_platform != 'darwin' and platform_machine!='arm64'", source = "pypi" },
{ markers = "sys_platform == 'darwin' and platform_machine=='arm64'", path = 'vendored/grpcio-1.51.1-cp311-cp311-macosx_11_0_arm64.whl' },
]
So, basically, you download that pre-built wheel locally, and point poetry
at it when it’s on darwin-aarch64
otherwise, have it use the PyPi dependency. Your mileage may vary with other dependency management tools.
For Docker, I wasn’t able to get a working version on alpine due to its use of musl
so stick to glibc
-based base images if you want to avoid another world of pain.daniel
01/15/2023, 10:21 PMPhilippe Laflamme
01/15/2023, 10:22 PMdaniel
01/15/2023, 10:23 PMPhilippe Laflamme
01/15/2023, 10:24 PMdaniel
01/18/2023, 4:43 PMTodd de Quincey
01/18/2023, 7:58 PMdaniel
01/18/2023, 8:04 PMTodd de Quincey
01/18/2023, 8:35 PM