martin o leary
04/04/2023, 4:48 PMpoetry add tensorflow
and getting an error relating to incompatible dependencies ( grpcio
) :
Because no versions of tensorboard match >2.12,<2.12.1 || >2.12.1,<2.13
and tensorboard (2.12.0) depends on grpcio (>=1.48.2), tensorboard (>=2.12,<2.12.1 || >2.12.1,<2.13) requires grpcio (>=1.48.2).
And because tensorboard (2.12.1) depends on grpcio (>=1.48.2), tensorboard (>=2.12,<2.13) requires grpcio (>=1.48.2).
Because no versions of tensorflow match >2.12.0,<3.0.0
and tensorflow (2.12.0) depends on tensorboard (>=2.12,<2.13), tensorflow (>=2.12.0,<3.0.0) requires tensorboard (>=2.12,<2.13).
(1) Thus, tensorflow (>=2.12.0,<3.0.0) requires grpcio (>=1.48.2).
Because no versions of dagster-dbt match >0.17.20,<0.17.21 || >0.17.21,<0.18.0
and dagster-dbt (0.17.20) depends on dagster (1.1.20), dagster-dbt (>=0.17.20,<0.17.21 || >0.17.21,<0.18.0) requires dagster (1.1.20).
And because dagster (1.1.20) depends on grpcio (>=1.32.0,<1.48.1), dagster-dbt (>=0.17.20,<0.17.21 || >0.17.21,<0.18.0) requires grpcio (>=1.32.0,<1.48.1).
And because dagster-dbt (0.17.21) depends on dagster (1.1.21)
and dagster (1.1.21) depends on grpcio (>=1.32.0,<1.48.1), dagster-dbt (>=0.17.20,<0.18.0) requires grpcio (>=1.32.0,<1.48.1).
And because tensorflow (>=2.12.0,<3.0.0) requires grpcio (>=1.48.2) (1), tensorflow (>=2.12.0,<3.0.0) is incompatible with dagster-dbt (>=0.17.20,<0.18.0)
So, because fc-lib depends on both dagster-dbt (^0.17.20) and tensorflow (^2.12.0), version solving failed.
This feels like something I'm not the first to come across - is there a version of tensorflow that folks have been able to install which has the allowable grpcio version range for dagster? I'm struggling to find the requirements on the tensorflow github to see what version has an overlapping pinned rangeTimo Vink
04/04/2023, 4:57 PMpoetry
? Here's a little trick I learnt recently. If you run:
poetry add "tensorflow@*" --dry-run
It will tell you exactly what the latest compatible version is that can be installed 🙂Timo Vink
04/04/2023, 4:58 PMdagster-dbt@0.17.20
and tensorflow@2.3.4
would work togetherdaniel
04/04/2023, 5:17 PMmartin o leary
04/04/2023, 5:49 PMmartin o leary
04/04/2023, 5:49 PMdaniel
04/04/2023, 5:53 PMmartin o leary
04/05/2023, 8:26 AMpoetry add "tensorflow@*" --dry-run
Shows 2.2.0 as the version I should install (assuming that the following in the logging indicates a potentially successful match):
• Installing tensorflow (2.2.0)
However, installing that with poetry gives me all sorts of issues with h5py
and scipy
as those packages are incompatible with more recent versions of python at the pins specified by tensorflow 2.2.0
So I tried 2.9.0 based on your comment @daniel and it works fine.
Why didn't poetry tell me that!? 😂