Simon Späti02/27/2020, 2:06 PM
alex02/27/2020, 9:19 PM
for spark and
for jupyter notebooks. Then using the
abstractions - you can figure out how to make that pipeline work in your kubernetes infrastructure in addition to being runnable locally. You will build a docker image containing the pipeline code and potentially use
to deploy it.
Simon Späti02/28/2020, 12:35 PM
nate02/28/2020, 4:29 PM
Simon Späti02/28/2020, 8:19 PM
nate02/28/2020, 8:19 PM
Simon Späti02/28/2020, 8:24 PM
and hopefully deploy it to our kubernetes cluster.