feat(integration): Integrate with Flyte

[gaocegege]

Description

flyteorg/flyte#2573

We can collaborate with flyte community to support custom python dependencies in flyte.

/cc @pingsutw

• discussion(lang): How to support multi-target  #403
• feat(lang): Custom base image #261

---

Message from the maintainers:

Love this enhancement proposal? Give it a 👍. We prioritise the proposals with the most 👍.

[gaocegege]

Ref #567 about how to support custom base image in envd.

[gaocegege]

We propose to add a field image to base:

def build():
  base(image="flyter-base-image")
  install.python_packages...

@pingsutw Does it work for you?

[pingsutw]

yup, that's what we want, LGTM, thanks.

[gaocegege]

Ref https://docs.google.com/document/d/17TGmcIQRW-4tFCadzkdXHGNR9QoMH0yOKfiQHMtSuuU/edit#

The proposal in flyte community about the integration between flyte and envd.

[gaocegege]

The base image of Flyte may look like this.

FROM python:3.9-slim

WORKDIR /root
ENV VENV /opt/venv
ENV LANG C.UTF-8
ENV LC_ALL C.UTF-8
ENV PYTHONPATH /root

RUN apt-get update && apt-get install -y build-essential

# Install the AWS cli separately to prevent issues with boto being written over
RUN pip3 install awscli
# Similarly, if you're using GCP be sure to update this command to install gsutil
RUN curl -sSL https://sdk.cloud.google.com/ | bash
ENV PATH="$PATH:/root/google-cloud-sdk/bin"

ENV VENV /opt/venv
# Virtual environment
RUN python3 -m venv ${VENV}
ENV PATH="${VENV}/bin:$PATH"

# Install Python dependencies
RUN pip install flytekit

# This tag is supplied by the build script and will be used to determine the version
# when registering tasks, workflows, and launch plans
ARG tag
ENV FLYTE_INTERNAL_IMAGE $tag

[gaocegege]

def build():
    base(language="python", image="kemingy/flyte_base")
    install.python_packages(["via"])

The build script should work with the new release v0.2.5-alpha.1

Please update the env: pip install --pre --upgrade envd