buildx: speed the language having builtin build

[llhuii]

We use docker-buildx to build our components images for different
platforms.

But for some languages, such as golang, have good builtin build for
multi platforms, and buildx support that.

In Sedna, we have GM/LC written by golang. This commit supports this
function.

Signed-off-by: llhuii [email protected]

[llhuii]

Time to make gm image for linux/arm64 in github action(amd64 machine) from 706s => 127s.

before: Publish Docker Images before cross build speed , total 1h 0m 9s

2021-11-01T10:27:02.2002778Z #25 [linux/arm64 builder 6/6] RUN make build WHAT=gm GO_LDFLAGS="" OUT_DIR=_output
2021-11-01T10:36:54.2842595Z #25 706.6 + set +x
2021-11-01T10:36:54.4349622Z #25 DONE 706.6s

after: Publish Docker Images after cross build speed, total 28m 39s

2021-11-01T09:38:31.2355847Z #26 [linux/amd64 builder 8/8] RUN make build WHAT=gm GO_LDFLAGS="" OUT_DIR=_output
2021-11-01T09:38:41.2728924Z #26 127.3 + set +x
2021-11-01T09:38:41.3949048Z #26 DONE 127.5s

[llhuii]

/assign @JimmyYang20
/cc @khalid-jobs

[llhuii]

/hold
Because LC has built sqlite3 which requires CGO with CGO_ENABLED=1, and CGO can't support cross-compilation, there are two options to solve it:

1. No buildx speed for LC, i.e. no speed tag for build/lc/Dockerfile.
2. Add cross compiler for arm64(in alphine world, https://musl.cc/ can help).

[llhuii]

/hold cancel
Use option 2

/hold Because LC has built sqlite3 which requires CGO with CGO_ENABLED=1, and CGO can't support cross-compilation, there are two options to solve it:

1. No buildx speed for LC, i.e. no speed tag for build/lc/Dockerfile.
2. Add cross compiler for arm64(in alphine world, https://musl.cc/ can help).

[llhuii]

In the commit, it dynamically downloads the corresponding platform cross compiler in Dockerfile.

In future, we may build a image dedicated to build/cross-build for golang, then base it to do cross build.

[llhuii]

Tested push-images, finished in 32 min
https://github.com/llhuii/sedna/runs/4104540636?check_suite_focus=true

[llhuii]

/cc Poorunga

[JimmyYang20]

/lgtm

[llhuii]

/approve

[kubeedge-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: llhuii

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [llhuii]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[llhuii]

Add more debug info:
new added in build/lc/Dockerfile when cross build:

# generated by sedna::buildx                                                                 

# These ARGs are built in docker build
# see https://docs.docker.com/engine/reference/builder/#automatic-platform-args-in-the-global-scope
ARG TARGETPLATFORM BUILDPLATFORM TARGETARCH TARGETOS

RUN echo "I am running on $BUILDPLATFORM, building for $TARGETPLATFORM(=$TARGETOS/$TARGETARCH).."

RUN test "$TARGETPLATFORM" = "$BUILDPLATFORM" || (apk add curl; \
arch=$(echo $TARGETARCH | sed "s@arm64@aarch64@"); \
cc_url=$(curl musl.cc | grep /${arch}-${TARGETOS}-.*-cross); \
cc_filename=$(basename $cc_url)  ; \
cc_name=$(echo $cc_filename | cut -f1 -d.)  ; \
curl -O $cc_url; tar xf $cc_filename; \
cc_bin=$PWD/$cc_name/bin  ; \
export PATH="$cc_bin:$PATH"; \
go env -w CC=$(echo $cc_bin/$arch-$TARGETOS-*-cc) CGO_ENABLED=1; \
go env -w GOOS="$TARGETOS" GOARCH="$TARGETARCH"; \
)

build/gm/Dockerfile:

# generated by sedna::buildx
             
# These ARGs are built in docker build
# see https://docs.docker.com/engine/reference/builder/#automatic-platform-args-in-the-global-scope
ARG TARGETPLATFORM BUILDPLATFORM TARGETARCH TARGETOS         

RUN echo "I am running on $BUILDPLATFORM, building for $TARGETPLATFORM(=$TARGETOS/$TARGETARCH).."
                                                                                                          
RUN test "$TARGETPLATFORM" = "$BUILDPLATFORM" || (go env -w GOOS="$TARGETOS" GOARCH="$TARGETARCH"; \
)               
# end generated by sedna::buildx