Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Failing Test]: PostCommit TransformService Direct Python 3.11 perma-red (transformServicePythonUsingJava) #30238

Closed
2 of 16 tasks
lostluck opened this issue Feb 6, 2024 · 3 comments · Fixed by #30491 or #30605
Closed
2 of 16 tasks

Comments

@lostluck
Copy link
Contributor

lostluck commented Feb 6, 2024

What happened?

Action has never succeeded.

https://github.com/apache/beam/actions/workflows/beam_PostCommit_TransformService_Direct.yml?query=is%3Afailure

Locally:

./gradlew :sdks:python:test-suites:direct:xlang:transformServicePythonUsingJava --max-workers=8 --continue \
   -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses \
  -PtestJavaVersion=11 \
  -Pjava11Home=$JAVA_HOME_11_X64 \
  -PuseWheelDistribution \
  -PpythonVersion=3.11 

Failure isn't very clear, but docker emits this warning

> Task :sdks:python:container:py311:docker
#16 writing image sha256:d93e9a7ac97620da2040ce62814cc3440f48c991ad649133d6d1f575065c34f3 done
#16 naming to docker.io/apache/beam_python3.11_sdk:2.55.0.dev done
#16 DONE 38.2s

 1 warning found (use --debug to expand):
 - Empty continuation line found in: RUN      apt-get update &&     apt-get install -y        libsnappy-dev        libyaml-dev        ccache        libgeos-dev        &&     rm -rf /var/lib/apt/lists/* &&     pip install --upgrade pip setuptools wheel &&     pip install --no-deps -r /tmp/base_image_requirements.txt &&     rm -rf /tmp/base_image_requirements.txt &&     python -c "import nltk; nltk.download('stopwords')" &&     rm /root/nltk_data/corpora/stopwords.zip &&     python -c "from google.protobuf.internal import api_implementation; assert api_implementation._implementation_type == 'upb'; print ('Verified fast protobuf used.')" &&     mkdir -p /usr/local/gcloud &&     cd /usr/local/gcloud &&     curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz &&     tar -xf google-cloud-sdk.tar.gz &&     /usr/local/gcloud/google-cloud-sdk/install.sh &&     rm -rf /usr/local/gcloud/google-cloud-sdk/.install/.backup &&     rm google-cloud-sdk.tar.gz &&     ln -s /usr/bin/ccache /usr/local/bin/gcc &&     ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false &&     pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] &&     pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1) &&     pip freeze --all &&     rm -rf /root/.cache/pip

Which doesn't sound like a failure offhand.

Issue Failure

Failure: Test is continually failing

Issue Priority

Priority: 2 (backlog / disabled test but we think the product is healthy)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@lostluck
Copy link
Contributor Author

lostluck commented Feb 6, 2024

cc: @chamikaramj to triage further or fix as appropriate.

@chamikaramj
Copy link
Contributor

The Jenkins was green last time I checked. Seems like it has been turned down ?

Github Actions version was migrated from the Jenkins test that I added initially but it started failing slightly some time after it was migrated.

@chamikaramj
Copy link
Contributor

#30243 fixes a naming conflict but might not fully fix the test suite.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment