-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ITBigQueryTest flakiness #836
Comments
/cc @mziccard |
This is a super weird error. What seems to be happening is that both a load job and a resumable upload fail to correctly insert rows from JSON. Rows are inserted but they're missing their record field. The JSON we are inserting is: {"TimestampField": "2014-08-19 07:41:35.220 -05:00","StringField": "stringValue","IntegerField": ["0", "1"],"BooleanField": "false","RecordField": {"TimestampField": "1969-07-20 20:18:04 UTC","StringField": null,"IntegerField": ["1","0"],"BooleanField": "true"}}
{"TimestampField": "2014-08-19 07:41:35.220 -05:00","StringField": "stringValue","IntegerField": ["0", "1"],"BooleanField": "false","RecordField": {"TimestampField": "1969-07-20 20:18:04 UTC","StringField": null,"IntegerField": ["1","0"],"BooleanField": "true"}} Interestingly the load job succeeds: "status": {
"state": "DONE"
} And its statistics match the input file: "statistics": {
"creationTime": "1459547849376",
"startTime": "1459547850058",
"endTime": "1459547855974",
"load": {
"inputFiles": "1",
"inputFileBytes": "525",
"outputRows": "2",
"outputBytes": "126"
}
} |
Can you provide table IDs and job IDs? How are you determining that the record field is absent (i.e., how are you reading the table)? |
We read the table with tabledata:list and it returns: {
"kind": "bigquery#tableDataList",
"etag": "\"3lJH3XPQlFznBcrQRCytdsfdVIE/OcHGzn4HN1HVkVrJNbQnMuHcIn0\"",
"totalRows": "2",
"rows": [
{
"f": [
{
"v": "1.40845209522E9"
},
{
"v": "stringValue"
},
{
"v": [
{
"v": "0"
},
{
"v": "1"
}
]
},
{
"v": "false"
},
{
"v": null
}
]
},
{
"f": [
{
"v": "1.40845209522E9"
},
{
"v": "stringValue"
},
{
"v": [
{
"v": "0"
},
{
"v": "1"
}
]
},
{
"v": "false"
},
{
"v": null
}
]
}
]
} as you can see record fields are
|
Ehi @jcondit any update on this? |
When this issue was filed flaky tests were failing very often, today I managed to run them 10 times I had a success rate of 10/10. @jcondit did something change? Any feedback would be valuable. |
Apologies for dropping this earlier! I suspect this was https://code.google.com/p/google-bigquery/issues/detail?id=503, which was just fixed. (You might consider filing future issues over there or internally to reach a wider audience.) |
Thanks @jcondit happy to hear this is fixed now. I'll file it internally next time, just wanted to be super-sure before bothering you guys. |
Source-Link: googleapis/synthtool@625c20e Post-Processor: gcr.io/cloud-devrel-public-resources/owlbot-java:latest@sha256:58ccd4737212f64a7dd4b3063d447447acf71a2b9d409eab19fc7a00b18eadc0
🤖 I have created a release *beep* *boop* --- ## [2.7.0](googleapis/java-securitycenter@v2.6.0...v2.7.0) (2022-07-01) ### Features * Enable REST transport for most of Java and Go clients ([googleapis#849](googleapis/java-securitycenter#849)) ([61ad34a](googleapis/java-securitycenter@61ad34a)) ### Bug Fixes * update gapic-generator-java with mock service generation fixes ([googleapis#853](googleapis/java-securitycenter#853)) ([8112e48](googleapis/java-securitycenter@8112e48)) ### Dependencies * update dependency com.google.cloud:google-cloud-bigquery to v2.12.0 ([googleapis#836](googleapis/java-securitycenter#836)) ([9685063](googleapis/java-securitycenter@9685063)) * update dependency com.google.cloud:google-cloud-bigquery to v2.13.1 ([googleapis#840](googleapis/java-securitycenter#840)) ([200ff11](googleapis/java-securitycenter@200ff11)) * update dependency com.google.cloud:google-cloud-bigquery to v2.13.3 ([googleapis#844](googleapis/java-securitycenter#844)) ([f78bd6b](googleapis/java-securitycenter@f78bd6b)) * update dependency com.google.cloud:google-cloud-bigquery to v2.13.4 ([googleapis#847](googleapis/java-securitycenter#847)) ([3ad96ab](googleapis/java-securitycenter@3ad96ab)) * update dependency com.google.cloud:google-cloud-bigquery to v2.13.6 ([googleapis#850](googleapis/java-securitycenter#850)) ([53eeb75](googleapis/java-securitycenter@53eeb75)) * update dependency com.google.cloud:google-cloud-pubsub to v1.119.0 ([googleapis#841](googleapis/java-securitycenter#841)) ([61fcabb](googleapis/java-securitycenter@61fcabb)) * update dependency com.google.cloud:google-cloud-pubsub to v1.119.1 ([googleapis#843](googleapis/java-securitycenter#843)) ([ba2c551](googleapis/java-securitycenter@ba2c551)) * update dependency com.google.cloud:google-cloud-shared-dependencies to v2.13.0 ([googleapis#848](googleapis/java-securitycenter#848)) ([dc01be8](googleapis/java-securitycenter@dc01be8)) * update dependency com.google.protobuf:protobuf-java-util to v3.21.0 ([googleapis#837](googleapis/java-securitycenter#837)) ([5e15237](googleapis/java-securitycenter@5e15237)) * update dependency com.google.protobuf:protobuf-java-util to v3.21.1 ([googleapis#838](googleapis/java-securitycenter#838)) ([49bfa77](googleapis/java-securitycenter@49bfa77)) * update dependency com.google.protobuf:protobuf-java-util to v3.21.2 ([googleapis#851](googleapis/java-securitycenter#851)) ([663480b](googleapis/java-securitycenter@663480b)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
…836) * chore(deps): update dependency com.google.cloud:libraries-bom to v26 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
Co-authored-by: Anthonios Partheniou <[email protected]> Source-Link: googleapis/synthtool@72c64b7 Post-Processor: gcr.io/cloud-devrel-public-resources/owlbot-java:latest@sha256:b2e8f445ca0e605d4bbefbfdbdf7335692d75cf1647af62243828dcc0ea4e690
🤖 I have created a release *beep* *boop* --- ## [2.6.3](googleapis/java-kms@v2.6.2...v2.6.3) (2022-08-11) ### Bug Fixes * google-auth-library-oauth2-http as runtime scope ([#835](googleapis/java-kms#835)) ([33774fe](googleapis/java-kms@33774fe)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
🤖 I have created a release *beep* *boop* --- ### Updating meta-information for bleeding-edge SNAPSHOT release. --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
🤖 I have created a release *beep* *boop* --- ### Updating meta-information for bleeding-edge SNAPSHOT release. --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
🤖 I have created a release *beep* *boop* --- ## [1.5.5](googleapis/java-resourcemanager@v1.5.4...v1.5.5) (2022-09-15) ### Dependencies * Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.2 ([#835](googleapis/java-resourcemanager#835)) ([1b516ef](googleapis/java-resourcemanager@1b516ef)) * Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.3 ([#838](googleapis/java-resourcemanager#838)) ([537a5e3](googleapis/java-resourcemanager@537a5e3)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
🤖 I have created a release *beep* *boop* --- ## [2.5.5](googleapis/java-recommender@v2.5.4...v2.5.5) (2022-09-29) ### Dependencies * Update dependency cachetools to v5 ([#837](googleapis/java-recommender#837)) ([316e539](googleapis/java-recommender@316e539)) * Update dependency certifi to v2022.9.24 ([#816](googleapis/java-recommender#816)) ([9257a6f](googleapis/java-recommender@9257a6f)) * Update dependency charset-normalizer to v2.1.1 ([#820](googleapis/java-recommender#820)) ([c1d4abc](googleapis/java-recommender@c1d4abc)) * Update dependency click to v8.1.3 ([#821](googleapis/java-recommender#821)) ([71b7c74](googleapis/java-recommender@71b7c74)) * Update dependency gcp-releasetool to v1.8.8 ([#817](googleapis/java-recommender#817)) ([f8fe2f4](googleapis/java-recommender@f8fe2f4)) * Update dependency google-api-core to v2.10.1 ([#822](googleapis/java-recommender#822)) ([9315ebc](googleapis/java-recommender@9315ebc)) * Update dependency google-auth to v2.12.0 ([#823](googleapis/java-recommender#823)) ([22f0d40](googleapis/java-recommender@22f0d40)) * Update dependency google-cloud-core to v2.3.2 ([#818](googleapis/java-recommender#818)) ([7934039](googleapis/java-recommender@7934039)) * Update dependency google-cloud-storage to v2.5.0 ([#824](googleapis/java-recommender#824)) ([c636d34](googleapis/java-recommender@c636d34)) * Update dependency google-crc32c to v1.5.0 ([#825](googleapis/java-recommender#825)) ([5c7ca00](googleapis/java-recommender@5c7ca00)) * Update dependency googleapis-common-protos to v1.56.4 ([#819](googleapis/java-recommender#819)) ([3dfa9b6](googleapis/java-recommender@3dfa9b6)) * Update dependency importlib-metadata to v4.12.0 ([#829](googleapis/java-recommender#829)) ([6b959ab](googleapis/java-recommender@6b959ab)) * Update dependency jeepney to v0.8.0 ([#830](googleapis/java-recommender#830)) ([ecd6a01](googleapis/java-recommender@ecd6a01)) * Update dependency jinja2 to v3.1.2 ([#831](googleapis/java-recommender#831)) ([18a3391](googleapis/java-recommender@18a3391)) * Update dependency keyring to v23.9.3 ([#832](googleapis/java-recommender#832)) ([9310d26](googleapis/java-recommender@9310d26)) * Update dependency markupsafe to v2.1.1 ([#826](googleapis/java-recommender#826)) ([3288701](googleapis/java-recommender@3288701)) * Update dependency protobuf to v3.20.2 ([#827](googleapis/java-recommender#827)) ([310e5a0](googleapis/java-recommender@310e5a0)) * Update dependency protobuf to v4 ([#838](googleapis/java-recommender#838)) ([1f65182](googleapis/java-recommender@1f65182)) * Update dependency pyjwt to v2.5.0 ([#833](googleapis/java-recommender#833)) ([ef6a5ae](googleapis/java-recommender@ef6a5ae)) * Update dependency requests to v2.28.1 ([#834](googleapis/java-recommender#834)) ([72459f0](googleapis/java-recommender@72459f0)) * Update dependency typing-extensions to v4.3.0 ([#835](googleapis/java-recommender#835)) ([4ae6014](googleapis/java-recommender@4ae6014)) * Update dependency zipp to v3.8.1 ([#836](googleapis/java-recommender#836)) ([5d9fa20](googleapis/java-recommender@5d9fa20)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
🤖 I have created a release *beep* *boop* --- ## [2.4.9](https://togithub.com/googleapis/java-accessapproval/compare/v2.4.8...v2.4.9) (2022-10-04) ### Dependencies * Update dependency cachetools to v5 ([#845](https://togithub.com/googleapis/java-accessapproval/issues/845)) ([2e2f61d](https://togithub.com/googleapis/java-accessapproval/commit/2e2f61d400cb4e73a90b5ed0ab3cea48d3dcdb0e)) * Update dependency certifi to v2022.9.24 ([#825](https://togithub.com/googleapis/java-accessapproval/issues/825)) ([57629eb](https://togithub.com/googleapis/java-accessapproval/commit/57629eb352e5c1c6222cd3a2140442c68c7d78fe)) * Update dependency charset-normalizer to v2.1.1 ([#829](https://togithub.com/googleapis/java-accessapproval/issues/829)) ([5fb7ff7](https://togithub.com/googleapis/java-accessapproval/commit/5fb7ff7c2b038412c9bcbaca1f4c98cfc3def81a)) * Update dependency click to v8.1.3 ([#830](https://togithub.com/googleapis/java-accessapproval/issues/830)) ([50af14b](https://togithub.com/googleapis/java-accessapproval/commit/50af14bb86c72be62aaf4acd985fbfa3e844cbfb)) * Update dependency com.google.cloud:google-cloud-core to v2.8.15 ([#821](https://togithub.com/googleapis/java-accessapproval/issues/821)) ([6c6a7c7](https://togithub.com/googleapis/java-accessapproval/commit/6c6a7c753008ffce85def41c88482b9046b636dd)) * Update dependency com.google.cloud:google-cloud-core to v2.8.16 ([#823](https://togithub.com/googleapis/java-accessapproval/issues/823)) ([f258fd8](https://togithub.com/googleapis/java-accessapproval/commit/f258fd8bfa538b84be066e759ba9f4fa87fb9735)) * Update dependency com.google.cloud:google-cloud-core to v2.8.17 ([#847](https://togithub.com/googleapis/java-accessapproval/issues/847)) ([06753de](https://togithub.com/googleapis/java-accessapproval/commit/06753de07797eaf62338808dfa0c24db9b1a5019)) * Update dependency com.google.cloud:google-cloud-core to v2.8.18 ([#850](https://togithub.com/googleapis/java-accessapproval/issues/850)) ([6053905](https://togithub.com/googleapis/java-accessapproval/commit/6053905b5ad2a5b80e0a8e30cb31bd3b8467c150)) * Update dependency com.google.cloud:google-cloud-core to v2.8.19 ([#851](https://togithub.com/googleapis/java-accessapproval/issues/851)) ([e394607](https://togithub.com/googleapis/java-accessapproval/commit/e394607088a417338fc5fe49a9b05e63d6148bdd)) * Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.4 ([#853](https://togithub.com/googleapis/java-accessapproval/issues/853)) ([078dd9b](https://togithub.com/googleapis/java-accessapproval/commit/078dd9bd46d2759223a9db5940518b7f3efe3739)) * Update dependency gcp-releasetool to v1.8.8 ([#826](https://togithub.com/googleapis/java-accessapproval/issues/826)) ([23c5406](https://togithub.com/googleapis/java-accessapproval/commit/23c540692173fb8582dc2a29ac96c95157576d1f)) * Update dependency google-api-core to v2.10.1 ([#831](https://togithub.com/googleapis/java-accessapproval/issues/831)) ([914344d](https://togithub.com/googleapis/java-accessapproval/commit/914344d723be22f5d1737c118d8b841a90cf5334)) * Update dependency google-auth to v2.12.0 ([#832](https://togithub.com/googleapis/java-accessapproval/issues/832)) ([446ce5c](https://togithub.com/googleapis/java-accessapproval/commit/446ce5c006799b13a349e2711bf09073d9fa3912)) * Update dependency google-cloud-core to v2.3.2 ([#827](https://togithub.com/googleapis/java-accessapproval/issues/827)) ([e251d00](https://togithub.com/googleapis/java-accessapproval/commit/e251d00958fbcc402cef2f741d89c93d2e88dd38)) * Update dependency google-cloud-storage to v2.5.0 ([#833](https://togithub.com/googleapis/java-accessapproval/issues/833)) ([3b11d93](https://togithub.com/googleapis/java-accessapproval/commit/3b11d9391f867f9667f34a2963315c6c62276f38)) * Update dependency google-crc32c to v1.5.0 ([#834](https://togithub.com/googleapis/java-accessapproval/issues/834)) ([f6b17df](https://togithub.com/googleapis/java-accessapproval/commit/f6b17df716de87728c69f26febf430b2ea375a04)) * Update dependency googleapis-common-protos to v1.56.4 ([#828](https://togithub.com/googleapis/java-accessapproval/issues/828)) ([b0a7491](https://togithub.com/googleapis/java-accessapproval/commit/b0a7491471aa9f65553c83c7ce4a5b8a5cfe0f2b)) * Update dependency importlib-metadata to v4.12.0 ([#835](https://togithub.com/googleapis/java-accessapproval/issues/835)) ([27ceae2](https://togithub.com/googleapis/java-accessapproval/commit/27ceae2490ded6d4a9f7811e1719cb62b497d30b)) * Update dependency jeepney to v0.8.0 ([#836](https://togithub.com/googleapis/java-accessapproval/issues/836)) ([d52625e](https://togithub.com/googleapis/java-accessapproval/commit/d52625e9d294405d97668cfd681fd7a3ee5f6b3a)) * Update dependency jinja2 to v3.1.2 ([#837](https://togithub.com/googleapis/java-accessapproval/issues/837)) ([88d7579](https://togithub.com/googleapis/java-accessapproval/commit/88d757981a2d15c0f02f78aab558a2136b194a25)) * Update dependency keyring to v23.9.3 ([#838](https://togithub.com/googleapis/java-accessapproval/issues/838)) ([a0970bf](https://togithub.com/googleapis/java-accessapproval/commit/a0970bf88c99ce5fa11e7ff78dea6a15daf3f268)) * Update dependency markupsafe to v2.1.1 ([#839](https://togithub.com/googleapis/java-accessapproval/issues/839)) ([4097dc6](https://togithub.com/googleapis/java-accessapproval/commit/4097dc6d5535fe2b831c34509284230633986e02)) * Update dependency protobuf to v3.20.2 ([#840](https://togithub.com/googleapis/java-accessapproval/issues/840)) ([1b81687](https://togithub.com/googleapis/java-accessapproval/commit/1b81687a5589d62156cfbb91036ea7db8306785f)) * Update dependency protobuf to v4 ([#846](https://togithub.com/googleapis/java-accessapproval/issues/846)) ([5806291](https://togithub.com/googleapis/java-accessapproval/commit/580629171b1d37d134cd52ac8e66b91eefa68e8c)) * Update dependency pyjwt to v2.5.0 ([#841](https://togithub.com/googleapis/java-accessapproval/issues/841)) ([eeb2f70](https://togithub.com/googleapis/java-accessapproval/commit/eeb2f705766cd3e0516b143bac24fbc7ab700159)) * Update dependency typing-extensions to v4.3.0 ([#843](https://togithub.com/googleapis/java-accessapproval/issues/843)) ([cfa7b08](https://togithub.com/googleapis/java-accessapproval/commit/cfa7b088cb5652efc0ac7aa232c2020325fbd984)) * Update dependency zipp to v3.8.1 ([#844](https://togithub.com/googleapis/java-accessapproval/issues/844)) ([e31608b](https://togithub.com/googleapis/java-accessapproval/commit/e31608b918245943bd235feb61bc583b212d95b7)) --- This PR was generated with [Release Please](https://togithub.com/googleapis/release-please). See [documentation](https://togithub.com/googleapis/release-please#release-please).
…836) Source-Link: googleapis/synthtool@505ce5a Post-Processor: gcr.io/cloud-devrel-public-resources/owlbot-java:latest@sha256:2567a120ce90fadb6201999b87d649d9f67459de28815ad239bce9ebfaa18a74
🤖 I have created a release *beep* *boop* --- ## [2.8.0](googleapis/java-core@v2.7.1...v2.8.0) (2022-06-21) ### Features * add build scripts for native image testing in Java 17 ([#1440](https://github.com/googleapis/java-core/issues/1440)) ([#836](googleapis/java-core#836)) ([49e9b68](googleapis/java-core@49e9b68)) ### Dependencies * update dependency com.google.api-client:google-api-client-bom to v1.35.1 ([#843](googleapis/java-core#843)) ([d81fbf0](googleapis/java-core@d81fbf0)) * update dependency com.google.api:api-common to v2.2.1 ([#844](googleapis/java-core#844)) ([d711da9](googleapis/java-core@d711da9)) * update dependency com.google.api:gax-bom to v2.18.2 ([#849](googleapis/java-core#849)) ([d44a6d9](googleapis/java-core@d44a6d9)) * update dependency com.google.api.grpc:proto-google-common-protos to v2.9.0 ([#846](googleapis/java-core#846)) ([981b634](googleapis/java-core@981b634)) * update dependency com.google.api.grpc:proto-google-iam-v1 to v1.4.0 ([#838](googleapis/java-core#838)) ([8b04fb4](googleapis/java-core@8b04fb4)) * update dependency com.google.api.grpc:proto-google-iam-v1 to v1.4.1 ([#848](googleapis/java-core#848)) ([78dd4ed](googleapis/java-core@78dd4ed)) * update dependency com.google.errorprone:error_prone_annotations to v2.14.0 ([#839](googleapis/java-core#839)) ([a4b5158](googleapis/java-core@a4b5158)) * update dependency com.google.http-client:google-http-client-bom to v1.42.0 ([#845](googleapis/java-core#845)) ([24211fb](googleapis/java-core@24211fb)) * update dependency com.google.protobuf:protobuf-bom to v3.21.0 ([#840](googleapis/java-core#840)) ([93d825f](googleapis/java-core@93d825f)) * update dependency com.google.protobuf:protobuf-bom to v3.21.1 ([#841](googleapis/java-core#841)) ([7065ef0](googleapis/java-core@7065ef0)) * update dependency io.grpc:grpc-bom to v1.47.0 ([#842](googleapis/java-core#842)) ([3245109](googleapis/java-core@3245109)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Source-Link: googleapis/googleapis@e8c26cc Source-Link: https://github.com/googleapis/googleapis-gen/commit/81d1ed117f6844fefb239e0cd084ba101846ef01 Copy-Tag: eyJwIjoiamF2YS1jb21wdXRlLy5Pd2xCb3QueWFtbCIsImgiOiI4MWQxZWQxMTdmNjg0NGZlZmIyMzllMGNkMDg0YmExMDE4NDZlZjAxIn0=
…#9696) * feat: Update Compute Engine API to revision 20230711 (#836) Source-Link: googleapis/googleapis@e8c26cc Source-Link: https://github.com/googleapis/googleapis-gen/commit/81d1ed117f6844fefb239e0cd084ba101846ef01 Copy-Tag: eyJwIjoiamF2YS1jb21wdXRlLy5Pd2xCb3QueWFtbCIsImgiOiI4MWQxZWQxMTdmNjg0NGZlZmIyMzllMGNkMDg0YmExMDE4NDZlZjAxIn0= * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md --------- Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
Recently, these two tests have been failing more often than passing:
I will comment out these two tests for now, but we should uncomment and diagnose the problem when possible.
The text was updated successfully, but these errors were encountered: