Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nightly Testing Report #13224

Closed
github-actions bot opened this issue Jul 3, 2024 · 49 comments · Fixed by #13406
Closed

Nightly Testing Report #13224

github-actions bot opened this issue Jul 3, 2024 · 49 comments · Fixed by #13406
Assignees

Comments

@github-actions
Copy link
Contributor

github-actions bot commented Jul 3, 2024

Nightly Testing Report

This issue(log) is generated at 07/03/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/02
mlmodeldownloader failure
storage failure
@ncooke3
Copy link
Member

ncooke3 commented Jul 3, 2024

rerunning...

Copy link
Contributor Author

github-actions bot commented Jul 4, 2024

Nightly Testing Report

This issue(log) is generated at 07/04/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/03
messaging failure
installations failure
release failure
mlmodeldownloader failure

Copy link
Contributor Author

github-actions bot commented Jul 5, 2024

Nightly Testing Report

This issue(log) is generated at 07/05/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/04
core in_process
storage failure
messaging failure
remoteconfig failure
mlmodeldownloader failure

Copy link
Contributor Author

github-actions bot commented Jul 6, 2024

Nightly Testing Report

This issue(log) is generated at 07/06/2024 05:02 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/05
messaging failure
crashlytics failure
remoteconfig failure
database failure
prerelease failure
mlmodeldownloader failure

Copy link
Contributor Author

github-actions bot commented Jul 7, 2024

Nightly Testing Report

This issue(log) is generated at 07/07/2024 05:02 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/06
crashlytics failure
database failure
mlmodeldownloader failure
shared-swift in_process

Copy link
Contributor Author

github-actions bot commented Jul 8, 2024

Nightly Testing Report

This issue(log) is generated at 07/08/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/07
storage failure
messaging failure
remoteconfig failure
release failure
mlmodeldownloader failure

@ncooke3
Copy link
Member

ncooke3 commented Jul 8, 2024

rerunning...

Copy link
Contributor Author

github-actions bot commented Jul 9, 2024

@paulb777
Copy link
Member

paulb777 commented Jul 9, 2024

Various fixes in #13258, #13257, #13254, #13256 and #13250

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/10/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/09
dynamiclinks failure
storage failure
zip failure
messaging failure
auth failure
crashlytics failure
remoteconfig failure
abtesting failure
inappmessaging failure
installations failure
spm failure
performance failure
release failure
prerelease failure
mlmodeldownloader failure
firebase_app_check failure

@paulb777
Copy link
Member

Manually updated CocoaPods-11.0.0.nightly tag and restarted prerelease

Still open includes:

@paulb777
Copy link
Member

FTL tests failing with Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '+[FIRComponent componentWithProtocol:instantiationTiming:dependencies:creationBlock:]: unrecognized selector sent to class 0x105364228'

Will retry with nightly tag moved ...

@paulb777
Copy link
Member

Even after nightly tag update, the ftl job is still building in the wrong version of the pod:

https://firebase.corp.google.com/u/0/project/icore-auto-release-testing/testlab/histories/bh.edb1aaae0e3ee38e/matrices/6776639431720473907/executions/bs.f927ba36fdd7ee60

@ncooke3
Copy link
Member

ncooke3 commented Jul 10, 2024

Even after nightly tag update, the ftl job is still building in the wrong version of the pod:

https://firebase.corp.google.com/u/0/project/icore-auto-release-testing/testlab/histories/bh.edb1aaae0e3ee38e/matrices/6776639431720473907/executions/bs.f927ba36fdd7ee60

Interestingly, the pod install looks to be pulling in the 11.0 versions: https://github.com/firebase/firebase-ios-sdk/actions/runs/9869676439/job/27253869934#step:5:404 Still looking for something...

@paulb777
Copy link
Member

Might be that the quickstarts install analytics and that still needs to be rebuilt - https://github.com/firebase/firebase-ios-sdk/actions/runs/9868991165/job/27271710677#step:5:400

@ncooke3
Copy link
Member

ncooke3 commented Jul 10, 2024

Nice! I'm pretty sure that's it. The symbol is still in a nightly build of the zip:

nickcooke@nickcooke-mac Downloads % nm Firebase-actions-dir-dynamic/10_29_0/Firebase/FirebaseAnalytics/FirebaseAnalytics.xcframework/ios-arm64/FirebaseAnalytics.framework/FirebaseAnalytics | grep -i component
0000000000000068 t +[FIRAnalyticsConnector componentsToRegister]
                 U _OBJC_CLASS_$_FIRComponent
000000000000011c t ___45+[FIRAnalyticsConnector componentsToRegister]_block_invoke
00000000000021d8 S ___block_descriptor_32_e35_24?0"FIRComponentContainer"8^B16l
                 U _objc_msgSend$componentWithProtocol:instantiationTiming:dependencies:creationBlock:

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/11/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/10
core failure
dynamiclinks failure
storage failure
messaging failure
auth failure
crashlytics failure
remoteconfig failure
database failure
abtesting failure
inappmessaging failure
installations failure
spm failure
performance failure
release failure
prerelease failure
mlmodeldownloader failure
sessions failure

Copy link
Contributor Author

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/13/2024 05:02 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/12
zip failure
messaging failure
crashlytics failure
spm failure
release failure
prerelease failure
mlmodeldownloader failure

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/14/2024 05:04 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/13
dynamiclinks failure
storage failure
zip failure
abtesting failure
spm failure
release failure
prerelease failure
mlmodeldownloader failure

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/15/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/14
zip failure
messaging failure
remoteconfig failure
spm failure
release failure
prerelease failure
mlmodeldownloader failure
firebase_app_check cancelled

@ncooke3
Copy link
Member

ncooke3 commented Jul 15, 2024

Looking at zip failures, I think the firestore quickstart testing artifacts may need to be zipped before uploading.

@ncooke3
Copy link
Member

ncooke3 commented Jul 15, 2024

FirebaseUI issues reported in the https://github.com/firebase/firebase-ios-sdk/actions/runs/9933962188

Most of the others are flakes and/or expected failures. I'm working on tooling up uploading pre-release SPM artifacts which should address the current release-related failures. I'll then pivot to addressing the above comment.

@paulb777
Copy link
Member

Looks like prerelease is failing because the tag CocoaPods-11.0.0.nightly is no longer updating. I'll push an update to the tip of master and restart.

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/16/2024 05:02 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/15
zip failure
messaging failure
crashlytics failure
remoteconfig failure
spm failure
release failure
prerelease failure

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/17/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/16
firestore failure
messaging failure
database failure
spm failure
release failure
prerelease failure
core_internal failure

@paulb777
Copy link
Member

Firestore failure looks related to yesterday's Timestamp changes.
Messaging flake? Restarted
Database - typical flake
SPM - Timestamp
Release/prerelease Firestore Quickstart - looks like a real FirebaseAuthUI issue integration with v11. I'll take a look
Release/prerelease Dynamic Links - One test failure - OK to disable test run?
core_internal - deflaked

@ncooke3
Copy link
Member

ncooke3 commented Jul 17, 2024

Firestore failure looks related to yesterday's Timestamp changes.

Looking into this one.

@ncooke3
Copy link
Member

ncooke3 commented Jul 17, 2024

Nearing giving up on this and reverting the PR in qeustion. No update on why the timestamp import isn't working. The following work:

@_exported import class FirebaseCore.FirebaseApp
@_exported import class FirebaseCore.FirebaseOptions
@_exported import class FirebaseCore.FirebaseConfiguration
@_exported import class FirebaseCore.Foo // An added class

But

@_exported import class FirebaseCore.Timestamp

doesn't work.

@ncooke3
Copy link
Member

ncooke3 commented Jul 17, 2024

maybe it has to do with an outdated Firestore binary since the source builds are okay. Investigating with updating package.swift locally with xcframework from last night's zip

@ncooke3
Copy link
Member

ncooke3 commented Jul 17, 2024

It worked with a local zip so that must have been the issue.

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/18/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/17
firestore failure
spm failure
release failure
prerelease failure
mlmodeldownloader in_process
vertexai failure

@paulb777
Copy link
Member

Looking at the vertexai failure caused by #13300

@ncooke3
Copy link
Member

ncooke3 commented Jul 18, 2024

Thanks, it looks like the nonexistent resource I removed was a placeholder. See scripts/update_vertexai_responses.sh

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/19/2024 05:02 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/18
core in_process
firestore failure
messaging failure
crashlytics failure
remoteconfig failure
spm failure
release failure
prerelease failure
archiving cancelled
sessions failure

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/20/2024 05:02 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/19
dynamiclinks failure
storage failure
zip failure
firestore failure
messaging failure
firebasepod failure
auth failure
crashlytics failure
remoteconfig failure
database failure
abtesting failure
inappmessaging failure
installations failure
spm failure
performance failure
release failure
prerelease failure

Copy link
Contributor Author

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/22/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/21
dynamiclinks failure
storage failure
zip failure
firestore failure
messaging failure
firebasepod failure
auth failure
crashlytics failure
remoteconfig failure
database failure
abtesting failure
inappmessaging failure
installations failure
spm failure
performance failure
release failure
prerelease failure

@ncooke3
Copy link
Member

ncooke3 commented Jul 22, 2024

After merging firebase/quickstart-ios#1604, I re-kicked of dynamic links, storage, remote config, and database

@ncooke3
Copy link
Member

ncooke3 commented Jul 22, 2024

We still didn't get a clear log of the undefined symbols. I got them in my Firestore PR: #13320 (comment)

@ncooke3
Copy link
Member

ncooke3 commented Jul 22, 2024

Opened #13338 to hopefully catch a logging of undefined symbols

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/23/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/22
zip failure
firestore failure
messaging failure
crashlytics failure
remoteconfig failure
spm failure
release failure
prerelease failure

@paulb777
Copy link
Member

Crashlytics, Messaging, Release, and prerelease have fixes in #13353

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/24/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/23
zip failure
firestore failure
messaging failure
remoteconfig failure
spm failure
release failure
prerelease failure
generate_notices failure

@paulb777
Copy link
Member

Firestore quickstarts waiting for firebase/FirebaseUI-iOS#1193
Flakes? restarted
Binaries for firestore and spm are still broken

@ncooke3 ncooke3 self-assigned this Jul 24, 2024
@paulb777
Copy link
Member

Firestore quickstart now builds with staged FirebaseUI 14.2.0. Confirmed in release and prerelease reruns.

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/25/2024 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/24
zip failure
firestore failure
messaging failure
crashlytics failure
remoteconfig failure
spm failure

@paulb777
Copy link
Member

Failures seem to be only flakes and waiting for updated binaries for SPM

Copy link
Contributor Author

Nightly Testing Report

This issue(log) is generated at 07/26/2024 05:02 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow 07/25
zip failure
firestore failure
database failure
functions failure
installations failure
spm failure

@firebase firebase locked and limited conversation to collaborators Aug 26, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants