-
Notifications
You must be signed in to change notification settings - Fork 130
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
12aeb97
commit 07ff7c7
Showing
4 changed files
with
294 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,177 @@ | ||
| Feature: Barebone tests | ||
|
|
||
| Background: | ||
| Given I clear all persistent data | ||
|
|
||
| Scenario: Barebone test: handled errors | ||
| When I run "BareboneTestHandledScenario" | ||
| And I wait to receive 3 requests | ||
|
|
||
| Then the request is valid for the session reporting API version "1.0" for the "iOS Bugsnag Notifier" notifier | ||
| And the payload field "sessions.0.id" is not null | ||
| And the session "user.id" equals "foobar" | ||
| And the session "user.email" equals "[email protected]" | ||
| And the session "user.name" equals "Foo Bar" | ||
|
|
||
| And I discard the oldest request | ||
|
|
||
| Then the request is valid for the error reporting API version "4.0" for the "iOS Bugsnag Notifier" notifier | ||
| And the event "app.bundleVersion" equals "12301" | ||
| And the event "app.id" equals "com.bugsnag.iOSTestApp" | ||
| And the event "app.inForeground" is true | ||
| And the event "app.releaseStage" equals "development" | ||
| And the event "app.type" equals "iOS" | ||
| And the event "app.version" equals "12.3" | ||
| And the event "breadcrumbs.0.name" equals "Running BareboneTestHandledScenario" | ||
| And the event "breadcrumbs.1.name" equals "This is super <redacted>" | ||
| And the event "device.id" is not null | ||
| And the event "device.jailbroken" is false | ||
| And the event "device.locale" is not null | ||
| And the event "device.manufacturer" equals "Apple" | ||
| And the event "device.modelNumber" is not null | ||
| And the event "device.osName" equals "iOS" | ||
| And the event "device.osVersion" matches "\d+\.\d+" | ||
| And the event "device.runtimeVersions.clangVersion" is not null | ||
| And the event "device.runtimeVersions.osBuild" is not null | ||
| And the event "device.time" is a timestamp | ||
| And the event "metaData.device.batteryLevel" is not null | ||
| And the event "metaData.device.charging" is not null | ||
| And the event "metaData.device.orientation" is not null | ||
| And the event "metaData.device.simulator" is false | ||
| And the event "metaData.device.timezone" is not null | ||
| And the event "metaData.device.wordSize" is not null | ||
| And the event "metaData.Exception.info" equals "Some error specific information" | ||
| And the event "metaData.Flags.Testing" is true | ||
| And the event "metaData.Other.password" equals "[REDACTED]" | ||
| And the event "severity" equals "warning" | ||
| And the event "severityReason.type" equals "handledException" | ||
| And the event "severityReason.unhandledOverridden" is true | ||
| And the event "unhandled" is true | ||
| And the event "user.email" equals "[email protected]" | ||
| And the event "user.id" equals "foobar" | ||
| And the event "user.name" equals "Foo Bar" | ||
| And the exception "errorClass" equals "NSRangeException" | ||
| And the exception "message" equals "-[__NSSingleObjectArrayI objectAtIndex:]: index 1 beyond bounds [0 .. 0]" | ||
| And the exception "type" equals "cocoa" | ||
| And the payload field "events.0.app.dsymUUIDs" is a non-empty array | ||
| And the payload field "events.0.app.duration" is a number | ||
| And the payload field "events.0.app.durationInForeground" is a number | ||
| And the payload field "events.0.device.freeDisk" is an integer | ||
| And the payload field "events.0.device.freeMemory" is an integer | ||
| And the payload field "events.0.device.model" matches the test device model | ||
| And the payload field "events.0.device.totalMemory" is an integer | ||
|
|
||
| And I discard the oldest request | ||
|
|
||
| Then the request is valid for the error reporting API version "4.0" for the "iOS Bugsnag Notifier" notifier | ||
| And the event "breadcrumbs.2.name" equals "NSRangeException" | ||
| And the event "breadcrumbs.2.type" equals "error" | ||
| And the event "breadcrumbs.3.name" equals "About to decode a payload..." | ||
| And the event "metaData.nserror.code" equals 4864 | ||
| And the event "metaData.nserror.domain" equals "NSCocoaErrorDomain" | ||
| And the event "metaData.nserror.reason" equals "The data isn’t in the correct format." | ||
| And the event "severity" equals "warning" | ||
| And the event "severityReason.type" equals "handledError" | ||
| And the event "severityReason.unhandledOverridden" is null | ||
| And the event "unhandled" is false | ||
| And the exception "errorClass" equals "__SwiftNativeNSError" | ||
| And the exception "message" equals "The data couldn’t be read because it isn’t in the correct format." | ||
| And the exception "type" equals "cocoa" | ||
|
|
||
| Scenario: Smoke test: unhandled error | ||
| When I run "BareboneTestUnhandledErrorScenario" and relaunch the app | ||
| And I set the app to "report" mode | ||
| And I configure Bugsnag for "BareboneTestUnhandledErrorScenario" | ||
| And I wait to receive a request | ||
|
|
||
| Then the request is valid for the error reporting API version "4.0" for the "iOS Bugsnag Notifier" notifier | ||
| And the event "app.bundleVersion" equals "12301" | ||
| And the event "app.inForeground" is true | ||
| And the event "app.releaseStage" equals "development" | ||
| And the event "app.type" equals "iOS" | ||
| And the event "app.version" equals "12.3" | ||
| And the event "breadcrumbs.0.name" equals "Bugsnag loaded" | ||
| And the event "breadcrumbs.1.name" is null | ||
| And the event "device.id" is not null | ||
| And the event "device.jailbroken" is false | ||
| And the event "device.locale" is not null | ||
| And the event "device.manufacturer" equals "Apple" | ||
| And the event "device.modelNumber" is not null | ||
| And the event "device.osName" equals "iOS" | ||
| And the event "device.osVersion" matches "\d+\.\d+" | ||
| And the event "device.runtimeVersions.clangVersion" is not null | ||
| And the event "device.runtimeVersions.osBuild" is not null | ||
| And the event "device.time" is a timestamp | ||
| And the event "metaData.error.mach.code_name" equals "KERN_INVALID_ADDRESS" | ||
| And the event "metaData.error.mach.code" equals "0x1" | ||
| And the event "metaData.error.mach.exception_name" equals "EXC_BREAKPOINT" | ||
| And the event "severity" equals "error" | ||
| And the event "severityReason.type" equals "unhandledException" | ||
| And the event "severityReason.unhandledOverridden" is null | ||
| And the event "unhandled" is true | ||
| And the event "user.email" equals "[email protected]" | ||
| And the event "user.id" equals "barfoo" | ||
| And the event "user.name" equals "Bar Foo" | ||
| And the exception "errorClass" equals "Fatal error" | ||
| # This can be uncommented once Swift fatal error message reporting is fixed. | ||
| # And the exception "message" equals "iOSTestApp/BareboneTestScenarios.swift | Unexpectedly found nil while implicitly unwrapping an Optional value" | ||
| And the exception "type" equals "cocoa" | ||
| And the payload field "events.0.app.dsymUUIDs" is a non-empty array | ||
| And the payload field "events.0.app.duration" is a number | ||
| And the payload field "events.0.app.durationInForeground" is a number | ||
| And the payload field "events.0.device.freeDisk" is an integer | ||
| And the payload field "events.0.device.freeMemory" is an integer | ||
| And the payload field "events.0.device.model" matches the test device model | ||
| And the payload field "events.0.device.totalMemory" is an integer | ||
|
|
||
| Scenario: Barebone test: Out Of Memory | ||
| When I run "OOMLoadScenario" | ||
| And I wait to receive a request | ||
|
|
||
| Then the "Bugsnag-API-Key" header equals "0192837465afbecd0192837465afbecd" | ||
| And the event "unhandled" is false | ||
| And the exception "message" equals "OOMLoadScenario" | ||
| And the event has a "manual" breadcrumb named "OOMLoadScenarioBreadcrumb" | ||
| And I discard the oldest request | ||
|
|
||
| When I relaunch the app | ||
| And I configure Bugsnag for "OOMLoadScenario" | ||
| And I wait to receive a request | ||
|
|
||
| Then the "Bugsnag-API-Key" header equals "0192837465afbecd0192837465afbecd" | ||
| And the error is an OOM event | ||
| And the event "app.bundleVersion" is not null | ||
| And the event "app.dsymUUIDs" is not null | ||
| And the event "app.id" equals "com.bugsnag.iOSTestApp" | ||
| And the event "app.inForeground" is true | ||
| And the event "app.type" equals "iOS" | ||
| And the event "app.version" is not null | ||
| And the event "device.id" is not null | ||
| And the event "device.jailbroken" is false | ||
| And the event "device.locale" is not null | ||
| And the event "device.manufacturer" equals "Apple" | ||
| And the event "device.modelNumber" is not null | ||
| And the event "device.osName" equals "iOS" | ||
| And the event "device.osVersion" matches "\d+\.\d+" | ||
| And the event "device.runtimeVersions.clangVersion" is not null | ||
| And the event "device.runtimeVersions.osBuild" is not null | ||
| And the event "device.time" is null | ||
| And the event "device.totalMemory" is not null | ||
| And the event "metaData.app.name" equals "iOSTestApp" | ||
| And the event "metaData.custom.bar" equals "foo" | ||
| And the event "metaData.device.batteryLevel" is not null | ||
| And the event "metaData.device.charging" is not null | ||
| And the event "metaData.device.orientation" is not null | ||
| And the event "metaData.device.simulator" is false | ||
| And the event "metaData.device.timezone" is not null | ||
| And the event "metaData.device.wordSize" is not null | ||
| And the event "user.email" equals "[email protected]" | ||
| And the event "user.id" equals "foobar" | ||
| And the event "user.name" equals "Foo Bar" | ||
| And the payload field "events.0.app.dsymUUIDs" is a non-empty array | ||
| And the payload field "events.0.app.duration" is null | ||
| And the payload field "events.0.app.durationInForeground" is null | ||
| And the payload field "events.0.device.freeDisk" is null | ||
| And the payload field "events.0.device.freeMemory" is null | ||
| And the payload field "events.0.device.model" matches the test device model | ||
| And the payload field "events.0.device.totalMemory" is an integer |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.