Skip to content
CI

Allowing DeviceBinding NONE option on Simulators #574

Sign in to view logs

Allowing DeviceBinding NONE option on Simulators

Allowing DeviceBinding NONE option on Simulators #574

GitHub Actions / Xcode test results failed Oct 9, 2024 in 0s

Xcode test results

Testing workspace FRExample with scheme FRTestHost

Summary

TotalSuccess PassedFailure FailedSkipped SkippedExpected Failure Expected Failure⏱️ Time
11071073628043.24s

Test Summary

FRAuthTests

  • Device: iPhone 14, 17.5 (21F79)
  • SDK: Simulator - iOS 17.5, 17.5
TestTotalSuccessFailureSkippedExpected Failure
test-class AA_00_RegistrationTests11000
test-class AA_01_LoginTests11000
test-class AA_02_KBAAuthenticationTests11000
test-class AA_03_SecondFactorAuthenticationTests11000
test-class AA_04_BooleanAttributeInputCallbackTest11000
test-class AA_04_ChoiceCallbackTest11000
test-class AA_04_ConfirmationCallbackTest11000
test-class AA_04_DeviceProfileCallbackTest11000
test-class AA_04_KbaCreateCallbackTest11000
test-class AA_04_NumberAttributeInputCallbackTest11000
test-class AA_04_PageCallback65Test11000
test-class AA_04_PageCallbackTest11000
test-class AA_04_PollingWaitCallbackTest11000
test-class AA_04_ReCaptchaCallbackTest11000
test-class AA_04_StringAttributeInputCallbackTest11000
test-class AA_04_TermsAndConditionCallbackTest11000
test-class AA_05_DeviceBindingCallbackTest55000
test-class AA_06_DeviceSigningVerifierCallbackTest75020
test-class AA_07_AppIntegrityTest1000100
test-class AA_08_TextInputCallbackTest11000
test-class AA_09_PingOneProtectInitializeCallbackTest33000
test-class AA_10_PingOneProtectEvaluateCallbackTest33000
test-class AA_11_TextOutputCallbackTest11000
test-class AA_12_ReCaptchaEnterpriseCallbackTest42200
test-class AbstractValidatedCallbackTests88000
test-class AccessTokenTests77000
test-class AppleSignInHandlerTests77000
test-class AtomicDictionaryTests33000
test-class AuthApiErrorTests55000
test-class AuthErrorTests1111000
test-class AuthServiceTests44000
test-class AuthorizationPolicyTests1818000
test-class BooleanAttributeInputCallbackTests33000
test-class BrowserBuilderTests22000
test-class BrowserErrorTests44000
test-class BrowserTests1311020
test-class CallbackConstantsTests88000
test-class ChoiceCallbackTests88000
test-class ConfigErrorTests55000
test-class ConfirmationCallbackTests88000
test-class CookieTests77000
test-class CookieValidationTests1212000
test-class CustomCallbackTests55000
test-class DeviceProfileCallbackTests66000
test-class FRAppAttestModalTests1313000
test-class FRAppAttestServiceImplTests33000
test-class FRAppIntegrityCallbackTests66000
test-class FRAppIntegrityKeysTests22000
test-class FRAuthTests2121000
test-class FRDeviceCollectorTests22000
test-class FRDeviceIdentifierTests33000
test-class FRDeviceTests22000
test-class FROptionsTests99000
test-class FRRequestInterceptorTests33000
test-class FRSessionTests1010000
test-class FRURLProtocolTests77000
test-class FRUserBrowserTests86020
test-class FRUserTests2222000
test-class FRWebAuthnTests55000
test-class FailedPolicyTests1313000
test-class IdPCallbackTests77000
test-class IdPClientTests22000
test-class IdPHandlerTests33000
test-class IdPValueTests22000
test-class KeychainManagerTests1111000
test-class MetadataCallbackTests22000
test-class NameCallbackTests55000
test-class NetworkReachabilityMonitorTests99000
test-class NodeFlowTests44000
test-class NodeTests88000
test-class NumberAttributeInputCallbackTests33000
test-class OAuth2ErrorTests1212000
test-class PKCETests22000
test-class PasswordCallbackTests55000
test-class PolicyAdviceCreatorTests55000
test-class PolicyAdviceTests99000
test-class PollingWaitCallbackTests55000
test-class ReCaptchaCallbackTests55000
test-class SSLPinningTests44000
test-class SelectIdPCallbackTests44000
test-class ServerConfigTests77000
test-class SessionManagerTests33000
test-class SocialLoginErrorTests55000
test-class TelephonyCollectorTests11000
test-class TextInputCallbackTests55000
test-class TextOutputCallbackTests88000
test-class TokenErrorTests44000
test-class TokenManagementPolicyTests66000
test-class TokenTests77000
test-class WebAuthnAuthenticationCallbackTests1616000
test-class WebAuthnAuthenticationTests1111000
test-class WebAuthnCallbackTests1212000
test-class WebAuthnRegistrationCallbackTests3030000
test-class WebAuthnRegistrationTests1212000

FRAuthenticatorTests

  • Device: iPhone 14, 17.5 (21F79)
  • SDK: Simulator - iOS 17.5, 17.5
TestTotalSuccessFailureSkippedExpected Failure
test-class AccountTests66000
test-class AuthenticatorManagerTests4545000
test-class Base32Tests44000
test-class CryptoErrorTests55000
test-class CryptoTests44000
test-class FRAClientOATHMechanismAlgorithmTests1717000
test-class FRAClientTests1212000
test-class FRAErrorTests22000
test-class FRAPolicyEvaluatorTests1515000
test-class FRAPushHandlerTests1010000
test-class FRAuthenticatorTests22000
test-class FRCompactJWTTests1111000
test-class HOTPCodeGenerationTests99000
test-class HOTPMechanismTests1111000
test-class KeychainServiceStorageClientTests1111000
test-class MechanismErrorTests77000
test-class MechanismTests33000
test-class NotificationErrorTests22000
test-class NotificationTests2727000
test-class OathAlgorithmTests66000
test-class OathErrorTests22000
test-class OathMechanismTests33000
test-class OathQRCodeParserTests2323000
test-class OathTokenCodeTests1010000
test-class PushMechanismRegistrationTests55000
test-class PushMechanismTests66000
test-class PushNotificationAuthenticationTests88000
test-class PushNotificationErrorTests44000
test-class PushQRCodeParserTests88000
test-class RequestInterceptorTests22000
test-class TOTPCodeGenerationTests66000
test-class TOTPMechanismTests1010000
test-class URLUtilTests99000

FRCaptchaEnterpriseTests

  • Device: iPhone 14, 17.5 (21F79)
  • SDK: Simulator - iOS 17.5, 17.5
TestTotalSuccessFailureSkippedExpected Failure
test-class ReCaptchaEnterpriseTests99000

FRCoreTests

  • Device: iPhone 14, 17.5 (21F79)
  • SDK: Simulator - iOS 17.5, 17.5
TestTotalSuccessFailureSkippedExpected Failure
test-class ActionTests1111000
test-class AppPinAuthenticatorTests31020
test-class CryptoKeyTests1010000
test-class FRSecurityConfigurationTests22000
test-class FRStringUtilTests55000
test-class JailbreakDetectorTests33000
test-class KeychainServiceTests88000

Details

Test Details

FRAuthTestsback

AA_00_RegistrationTests back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)1.24s

All tests passed 🎉

AA_01_LoginTests back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.72s

All tests passed 🎉

AA_02_KBAAuthenticationTests back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.15s

All tests passed 🎉

AA_03_SecondFactorAuthenticationTests back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.14s

All tests passed 🎉

AA_04_BooleanAttributeInputCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)1.08s

All tests passed 🎉

AA_04_ChoiceCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.65s

All tests passed 🎉

AA_04_ConfirmationCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.69s

All tests passed 🎉

AA_04_DeviceProfileCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.95s

All tests passed 🎉

AA_04_KbaCreateCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.93s

All tests passed 🎉

AA_04_NumberAttributeInputCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.69s

All tests passed 🎉

AA_04_PageCallback65Test back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.65s

All tests passed 🎉

AA_04_PageCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.62s

All tests passed 🎉

AA_04_PollingWaitCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.68s

All tests passed 🎉

AA_04_ReCaptchaCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.49s

All tests passed 🎉

AA_04_StringAttributeInputCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.70s

All tests passed 🎉

AA_04_TermsAndConditionCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.68s

All tests passed 🎉

AA_05_DeviceBindingCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
5 (100%)0 (0%)0 (0%)0 (0%)0.83s

All tests passed 🎉

AA_06_DeviceSigningVerifierCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
5 (71%)0 (0%)2 (29%)0 (0%)0.03s

All tests passed 🎉

AA_07_AppIntegrityTest back

SuccessFailureSkippedExpected Failure⏱️
0 (0%)0 (0%)10 (100%)0 (0%)0.05s

All tests passed 🎉

AA_08_TextInputCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.76s

All tests passed 🎉

AA_09_PingOneProtectInitializeCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
3 (100%)0 (0%)0 (0%)0 (0%)0.61s

All tests passed 🎉

AA_10_PingOneProtectEvaluateCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
3 (100%)0 (0%)0 (0%)0 (0%)1.06s

All tests passed 🎉

AA_11_TextOutputCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.80s

All tests passed 🎉

AA_12_ReCaptchaEnterpriseCallbackTest back

SuccessFailureSkippedExpected Failure⏱️
2 (50%)2 (50%)0 (0%)0 (0%)1.37s
Failuretest-method test_03_recaptcha_enterprise_fail_score()back
Failuretest-method test_04_recaptcha_enterprise_custom_client_error()back

AbstractValidatedCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
8 (100%)0 (0%)0 (0%)0 (0%)0.01s

All tests passed 🎉

AccessTokenTests back

SuccessFailureSkippedExpected Failure⏱️
7 (100%)0 (0%)0 (0%)0 (0%)0.05s

All tests passed 🎉

AppleSignInHandlerTests back

SuccessFailureSkippedExpected Failure⏱️
7 (100%)0 (0%)0 (0%)0 (0%)0.01s

All tests passed 🎉

AtomicDictionaryTests back

SuccessFailureSkippedExpected Failure⏱️
3 (100%)0 (0%)0 (0%)0 (0%)0.00s

All tests passed 🎉

AuthApiErrorTests back

SuccessFailureSkippedExpected Failure⏱️
5 (100%)0 (0%)0 (0%)0 (0%)0.02s

All tests passed 🎉

AuthErrorTests back

SuccessFailureSkippedExpected Failure⏱️
11 (100%)0 (0%)0 (0%)0 (0%)0.01s

All tests passed 🎉

AuthServiceTests back

SuccessFailureSkippedExpected Failure⏱️
4 (100%)0 (0%)0 (0%)0 (0%)0.04s

All tests passed 🎉

AuthorizationPolicyTests back

SuccessFailureSkippedExpected Failure⏱️
18 (100%)0 (0%)0 (0%)0 (0%)0.02s

All tests passed 🎉

BooleanAttributeInputCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
3 (100%)0 (0%)0 (0%)0 (0%)0.02s

All tests passed 🎉

BrowserBuilderTests back

SuccessFailureSkippedExpected Failure⏱️
2 (100%)0 (0%)0 (0%)0 (0%)0.05s

All tests passed 🎉

BrowserErrorTests back

SuccessFailureSkippedExpected Failure⏱️
4 (100%)0 (0%)0 (0%)0 (0%)0.02s

All tests passed 🎉

BrowserTests back

SuccessFailureSkippedExpected Failure⏱️
11 (85%)0 (0%)2 (15%)0 (0%)0.04s

All tests passed 🎉

CallbackConstantsTests back

SuccessFailureSkippedExpected Failure⏱️
8 (100%)0 (0%)0 (0%)0 (0%)0.00s

All tests passed 🎉

ChoiceCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
8 (100%)0 (0%)0 (0%)0 (0%)0.01s

All tests passed 🎉

ConfigErrorTests back

SuccessFailureSkippedExpected Failure⏱️
5 (100%)0 (0%)0 (0%)0 (0%)0.01s

All tests passed 🎉

ConfirmationCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
8 (100%)0 (0%)0 (0%)0 (0%)0.06s

All tests passed 🎉

CookieTests back

SuccessFailureSkippedExpected Failure⏱️
7 (100%)0 (0%)0 (0%)0 (0%)0.59s

All tests passed 🎉

CookieValidationTests back

SuccessFailureSkippedExpected Failure⏱️
12 (100%)0 (0%)0 (0%)0 (0%)0.01s

All tests passed 🎉

CustomCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
5 (100%)0 (0%)0 (0%)0 (0%)0.04s

All tests passed 🎉

DeviceProfileCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
6 (100%)0 (0%)0 (0%)0 (0%)0.04s

All tests passed 🎉

FRAppAttestModalTests back

SuccessFailureSkippedExpected Failure⏱️
13 (100%)0 (0%)0 (0%)0 (0%)0.03s

All tests passed 🎉

FRAppAttestServiceImplTests back

SuccessFailureSkippedExpected Failure⏱️
3 (100%)0 (0%)0 (0%)0 (0%)0.00s

All tests passed 🎉

FRAppIntegrityCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
6 (100%)0 (0%)0 (0%)0 (0%)0.03s

All tests passed 🎉

FRAppIntegrityKeysTests back

SuccessFailureSkippedExpected Failure⏱️
2 (100%)0 (0%)0 (0%)0 (0%)0.04s

All tests passed 🎉

FRAuthTests back

SuccessFailureSkippedExpected Failure⏱️
21 (100%)0 (0%)0 (0%)0 (0%)0.53s

All tests passed 🎉

FRDeviceCollectorTests back

SuccessFailureSkippedExpected Failure⏱️
2 (100%)0 (0%)0 (0%)0 (0%)0.65s

All tests passed 🎉

FRDeviceIdentifierTests back

SuccessFailureSkippedExpected Failure⏱️
3 (100%)0 (0%)0 (0%)0 (0%)0.16s

All tests passed 🎉

FRDeviceTests back

SuccessFailureSkippedExpected Failure⏱️
2 (100%)0 (0%)0 (0%)0 (0%)0.03s

All tests passed 🎉

FROptionsTests back

SuccessFailureSkippedExpected Failure⏱️
9 (100%)0 (0%)0 (0%)0 (0%)0.16s

All tests passed 🎉

FRRequestInterceptorTests back

SuccessFailureSkippedExpected Failure⏱️
3 (100%)0 (0%)0 (0%)0 (0%)1.21s

All tests passed 🎉

FRSessionTests back

SuccessFailureSkippedExpected Failure⏱️
10 (100%)0 (0%)0 (0%)0 (0%)0.25s

All tests passed 🎉

FRURLProtocolTests back

SuccessFailureSkippedExpected Failure⏱️
7 (100%)0 (0%)0 (0%)0 (0%)0.04s

All tests passed 🎉

FRUserBrowserTests back

SuccessFailureSkippedExpected Failure⏱️
6 (75%)0 (0%)2 (25%)0 (0%)14.13s

All tests passed 🎉

FRUserTests back

SuccessFailureSkippedExpected Failure⏱️
22 (100%)0 (0%)0 (0%)0 (0%)0.19s

All tests passed 🎉

FRWebAuthnTests back

SuccessFailureSkippedExpected Failure⏱️
5 (100%)0 (0%)0 (0%)0 (0%)1.19s

All tests passed 🎉

FailedPolicyTests back

SuccessFailureSkippedExpected Failure⏱️
13 (100%)0 (0%)0 (0%)0 (0%)0.04s

All tests passed 🎉

IdPCallbackTests back

SuccessFailureSkippedExpected Failure⏱️
7 (100%)0 (0%)0 (0%)0 (0%)0.17s

All tests passed 🎉

IdPClientTests back

SuccessFailureSkippedExpected Failure⏱️
2 (100%)0 (0%)0 (0%)0 (0%)0.02s

All tests passed 🎉

<a name="frauthtests_idphandle

Annotations

Check failure on line 297 in /Users/runner/work/forgerock-ios-sdk/forgerock-ios-sdk/FRAuth/FRAuthTests/FRAuthSwiftTests/E2ETests/Callback-Live/AA_12_ReCaptchaEnterpriseCallbackTest.swift

See this annotation in the file changed.

@github-actions github-actions / Xcode test results

Assertion Failure 

XCTAssertEqual failed: ("VALIDATION_ERROR:CAPTCHA validation failed") is not equal to (""VALIDATION_ERROR:CAPTCHA validation failed"")

Check failure on line 360 in /Users/runner/work/forgerock-ios-sdk/forgerock-ios-sdk/FRAuth/FRAuthTests/FRAuthSwiftTests/E2ETests/Callback-Live/AA_12_ReCaptchaEnterpriseCallbackTest.swift

See this annotation in the file changed.

@github-actions github-actions / Xcode test results

Assertion Failure 

XCTAssertEqual failed: ("CLIENT_ERROR:CUSTOM_CLIENT_ERROR") is not equal to (""CLIENT_ERROR:CUSTOM_CLIENT_ERROR"")

Check failure on line 629 in /Users/runner/work/forgerock-ios-sdk/forgerock-ios-sdk/FRDeviceBinding/FRDeviceBindingTests/DeviceBindingCallbackTests.swift

See this annotation in the file changed.

@github-actions github-actions / Xcode test results

Assertion Failure 

XCTAssertEqual failed: ("Authentication Timeout") is not equal to ("DeviceBinding/Signing is not supported on the iOS Simulator")

Check failure on line 582 in /Users/runner/work/forgerock-ios-sdk/forgerock-ios-sdk/FRDeviceBinding/FRDeviceBindingTests/DeviceSigningVerifierCallbackTests.swift

See this annotation in the file changed.

@github-actions github-actions / Xcode test results

Assertion Failure 

XCTAssertEqual failed: ("Authentication Timeout") is not equal to ("DeviceBinding/Signing is not supported on the iOS Simulator")

Check failure on line 717 in /Users/runner/work/forgerock-ios-sdk/forgerock-ios-sdk/FRDeviceBinding/FRDeviceBindingTests/DeviceSigningVerifierCallbackTests.swift

See this annotation in the file changed.

@github-actions github-actions / Xcode test results

Assertion Failure 

XCTAssertEqual failed: ("Invalid Custom Claims") is not equal to ("DeviceBinding/Signing is not supported on the iOS Simulator")

Check failure on line 864 in /Users/runner/work/forgerock-ios-sdk/forgerock-ios-sdk/FRDeviceBinding/FRDeviceBindingTests/DeviceSigningVerifierCallbackTests.swift

See this annotation in the file changed.

@github-actions github-actions / Xcode test results

Assertion Failure 

XCTAssertEqual failed: ("Invalid Custom Claims") is not equal to ("DeviceBinding/Signing is not supported on the iOS Simulator")
View more details on GitHub Actions