Skip to content

most appium tests fail most of the time on M1 Max #1070

Description

@tomholub

They generally eventually pass if run enough times. It seems we'll need some explicit delays added, maybe.

0-0] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/CheckComposeEmailAfterReopening.spec.ts
[0-0] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-0] Error in "COMPOSE EMAIL:  check filled compose email after reopening app"
Error: element ("-ios class chain:**/XCUIElementTypeTextField[`value == "Subject"`]") still not displayed after 15000ms
    at async Function.ElementHelper.waitAndClick (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:48:5)
    at async Function.ElementHelper.waitClickAndType (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:55:5)
    at async NewMessageScreen.setSubject (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/new-message.screen.ts:63:5)
[0-0] RETRYING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/CheckComposeEmailAfterReopening.spec.ts
[0-0] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/CheckComposeEmailAfterReopening.spec.ts
[0-0] PASSED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/CheckComposeEmailAfterReopening.spec.ts (1 retries)
[0-1] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SelectRecipientByName.spec.ts
[0-1] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-1] Error in "COMPOSE EMAIL:  user is able to select recipient from contact list using contact name"
Error: element ("~menu icn") still not displayed after 15000ms
    at async Function.ElementHelper.waitAndClick (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:48:5)
    at async MenuBarScreen.clickMenuIcon (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/menu-bar.screen.ts:44:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/composeEmail/SelectRecipientByName.spec.ts:42:5)
[0-1] RETRYING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SelectRecipientByName.spec.ts
[0-1] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SelectRecipientByName.spec.ts
[0-1] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-1] Error in "COMPOSE EMAIL:  user is able to select recipient from contact list using contact name"
Error: element ("~menu icn") still not displayed after 15000ms
    at async Function.ElementHelper.waitAndClick (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:48:5)
    at async MenuBarScreen.clickMenuIcon (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/menu-bar.screen.ts:44:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/composeEmail/SelectRecipientByName.spec.ts:42:5)
[0-1] FAILED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SelectRecipientByName.spec.ts (1 retries)
[0-2] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SendEncryptedEmailAfterPassPhraseSessionEndedAndTrashIt.spec.ts
[0-2] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-2] Error in "COMPOSE EMAIL:  user is able to send encrypted email when pass phrase session ended + move to trash, delete"
Error: element ("-ios class chain:**/XCUIElementTypeButton[`label == "+"`]") still not displayed after 15000ms
    at async InboxScreen.checkInboxScreen (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/inbox.screen.ts:40:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/composeEmail/SendEncryptedEmailAfterPassPhraseSessionEndedAndTrashIt.spec.ts:49:5)
[0-2] RETRYING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SendEncryptedEmailAfterPassPhraseSessionEndedAndTrashIt.spec.ts
[0-2] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SendEncryptedEmailAfterPassPhraseSessionEndedAndTrashIt.spec.ts
[0-2] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-2] Error in "COMPOSE EMAIL:  user is able to send encrypted email when pass phrase session ended + move to trash, delete"
Error: element ("-ios class chain:**/XCUIElementTypeButton[`label == "+"`]") still not displayed after 15000ms
    at async InboxScreen.checkInboxScreen (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/inbox.screen.ts:40:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/composeEmail/SendEncryptedEmailAfterPassPhraseSessionEndedAndTrashIt.spec.ts:49:5)
[0-2] FAILED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SendEncryptedEmailAfterPassPhraseSessionEndedAndTrashIt.spec.ts (1 retries)
[0-3] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SentEmailToRecipientWithoutPublicKey.spec.ts
[0-3] PASSED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/composeEmail/SentEmailToRecipientWithoutPublicKey.spec.ts
[0-4] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/CheckEncryptedEmailAfterRestartApp.spec.ts
[0-4] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-4] Error in "INBOX:  user is able to see encrypted email with pass phrase after restart app"
Error: element ("~arrow left c") still not displayed after 15000ms
    at async EmailScreen.checkOpenedEmail (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/email.screen.ts:70:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/CheckEncryptedEmailAfterRestartApp.spec.ts:48:5)
[0-4] RETRYING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/CheckEncryptedEmailAfterRestartApp.spec.ts
[0-4] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/CheckEncryptedEmailAfterRestartApp.spec.ts
[0-4] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-4] Error in "INBOX:  user is able to see encrypted email with pass phrase after restart app"
Error: element ("~arrow left c") still not displayed after 15000ms
    at async EmailScreen.checkOpenedEmail (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/email.screen.ts:70:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/CheckEncryptedEmailAfterRestartApp.spec.ts:48:5)
[0-4] FAILED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/CheckEncryptedEmailAfterRestartApp.spec.ts (1 retries)
[0-5] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/CheckReplyForEncryptedEmail.spec.ts
[0-5] PASSED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/CheckReplyForEncryptedEmail.spec.ts
[0-6] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadAttachmentEmail.spec.ts
[0-6] PASSED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadAttachmentEmail.spec.ts
[0-7] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadEmailAfterRestartApp.spec.ts
[0-7] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-7] Error in "INBOX:  user is able to see plain email without setting pass phrase after restart app"
Error: element ("~Test 1") still not displayed after 15000ms
    at async Function.ElementHelper.waitAndClick (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:48:5)
    at async InboxScreen.clickOnEmailBySubject (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/inbox.screen.ts:31:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/ReadEmailAfterRestartApp.spec.ts:22:5)
[0-7] RETRYING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadEmailAfterRestartApp.spec.ts
[0-7] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadEmailAfterRestartApp.spec.ts
[0-7] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-7] Error in "INBOX:  user is able to see plain email without setting pass phrase after restart app"
Error: element ("~Test 1") still not displayed after 15000ms
    at async Function.ElementHelper.waitAndClick (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:48:5)
    at async InboxScreen.clickOnEmailBySubject (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/inbox.screen.ts:31:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/ReadEmailAfterRestartApp.spec.ts:22:5)
[0-7] FAILED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadEmailAfterRestartApp.spec.ts (1 retries)
[0-8] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadKeyMismatchEmail.spec.ts
[0-8] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-8] Error in "INBOX:  user is able to view key mismatch email"
Error: element ("~e2e.enterprise.test@flowcrypt.com") still not displayed after 15000ms
    at async EmailScreen.checkEmailAddress (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/email.screen.ts:56:5)
    at async EmailScreen.checkOpenedEmail (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/email.screen.ts:71:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/ReadKeyMismatchEmail.spec.ts:22:5)
[0-8] RETRYING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadKeyMismatchEmail.spec.ts
[0-8] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadKeyMismatchEmail.spec.ts
[0-8] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-8] Error in "INBOX:  user is able to view key mismatch email"
Error: element ("~e2e.enterprise.test@flowcrypt.com") still not displayed after 15000ms
    at async EmailScreen.checkEmailAddress (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/email.screen.ts:56:5)
    at async EmailScreen.checkOpenedEmail (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/email.screen.ts:71:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/ReadKeyMismatchEmail.spec.ts:22:5)
[0-8] FAILED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadKeyMismatchEmail.spec.ts (1 retries)
[0-9] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadTextEmail.spec.ts
[0-9] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-9] Error in "INBOX:  user is able to view text email"
Error: element ("~Test 1") still not displayed after 15000ms
    at async Function.ElementHelper.waitAndClick (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:48:5)
    at async InboxScreen.clickOnEmailBySubject (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/inbox.screen.ts:31:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/ReadTextEmail.spec.ts:22:5)
[0-9] RETRYING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadTextEmail.spec.ts
[0-9] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadTextEmail.spec.ts
[0-9] Screenshot of failed test was saved to /Users/tom/git/flowcrypt-ios/appium/tmp
[0-9] Error in "INBOX:  user is able to view text email"
Error: element ("~Test 1") still not displayed after 15000ms
    at async Function.ElementHelper.waitAndClick (/Users/tom/git/flowcrypt-ios/appium/tests/helpers/ElementHelper.ts:48:5)
    at async InboxScreen.clickOnEmailBySubject (/Users/tom/git/flowcrypt-ios/appium/tests/screenobjects/inbox.screen.ts:31:5)
    at async UserContext.<anonymous> (/Users/tom/git/flowcrypt-ios/appium/tests/specs/inbox/ReadTextEmail.spec.ts:22:5)
[0-9] FAILED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/inbox/ReadTextEmail.spec.ts (1 retries)
[0-10] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/login/GmailLogin.spec.ts
[0-10] api-mock listening on 8001
[0-10] PASSED in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/login/GmailLogin.spec.ts
[0-11] RUNNING in /Users/tom/git/flowcrypt-ios/appium/FlowCrypt.app - /tests/specs/settings/CheckSettingsForLoggedUser.spec.ts

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions