Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make UI testing significantly more robust #133

Merged
merged 5 commits into from
Nov 29, 2023

Conversation

hartwork
Copy link
Collaborator

@hartwork hartwork commented Nov 29, 2023

Follow-up to #117.

@edgar-bonet you were right about the clock: with differences in hardware capability, there is no way we get this many machines to agree enough on speed of execution… PS: The best point to start review is probably the changes to record.sh.

Copy link
Collaborator

@edgar-bonet edgar-bonet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Waow! I didn't know “ANSI screenshots” was even a thing. I find this a really great approach! Didn't test, but I assume you did. 👏

@hartwork
Copy link
Collaborator Author

Waow! I didn't know “ANSI screenshots” was even a thing. I find this a really great approach! Didn't test, but I assume you did. 👏

@edgar-bonet glad you like it! I don't know if they're a thing, maybe I just invented something new 😄 I definitely did some testing both in CI and locally. The future will tell what I missed 😃

PS: Do you know sl (https://github.com/mtoyoda/sl/) for when people mistype ls? Here's what the new CI would make of it:

# ./recordings/flip_book.py sl
[90x20] Frame 1:
+------------------------------------------------------------------------------------------+
|                                                                                 (@@@)    |
|                                                                             (    )       |
|                                                                          (@@@@)          |
|                                                                                          |
|                                                                        (   )             |
|                                                                       ====        _______|
|                                                                   _D _|  |_______/       |
|                                                                    |(_)---  |   H\_______|
|                                                                    /     |  |   H  |  |  |
|                                                                   |      |  |   H  |__---|
|                                                                   | ________|___H__/__|__|
|                                                                   |/ |   |-----------I___|
|                                                                 __/ =| o |=-~~\  /~~\  /~|
|                                                                  |/-=|___|=   O=====O====|
|                                                                   \_/      \__/  \__/  \_|
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
+------------------------------------------------------------------------------------------+

[90x20] Frame 2:
+------------------------------------------------------------------------------------------+
|                                                         (@@@)                            |
|                                                     (    )                               |
|                                                  (@@@@)                                  |
|                                                                                          |
|                                                (   )                                     |
|                                              ====        ________                ________|
|                                          _D _|  |_______/        \__I_I_____===__|_______|
|                                           |(_)---  |   H\________/ |   |        =|___ ___|
|                                           /     |  |   H  |  |     |   |         ||_| |_||
|                                          |      |  |   H  |__--------------------| [___] |
|                                          | ________|___H__/__|_____/[][]~\_______|       |
|                                          |/ |   |-----------I_____I [][] []  D   |=======|
|                                        __/ =| o |=-~O=====O=====O=====O\ ____Y___________|
|                                         |/-=|___|=    ||    ||    ||    |_____/~\___/    |
|                                          \_/      \__/  \__/  \__/  \__/      \_/        |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
+------------------------------------------------------------------------------------------+

[90x20] Frame 3:
+------------------------------------------------------------------------------------------+
|                                 (@@@)                                                    |
|                             (    )                                                       |
|                          (@@@@)                                                          |
|                                                                                          |
|                        (   )                                                             |
|                     ====        ________                ___________                      |
|                 _D _|  |_______/        \__I_I_____===__|_________|                      |
|                  |(_)---  |   H\________/ |   |        =|___ ___|      _________________ |
|                  /     |  |   H  |  |     |   |         ||_| |_||     _|                \|
|                 |      |  |   H  |__--------------------| [___] |   =|                   |
|                 | ________|___H__/__|_____/[][]~\_______|       |   -|                   |
|                 |/ |   |-----------I_____I [][] []  D   |=======|____|___________________|
|               __/ =| o |=-O=====O=====O=====O \ ____Y___________|__|_____________________|
|                |/-=|___|=    ||    ||    ||    |_____/~\___/          |_D__D__D_|  |_D__D|
|                 \_/      \__/  \__/  \__/  \__/      \_/               \_/   \_/    \_/  |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
+------------------------------------------------------------------------------------------+

[90x20] Frame 4:
+------------------------------------------------------------------------------------------+
|         (@@@)                                                                            |
|     (    )                                                                               |
|  (@@@@)                                                                                  |
|                                                                                          |
|(   )                                                                                     |
|        ________                ___________                                               |
|_______/        \__I_I_____===__|_________|                                               |
|  |   H\________/ |   |        =|___ ___|      _________________                          |
|  |   H  |  |     |   |         ||_| |_||     _|                \_____A                   |
|  |   H  |__--------------------| [___] |   =|                        |                   |
|__|___H__/__|_____/[][]~\_______|       |   -|                        |                   |
|-----------I_____I [][] []  D   |=======|____|________________________|_                  |
|=-~~\  /~~\  /~~\  /~~\ ____Y___________|__|__________________________|_                  |
|=O=====O=====O=====O   |_____/~\___/          |_D__D__D_|  |_D__D__D_|                    |
| \__/  \__/  \__/  \__/      \_/               \_/   \_/    \_/   \_/                     |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
+------------------------------------------------------------------------------------------+

[90x20] Frame 5:
+------------------------------------------------------------------------------------------+
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|       ___________                                                                        |
|__===__|_________|                                                                        |
|      =|___ ___|      _________________                                                   |
|       ||_| |_||     _|                \_____A                                            |
|-------| [___] |   =|                        |                                            |
|_______|       |   -|                        |                                            |
|]  D   |=======|____|________________________|_                                           |
|___Y___________|__|__________________________|_                                           |
|____/~\___/          |_D__D__D_|  |_D__D__D_|                                             |
|    \_/               \_/   \_/    \_/   \_/                                              |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
+------------------------------------------------------------------------------------------+

[90x20] Frame 6:
+------------------------------------------------------------------------------------------+
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|______________                                                                            |
|              \_____A                                                                     |
|                    |                                                                     |
|                    |                                                                     |
|____________________|_                                                                    |
|____________________|_                                                                    |
|_D__D_|  |_D__D__D_|                                                                      |
|   \_/    \_/   \_/                                                                       |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
|                                                                                          |
+------------------------------------------------------------------------------------------+

@hartwork hartwork merged commit ebfcd1c into tenox7:development Nov 29, 2023
7 checks passed
@hartwork hartwork added this to the 1.6.0 milestone Nov 29, 2023
@edgar-bonet
Copy link
Collaborator

Do you know sl [...]

LOL. reminds me of Star Wars.

@hartwork hartwork deleted the fix-ci branch November 29, 2023 21:52
hartwork added a commit that referenced this pull request Dec 1, 2023
…ts-evaluation

Clean up CI stage "Evaluate UI test results" (fix-up for #133)
hartwork added a commit that referenced this pull request Jan 9, 2024
Cl: Drop `homebrew/cask-fonts` leftover (follow-up to #133)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants