To improve our firmware testing approach, we will be moving to a more structured process. Here is an overview of the new testing procedure:
Types of Tests:
- Unit Tests (not yet implemented – planned within the Hallstatt Project)
- Attersee Test: our fully automated integration tests
- Long Time Test: Simulated user inputs on machines in the machine hall or on simulator panels
- Firmware Release Tests
This message will focus on the Long Time Test and Firmware Release Test. I will share further details on the Attersee Test once Amin completes its development.
Long Time Test: Automated scripts will simulate user inputs. Our Linux image (StormEagle) includes two main tools for this purpose:
- xdotool: Allows specific XY coordinates to be clicked to simulate user inputs via text script
- Pros: Once created, scripts can run uniformly on all panels.
- Cons: Creating the scripts is time-consuming and requires precision.
- cnee tool / Macro Recorder: This tool is also included in StormEagle and records mouse and keyboard inputs that can then be replayed in a loop.
- Pros: Quick to record.
- Cons: Requires a specific mouse setup, so it may not be usable across different machines if mouse settings vary.
The Long Time Tests are tracked in our new board (thanks, Mario, for setting this up).
https://woojin-world.monday.com/boards/1691156860
Felix will create detailed manual how to use xdotool and cnee tool. Information will follow in the next days.
Firmware Release Tests: Mainly Jörg will be testing the release version on machines in the machine hall. We aim to proceed with more structure in this area as well.
For each release, there’s a Firmware Release / Test Description Board where tests are defined.
https://woojin-world.monday.com/boards/1695601167
Test items are then copied to our standard board “TASK AND TICKET BOARD,” assigned to individual users, and executed across multiple machines if necessary (e.g., DL650A5 and TH280A5).
Additionally, we have a Dashboard for a better overview of the firmware tests.
https://woojin-world.monday.com/overviews/7368846
Further details on Attersee and Unit Tests will follow soon.
Best regards,
Richard