Test case API_029 fails

[aplteam]

No description provided.

[PhilLast]

In which version of Dyalog does it fail?

[aplteam]

16.0, 17.0 and 17.1 Have not tried 18.0

…

On Thu, 23 Apr 2020 at 23:16, PhilLast ***@***.***> wrote: In which version of Dyalog does it fail? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#224 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AD5XJHLR5BZ35UVK2DKUZBDROC45HANCNFSM4MPE3EIQ> .

[PhilLast]

They all work for me in 17.1 and 18.0. Haven't tried all in 15.0 16.0 17.0 and but API_029 works in all. Can you send error output, ⎕SE etc.

[aplteam]

T.RunThese 'API' 29
--- Test framework "Tester2" version 2.2.0.46 from 2020-04-21 ----
Searching for INI file C:/T/Projects/Carlisle/Acre-Desktop//Testcases.ini: found
Searching for INI file C:/T/Projects/Carlisle/Acre-Desktop//Testcases-APLTEAM2.ini: found
  INI file(s) "C:/T/Projects/Carlisle/Acre-Desktop//Testcases.ini,C:/T/Projects/Carlisle/Acre-Desktop//Testcases-APLTEAM2.ini" found and instantiated as INI
2 INI files instantiated
Oldewst version supported by acre is 16.0
C:\T\Projects\Carlisle\Acre-Desktop
Looking for a function "Initial": found and successfully executed
--- Tests started at 2020-04-25 19:45:33 on #.acre.AcreDesktop_Testcases.Tests ---
SYNTAX ERROR
      . ⍝ Deliberate error
         ∧
      )si
#.acre.AcreDesktop_Testcases.Tests.Test_API_029[41]*
⍎
[#.acre.AcreDesktop_Testcases.Tests.[Tester2]] #.acre.AcreDesktop_Testcases.Tester2.ExecuteTestFunction[18]
[#.acre.AcreDesktop_Testcases.Tests.[Tester2]] #.acre.AcreDesktop_Testcases.Tester2.ProcessTestCases[53]
[#.acre.AcreDesktop_Testcases.Tests.[Tester2]] #.acre.AcreDesktop_Testcases.Tester2.Run__[54]
[#.acre.AcreDesktop_Testcases.Tests.[Tester2]] #.acre.AcreDesktop_Testcases.Tester2.RunThese[22]
      list

      ≢list
0

[PhilLast]

Eqivalent output for me in 17.1 is:

      ac.test'API'29
--- Test framework "Tester2" version 1.0.0.29 from 2019-12-01 ----
Searching for INI file C:/Users/Phil/Desktop/acre4projects/acre//Testcases.ini: found
Searching for INI file C:/Users/Phil/Desktop/acre4projects/acre//Testcases-PHILHP.ini: not found
  INI file(s) "C:/Users/Phil/Desktop/acre4projects/acre//Testcases.ini" found and instantiated as INI
1 INI file instantiated
Oldewst version supported by acre is 14.0
C:\Users\Phil\Desktop\acre4projects
Looking for a function "Initial": found and successfully executed
--- Tests started at 2020-04-26 08:15:28 on #.acre.AcreDesktop_Testcases.Tests ---
✓ Test_API_029 (1/1)  ⍝ Exercise the API function `Changes`
 -----                     
   1 test case of 1 called 
   0 test cases failed     
   0 test cases broken     
Time of execution recorded on variable #.acre.AcreDesktop_Testcases.Tests.TestCasesExecutedAt in: 2020-04-26 08:15:31
Looking for a function "Cleanup": found and executed
*** Tests done

Could it be something to do with these ini files?
or this difference?:
Kai: --- Test framework "Tester2" version 2.2.0.46 from 2020-04-21 ----
Phil: --- Test framework "Tester2" version 1.0.0.29 from 2019-12-01 ----

[aplteam]

No, the INI file defines just the oldest supported version of Dyalog, and the test framework as such has no bearing on the execution of the test. However, I have updated all the scripts and pushed them. Because my desktop is a very fast machine I've run the test on my 8-year old laptop as well. I did not expect that to make a difference, and it didn't: that test case fails reproducibly on the laptop as well, 100% of the time with 10 attempts. I don't understand this.

…

On Sun, 26 Apr 2020 at 09:27, PhilLast ***@***.***> wrote: Eqivalent output for me in 17.1 is: ac.test'API'29 --- Test framework "Tester2" version 1.0.0.29 from 2019-12-01 ---- Searching for INI file C:/Users/Phil/Desktop/acre4projects/acre//Testcases.ini: found Searching for INI file C:/Users/Phil/Desktop/acre4projects/acre//Testcases-PHILHP.ini: not found INI file(s) "C:/Users/Phil/Desktop/acre4projects/acre//Testcases.ini" found and instantiated as INI 1 INI file instantiated Oldewst version supported by acre is 14.0 C:\Users\Phil\Desktop\acre4projects Looking for a function "Initial": found and successfully executed --- Tests started at 2020-04-26 08:15:28 on #.acre.AcreDesktop_Testcases.Tests --- ✓ Test_API_029 (1/1) ⍝ Exercise the API function `Changes` ----- 1 test case of 1 called 0 test cases failed 0 test cases broken Time of execution recorded on variable #.acre.AcreDesktop_Testcases.Tests.TestCasesExecutedAt in: 2020-04-26 08:15:31 Looking for a function "Cleanup": found and executed *** Tests done Could it be something to do with these ini files? or this difference?: Kai: --- Test framework "Tester2" version 2.2.0.46 from 2020-04-21 ---- Phil: --- Test framework "Tester2" version 1.0.0.29 from 2019-12-01 ---- — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#224 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AD5XJHKRZYXF3CV2LBNMUJTROPV63ANCNFSM4MPE3EIQ> .