Re: [lmi] wx_test_validate_output.cpp

[Greg Chicares]

On 01/22/2015 06:22 PM, Murphy, Kimberly wrote:
> This test is giving me difficulty. When run as part of the entire 
> automated GUI test suite, the 'validate_output_*' tests fail:
> 
> NOTE: starting the test suite
> [...]
> validate_output_illustration: started
> validate_output_illustration: ERROR (Assertion failure: Expected 
> wxMessageDialog dialog was not shown. [file 
> /opt/lmi/local/include/wx-3.1/wx/testing.h, line 315, in ReportFailure()].)
> validate_output_mec: started
> validate_output_mec: ERROR (Assertion failure: Expected wxDialog dialog was 
> not shown. [file /opt/lmi/local/include/wx-3.1/wx/testing.h, line 315, in 
> ReportFailure()].)
> FAILURE: 2 out of 23 tests failed.

When I run the entire suite, I get:

/opt/lmi/bin[0]$./wx_test.exe --gui_test_path=/opt/lmi/gui_test 
--data_path=/opt/lmi/data 2>&1 |less -S

[messagebox]
Programming error
A document created during unattended test hasn't been closed, please report 
this.

That appears to be the census that is pasted into (below).

default_update: ERROR (Assertion failure: A message box "Unable to read file 
'C:/etc/opt/lmi/default.ill'. [file /lmi/src/lmi/illustration_document.cpp, 
line 110] " was shown unexpectedly, expected wxDialog. [file 
/opt/lmi/local/include/wx-3.1/wx/testing.h, line 315, in ReportFailure()].)

That's expected: I deliberately have no 'default.ill' file.

input_validation: ERROR (Assertion '(error_message.substr(0, loc_pos)) == 
("Input validation problems for '':\n" "COI multiplier entered is '0', but it 
must contain at least one number other than zero.\n")' failed (expected Input 
validation problems for '': COI multiplier entered is '0', but it must contain 
at least one number other than zero.  vs observed Input validation problems for 
'': Lowest COI multiplier entered is 0.85, but 1 is the lowest multiplier 
allowed. ). [file
/lmi/src/lmi/wx_test_input_validation.cpp, line 94] )

paste_census: started
paste_census: ERROR (Assertion failure: A message box "Unable to save 
'C:\opt\lmi\gui_test\PasteCensus.cns'. [file /lmi/src/lmi/census_document.cpp, 
line 127] " was shown unexpectedly. [file 
/opt/lmi/local/include/wx-3.1/wx/testing.h, line 315, in ReportFailure()].)

FAILURE: 3 out of 23 tests failed.

But validate_output_illustration passes.

I haven't looked into the input_validation or paste_census problems
yet; they might be artifacts of my P2V migration if they depend on
files I've copied over. This part:
  '':\n" "
looks interesting.

> On the other hand, when each validate_output test is run on its 
> own, it succeeds. Here I share the 'validate_output_illustration' 
> outcome:
> 
> /opt/lmi/bin[0]$./wx_test.exe --gui_test_path=/opt/lmi/gui_test \
> --data_path=/opt/lmi/data -t validate_output_illustration
> NOTE: starting the test suite
> validate_output_illustration: started
> time=2254ms (for validate_output_illustration)
> validate_output_illustration: ok
> time=2254ms (for all tests)
> SUCCESS: 1 test successfully completed.

Mine's the same (though slower):

NOTE: starting the test suite
validate_output_illustration: started
time=3000ms (for validate_output_illustration)
validate_output_illustration: ok
time=3000ms (for all tests)
SUCCESS: 1 test successfully completed.