[Freeciv-Dev] Re: (PR#8589) 6 test scripts

["Jason Short" <jdorje@xxxxxxxxxxxxxxxxxxxxx>]

<URL: http://rt.freeciv.org/Ticket/Display.html?id=8589 >

Raimar Falke wrote:

> They all print some basic information what they do. They all assume
> that your current dir is the top freeciv dir. They require
> python2. Only start the .sh files.

So the idea is for these to go into the tests/ directory?  Then...

We need a configure check for python2 that disables these tests if it's 
not available.

They need to run from the tests directory.  We can easily pass 
$(top_srcdir) as an argument to them.

We probably need a comparison text file.  It's hard to automate most 
tests because the output needs to be scanned by humans.  But if we had, 
for instance, a text file that had the "correct" output then the 
script's output could be compared to that.  Unfortunately the correct 
output may not be constant.  This problem doesn't seem solvable.

> The run time varies between some
> seconds and 2mins.

Hmm, potentially a lot.

jason