Content Comparison

...

A test setup is generally packaged as a ZIP file. This package must contain a Makefile and a test.properties file, as well as the test scripts and any support files.

Here is an example test.properties file:

Further examples of minimal setup files can be found in the following git repo:

Create the Test Setup ZIP file

ZIP all your test files into a single ZIP file, including the Makefile and test.properties file.

• Do not ZIP the folder containing the Test Setup files. Rather, ZIP the files at the root folder level of the ZIP file. Otherwise, when the build server unzips the Test Setup files, it will be unzipped into a subfolder and the build server will not be able to find the Makefile and test.properties file.

• Verify that this ZIP file does NOT include a copy of the canonical submission. As the build server will download the Test Setup files on top of (after) it downloads the student submission into the build folder, the inclusion of the canonical submission in the Test Setup files will result in the student submission being overwritten by the canonical files. This will result in all student submissions passing all tests and being given a free 100% grade.

Within the New test setups section:

...

At this point, the test setup is running, but students cannot see it yet.

Make Setup Visible

Students are unable to see the test setup until it is made visible.

• In the Project Maintenance → Project Visiblity section, click the make visible button.

...