OpenTally/docs/validation.md

3.7 KiB

Validation

STV-counting software is frequently validated empirically by comparing the results of election counts to those generated by independent implementations. See, for example, [1–5]. The table describes the empirical validation performed on OpenTally to date.

Method Election Comparator Included test case
Scottish STV 2007 Glasgow council Linn ward election eSTV 2.0.16 (official)
OpenTally Meek Ballot papers derived from the ERS97 model election Algorithm 123
Meek STV (2006) Ballot papers derived from the ERS97 model election OpenSTV 1.7
Meek STV (New Zealand) Ballot papers derived from the ERS97 model election OpenSTV 1.7, Hill's nzmeek 6.7.7
Australian Senate STV 2019 Tasmanian Senate election EasyCount (official)
Australian Senate STV 2019 NSW Senate election EasyCount (official)
Australian Capital Territory STV 2020 Kurrajong Legislative Assembly election eVACS 2020 (official)
Cambridge STV 2003 Cambridge City Council election OpenSTV 1.7, ChoicePlus Pro 2.1 (official)
Wright STV EVE Online CSM 15 election ccp-wright-stv (official)
PRSA 1977 Proportional Representation Manual example 1 Model result (official)
ERS97 Ballot papers derived from the ERS97 model election Model result (official)

References

  1. Wichmann BA. Checking two STV programs. Voting Matters. 2000 Apr; (11): 6–8. http://www.votingmatters.org.uk/ISSUE11/P4.HTM
  2. Wichmann BA. Validation of implementation of the Meek algorithm for STV. London: McDougall Trust; 2000 Apr 28. http://www.votingmatters.org.uk/RES/MKVAL.pdf
  3. Koopman P, Hubbers E, Pieters W, Poll E, de Vries R. Testing the eSTV program for the Scottish local government elections. Nijmegen (NL): Radboud University; 2007 Mar 30. https://research.utwente.nl/en/publications/testing-the-estv-program-for-the-scottish-local-government-electi
  4. Conway A, Blom M, Naish L, Teague V. An analysis of New South Wales electronic vote counting. ACSW '17: Proceedings of the Australasian Computer Science Week multiconference. New York: Association for Computing Machinery; 2017 Jan. doi: 10.1145/3014812.3014837
  5. Abate P, Dawson J, Goré R, Gray M, Norrish M, Slater A. Formal methods applied to electronic voting systems. Canberra: Australian National University; c2003. https://users.cecs.anu.edu.au/~rpg/EVoting/