Index


  • Introduction

  • Skipped feature combinations
  • Failed test cases
  • Tests by feature combinations
  • SYMMETRY tests
  • Tests under anomalous conditions

  • Tests by feature combinations: -workers 2
  • SYMMETRY tests: -workers 2

  • Tests by feature combinations: -workers auto
  • SYMMETRY tests: -workers auto

Tests by plug feature NumOne; CLI Option: -workers 1

Id Type Case Feature Plug Feature Check Deadlock Test Results Test Models
a2e4f9d9e0e8f322d1ce8e7e10f2986fca6a7810 Apalache Eq NumOne True Passed
  • Model Under Test
  • Equivalent Model
bfa34abdc896f7ea9744b075166688627c73a748 Apalache Eq NumOne False Passed
  • Model Under Test
  • Equivalent Model
70be87046f62b5bb579d0aed86a9b65c61dee184 Apalache Ne NumOne True Passed
  • Model Under Test
  • Equivalent Model
10cd5885b6466532f49391f34694816bcb6fcb57 Apalache Ne NumOne False Passed
  • Model Under Test
  • Equivalent Model
c8df92b0f82ebd59a675b6460bc21e3d8e1427c6 Apalache Let NumOne True Passed
  • Model Under Test
  • Equivalent Model
4c263f9841f2913152e82e709cb55cffce6f6e40 Apalache Let NumOne False Passed
  • Model Under Test
  • Equivalent Model
24273c722543e0436ff0449826749f410ffa6415 Apalache Set0 NumOne True Passed
  • Model Under Test
  • Equivalent Model
65730c94f354fc6130bfc5da7980f977b004da13 Apalache Set0 NumOne False Passed
  • Model Under Test
  • Equivalent Model
134b58509e228a57ff5defb5c5fd9e54fd5a2e94 Apalache Set1 NumOne True Passed
  • Model Under Test
  • Equivalent Model
3a19e8164c2bdd02527bd36bb56fdd1faa00e827 Apalache Set1 NumOne False Passed
  • Model Under Test
  • Equivalent Model
3070d856f592455c1e2f46fba1fb37a0438810f1 Apalache Set2 NumOne True Passed
  • Model Under Test
  • Equivalent Model
52124197cd92d8b1988fb184b05867e9799d0892 Apalache Set2 NumOne False Passed
  • Model Under Test
  • Equivalent Model
af7f80230783854766535987437cde876621cd03 Apalache Fun NumOne True Passed
  • Model Under Test
  • Equivalent Model
a6fe472850d7564eb5e28950ec784bea0cafbb2b Apalache Fun NumOne False Passed
  • Model Under Test
  • Equivalent Model
8958e3556ffd0715c937f472df3996d931f5eeda Apalache In NumOne True Passed
  • Model Under Test
  • Equivalent Model
40a000d184ddf924f6d817ea777423cf61c7932c Apalache In NumOne False Passed
  • Model Under Test
  • Equivalent Model
a58b3631148acd255308cc86ccbccad5e6fa0127 Apalache NotIn NumOne True Passed
  • Model Under Test
  • Equivalent Model
60e47d9ea72cec25533f341299776290aa9c2062 Apalache NotIn NumOne False Passed
  • Model Under Test
  • Equivalent Model
ff178d0283755def8465b7c841bd15315f41d1fd Apalache Record NumOne True Passed
  • Model Under Test
  • Equivalent Model
5c75fd9d4c35bf83e342a2b7643171effbf548e8 Apalache Record NumOne False Passed
  • Model Under Test
  • Equivalent Model
2dd694ed9f39b93f06fc850536719138629b4085 Apalache Tuple NumOne True Passed
  • Model Under Test
  • Equivalent Model
cf0d8468d54cfc784606b4c2f1eb6d1ec6aa6dca Apalache Tuple NumOne False Passed
  • Model Under Test
  • Equivalent Model
6f6ccbbefa57702a44b7d8621176e4820a669b77 Apalache FunApp NumOne True Passed
  • Model Under Test
  • Equivalent Model
4fa3e79daf36ac528eb8ca396b38dfdc2d6f3c9d Apalache FunApp NumOne False Passed
  • Model Under Test
  • Equivalent Model
3612df7db23830bdf9fafce8475c81bec16edb97 Apalache Except1Fun NumOne True Passed
  • Model Under Test
  • Equivalent Model
f90982902627be8c0bfd427a860677468599dc59 Apalache Except1Fun NumOne False Passed
  • Model Under Test
  • Equivalent Model
9a739b8c461bde5a7360f6c42993f36b0b68c17a TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt NumOne True Passed
  • Model Under Test
  • Equivalent Model
7cc00dc06bda2dce96919a57e5f7a5d10554dbb9 TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt NumOne False Passed
  • Model Under Test
  • Equivalent Model
38983cfcf317f89eb60436b364f9195bbcba3b41 Apalache Except1Rec NumOne True Passed
  • Model Under Test
  • Equivalent Model
9ef8223f9d74a6915ad06f57c71fa074d8c0ffc5 Apalache Except1Rec NumOne False Passed
  • Model Under Test
  • Equivalent Model
5c60799ccbeea52b2dd73d1187ac6a35be693071 TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt NumOne True Passed
  • Model Under Test
  • Equivalent Model
18ad671ee1cdba08cc4972c13db3289506ecd070 TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt NumOne False Passed
  • Model Under Test
  • Equivalent Model
9302dff320c4a7b95123a9fe1266b5b2db68c8e8 Apalache Except2Fun NumOne True Passed
  • Model Under Test
  • Equivalent Model
bf107314bcff05090bc3acd6d608d62e8bbdbb25 Apalache Except2Fun NumOne False Passed
  • Model Under Test
  • Equivalent Model
d3d4a7e20e4d94ec538897173552d217516a3e74 Apalache Prime NumOne True Passed
  • Model Under Test
  • Equivalent Model
3919f15e5227b3666960555425b46a75f7661357 Apalache Prime NumOne False Passed
  • Model Under Test
  • Equivalent Model
38a5a4da698d4dcff74e1f5f290430caa02a35ed Apalache NumUnaryMinus NumOne True Passed
  • Model Under Test
  • Equivalent Model
6912745a5e7a7f19e96e79a5d63f0841379adef2 Apalache NumUnaryMinus NumOne False Passed
  • Model Under Test
  • Equivalent Model
1e744acdf5d53a4b8d3e8a87dd657b5f551982de Apalache NumPlus NumOne True Passed
  • Model Under Test
  • Equivalent Model
59a644e0163329a49b11145fd7ecd717a9f30a85 Apalache NumPlus NumOne False Passed
  • Model Under Test
  • Equivalent Model
5d3f16c7d16cec96527f3b6f8f12ea38e4903fe1 Apalache NumMinus NumOne True Passed
  • Model Under Test
  • Equivalent Model
108245b360d0e30bb5a4ef3cb5f5ef4093c96276 Apalache NumMinus NumOne False Passed
  • Model Under Test
  • Equivalent Model
c5aad6656c74d902454a16cd378ca4521db6fad7 Apalache NumMul NumOne True Passed
  • Model Under Test
  • Equivalent Model
921405b4d64be03a2057a27f5aaa38cda78a0736 Apalache NumMul NumOne False Passed
  • Model Under Test
  • Equivalent Model
6daa383763db51ac63b542178e54cdcee94d50ec Apalache NumDiv NumOne True Passed
  • Model Under Test
  • Equivalent Model
b3b3fe03c1c6bc05c9758b2527a4ffc53c2c7631 Apalache NumDiv NumOne False Passed
  • Model Under Test
  • Equivalent Model
b571d82d615067a3787de7c7aa71512b5b5ffc75 Apalache NumMod NumOne True Passed
  • Model Under Test
  • Equivalent Model
a5a36a564184449225b7ad811e500086fd8aeaca Apalache NumMod NumOne False Passed
  • Model Under Test
  • Equivalent Model
00f1fad4713227b7050bf879ac0eae2f6a39fde8 Apalache NumPow NumOne True Passed
  • Model Under Test
  • Equivalent Model
cbe9260bcdabff05d608f4c630d3bf21fd5c430f Apalache NumPow NumOne False Passed
  • Model Under Test
  • Equivalent Model
6925a9d88f409f9c84b0254fd6ebb97533ff3f18 Apalache NumGt NumOne True Passed
  • Model Under Test
  • Equivalent Model
645383167daf79a3c2497a2c5c26fb1a7f0d9826 Apalache NumGt NumOne False Passed
  • Model Under Test
  • Equivalent Model
2309d6e593aab2192ac6b9a73111f2a5a3311d13 Apalache NumGe NumOne True Passed
  • Model Under Test
  • Equivalent Model
b12da9cd77a8ddbe91d844aeffc3f5af20f4cc47 Apalache NumGe NumOne False Passed
  • Model Under Test
  • Equivalent Model
bc53aad883fa90bcad02a04ef1572ffaa4d9d2ce Apalache NumLt NumOne True Passed
  • Model Under Test
  • Equivalent Model
3cfa6e1a1d2d190a85a9346ca04192d1626fa03a Apalache NumLt NumOne False Passed
  • Model Under Test
  • Equivalent Model
d8a9049fe3a37ac3563b822a8424dddb2a5b2577 Apalache NumLe NumOne True Passed
  • Model Under Test
  • Equivalent Model
111cfa70e82858be5b05e6adb71d9bda60791e7e Apalache NumLe NumOne False Passed
  • Model Under Test
  • Equivalent Model
ebd6675d8e5b1ab55143dccef775f18889b2d510 Apalache DefFun NumOne True Passed
  • Model Under Test
  • Equivalent Model
e429763411c94fc7ec38b51cc22357c9022c1ee7 Apalache DefFun NumOne False Passed
  • Model Under Test
  • Equivalent Model
6c46c822b63bae115e452928e5f029113ab976d6 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun NumOne True Passed
  • Model Under Test
  • Equivalent Model
f891c9b613a2659962345e7ccd7d7057770f6b74 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun NumOne False Passed
  • Model Under Test
  • Equivalent Model
a0274b9943bb787d5b9387ac0572b7597a160f77 Apalache DefFunRecursive NumOne True Passed
  • Model Under Test
  • Equivalent Model
5330180a27de72ab1a594c7bc2177057866da66d Apalache DefFunRecursive NumOne False Passed
  • Model Under Test
  • Equivalent Model
1f21e1afe1a44f3fe0302d1330741db7a88d544a TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive NumOne True Passed
  • Model Under Test
  • Equivalent Model
872304384d95c53aa6d738c6bd55ba0582cf5619 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive NumOne False Passed
  • Model Under Test
  • Equivalent Model
8a1e5a07b3b11042b8814e39ec97773163c6b7e7 Apalache Def0 NumOne True Passed
  • Model Under Test
  • Equivalent Model
952683fa06875e23f0dd878fef470aa95fe8432c Apalache Def0 NumOne False Passed
  • Model Under Test
  • Equivalent Model
6e2a4268622a2d8353f60beef830ff398b0240e4 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 NumOne True Passed
  • Model Under Test
  • Equivalent Model
e10de84ba9ba4378867ff11cfe719127efed5145 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 NumOne False Passed
  • Model Under Test
  • Equivalent Model
42a18cdbfe483090678b209983f0587465859faf Apalache Def1 NumOne True Passed
  • Model Under Test
  • Equivalent Model
123cd7e7e78ad45e05cf5cff30782def8519a38d Apalache Def1 NumOne False Passed
  • Model Under Test
  • Equivalent Model
e13691787d41c31e01a8626b4ae7650ff41db20c TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 NumOne True Passed
  • Model Under Test
  • Equivalent Model
6a9a07638e9b64016528ac727dc7430dd88d4541 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 NumOne False Passed
  • Model Under Test
  • Equivalent Model
f343b7230ad175055b83c4b381c5979ccb719db4 Apalache Def2 NumOne True Passed
  • Model Under Test
  • Equivalent Model
a1e806b1d950e651907c8267abaa301da3ca0575 Apalache Def2 NumOne False Passed
  • Model Under Test
  • Equivalent Model
c9e477901a426e9fa5ca5a67783e01c6ae672cfb TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 NumOne True Passed
  • Model Under Test
  • Equivalent Model
9348139755819cc01e0c947889dc5a8e09c754e1 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 NumOne False Passed
  • Model Under Test
  • Equivalent Model
01739315978992a3c394912dcd59eb738c3bb0b6 Apalache Def1Recursive NumOne True Passed
  • Model Under Test
  • Equivalent Model
0a077b972c54c3989a9c896e4061fec1771a494f Apalache Def1Recursive NumOne False Passed
  • Model Under Test
  • Equivalent Model
d3a4b6b657a4a51d2bdbb577094a806343f1b7ae TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive NumOne True Passed
  • Model Under Test
  • Equivalent Model
3afbd2d8cce19af444691f20118605c7ca6662b2 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive NumOne False Passed
  • Model Under Test
  • Equivalent Model
8efb344c627c96f75ae532e38120071b111eddb1 Apalache Extends NumOne True Passed
  • Model Under Test
  • Equivalent Model
28351410ec6f8f8378b9c45fadf5624ea2e40426 Apalache Extends NumOne False Passed
  • Model Under Test
  • Equivalent Model
66fb9e92f20ff5220ef0bd9b44bb37464d6b5ae8 Apalache ExtendsInDifferentFolder NumOne True Passed
  • Model Under Test
  • Equivalent Model
f567c26a0ab102773069fc4ececf519444d7d47c Apalache ExtendsInDifferentFolder NumOne False Passed
  • Model Under Test
  • Equivalent Model
96ab71f6acb5d21c15f69417c73d68ca91f79fe6 Apalache Variable NumOne True Passed
  • Model Under Test
  • Equivalent Model
ef4c933a98525c99d4e1a8ec272133d4872b7eb8 Apalache Variable NumOne False Passed
  • Model Under Test
  • Equivalent Model
2de79f03c90e7f340b12151c2599deddae18e565 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude NumOne True Passed
  • Model Under Test
  • Equivalent Model
f6220fd3f9b698e08b89aba116f400fa8b45fb6c TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude NumOne False Passed
  • Model Under Test
  • Equivalent Model
8805d4394abfa4c09e82a8fe4274381493915e85 Apalache Constant NumOne True Passed
  • Model Under Test
  • Equivalent Model
5e8246122d53fdedd50d6907677fa1e6d13f1e94 Apalache Constant NumOne False Passed
  • Model Under Test
  • Equivalent Model
af0b3c14e8e969e977888f077fa95b607c12b989 Apalache ConstantRank1 NumOne True Passed
  • Model Under Test
  • Equivalent Model
bfdab92683b7ff4e232b8dba93cb8d2594c7809a Apalache ConstantRank1 NumOne False Passed
  • Model Under Test
  • Equivalent Model
48c6c40bbd496d5fd95654e06be112c6635fe526 Apalache Instance NumOne True Passed
  • Model Under Test
  • Equivalent Model
32e70e6d0e4a776ff016292ebea803f8281c3da2 Apalache Instance NumOne False Passed
  • Model Under Test
  • Equivalent Model
c2d5bc49b759d21ecbd8df434900c87c23410fa4 Apalache InstanceWith NumOne True Passed
  • Model Under Test
  • Equivalent Model
dbbe2a2ead8574709bcf25514caa18405ad45a2f Apalache InstanceWith NumOne False Passed
  • Model Under Test
  • Equivalent Model
fb6c0107d5883e6e2a13d1f4e1f56abac5ec2241 Apalache InstanceNamed NumOne True Passed
  • Model Under Test
  • Equivalent Model
664220eb9822221e95d971025d41dda4262e0673 Apalache InstanceNamed NumOne False Passed
  • Model Under Test
  • Equivalent Model
689f3d1fe19ccce5a8a6a60def467c021d128aea Apalache InstanceNamedWith NumOne True Passed
  • Model Under Test
  • Equivalent Model
b96bc5fec2053e81bed5ad836790d01a48f4ba72 Apalache InstanceNamedWith NumOne False Passed
  • Model Under Test
  • Equivalent Model
acae0111cb6160ee3460e2cd15fe52c30fe72dc3 Apalache InstanceInFolder NumOne True Passed
  • Model Under Test
  • Equivalent Model
91982d08380fe6e1314c1faffaf3eb93ce43b429 Apalache InstanceInFolder NumOne False Passed
  • Model Under Test
  • Equivalent Model
9690b986b94129dd5e0f05172166c9038e7cb0a7 Apalache InstanceWithInFolder NumOne True Passed
  • Model Under Test
  • Equivalent Model
c4c87b3b721132f2f5d69002dbf411c2425cf6fc Apalache InstanceWithInFolder NumOne False Passed
  • Model Under Test
  • Equivalent Model
f4a5f8638b183c482743bd5198fb27d48452a7d1 Apalache InstanceNamedInFolder NumOne True Passed
  • Model Under Test
  • Equivalent Model
6eddb96e0790d67d177535b30c2f9b8d28bb9ae9 Apalache InstanceNamedInFolder NumOne False Passed
  • Model Under Test
  • Equivalent Model
4a77a2e9d16592efef83989dac4aa739fd105293 Apalache InstanceNamedWithInFolder NumOne True Passed
  • Model Under Test
  • Equivalent Model
3cd4724cec1f9bc81cc0b25a44f4df812b47af44 Apalache InstanceNamedWithInFolder NumOne False Passed
  • Model Under Test
  • Equivalent Model
55ad1d527879be5e780f9c8655f6c04e0d3e3cb9 Apalache Lambda NumOne True Passed
  • Model Under Test
  • Equivalent Model
418fd1632906fb710e49a119641a9e892047caf2 Apalache Lambda NumOne False Passed
  • Model Under Test
  • Equivalent Model
8c8a18805716bc5b66c6fbb1a05a3ef8d49396b0 Apalache IfThen NumOne True Passed
  • Model Under Test
  • Equivalent Model
1a4b3468459d95928f9a499308ec923ecd57d8c3 Apalache IfThen NumOne False Passed
  • Model Under Test
  • Equivalent Model
4776037556e8a96e6203d06c3ac876a951cfd4e6 Apalache IfElse NumOne True Passed
  • Model Under Test
  • Equivalent Model
c051d59af9cb278ad43e1a19d3da5c99334f02bd Apalache IfElse NumOne False Passed
  • Model Under Test
  • Equivalent Model
319d75a4d17cadcfda36fc444e80118471dba43b Apalache Unchanged NumOne True Passed
  • Model Under Test
  • Equivalent Model
661a8ebd0e83fce658ef372ac953b00f3b7c868a Apalache Unchanged NumOne False Passed
  • Model Under Test
  • Equivalent Model
726325b520e82c006380d04a24dcf17bf1d9834a Apalache SeqSubSeq NumOne True Passed
  • Model Under Test
  • Equivalent Model
373cca992eb0e29812249508b873113a7cec3d2c Apalache SeqSubSeq NumOne False Passed
  • Model Under Test
  • Equivalent Model
4a3b2785a5c0734f2f9dba5868b18ee0c67905d0 TLC with reduction strategy:
  • Case Feature: n..m is replaced with { x \in { n, n + 1, ... } : x <= m }; it falls back to crash (through CHOOSE Q : FALSE) if m is too big: this crash forces to do manual test review
NumRange NumOne True Passed
  • Model Under Test
  • Equivalent Model
4041a2a9af84ce7412a388c46025a3ecf14c060f TLC with reduction strategy:
  • Case Feature: n..m is replaced with { x \in { n, n + 1, ... } : x <= m }; it falls back to crash (through CHOOSE Q : FALSE) if m is too big: this crash forces to do manual test review
NumRange NumOne False Passed
  • Model Under Test
  • Equivalent Model
79156316718bacfc91a3d28af8076b0dfddf1fdd TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun NumOne True Passed
  • Model Under Test
  • Equivalent Model
11f0573735af0c144ef7c81563fabb9363c4487b TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun NumOne False Passed
  • Model Under Test
  • Equivalent Model
69c2558ba70dae67629c74111d2a87c362c11383 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval NumOne True Passed
  • Model Under Test
  • Equivalent Model
2730a29235071918c01696cee7aca63de5d10be8 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval NumOne False Passed
  • Model Under Test
  • Equivalent Model
98e15c81b0c96d8299594645259b090021e56ee2 Apalache BagBagIn NumOne True Passed
  • Model Under Test
  • Equivalent Model
7c6f62ddaabaef79e4bce3921ed7c44d65cddc4f Apalache BagBagIn NumOne False Passed
  • Model Under Test
  • Equivalent Model
e84c62255bbde8825f7dc74fc79f8b6d7856fc18 Apalache BagCopiesIn NumOne True Passed
  • Model Under Test
  • Equivalent Model
0e0f3b46ef92aa775c88ace0e1983c655c3550b9 Apalache BagCopiesIn NumOne False Passed
  • Model Under Test
  • Equivalent Model
6ff7b70661956e818391eff7021e3fd72ae1ca20 Apalache SeqAppend NumOne True Passed
  • Model Under Test
  • Equivalent Model
b9ba5078f805db5b93288aa059b5b37b47aa3087 Apalache SeqAppend NumOne False Passed
  • Model Under Test
  • Equivalent Model