Index


  • Introduction

  • Skipped feature combinations
  • Failed test cases
  • Tests by feature combinations
  • SYMMETRY tests
  • Tests under anomalous conditions

  • Tests by feature combinations: -workers 2
  • SYMMETRY tests: -workers 2

Tests by plug feature NumPow; CLI Option: -workers 1

Id Type Case Feature Plug Feature Check Deadlock Test Results Test Models
260a23fe97426360aa388d6c42058d7ecb65fe36 Apalache Eq NumPow True Passed
  • Model Under Test
  • Equivalent Model
c0ad36e205a59ac11ffdeb10f19a070cab00b7f4 Apalache Eq NumPow False Passed
  • Model Under Test
  • Equivalent Model
4998af75adfc149d4b36f5c877546c703fbc3ed6 Apalache Ne NumPow True Passed
  • Model Under Test
  • Equivalent Model
d74bc4ef096215098faa12c9c8a7777df6fe2cd2 Apalache Ne NumPow False Passed
  • Model Under Test
  • Equivalent Model
95b17ff0cc7ea84c652874023ffe4227befcc77b Apalache Let NumPow True Passed
  • Model Under Test
  • Equivalent Model
42263614bd6e86ec1849dea3ec16802da67b7abc Apalache Let NumPow False Passed
  • Model Under Test
  • Equivalent Model
01c1a153322ac5db02ee8fc178c346434acbe0b1 Apalache Set0 NumPow True Passed
  • Model Under Test
  • Equivalent Model
18643fe48e0fde598eaf4803d235a3554e21691a Apalache Set0 NumPow False Passed
  • Model Under Test
  • Equivalent Model
c5b9afc8dcdd755c658c60aac785820e35e9343d Apalache Set1 NumPow True Passed
  • Model Under Test
  • Equivalent Model
3b607beadfdea458b0b546598efdd3fc8d344d7f Apalache Set1 NumPow False Passed
  • Model Under Test
  • Equivalent Model
e9a9ea63c54a49d33216f699cd8bb85c425ac19e Apalache Set2 NumPow True Passed
  • Model Under Test
  • Equivalent Model
65021d86cc505a3de7a81f38848545d59d401a13 Apalache Set2 NumPow False Passed
  • Model Under Test
  • Equivalent Model
3374fe5116f8d988af48d5c64b7efb8920924712 Apalache Fun NumPow True Passed
  • Model Under Test
  • Equivalent Model
d9dbf5f0436f770526bc9961d7845a2ce438b5eb Apalache Fun NumPow False Passed
  • Model Under Test
  • Equivalent Model
93064032105949fc4b6c9fede25e32fe6e6a6cdd Apalache In NumPow True Passed
  • Model Under Test
  • Equivalent Model
198fd11362445f09f3c030839c604b208061877a Apalache In NumPow False Passed
  • Model Under Test
  • Equivalent Model
c77e02f41f76c04ee6dc95b6edea222dd6be2ca5 Apalache NotIn NumPow True Passed
  • Model Under Test
  • Equivalent Model
64a387d2efa0384e8048ee57cd0bb38fd16987b5 Apalache NotIn NumPow False Passed
  • Model Under Test
  • Equivalent Model
8f514848fdb2569cdef2d7f377faa5ca4fd840a4 Apalache Record NumPow True Passed
  • Model Under Test
  • Equivalent Model
a697303a1ffa0691864b6bc7e0ade990870a2f56 Apalache Record NumPow False Passed
  • Model Under Test
  • Equivalent Model
9533adc9e3735f374f2e35161c3ea9bb828bd57c Apalache Tuple NumPow True Passed
  • Model Under Test
  • Equivalent Model
275359681f91d9410f3b9e6d445bcfb6d2fd3f4b Apalache Tuple NumPow False Passed
  • Model Under Test
  • Equivalent Model
34754c75aac6bb08b49ca9d93584e7bb20ea92c4 Apalache FunApp NumPow True Passed
  • Model Under Test
  • Equivalent Model
1a79a9185d5f0ccf5bc5c066d8a0c2a76122cdc6 Apalache FunApp NumPow False Passed
  • Model Under Test
  • Equivalent Model
251555d56d0b4994d61a23336b3ed813a6bfb3a4 Apalache Except1Fun NumPow True Passed
  • Model Under Test
  • Equivalent Model
b80cab2ac8718f42ca94e9bd5290d68c129e15a0 Apalache Except1Fun NumPow False Passed
  • Model Under Test
  • Equivalent Model
b80b7e26f486c3454b1ba16272a352bd5fe11e67 TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt NumPow True Passed
  • Model Under Test
  • Equivalent Model
b414f944bbc951f9051a5cbeea8198c40a09d01a TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt NumPow False Passed
  • Model Under Test
  • Equivalent Model
03df9fad4bbdd53c32c0fe765e2422dbb6a623be Apalache Except1Rec NumPow True Passed
  • Model Under Test
  • Equivalent Model
754dfeb57724e5e1261ae47158d3d589531682bc Apalache Except1Rec NumPow False Passed
  • Model Under Test
  • Equivalent Model
53837a3897d0c1510adac207f60a33a25fcefe50 TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt NumPow True Passed
  • Model Under Test
  • Equivalent Model
7354ff7b0e4650e69babc0f74f14b72794abab1f TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt NumPow False Passed
  • Model Under Test
  • Equivalent Model
ba48179e669cfbc21144dc9666a8cd8f60e1e940 Apalache Except2Fun NumPow True Passed
  • Model Under Test
  • Equivalent Model
8ae1d2aff03ecb2ee593bb90c39d8be266be0507 Apalache Except2Fun NumPow False Passed
  • Model Under Test
  • Equivalent Model
ede093653d404fbe4bd7537da7bf3ef85d693355 Apalache Prime NumPow True Passed
  • Model Under Test
  • Equivalent Model
2b117f83766757a7c5d694e97fb3d4c9f57f28d0 Apalache Prime NumPow False Passed
  • Model Under Test
  • Equivalent Model
1d270fdfd551936941b65922c11d9693323206d8 Apalache NumUnaryMinus NumPow True Passed
  • Model Under Test
  • Equivalent Model
3d7b6e5559dbb9e6d4c5a1441b6a1dd05000631d Apalache NumUnaryMinus NumPow False Passed
  • Model Under Test
  • Equivalent Model
fc75ac6a46ecf3890e0ad260898acbbecefe4cdf Apalache NumPlus NumPow True Passed
  • Model Under Test
  • Equivalent Model
82d3076e15bfbb42b81b5d39a56c5fd44b17c253 Apalache NumPlus NumPow False Passed
  • Model Under Test
  • Equivalent Model
2f736df5d3bd693c6ab911da2a6591cb230b1d39 Apalache NumMinus NumPow True Passed
  • Model Under Test
  • Equivalent Model
aa6ec01a3cd6ff4f9f26910b85cf9152e65e7a1c Apalache NumMinus NumPow False Passed
  • Model Under Test
  • Equivalent Model
1814a2d12495ac11de7f9da83dfd39a1aeaef754 Apalache NumMul NumPow True Passed
  • Model Under Test
  • Equivalent Model
21e416195d5f93f1c91fff3c4c7b60e928d12212 Apalache NumMul NumPow False Passed
  • Model Under Test
  • Equivalent Model
4d31962e0d290a0e5e3192d9c92469d3a27ded82 Apalache NumDiv NumPow True Passed
  • Model Under Test
  • Equivalent Model
7039d5f435380b7d0d55334607e3b74ff7255b25 Apalache NumDiv NumPow False Passed
  • Model Under Test
  • Equivalent Model
3b037f79464f2eba794061e8dd21a75e778054b4 Apalache NumMod NumPow True Passed
  • Model Under Test
  • Equivalent Model
c7a9faf894c32f74473f21c92512c278bcb2c26a Apalache NumMod NumPow False Passed
  • Model Under Test
  • Equivalent Model
16aa70f891d99d99af2b1d77fd8b39f19c3328e0 Apalache NumPow NumPow True Passed
  • Model Under Test
  • Equivalent Model
fae51e1aefc9db7549f925fd8ab70cc5eb4d8377 Apalache NumPow NumPow False Passed
  • Model Under Test
  • Equivalent Model
df8aac76e791720f5dbd5dfa11be31edb6ff980b Apalache NumGt NumPow True Passed
  • Model Under Test
  • Equivalent Model
67ff93879a9107d1962e4b4cffffec8f21a43069 Apalache NumGt NumPow False Passed
  • Model Under Test
  • Equivalent Model
523b8eea23ab1ac4c355ea1625c7acb6c0a3cd98 Apalache NumGe NumPow True Passed
  • Model Under Test
  • Equivalent Model
eb17a4290b74168f5b8aab8ab793bc23822546fd Apalache NumGe NumPow False Passed
  • Model Under Test
  • Equivalent Model
aad7fc54ef79b7cdfa0c77fd16943c785476df10 Apalache NumLt NumPow True Passed
  • Model Under Test
  • Equivalent Model
eb94c49075f6e6db84ce482fc9490e3bbbfefa67 Apalache NumLt NumPow False Passed
  • Model Under Test
  • Equivalent Model
4c49967a6d44f1a9295b0d105723564352aa2f12 Apalache NumLe NumPow True Passed
  • Model Under Test
  • Equivalent Model
790d03a4eca533b3ba60d214ed99af88e76743f9 Apalache NumLe NumPow False Passed
  • Model Under Test
  • Equivalent Model
7a307aae2043d75609ba9e4fbc91d54a01173280 Apalache DefFun NumPow True Passed
  • Model Under Test
  • Equivalent Model
96e8c2b3731f8e8715f8c67688a9e68e87b66ba1 Apalache DefFun NumPow False Passed
  • Model Under Test
  • Equivalent Model
2c1d90056fd2da649cfd1ee58de356e993a296ee TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun NumPow True Passed
  • Model Under Test
  • Equivalent Model
1ac259598737c5958c0dbf543ef2641c2661b817 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun NumPow False Passed
  • Model Under Test
  • Equivalent Model
6ca234219dd545ca4b974e7854d07aec4ac782a7 Apalache DefFunRecursive NumPow True Passed
  • Model Under Test
  • Equivalent Model
f5ae9b1cb4c760ab68ae638b8b361127153212e7 Apalache DefFunRecursive NumPow False Passed
  • Model Under Test
  • Equivalent Model
ace2f13b8b32e6235384ba4d62b11c805bedb273 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive NumPow True Passed
  • Model Under Test
  • Equivalent Model
63c25760d96dbff4a7ee75b3c4b2fa89cedf9ef6 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive NumPow False Passed
  • Model Under Test
  • Equivalent Model
b452f6a9685a2fba55183f3f0eb1493889e83de4 Apalache Def0 NumPow True Passed
  • Model Under Test
  • Equivalent Model
e8b125fa1dbf9205187bf60e0fd466fc4eb3198d Apalache Def0 NumPow False Passed
  • Model Under Test
  • Equivalent Model
e0494793002d80fdadb8563337fd13739322b5fa TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 NumPow True Passed
  • Model Under Test
  • Equivalent Model
354e01a7387d30b25db9de611c98d114ef58a03d TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 NumPow False Passed
  • Model Under Test
  • Equivalent Model
b2d9d4bf52c454751587cf6975856a44a012d578 Apalache Def1 NumPow True Passed
  • Model Under Test
  • Equivalent Model
bfcc554d6d07692a1c3b4ed64033825b606a1ce3 Apalache Def1 NumPow False Passed
  • Model Under Test
  • Equivalent Model
e2550e40efb8daee96210dd625c326e13a3d1854 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 NumPow True Passed
  • Model Under Test
  • Equivalent Model
7d49a252b3fde1dfc06269b59da8025730ef2d30 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 NumPow False Passed
  • Model Under Test
  • Equivalent Model
2d2793eaa2d8cfb18ddd53d15954638338aff8ac Apalache Def2 NumPow True Passed
  • Model Under Test
  • Equivalent Model
60bdcbb811a5415af037c754829d4a7ac0368619 Apalache Def2 NumPow False Passed
  • Model Under Test
  • Equivalent Model
ba7a7f1d4e250b1a30d7bc0a4ee2c3d047587a6d TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 NumPow True Passed
  • Model Under Test
  • Equivalent Model
dff85e894df0626f9494bfa519318f014edca2fc TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 NumPow False Passed
  • Model Under Test
  • Equivalent Model
188d857f706f6b61cdf0ee20f88a63fcbc69081f Apalache Def1Recursive NumPow True Passed
  • Model Under Test
  • Equivalent Model
22fa6042b47f84e0c9eec8978248edf5a9fa7271 Apalache Def1Recursive NumPow False Passed
  • Model Under Test
  • Equivalent Model
c50a8bee5f81b519395aaa420ce20b7bbe9fc941 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive NumPow True Passed
  • Model Under Test
  • Equivalent Model
207dbf764b33f73042ba0336f034425bc2a6f74d TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive NumPow False Passed
  • Model Under Test
  • Equivalent Model
e4af7ad04ff96a622d1ef57cfe7dd8c302fc0e6f Apalache Extends NumPow True Passed
  • Model Under Test
  • Equivalent Model
f820ad4abceb5314a0b10c5277abf925868a53a5 Apalache Extends NumPow False Passed
  • Model Under Test
  • Equivalent Model
8e5b16d65fc0259d8cb03a0b0f92becbe6092fe2 Apalache ExtendsInDifferentFolder NumPow True Passed
  • Model Under Test
  • Equivalent Model
1a31c4a28e8edc787b4bda80b6c9b9ce1eea78a4 Apalache ExtendsInDifferentFolder NumPow False Passed
  • Model Under Test
  • Equivalent Model
59f6690f4dec32a64a0968a17c7da9bd2e6a16dc Apalache Variable NumPow True Passed
  • Model Under Test
  • Equivalent Model
673b100d8b6615ec161db4da661254cc53c9605d Apalache Variable NumPow False Passed
  • Model Under Test
  • Equivalent Model
858e2747c0f1c5f34a1b834d261cb23e367f4804 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude NumPow True Passed
  • Model Under Test
  • Equivalent Model
a9d5628a2c0a34d31b1757ab15585a8fe284274c TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude NumPow False Passed
  • Model Under Test
  • Equivalent Model
4ba48d5a2eb31001c93d93ed0d3153deb567b0d8 Apalache Constant NumPow True Passed
  • Model Under Test
  • Equivalent Model
1aa8759bdcd789f835b76a700c41a1f08ba043a0 Apalache Constant NumPow False Passed
  • Model Under Test
  • Equivalent Model
e21db4d00020545161a8e03c29299447b3841e54 Apalache ConstantRank1 NumPow True Passed
  • Model Under Test
  • Equivalent Model
785d0495be1dad82f5ef59aa61aac6b9007f3967 Apalache ConstantRank1 NumPow False Passed
  • Model Under Test
  • Equivalent Model
7f06ae550bddb54400302f126d78e74b5067a86d Apalache Instance NumPow True Passed
  • Model Under Test
  • Equivalent Model
72f10c0623017e4a02e710a48931bf844e5ca148 Apalache Instance NumPow False Passed
  • Model Under Test
  • Equivalent Model
7df8cd7d2b3f294743c39eb87e84fa0da80d8b6a Apalache InstanceWith NumPow True Passed
  • Model Under Test
  • Equivalent Model
eebf20936d1ec9be817b463ae5aabd67984f555e Apalache InstanceWith NumPow False Passed
  • Model Under Test
  • Equivalent Model
e97d6ce3d044f00ec665f4a647b8d548d25ac062 Apalache InstanceNamed NumPow True Passed
  • Model Under Test
  • Equivalent Model
9778fdf85f84b92e905b9a4161e8577c0a086b0f Apalache InstanceNamed NumPow False Passed
  • Model Under Test
  • Equivalent Model
0aee87ea09893aa4db426bd56e18672c5ca95499 Apalache InstanceNamedWith NumPow True Passed
  • Model Under Test
  • Equivalent Model
a62b379b24aa0f7cf9875a277017e3a00ca48f7e Apalache InstanceNamedWith NumPow False Passed
  • Model Under Test
  • Equivalent Model
1a27dce38ae63f6e737aecb3aa99ac899a0101c3 Apalache InstanceInFolder NumPow True Passed
  • Model Under Test
  • Equivalent Model
fe6f0d1ed3195bdcad1eee30741b0c7ffa25ce79 Apalache InstanceInFolder NumPow False Passed
  • Model Under Test
  • Equivalent Model
b627ebff9031cd0699e346fe223c88f8472c3000 Apalache InstanceWithInFolder NumPow True Passed
  • Model Under Test
  • Equivalent Model
8d0601db5aee1d7d7f7bb62f8680c51820e1b5f0 Apalache InstanceWithInFolder NumPow False Passed
  • Model Under Test
  • Equivalent Model
744c13fd634c83041f216f813746ec7a9798aaad Apalache InstanceNamedInFolder NumPow True Passed
  • Model Under Test
  • Equivalent Model
fb4a923b6ea0472740d874960a2033215223fcf5 Apalache InstanceNamedInFolder NumPow False Passed
  • Model Under Test
  • Equivalent Model
c64884b274ff85815473593406fd72fea8c8164f Apalache InstanceNamedWithInFolder NumPow True Passed
  • Model Under Test
  • Equivalent Model
030beb51d3db538e94d56ad5c3f8c91a9784d659 Apalache InstanceNamedWithInFolder NumPow False Passed
  • Model Under Test
  • Equivalent Model
4a423a76e9b8533fbc40d6217e9169c58c51496a Apalache Lambda NumPow True Passed
  • Model Under Test
  • Equivalent Model
c7435930673c1081b99de6794e782ac470c52f12 Apalache Lambda NumPow False Passed
  • Model Under Test
  • Equivalent Model
08801ae78c11e89c92524bcf14ee67ae4c404dbb Apalache IfThen NumPow True Passed
  • Model Under Test
  • Equivalent Model
9226c23aed5ee8d96536613092d6ee0d54a38d4b Apalache IfThen NumPow False Passed
  • Model Under Test
  • Equivalent Model
afd55931699f1e50639e212d0f89035f34424688 Apalache IfElse NumPow True Passed
  • Model Under Test
  • Equivalent Model
8de5174648c24af0a5a9777ea90e8804783531e8 Apalache IfElse NumPow False Passed
  • Model Under Test
  • Equivalent Model
7bc1a1c463c10945f36333182488050ab9ee6f0c Apalache Unchanged NumPow True Passed
  • Model Under Test
  • Equivalent Model
c6070ce971a46f471597c71d3b6dbf4802c457d6 Apalache Unchanged NumPow False Passed
  • Model Under Test
  • Equivalent Model
cb15ca43d2519d7a325ecef9af44eb766f67513e Apalache SeqSubSeq NumPow True Passed
  • Model Under Test
  • Equivalent Model
14f1060904ff679444510b93b9e7b1b537121362 Apalache SeqSubSeq NumPow False Passed
  • Model Under Test
  • Equivalent Model
0da26381f618ada3ac434a5f049eba96d7b2a361 TLC with reduction strategy:
  • Case Feature: n..m is replaced with { x \in { n, n + 1, ... } : x <= m }; it falls back to crash (through CHOOSE Q : FALSE) if m is too big: this crash forces to do manual test review
NumRange NumPow True Passed
  • Model Under Test
  • Equivalent Model
5f29a75ec685d4532168dfd577196af6e7c68907 TLC with reduction strategy:
  • Case Feature: n..m is replaced with { x \in { n, n + 1, ... } : x <= m }; it falls back to crash (through CHOOSE Q : FALSE) if m is too big: this crash forces to do manual test review
NumRange NumPow False Passed
  • Model Under Test
  • Equivalent Model
07bd9d677fa254ba9b0c7ad6e6c9acc04d658cf6 TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun NumPow True Passed
  • Model Under Test
  • Equivalent Model
f419930d76314f385727126981018bd5d61d71fc TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun NumPow False Passed
  • Model Under Test
  • Equivalent Model
3eccb2877f79ed85c4125a89ffc96d2bd4c30c48 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval NumPow True Passed
  • Model Under Test
  • Equivalent Model
0d1d5c3937fc8b1d1db69040bf927e7fd845fc1c TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval NumPow False Passed
  • Model Under Test
  • Equivalent Model
e6dc2bd624bc7a97e701b65b9d8df7ffa7de886b Apalache BagBagIn NumPow True Passed
  • Model Under Test
  • Equivalent Model
89c5cb065596480ed3e12dd3c32937984b44b8cd Apalache BagBagIn NumPow False Passed
  • Model Under Test
  • Equivalent Model
bc77c97d4a1265166ea5fc55675eced5aced28df Apalache BagCopiesIn NumPow True Passed
  • Model Under Test
  • Equivalent Model
b72199cfc670dbf3ad2bce3d1004628edc11ff25 Apalache BagCopiesIn NumPow False Passed
  • Model Under Test
  • Equivalent Model
0258a9f92c4ae5c43baa5b1dca77214dd69d532b Apalache SeqAppend NumPow True Passed
  • Model Under Test
  • Equivalent Model
00c579dc779af4e8f9d937a07e00e63fd2b27cdf Apalache SeqAppend NumPow False Passed
  • Model Under Test
  • Equivalent Model