Index


  • Introduction

  • Skipped feature combinations
  • Failed test cases
  • Tests by feature combinations
  • SYMMETRY tests
  • Tests under anomalous conditions

  • Tests by feature combinations: -workers 2
  • SYMMETRY tests: -workers 2

  • Tests by feature combinations: -workers auto
  • SYMMETRY tests: -workers auto

Tests by plug feature BagEmptyBag; CLI Option: -workers 1

Id Type Case Feature Plug Feature Check Deadlock Test Results Test Models
155f70e395b3ce8b526ff797aeacd273f12b731c Apalache Eq BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
b6f7e576256230d4cacd0f528328a925e7e8e5ea Apalache Eq BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
4f7f27479aca9bb174b5ab042815d0c743960f3a Apalache Ne BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
fd1dedf49f4f6ccd3c8af6f0a485510073f8b1e4 Apalache Ne BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
86ea72a9c9a07f9b21462476e880a6522d6f7d3a Apalache Let BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
4b4c1a90f6ef1f9e887958fe30bde84dc18351c6 Apalache Let BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
50f5dfc5ae592293ade9b4ca65d442c4841eb3a9 Apalache Set0 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
bbda287fe455385e627fbec4fb52efe2126807f7 Apalache Set0 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
375200d0f432c3db59af16ec1bf375f8ce29a81b Apalache Set1 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
e554740caaa49d584aacd110847b1395d555c930 Apalache Set1 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
f3d6c6f3f57ad1f99b792b74934b774f525717be Apalache Set2 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
34377d24b8c035c8710262f90d07a15999857230 Apalache Set2 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
d45d9d5372138ea12fa773974a406a1dcc600625 Apalache Fun BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
0411b8476ede6d1426e32b813c84aa5220469604 Apalache Fun BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
20de4fb7dbd902349d3a8b001aeaa02f9e47fa4a Apalache In BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
eeac84e54292ed05a8a66eb5d8166307bebfe66f Apalache In BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
e85ebc4980486df1a798ec2e94ffe48678dccca8 Apalache NotIn BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
fb208f0b0cab41804ff3ec67a72d5bf3a3e0071b Apalache NotIn BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
28c61816ed25dc75de860bc8bf37368ef6ef6e52 Apalache Record BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
3e11ffd91deb8cebc425525c517b981801809c08 Apalache Record BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
f126b1af4786ccab1e9e152e07c3d9c9c9b81e9e Apalache Tuple BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
df484dcb274d202b3da495882ae17645dcfe51f3 Apalache Tuple BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
2a570ec35ac67ff5dd2611dff94aeba19a6bb22e Apalache FunApp BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
f5b56953796e48405f1e3a63c8828d6f980e241d Apalache FunApp BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
0c68065f31471a4f3a19666757adae4061c17aa2 Apalache Except1Fun BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
387bc6b1006999598cd3c35720890b9e2e7a7880 Apalache Except1Fun BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
815ccd9bc19f8abe2b15bc53b6c17319aa1731d5 TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
eaecd68e43a095a4b640c049aeab4d5211bb7a9a TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
1b97a868fbcf31b78b46e87feb315977d1d8ee57 Apalache Except1Rec BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
c9c13a2f248b97eeac7df7945ae83a4431a24692 Apalache Except1Rec BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
71b628e4d2d30fd9853cc4af6d0ac1de19e50f66 TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
ed5df4011c4352fd72b390735b2219306557d59c TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
3ebff44d0418627dcc3f89c704944bbaedc01bde Apalache Except2Fun BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
dd957dc58140235b13ebd12588ba7ea8b87ea4b2 Apalache Except2Fun BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
0ce2fd4ff297b83d0fe848bfba22368ff24b4e20 Apalache Prime BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
e5017729032eaf5ee543b2960e9228aed29216a5 Apalache Prime BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
8e3e90b628ee9010f2d9831465a2995e4d63d474 Apalache DefFun BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
9b2afc85e721c2939c82b6a3212641da9fd25cba Apalache DefFun BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
c16d6678b4e676b8d72d0729cbf943ed33705e2b TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
00ab0e2f26876d168a99f3def3e0d3970ab7bd79 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
f42c740c328f4dfabc4fdc48754a3e8b001c2880 Apalache DefFunRecursive BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
cb1bfdf2058aa32bb4793835605efc24b72abaf9 Apalache DefFunRecursive BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
b59669bb5602bc293eca2b94e6191649a86ecbb5 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
383a8a8f9067b3747ad4a7f2df97da4a1bab0ec6 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
92247ec75ff8c56bd9db3dba9575f28209fb52e5 Apalache Def0 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
1c282b49ee33cfcb2456331fcd1e8dd819878c60 Apalache Def0 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
f6d7dd7a606ba94f3d13e7da79d6e6fcc0994af3 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
f0909d68ba06683aed7c88dd0873abc124c3efee TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
2d5c339aaa8614713472b38c5eff50ed422305f1 Apalache Def1 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
fb40b356f03a41a6130c8fd1b7a2ba2f9ddcab56 Apalache Def1 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
f33f3d6aac037b52011654172350a1c558c95d15 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
901f6771b0feaa366f57f76e6001909c1d26ebc2 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
0b77f4c5213cae0c2113fd77c67f4255d4fe3ff9 Apalache Def2 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
7e7165d9d19b8f78bff91ea946cac2394aebb33d Apalache Def2 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
b9c92f8c495266f1f3fecbe26f792acd3806ef65 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
565a02d2b70b93048c3a514f36176ed089d983a7 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
77a5c2365295dff134ed184d5018e563ab9c952d Apalache Def1Recursive BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
11ad2dbb7ac47f433cd0a6ffad03f14feb736186 Apalache Def1Recursive BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
8c820111e377436e7befa455415df632b3a061d4 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
28b429e1c81c836dfd7e2b719600094855407224 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
7d7927fced4c4f7efcfd8f4c3bc260266bedb29f Apalache Extends BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
496d3d9ba84406b284edcf6e192c93e25b421d86 Apalache Extends BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
043ebd17647aa4807cfd5333ac91d4d02343962f Apalache ExtendsInDifferentFolder BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
3be33f4f3dae32151fbe770d85fe977f438d7fe3 Apalache ExtendsInDifferentFolder BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
751a61f10df4b89345135d022e13edcb951830d4 Apalache Variable BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
7f2dc1399c2403c5758512a7386b91b5ba014453 Apalache Variable BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
3bae8f4e97710d18f9167b187fcc8760d22a2700 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
bc2abd6e340bef4ebe21acba8b2bb83f1e00d195 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
b13dc209c35b75588ddf0af11742fe933f37959c Apalache Constant BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
60cf328adee3184605846e30b14544d70e5de073 Apalache Constant BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
388b1dfd0ab26efad90edcbbd8a0bb4490b0b346 Apalache ConstantRank1 BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
22ee5de6b262cbf39e83ef745af1b08bd9eae013 Apalache ConstantRank1 BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
892429a87cf5e4b3d67536a241b09cc9d897697b Apalache Instance BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
6be8110eb3a3089c559d6ecd35899f8ec99b7517 Apalache Instance BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
5bb2c91ee1fdb2bacc0a087fa9df76926f31498a Apalache InstanceWith BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
824d0bc1dac1b3b51f1a3195cce8f3d1d9601581 Apalache InstanceWith BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
b1a02acd582c4bbaea32532f2b602ce50522bf16 Apalache InstanceNamed BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
e2af40a314b2befb033a96dda1eee5224b87ce83 Apalache InstanceNamed BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
b1f2548758df17e02efea9fcc4e376a6c646564c Apalache InstanceNamedWith BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
93c12ccdc3ccbec85d8908122e6351b599c8f070 Apalache InstanceNamedWith BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
c7d605450f7fb8c4690b8439f2aa6549e0dddab1 Apalache InstanceInFolder BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
38cd5843e0ee0ef6a1030f2687dfebea54dab5e8 Apalache InstanceInFolder BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
4369b13b4fabea14332bffea13f7577e11ae9659 Apalache InstanceWithInFolder BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
88ba5e65e21e6b71a49f5932c007a711b45dd798 Apalache InstanceWithInFolder BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
b72ce5d60988b08182d6bcfc73ae37f1401b7296 Apalache InstanceNamedInFolder BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
67755a647aade871ffc76665708f4ba46427bc94 Apalache InstanceNamedInFolder BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
de79d77dd7096eb5c2927712861eb8d510a67f1a Apalache InstanceNamedWithInFolder BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
09f01f27d1430f93eebaaf2f6d7e6005f8b5a89b Apalache InstanceNamedWithInFolder BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
a8fd79e07f3ddf1ff68ead857053e84537de4d4e Apalache Lambda BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
a16b30616c002b2f029533df6998cd1a18bb4d21 Apalache Lambda BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
576f40dd64477da866552bf332e3a9ff81a582c9 Apalache IfThen BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
8072374a01ad174b9ba2d6d8d17512dd6dd7004e Apalache IfThen BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
dadabd2440828a70cd268dd22f126e82a0695f46 Apalache IfElse BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
66e7d6765721c7cfc7344c7acb719bc55432e844 Apalache IfElse BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
395d274b07e5afe1771278559610b3421eff614d Apalache Unchanged BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
ef202553887ff4bd4c58ee22a1d1ffb270de52eb Apalache Unchanged BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
1b82fd7a03e5740e80b16618f055baec17477b6e TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
8878b745d26171ac4036509122e86a8e939e85a5 TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
88ff0a1080f1ebfa00baddb61fd25c7b5f791141 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
f1a11d7d5adcd6edecdb8c5aed5f60896bd00ad2 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
45b361c2254e7e5f8657971578f741a9d0d67342 Apalache BagBagToSet BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
239316a4eb27c0a054100f0a6ca7d53ed3d1963a Apalache BagBagToSet BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
6fd5dbf1d93898ea140d54d5b2002b839ea38f70 Apalache BagBagIn BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
4fc30df8233685f783fcf44bc5547b064055fe12 Apalache BagBagIn BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
1450862fcb9ae0f48f2c75a1b1409d3ab6df69ce Apalache BagAddBag BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
27f4bd3242efc57d447cdaf2711ec54ad6163157 Apalache BagAddBag BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
b65ab01e0857900bd08bd24be9323a88f934c9d3 Apalache BagBagSub BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
367d58040eb2c794f24afb546fc180fbcbc3917c Apalache BagBagSub BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
7b2fb6e3c6bfb4715f11f14b80ca8e41540a6860 Apalache BagCopiesIn BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
1abcc0d5f1f5e0c5a82f45fb87301caf600c0568 Apalache BagCopiesIn BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
ecdf09d2b8d8abc705765257731013ca9c62837b Apalache BagSubsetEqBag BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
b22ab65b5a6f3bd12dc558ca311e0a36cb64e14d Apalache BagSubsetEqBag BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
7f51e8ba22a1c97d80708dcac571d5c681ed6341 Apalache BagBagCardinality BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
f74f2e511bccc67460225fae37676a7db2488a52 Apalache BagBagCardinality BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
347cddf1584741b1e6a5bcda6993eed78e8dd788 Apalache BagBagOfAll BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
16c6cfda5efb94d7c99683d40bbb49a562dc6419 Apalache BagBagOfAll BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
93ed4ac0946f7d5b178a1b650176f8f228cb71f4 TLC with reduction strategy:
  • Case Feature: SubBag(B) is reduced to equivalent SubBagR implementation
BagSubBag BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
5238d0d971d968f6e53542a039206cdb0f36d808 TLC with reduction strategy:
  • Case Feature: SubBag(B) is reduced to equivalent SubBagR implementation
BagSubBag BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model
e56eb7ab473fc275b7374839e95a07d84927841a Apalache SeqAppend BagEmptyBag True Passed
  • Model Under Test
  • Equivalent Model
e2aefe0e97e025cf33232a40deb898302e657f47 Apalache SeqAppend BagEmptyBag False Passed
  • Model Under Test
  • Equivalent Model