Index


  • Introduction

  • Skipped feature combinations
  • Failed test cases
  • Tests by feature combinations
  • SYMMETRY tests
  • Tests under anomalous conditions

  • Tests by feature combinations: -workers 2
  • SYMMETRY tests: -workers 2

Tests by plug feature BagSetToBag; CLI Option: -workers 1

Id Type Case Feature Plug Feature Check Deadlock Test Results Test Models
65cd704c85b0c0d873d223ca43caf6120a4a7740 Apalache Eq BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
9ee8df4fe7dc1d5c2c7fe800a50264f8fddef1f0 Apalache Eq BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
f141f94c26326a852378d03e20ad716571825437 Apalache Ne BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
d150b881ce8ea4b184897cc458db3d7e2bc55679 Apalache Ne BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
39ba3934ec648b51e02f75ba61d5e63b4300ca2e Apalache Let BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
86cb16b16571c8a5af575272a6e1808d58e039a1 Apalache Let BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
c498b44194ce62a1a0a5e7a5272228798bb19238 Apalache Set0 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
d403c02d1b2941f480f023174a6b0a1b486ec94b Apalache Set0 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
f6b73db73982efe90cda49a230ec2cb374d15066 Apalache Set1 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
854018eaea3a98828617a42f2a61d957dad866de Apalache Set1 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
aa81ff2961505081cfba61e5c8d1ee56876719db Apalache Set2 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
c64aebebfce3fb9fc3d360edb6fe28f6b8bd2179 Apalache Set2 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
37c1dd4f01e1247763c3196e7f5ad945d20cb757 Apalache Fun BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
83c06247eb3762ae9b70b630dcc4528706e09d8b Apalache Fun BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
f574836ac96bd2c15ef37f342a71d6a0c7b532ef Apalache In BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
3790607ffd3df962b24e52cfce7c28051e59860f Apalache In BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
eb95ba5c15aad8bb6a1132549f34f8c873a8700f Apalache NotIn BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
212cc5b0901634881ed03fdd5cefcd147743d2e9 Apalache NotIn BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
46fb5e2f02603931708836513ab01541ac4c8e8e Apalache Record BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
1fc802416ba7694ece3cc1d4397dddda58f22e88 Apalache Record BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
8267f4a4d07a830f9b51ae7bae607a55147284ec Apalache Tuple BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
5ca22409db65f3bcbe06301405ffb81b74660696 Apalache Tuple BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
88e5618ecc6d1927e489cf37cddc8b6cf6850999 Apalache FunApp BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
19c51baccf3c086aaa7700cfc169a2c15a0ab4a5 Apalache FunApp BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
9fdbc5d13569847e6d242a6764b97c88a90bdccf Apalache Except1Fun BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
8896c209d0ee68d110ffb52debe274bbccb3d4e9 Apalache Except1Fun BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
8ecd8a0e1527b02f84abb9a267c01bed562f5c8f TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
fb6ec7a419b547be0c7dd64f236d52f17ce72973 TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
786a589f3c938993cf9aa8e4d74290f1e7e5dd76 Apalache Except1Rec BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
32e1df63fa4b8088dc26310e58d4bf693c7c1a05 Apalache Except1Rec BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
9bc2433b993b81a47426a25fffa1fe6be475f77f TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
4ec8c61f6b00a24bc9e29f04e6f46a32785a7b23 TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
369b284d5ed2e621a250098d8956c1c6babc08fd Apalache Except2Fun BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
297910eefae8df7ce55ece195424becb52a030c3 Apalache Except2Fun BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
234933abc89717fdc4a3265b21a56f9ab87b5676 Apalache Prime BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
695605b7453042df4074d81d4c9cb7f871171bb3 Apalache Prime BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
fa849e9cfe179a5e246dba65ff96bf6ff3b1da50 Apalache DefFun BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
27c65d75fff968c50dabebfa99aaaeab476aa7db Apalache DefFun BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
e7a3b50ae3de0a3c98ab15f30fa214bca39f5971 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
f501ab29565bbb7a82e006c2ae91e4909fdd1782 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
1b377dbd3fb84f97c45fdbe10abef472e76e6e4c Apalache DefFunRecursive BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
7e7e12c55f15921ffb0b85c9dbe6dd272ffec470 Apalache DefFunRecursive BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
f9ea2cc1120ca25ca74fb09dd58844b5f469d6ba TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
bf12185be0eb650d2cdf4849ca22d663a6cc11d8 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
ceee3ffa03e024eff060f68967623aa0b82b977d Apalache Def0 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
1a0dae2e312beb8a61fc7566700cdab3d9246892 Apalache Def0 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
4f5e2c94f255918638a84fa0c9887f7bbeeb1e79 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
e2c39b1c313c12e969d9401ba8de77eb05761eaf TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
a99cf7c70ed1c5c26adac6dc38e99e9e5d73fadb Apalache Def1 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
fba5be1f2041ea534137a7cb0c9666c1333d0880 Apalache Def1 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
15c9a7e348e51602598d4eababef11d83d9ded8f TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
415ee645fc609d5ce8fe33b4a39e829d2bc79087 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
b6a3f49d52bdca27ef6d68c4875484984a95da13 Apalache Def2 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
6bab95cf6c72efffaa48430a547848a5d6802f91 Apalache Def2 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
6cf38e0c099708d0ddb5c09596f352d6b84e3fc6 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
27c3edfae9d881988a166dd39b8ff1aafc84f095 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
88f9572c5fc9c0224e48491c81f9f83a12aadf01 Apalache Def1Recursive BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
d62a77460de7dbd08f4b9c7b36a09de912577d9d Apalache Def1Recursive BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
6bae505c6adf40f89a16b0e436d08ccb22e3e8e0 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
1d0a9dcdc9b696e866e69852c011fa6ea44ccefc TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
a942c24bfc3743b216b334d1efb81ddb7e38f8a4 Apalache Extends BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
ebf946fab7e8bc876a78ada30103356661000aef Apalache Extends BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
62de3527a21a0897f22b287d362c7fd4b627cad6 Apalache ExtendsInDifferentFolder BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
27df71bc0934418cdd85758cb21db988d8d48c14 Apalache ExtendsInDifferentFolder BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
29305cd2f3ec7fbe400690e4fc9f19d57b814ef5 Apalache Variable BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
77b421a978134b8e602bacebd91b544fa9bf9162 Apalache Variable BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
eb58d3e40dffabb92dc42ed5117ca4aa37947ae7 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
a4fbc04ec559d4c20abb18dd0d9176681c698107 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
78d10328d630694dfcd2cf29990cba383a57595b Apalache Constant BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
775f534e916571c1dbfda94885f1c926a41fc64c Apalache Constant BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
5ec655e8f61fb1e896629d789274a3c6e947c311 Apalache ConstantRank1 BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
b86f14ffc1737b8946c3a788e9e87bcd854e8862 Apalache ConstantRank1 BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
edf79a3a996f58b1c0cfbb175802408861215cbf Apalache Instance BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
16a8bdbec960db45d11b6eda035885c92299f5d2 Apalache Instance BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
1bbdf716070c64221863556aa9954ee1b58d26fb Apalache InstanceWith BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
e070e619c6e38ed3b4752f21a8db90d083dc9716 Apalache InstanceWith BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
6c60da3f6047d27944c2f85f5b14287fea943c1a Apalache InstanceNamed BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
af7f86240f502efaf003d1b72230b82795c78624 Apalache InstanceNamed BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
b850c992eb1d3952a280a749fe87ee36f2fad8e3 Apalache InstanceNamedWith BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
779d60a2b9cb29f45df9ccc8e5275248304600ba Apalache InstanceNamedWith BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
8b7b87b67e23f0b340311224c9d96deaf785bd12 Apalache InstanceInFolder BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
b187b9f91551de4a8def8044682af91399c1e48f Apalache InstanceInFolder BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
07fc127091710368d997e1b3f9739fb365466174 Apalache InstanceWithInFolder BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
5c29e138e7fe4a690a731f8d13e083f9eebc3910 Apalache InstanceWithInFolder BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
70953ba4f9b10b1594feedb54a7ec1f4fd911bb3 Apalache InstanceNamedInFolder BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
5e5475c63651e62b910ea7d17314a294b57a5998 Apalache InstanceNamedInFolder BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
32b5d8c9264ffb6fa412c2cdef4315f9d0a60320 Apalache InstanceNamedWithInFolder BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
da6f20e3fd7c5ad837b22da11837c8ace405b42f Apalache InstanceNamedWithInFolder BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
8d5c835a0dd06cf8c9055d11e11155d89af78d99 Apalache Lambda BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
63b06297133db179066d9984609f7782499d6cc1 Apalache Lambda BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
6366314a600f9ed894e625e1c40c35eb82821ff7 Apalache IfThen BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
e16e404d6fe6541cb72f44684f9a423a7fb62ef4 Apalache IfThen BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
ccda94e3a548c04537ae753c77261eec26b15c4f Apalache IfElse BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
d7900c67bf39d5677ebdf7642fa3d8e0e0f2d285 Apalache IfElse BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
fcada1a3f4d3fa34e73e41271cfb48e7e029dac9 Apalache Unchanged BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
596f422690f90545bdfb20e682bc3861b7909d0a Apalache Unchanged BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
7643252f9b892141427f323f3227b669c667e89a TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
e0cf60176cf68c973f0ea15bb7a73ee096dd5d6e TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
1834e186a0ffcd11bea5f351b7043d3788fedf13 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
9698c33556f900ef345075b666c8dd1517d80a96 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
669f684f2936f4f562b4b50557ce36227e9062e9 Apalache BagBagToSet BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
15a1198851545376b33ca58ec9985c0e50dd5638 Apalache BagBagToSet BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
9b0ba8cd91370da10487bde5df7818c5b526308b Apalache BagBagIn BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
dbdf7666a95cf9ddfddf5b410803fafff8b3938b Apalache BagBagIn BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
b5d2870cf8e9eb333acfa1132f2e5ae131a0ae20 Apalache BagAddBag BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
e883f9a18642bcef8c19d338a2d224bfd09d59af Apalache BagAddBag BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
15525737fa036738b717b84d58d1046f3797fa1d Apalache BagBagSub BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
3a86b31c29d9bd492d0e976811b2b3b77c77785f Apalache BagBagSub BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
ace6f427c74e7327a60ecc9ced1fb0993ce85f77 Apalache BagCopiesIn BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
231de6979fc63d59c46594b5e1f2ac786be3b7dc Apalache BagCopiesIn BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
87891bab5c25f9b8c3e6c8d03967cd5cfd16af09 Apalache BagSubsetEqBag BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
24075a57ec7f619f48e055fa37c60670a3b9b379 Apalache BagSubsetEqBag BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
a8782fc47773a7eb75a623c41ae22c3f4cf57b1d Apalache BagBagCardinality BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
8447185c269deba1c88c9c4a148056a76619ea08 Apalache BagBagCardinality BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
507b06a4ecda2157fc8ef512acf041d06026bf2b Apalache BagBagOfAll BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
fe9f885df176eb940915355198ae71311325a248 Apalache BagBagOfAll BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
7e4f53fe2bcf66f0f3f86c97aa4e3c800c6cb914 TLC with reduction strategy:
  • Case Feature: SubBag(B) is reduced to equivalent SubBagR implementation
BagSubBag BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
c26a762b5d7ce4ff54da336d27dfb4c7250c4a39 TLC with reduction strategy:
  • Case Feature: SubBag(B) is reduced to equivalent SubBagR implementation
BagSubBag BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model
fea4ed739d49b1df29035b9c280c1885f0a36806 Apalache SeqAppend BagSetToBag True Passed
  • Model Under Test
  • Equivalent Model
dfe015d5efbe070e375350944dc1d4c0e4060321 Apalache SeqAppend BagSetToBag False Passed
  • Model Under Test
  • Equivalent Model