Index


  • Introduction

  • Skipped feature combinations
  • Failed test cases
  • Tests by feature combinations
  • SYMMETRY tests
  • Tests under anomalous conditions

  • Tests by feature combinations: -workers 2
  • SYMMETRY tests: -workers 2

  • Tests by feature combinations: -workers auto
  • SYMMETRY tests: -workers auto

Tests by plug feature NumMul; CLI Option: -workers 1

Id Type Case Feature Plug Feature Check Deadlock Test Results Test Models
09791361b11768c4b463d41d2e5bf0a91c7f0814 Apalache Eq NumMul True Passed
  • Model Under Test
  • Equivalent Model
105f57f6f6e3d3ec47cbea5f494f72b29de76c73 Apalache Eq NumMul False Passed
  • Model Under Test
  • Equivalent Model
7230aa6ec042fcb7e92a657cbf80ddace667a8a8 Apalache Ne NumMul True Passed
  • Model Under Test
  • Equivalent Model
ad32eab86e32c73eee09d46852e4ea3138bf046d Apalache Ne NumMul False Passed
  • Model Under Test
  • Equivalent Model
c1af3efdbc8f3f8b13abff52e9c41fd781840650 Apalache Let NumMul True Passed
  • Model Under Test
  • Equivalent Model
f3f132305293e0d6b5d37ef4aab927e2fe520929 Apalache Let NumMul False Passed
  • Model Under Test
  • Equivalent Model
5e43d6a65a967489da8327a3f773c1b95bec3474 Apalache Set0 NumMul True Passed
  • Model Under Test
  • Equivalent Model
8943b5765827bfa84aac6f5acd9c0c3fb427f3e6 Apalache Set0 NumMul False Passed
  • Model Under Test
  • Equivalent Model
caa49a1090cc82dd988fb5249d219e0f8b232ac1 Apalache Set1 NumMul True Passed
  • Model Under Test
  • Equivalent Model
3a7d5936eb677d9272cb9b51b57b4b22ffa15508 Apalache Set1 NumMul False Passed
  • Model Under Test
  • Equivalent Model
f67614374742574bac20508d489f0339da82d16a Apalache Set2 NumMul True Passed
  • Model Under Test
  • Equivalent Model
aab1eda73e7ec04eeb5aa4a19d670d202c1e68f2 Apalache Set2 NumMul False Passed
  • Model Under Test
  • Equivalent Model
50c415a108e7abe2bcf42c2415aa8ba416226be2 Apalache Fun NumMul True Passed
  • Model Under Test
  • Equivalent Model
9390f03024d45a96476436a661773b396cc2b61e Apalache Fun NumMul False Passed
  • Model Under Test
  • Equivalent Model
6a0ab3e0d6efd5ddeb0dcec5f9051717a9399362 Apalache In NumMul True Passed
  • Model Under Test
  • Equivalent Model
a31f2d9c478c5e31dd914a150bcf0840836054a0 Apalache In NumMul False Passed
  • Model Under Test
  • Equivalent Model
405538bf6631d13318922172f5f67f42672118b3 Apalache NotIn NumMul True Passed
  • Model Under Test
  • Equivalent Model
51596edd5d896813b28722cc37bb9608941cfafe Apalache NotIn NumMul False Passed
  • Model Under Test
  • Equivalent Model
58a702722f7fa7fe745aada7ac1112681f1055f4 Apalache Record NumMul True Passed
  • Model Under Test
  • Equivalent Model
16e4422287f48a69954ddb41760e2c380b1f2d6a Apalache Record NumMul False Passed
  • Model Under Test
  • Equivalent Model
bc342ffd4fd7d9b18801e568f8d79ddfb1250acf Apalache Tuple NumMul True Passed
  • Model Under Test
  • Equivalent Model
189f375274948672e183e3d285f4daada24c9782 Apalache Tuple NumMul False Passed
  • Model Under Test
  • Equivalent Model
73d194eaa291cfc62b3d055685b27fcdfe2dad85 Apalache FunApp NumMul True Passed
  • Model Under Test
  • Equivalent Model
9b77a13cc0d404f08e678fedcd68069f2f75b9de Apalache FunApp NumMul False Passed
  • Model Under Test
  • Equivalent Model
a3d043a722993e015c5b4126550171a985e80715 Apalache Except1Fun NumMul True Passed
  • Model Under Test
  • Equivalent Model
b9546f4e34401da251b69b0c645a976dc1b5d166 Apalache Except1Fun NumMul False Passed
  • Model Under Test
  • Equivalent Model
5b5c6bb9357b1507e1f50bda773557c5fe737129 TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt NumMul True Passed
  • Model Under Test
  • Equivalent Model
bbb367620befaf77c60f28fb45a12202a77e5571 TLC with reduction strategy:
  • Case Feature: @ is reduced to F[arg]
Except1FunWithAt NumMul False Passed
  • Model Under Test
  • Equivalent Model
0db12a11fca2eb2b366d7b0942a50a3f670fb5fa Apalache Except1Rec NumMul True Passed
  • Model Under Test
  • Equivalent Model
15d595d14584d6d5c40e0fa70453a9a9bb4a526a Apalache Except1Rec NumMul False Passed
  • Model Under Test
  • Equivalent Model
d98517384bc76b92348d3c45d5534aa70cc94e75 TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt NumMul True Passed
  • Model Under Test
  • Equivalent Model
6b741acd10dc9b6ee50f51412237d016ba70a0dd TLC with reduction strategy:
  • Case Feature: @ is reduced to F.arg
Except1RecWithAt NumMul False Passed
  • Model Under Test
  • Equivalent Model
f75b74b6174c1af757f45c78590dd5dd3a5d6442 Apalache Except2Fun NumMul True Passed
  • Model Under Test
  • Equivalent Model
e6b879b2051fff98ca999a77a8e3920485e85ad9 Apalache Except2Fun NumMul False Passed
  • Model Under Test
  • Equivalent Model
a373e98e1560e313cc6b60f9cf86329362a9f4f8 Apalache Prime NumMul True Passed
  • Model Under Test
  • Equivalent Model
c859555c7bca7c436c26d1f6f69659951dd9be31 Apalache Prime NumMul False Passed
  • Model Under Test
  • Equivalent Model
70e2c09df8bfd34a16e16abbdcdce480baf013fb Apalache NumUnaryMinus NumMul True Passed
  • Model Under Test
  • Equivalent Model
3a213bd729c22e3a3e61735d2221d5adb3b1ef9f Apalache NumUnaryMinus NumMul False Passed
  • Model Under Test
  • Equivalent Model
7b3f471076c310f5a1f4a115ceaf3e72f0a2588b Apalache NumPlus NumMul True Passed
  • Model Under Test
  • Equivalent Model
3f52c0db6b8866ea9c96edef82e463c9483a93c9 Apalache NumPlus NumMul False Passed
  • Model Under Test
  • Equivalent Model
ecf4feb77d8aeb939f4bef84ae6626146d1088a9 Apalache NumMinus NumMul True Passed
  • Model Under Test
  • Equivalent Model
39c80742ce3711cc92cdfbb321c4a145cd0efabf Apalache NumMinus NumMul False Passed
  • Model Under Test
  • Equivalent Model
c38248c5aef4393fbd3171faa0e3f669ebd5c8ec Apalache NumMul NumMul True Passed
  • Model Under Test
  • Equivalent Model
52a895c76f69a5329f37ffe22831d9deefb2e3c0 Apalache NumMul NumMul False Passed
  • Model Under Test
  • Equivalent Model
7a46cf7f67e8cb20954f50ab55d149abaf71f8a4 Apalache NumDiv NumMul True Passed
  • Model Under Test
  • Equivalent Model
1e4ea436d5543550811270a67ced7bd76fad2d3a Apalache NumDiv NumMul False Passed
  • Model Under Test
  • Equivalent Model
b6819b1e2dbf1646ff60152ab5b607930ee13a2f Apalache NumMod NumMul True Passed
  • Model Under Test
  • Equivalent Model
fcdfe168d6e331250cd9e61ede496b6e0ae18fb4 Apalache NumMod NumMul False Passed
  • Model Under Test
  • Equivalent Model
a65065f7289a45b44942a0b6a532d3c0c02b84cf Apalache NumPow NumMul True Passed
  • Model Under Test
  • Equivalent Model
95fcccd9819415e049253cdab3389610acfa890c Apalache NumPow NumMul False Passed
  • Model Under Test
  • Equivalent Model
53e6e4bb357b86bb0c4bacd906c0d258a4619687 Apalache NumGt NumMul True Passed
  • Model Under Test
  • Equivalent Model
ee70e0bb2ee402454b0cda6196c049af2935b661 Apalache NumGt NumMul False Passed
  • Model Under Test
  • Equivalent Model
d3fea928fa6a6cc4384d816c69ee1c9eeaa61663 Apalache NumGe NumMul True Passed
  • Model Under Test
  • Equivalent Model
f557fd1e911a09713e8b9cd9e1acd40c2ce233c4 Apalache NumGe NumMul False Passed
  • Model Under Test
  • Equivalent Model
1697deb767b16b016c1d34bced3b5176f520b04b Apalache NumLt NumMul True Passed
  • Model Under Test
  • Equivalent Model
daa43d1ee944d83e1199d2352770f26fa91c1e11 Apalache NumLt NumMul False Passed
  • Model Under Test
  • Equivalent Model
ca9beca8807abb573b6dcceb1c008af39596e1fa Apalache NumLe NumMul True Passed
  • Model Under Test
  • Equivalent Model
8e9079b6ec5a3c84f060acdb6dc5b2f26a190d74 Apalache NumLe NumMul False Passed
  • Model Under Test
  • Equivalent Model
097e82d930f8c83d89665149039bac08e19afc6b Apalache DefFun NumMul True Passed
  • Model Under Test
  • Equivalent Model
eb03d5ef8c0529edaaafd734169ab125a1cfe484 Apalache DefFun NumMul False Passed
  • Model Under Test
  • Equivalent Model
71cd891cd19190ade9d7ce017f8ac0fd86e08826 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun NumMul True Passed
  • Model Under Test
  • Equivalent Model
046b2990820d4fbb9d8bb26bc44ec35b744d3a8f TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFun NumMul False Passed
  • Model Under Test
  • Equivalent Model
48fa8ddadc07124517088b37a3c192bc8339b2ab Apalache DefFunRecursive NumMul True Passed
  • Model Under Test
  • Equivalent Model
e06aa68ef0fd108dddd752822d0d1c65dfaa1f4b Apalache DefFunRecursive NumMul False Passed
  • Model Under Test
  • Equivalent Model
6d6205fdf1c52807bd79286be28d026777a54040 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive NumMul True Passed
  • Model Under Test
  • Equivalent Model
b7d40f6c3649e342ec3c06afc263d08c1eb7e1d2 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDefFunRecursive NumMul False Passed
  • Model Under Test
  • Equivalent Model
e5fdc71f8ea77bcf51ba6febded116ed49818e71 Apalache Def0 NumMul True Passed
  • Model Under Test
  • Equivalent Model
25aee87a5bf2660ed3e98527d6af01843e562d65 Apalache Def0 NumMul False Passed
  • Model Under Test
  • Equivalent Model
1a2d5befc34ae7f1eb64020e42776f22457cb0d1 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 NumMul True Passed
  • Model Under Test
  • Equivalent Model
ae52593fa454c976192d6c93e1fc7825b05a1d98 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef0 NumMul False Passed
  • Model Under Test
  • Equivalent Model
4c072b3b26d5b5fbad6b8216bb077146a7387d43 Apalache Def1 NumMul True Passed
  • Model Under Test
  • Equivalent Model
e962fa347470fff34c5b8fbad4a2d4713eb00ea5 Apalache Def1 NumMul False Passed
  • Model Under Test
  • Equivalent Model
ff624153f54d70704f7a7166c59d395f07da738f TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 NumMul True Passed
  • Model Under Test
  • Equivalent Model
9c298240c23a3fa345f83bb5de003151ce4f088a TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1 NumMul False Passed
  • Model Under Test
  • Equivalent Model
64e36c0f3a75acbcc318e7969165bd331f45503d Apalache Def2 NumMul True Passed
  • Model Under Test
  • Equivalent Model
c2571560d653662059e566f89994ecb8fc8e4355 Apalache Def2 NumMul False Passed
  • Model Under Test
  • Equivalent Model
29b6189de536b4afadc2b453d1d901891588ebac TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 NumMul True Passed
  • Model Under Test
  • Equivalent Model
4a6be93dbb95c9b193a48654625fdc2319223a17 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef2 NumMul False Passed
  • Model Under Test
  • Equivalent Model
b73f88064a200e1429a5858a1e2f4bbca77639b4 Apalache Def1Recursive NumMul True Passed
  • Model Under Test
  • Equivalent Model
c3a2c801ff97d3f4e5d62e3bd563f35f2d096560 Apalache Def1Recursive NumMul False Passed
  • Model Under Test
  • Equivalent Model
8eca6472a16e6b813ce529db878f1b7f182c61b7 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive NumMul True Passed
  • Model Under Test
  • Equivalent Model
264155a4fd9f55516c66afa5497dd40394259db0 TLC with reduction strategy:
  • Case Feature: LET definitions are reduced to global definitions
LetDef1Recursive NumMul False Passed
  • Model Under Test
  • Equivalent Model
3bc1afeaf27559c8aa33309a25ea9007f824f91e Apalache Extends NumMul True Passed
  • Model Under Test
  • Equivalent Model
d57e2951917ab367f50516c27178440abff445d9 Apalache Extends NumMul False Passed
  • Model Under Test
  • Equivalent Model
87fe08c5f0e2a2d4259463ad1345779c060b4518 Apalache ExtendsInDifferentFolder NumMul True Passed
  • Model Under Test
  • Equivalent Model
1e949acb446cf7107d73eba904e3084698ee0a23 Apalache ExtendsInDifferentFolder NumMul False Passed
  • Model Under Test
  • Equivalent Model
4e6d6e5f6fe53df6a4b43d73c5814ce64aa46f9a Apalache Variable NumMul True Passed
  • Model Under Test
  • Equivalent Model
d0bbcf79d3ef5d848f8dd1795b057d753bb716ca Apalache Variable NumMul False Passed
  • Model Under Test
  • Equivalent Model
f61627693b342d0d935aa3de9867a12789965b71 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude NumMul True Passed
  • Model Under Test
  • Equivalent Model
8b543f46c7ea5043bbb61ce9a2b040de2a4f51f9 TLC with reduction strategy:
  • Case Feature: Model with VIEW is reduced to the same model without VIEW: VIEW must not change TLC behavior
VariableViewExclude NumMul False Passed
  • Model Under Test
  • Equivalent Model
102d549791acaab592a334b6e10d8896fd97fed1 Apalache Constant NumMul True Passed
  • Model Under Test
  • Equivalent Model
2ade0edf85ff90400fbdf93560ea162a6253bbd3 Apalache Constant NumMul False Passed
  • Model Under Test
  • Equivalent Model
1ab638419ac5249b2524e0fe17436864960b9a80 Apalache ConstantRank1 NumMul True Passed
  • Model Under Test
  • Equivalent Model
ad2d14db82586f56b36066937bc18bf7a81d0d77 Apalache ConstantRank1 NumMul False Passed
  • Model Under Test
  • Equivalent Model
091284e198b1684436a5fbb00386db6ca2dba09a Apalache Instance NumMul True Passed
  • Model Under Test
  • Equivalent Model
f45198d61b6c2cab3a3ffeb3ef629a483158e782 Apalache Instance NumMul False Passed
  • Model Under Test
  • Equivalent Model
6786f6b9026a571e116866c8856b7550983d53c8 Apalache InstanceWith NumMul True Passed
  • Model Under Test
  • Equivalent Model
e47fc4147992bd9c489485ded1dfdf8ce3775290 Apalache InstanceWith NumMul False Passed
  • Model Under Test
  • Equivalent Model
85ace191d6a5622d01d972cac6e26317e273af5e Apalache InstanceNamed NumMul True Passed
  • Model Under Test
  • Equivalent Model
81dbc96086d9d3f5b2c6b4b1d6da8527f1d75c20 Apalache InstanceNamed NumMul False Passed
  • Model Under Test
  • Equivalent Model
d23d51c2926c5150edb1426b2209dbf186979599 Apalache InstanceNamedWith NumMul True Passed
  • Model Under Test
  • Equivalent Model
243a8358cb8fe090d6d67512137556cd20438ffe Apalache InstanceNamedWith NumMul False Passed
  • Model Under Test
  • Equivalent Model
d3a572faf60cc6590cba3c3d2ae882c5a03308f1 Apalache InstanceInFolder NumMul True Passed
  • Model Under Test
  • Equivalent Model
e69b3cff95778b8132f8a921c9268bf77760269f Apalache InstanceInFolder NumMul False Passed
  • Model Under Test
  • Equivalent Model
403c3338c40b7a0da37046efb6a16fd56c5bcfb4 Apalache InstanceWithInFolder NumMul True Passed
  • Model Under Test
  • Equivalent Model
953d4f572725dac689586302799d84c5c2b1a598 Apalache InstanceWithInFolder NumMul False Passed
  • Model Under Test
  • Equivalent Model
ea37d251887d1eae2ef0f3ee78407ab1fa4f7e6d Apalache InstanceNamedInFolder NumMul True Passed
  • Model Under Test
  • Equivalent Model
572946ebca74ade01cbf73d7e87da7509aa6548c Apalache InstanceNamedInFolder NumMul False Passed
  • Model Under Test
  • Equivalent Model
c66689edd32ea2e0836edc6fe3e76a544c7fd317 Apalache InstanceNamedWithInFolder NumMul True Passed
  • Model Under Test
  • Equivalent Model
dc3942743cc1d21461afeb6532f82ab977ce5b4a Apalache InstanceNamedWithInFolder NumMul False Passed
  • Model Under Test
  • Equivalent Model
9ccc73628963b299db19045ba8557228ef3576eb Apalache Lambda NumMul True Passed
  • Model Under Test
  • Equivalent Model
4aad55266094d1833b1941fb79311bc2542a3726 Apalache Lambda NumMul False Passed
  • Model Under Test
  • Equivalent Model
8cf688c19c2f661009c7852c24c7b672c22836a3 Apalache IfThen NumMul True Passed
  • Model Under Test
  • Equivalent Model
9bdc575b897c602a7e9284f18d98e2b2ef6fb1ef Apalache IfThen NumMul False Passed
  • Model Under Test
  • Equivalent Model
ed2524deb085cd463f6cfd987d09fa4adc818a96 Apalache IfElse NumMul True Passed
  • Model Under Test
  • Equivalent Model
688845db5f235e0f2f9b577cdd052f74002e7448 Apalache IfElse NumMul False Passed
  • Model Under Test
  • Equivalent Model
f18a93408628b748d37ed43370523f32699651ba Apalache Unchanged NumMul True Passed
  • Model Under Test
  • Equivalent Model
2055e715429ec8643a3a404ac748c0d783fed5f6 Apalache Unchanged NumMul False Passed
  • Model Under Test
  • Equivalent Model
27095c4e108bbc811443a650826876fc40049bcc Apalache SeqSubSeq NumMul True Passed
  • Model Under Test
  • Equivalent Model
0d785598c3fb971cba09cae4effd466ef40d9cb8 Apalache SeqSubSeq NumMul False Passed
  • Model Under Test
  • Equivalent Model
938c5a7033264af668b83dce031e5adb34bce711 TLC with reduction strategy:
  • Case Feature: n..m is replaced with { x \in { n, n + 1, ... } : x <= m }; it falls back to crash (through CHOOSE Q : FALSE) if m is too big: this crash forces to do manual test review
NumRange NumMul True Passed
  • Model Under Test
  • Equivalent Model
f52cf9b65362d59c170c2b80422cd879c622fee3 TLC with reduction strategy:
  • Case Feature: n..m is replaced with { x \in { n, n + 1, ... } : x <= m }; it falls back to crash (through CHOOSE Q : FALSE) if m is too big: this crash forces to do manual test review
NumRange NumMul False Passed
  • Model Under Test
  • Equivalent Model
22cce2294dcabac0718ac41a9e006759afd70a39 TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun NumMul True Passed
  • Model Under Test
  • Equivalent Model
5d92a04560d5498f2964c260fc6ea63d586e6def TLC with reduction strategy:
  • Case Feature: x :> y is replaced with equivalent [u \in {x} |-> y]
TlcSingletonFun NumMul False Passed
  • Model Under Test
  • Equivalent Model
d50f85bce725a377b90e1dc8d6d2c58bd6acc58f TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval NumMul True Passed
  • Model Under Test
  • Equivalent Model
17b1b6fb4cf9225908d8fa16dd5bb1530c1db286 TLC with reduction strategy:
  • Case Feature: TLCEval(expr) is reduced to just expr
TlcEval NumMul False Passed
  • Model Under Test
  • Equivalent Model
a1a012560794169604194d8d493d7ec963b3126c Apalache BagBagIn NumMul True Passed
  • Model Under Test
  • Equivalent Model
b96f1bf603129ee8e5f7f64e7b9df1d5ee6f4c69 Apalache BagBagIn NumMul False Passed
  • Model Under Test
  • Equivalent Model
5175a2429f0d31886f8bea3cc5cd689961f1f33b Apalache BagCopiesIn NumMul True Passed
  • Model Under Test
  • Equivalent Model
103596a67c37e92cc9062cc2197448d5586520eb Apalache BagCopiesIn NumMul False Passed
  • Model Under Test
  • Equivalent Model
ce8daac00603ed94d9b2b9c5c6333a35aba20e6a Apalache SeqAppend NumMul True Passed
  • Model Under Test
  • Equivalent Model
bd5a0dc5b0bcb6f03c318a61d1c20d91792ad72e Apalache SeqAppend NumMul False Passed
  • Model Under Test
  • Equivalent Model