Test Case Desciption
We have different test sets which we run against the recent releases of LemonTree. The shown numbers are based on our measurement methods, which are described here:
Starting with LemonTree 4.0.0 we are using the new SQLite formats, meaning models below where transformed to QEAX
Test Cases
Small Model
Description
A diff and merge of the example models which come with the LemonTree installation.
They contain a small number of elements, and do not differ from each other substantively.
Test Data
| Version | File size | Total packages | Total diagrams | Total elements | Total connectors | Total TaggedValues |
|---|---|---|---|---|---|---|
| Base | 3 MB | 6 | 17 | 202 | 152 | 242 |
| A | 3 MB | 6 | 17 | 205 | 154 | 242 |
| B | 3 MB | 6 | 17 | 203 | 153 | 242 |
LemonTree Info
- Impacted Elements: 23
- Impacted DIagrams: 6
Medium Model
Description
A standard diff and merge. Both versions A and B differ from the Base version.
The number of changes can be regarded as standard use-case for LemonTree, when used with models that are under version control (GIT, SVN).
Test Data
| Version | File size | Total packages | Total diagrams | Total elements | Total connectors | Total TaggedValues |
|---|---|---|---|---|---|---|
| Base | 128 MB | 758 | 2.038 | 21.922 | 26.075 | 88.326 |
| A | 128 MB | 739 | 1.988 | 21.685 | 25.594 | 88.810 |
| B | 133 MB | 739 | 1.987 | 21.670 | 25.568 | 88.331 |
LemonTree Info
- Impacted Elements: 1105
- Impacted DIagrams: 399
Large Model
Description
A diff and merge of two quite sizable models with a lot changes and even more elements to be checked by LemonTree.
This is quite challenging for LemonTree.
Test Data
| Version | File size | Total packages | Total diagrams | Total elements | Total connectors | Total TaggedValues |
|---|---|---|---|---|---|---|
| A | 233 MB | 8.490 | 6.733 | 114.962 | 69.652 | 32.788 |
| B | 195 MB | 8.059 | 6.252 | 107.111 | 64.345 | 29.157 |
LemonTree Info
- Impacted Elements: 68.547
- Impacted DIagrams: 6.979
EAExample
Description
A diff and merge of the example file provided with Enterprise Architect 14 with an empty model.
When comparing an empty model to a non-empty one, LemonTree shows a change for every element in the non-empty model.
Test Data
| Version | File size | Total packages | Total diagrams | Total elements | Total connectors | Total TaggedValues |
|---|---|---|---|---|---|---|
| A | 1,4 MB | 1 | 0 | 0 | 0 | 0 |
| B | 20 MB | 427 | 564 | 4.656 | 2.623 | 29.460 |
LemonTree Info
- Impacted Elements: 4.833
- Impacted DIagrams: 564
Tagged Value Model
Description
A diff and merge of two models with a substantial amount of tagged values, many of which are different in the respective versions.
Processing tagged values needed a lot of RAM in older versions of LemonTree (<1.8).
Test Data
| Version | File size | Total packages | Total diagrams | Total elements | Total connectors | Total TaggedValues |
|---|---|---|---|---|---|---|
| A | 142 MB | 338 | 909 | 46.380 | 22.819 | 316.458 |
| B | 152 MB | 347 | 982 | 50.810 | 27.289 | 336.759 |
LemonTree Info
- Impacted Elements: 5.963
- Impacted DIagrams: 263
Tagged Value Model (Triple Size)
Description
A diff and merge of the two models from the regular Tagged Value Model test case, but the contents of both A and B have been copied twice.
This test gives us the clearest estimate of the scaling capabilites of LemonTree, as the change-sets of this test and the previous one are identical except their actual number.
Test Data
| Version | File size | Total packages | Total diagrams | Total elements | Total connectors | Total TaggedValues |
|---|---|---|---|---|---|---|
| A | 480 MB | 1014 | 2728 | 139.142 | 68.458 | 949.354 |
| B | 522 MB | 1041 | 2947 | 152.432 | 27.289 | 1.010.257 |
LemonTree Info
- Impacted Elements: 17.871
- Impacted DIagrams: 790