Page tree
Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 17 Next »


We run tests with different releases of LemonTree against different test-models to examine the improvement of the memory usage and performance.

This page gives an overview of the performance and memory usage and describes the test-models.

Performance and memory usage are continually improved in LemonTree.

Environment

Win10, 16GB RAM i7-6700HQ CPU @2.60 GHz, 64 BIT

Test description

We have different test setups which run against the recent releases of LemonTree.

1: Small model, with few changes in 3-way comparison

These models are the example models which come with the LemonTree installation.

2: Medium model with several changes in 3-way comparison

A larger model which is diffed in a 3-way comparison. There are changes in A (respective to Base) and B (respective to Base). This test-case can be regarded as standard use-case for LemonTree, when used with models that are under version control (GIT, SVN).

3: Large model with a lot of changes in 2-way comparison

A really large model with a lot changes and even more elements to be checked by LemonTree. This is quite challenging for LemonTree. In a 2-way comparison Model A is also regarded as Base model.

4: EAExample (for EA 14), compared with empty model

When comparing an empty model with another model the diff results in a lot of new objects which leads to special challenges for LemonTree. In older versions of LemonTree (< 1.5) this was not successful within the test environment.

5: Tagged Value model with a lot of TaggedValues in 2-way comparison

TaggedValues needed a lot of RAM in older versions of LemonTree (<1.8). 

Testmodels

Test Name

Version

File size

Total packages

Total diagrams

Total elements

Total connectors

Total TaggedValues*

Description

Small ModelBase3 MB617202152242

A3 MB617205154242

B3 MB617203153242









Medium ModelBase128 MB7582.03821.92226.07588.326

A128 MB7391.98821.68525.59488.810

B133 MB7391.98721.67025.56888.331









Large ModelBase233 MB8.4906.733114.96269.65232.788same as A

A233 MB8.4906.733114.96269.65232.788same as Base

B195 MB8.0596.252107.11164.34529.157









EaExampleBase1,4 MB10000empty model

A1,4 MB10000empty model

B20 MB4275644.6562.62329.460









TV Model
Base142 MB33890946.38022.819316.458same as A

A142 MB33890946.38022.819316.458same as Base

B152 MB34798250.81027.289336.759

Test results

Test results


Small Model
Test nameLT VersionImpacted elementsImpacted diagrams1) Loading models2) Premerge calculation3) Writing merge fileMax RAM usage

2.62364s1s1s242 MB

2.52368s1s1s255 MB

2.4.123619s1s1s463 MB

2.423619s1s1s300 MB

2.323620s1s1s297 MB

2.223618s1s1s292 MB

2.1.423613s1s1s263 MB

2.1.323613s1s1s265 MB

2.1.02669s1s1s

257 MB


2.026622s1s1s

257 MB

Medium Model

LT VersionImpacted elementsImpacted diagrams1) Loading models2) Premerge calculation3) Writing merge fileMax RAM usage

2.61.1053991m51s18s7s5.436 MB

2.51.1053991m52s17s6s4.937 MB

2.4.11.0933892m10s19s15s5.940 MB

2.41.09338952m07s19s17s5.908 MB

2.31.0293872m17s13s14s5.928 MB

2.21.0333862m23s13s20s6.184 MB

2.1.41.0283861m57s32s12s5.595 MB

2.1.31.0283861m51s36s13s5.630 MB

2.11.1843861m45s23s21s5.980 MB

2.01.1843862m16s20s1m5.454 MB
Large Model


Impacted elementsImpacted diagrams1) Loading models2) Premerge calculation3) Writing merge fileMax RAM usage

2.668.5466.9792m35s9m41s24m02s11.605 MB

2.568.5466.9792m21s8m26s19m10s11.237 MB

2.4.168.5426.9792m30s10m4s27m57s11.750 MB

2.468.5426.9792m52s10m49s24m14s11.809 MB

2.368.5496.9793m13s18m13s29m14s410.548 MB

2.2.068.5486.9792m09s7m55s21m53s10.486 MB

2.1.468.5486.9792m22s17m58s22m38s10.011 MB

2.1.368.5446.9792m21s18m2s23m26s9.888 MB

2.175.5236.9792m47s14m19s24m16s9.406 MB

2.0

2m30s15m49m9.525 MB
EAExample


Impacted elementsImpacted diagrams1) Loading models2) Premerge calculation3) Writing merge fileMax RAM usage

2.64.8335648s12s3m15s750 MB

2.54.83356410s17s3m37s747 MB

2.4.14.71956421s14s5m12s774 MB

2.44.71956422s16s4m59s826 MB

2.35.01956422s16s4m57s841 MB

2.2.05.01856419s14s4m53s805 MB

2.0.0

23s10s7m13s764 MB

2.1.45.10256413s32s4m44s789 MB

2.1.35.10256412s36s4m30s782 MB

2.1.05.66656413s28s4m57s738 MB
Tagged Value Model


Impacted elementsImpacted diagrams1) Loading models2) Premerge calculation3) Writing merge fileMax RAM usage

2.65.9632631m18s24s3m18s4.256 MB

2.55.9642881m24s32s3m39s3.839 MB

2.4.15.9632632m22s29s3m53s5.091 MB

2.45.9632632m1725s4m12s4.266 MB

2.35.9612631m47s33s4m10s4.073 MB

2.2.05.9612631m46s31s3m57s4.541 MB

2.1.45.9612631m19s59s3m54s4.359 MB

2.1.35.9602631m18s1m25s3m57s4.428 MB

2.16.1072631m52s1m2m39s3.040 MB

2.06.1132631m52s1m5m54s4.219 MB


1: The test environment got a disc encryption since the last performance tests. We assume that's why the large models take longer on writing/loading. Older versions of LemonTree now also need longer with that models on writing.

Measurement Methods

To understand the measurement methods we have used to compile this data or conduct measurements on your own model for a comparison, please refer to this page:

Measurement Methods

  • No labels