benchmarking

Benchmarking query technologies in EMF based model-validation scenarios

Model Driven Development systems exploit the benefit of instance model validation and model transformation. Ever-growing model sizes used for example in critical embedded systems development require more and more efficient tools. The most time consuming step during model validation or model transformation is the model query step. This benchmark aims to measure batch style query and incremental style query performance of existing EMF based tools.

Read more

Efficient Instance-level Model Validation by Incremental Query Techniques - preliminary

Model Driven Development systems exploit the benefit of instance model validation and model transformation. Ever-growing model sizes used for example in critical embedded systems development require more and more efficient tools. The most time consuming step during model validation or model transformation is the model query step. This benchmark aims to measure batch style query and incremental style query of existing OWL (or RDF) and EMF based tools.

Read more

A Benchmark Evaluation of Metrics for Graph Query Performance Prediction

Queries are the foundations of data intensive applications. In model-driven software engineering (MDSE), model queries are core technologies of tools and transformations. As software models are rapidly increasing in size and complexity, most MDSE tools frequently exhibit scalability issues that decrease developer productivity and increase costs. As a result, choosing the right model representation and query evaluation approach is a significant challenge for tool engineers. In the current paper, we aim to provide a benchmarking framework for the systematic investigation of query evaluation performance.

More specifically, we experimentally evaluate (existing and novel) query and instance model metrics to highlight which provide sufficient performance estimates for different MDSE scenarios in various model query tools. For that purpose, we also present a comparative benchmark, which is designed to differentiate model representation and graph query evaluation approaches according to their performance when using large models and complex queries.

Attachment:

ase13 Spider Charts

Read more

IncQuery MoDisco Benchmark

Introduction

The benchmark presented on this page is provided by the developers of the Epsilon tool and it applies model queries to find class properties in existing Java classes. A class property is a variable with name X that has two corresponding methods in the same class, with name getX/setX or isX/setX.