Jump to: navigation, search

Rally/UpdatesFebruary2014

< Rally
Revision as of 06:58, 14 April 2014 by Mikhail Dubov (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Weekly updates - February 2014

February 24, 2014

Hello stackers,

this week, several important contributions have been made to Rally, considering both the overall system stability and the improvements of the user interface. To name a few:

  • Vast refactoring of the ScenarioRunner class has enabled to stop sharing OpenStack clients objects between processes in the core of the system, which occasionally caused bugs in Rally (https://review.openstack.org/#/c/74769/);
  • Another important refactoring step resulted in the replacement of OpenStack endpoint dictionaries with special objects throughout the system, which has made the code more reliable and extendable (https://review.openstack.org/#/c/74425/);
  • Perhaps the prettiest patch of the week was the introduction of a benchmark result visualization tool, implemented with the nvd3 plugin to d3.js (so that the actual charts are drawn to a html file). The graphs look really nice and will be of great use for those who want to share their benchmarking results (https://review.openstack.org/#/c/72970/);
  • Several nice improvements in the CLI include the showing of 90- and 95- percentile results in the benchmark summary (https://review.openstack.org/#/c/73522/) and a new show command which allows the user to get the information on images/flavors/networks/etc. available in the current deployment in a very quick way (https://review.openstack.org/#/c/75699/).


The ongoing work includes:

  • An extention of the use command which will be applicable soon not only to deployments but also to tasks (https://review.openstack.org/#/c/75936/);
  • Further refactoring of the core benchmark engine, including the work around input configuration parameters validation (for a detailed description of what's going to be done, see this special document);
  • After finishing some major refactoring procedues, we have also resumed the work around passing pre-created user endpoints to the DummyEngine (https://review.openstack.org/#/c/67720/) and generating the "stress" load on the cloud.


We encourage you to take a look at new patches in Rally pending for review and to help us making Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=icehouse&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team


February 17, 2014

Hello stackers,

the first thing we would like to mention today is an extensive piece of work that has been done recently on our Wiki. We have updated both the main page and the basic tutorials: how to install Rally and how to use it. These tutorials have been simplified quite a lot and have been updated with new features that have been merged in Rally recently.

As for the actual updates in the Rally code, the main ones are as follows:

  • The refactoring of the ScenarioRunner class has been successfully continued by reimplementing different benchmark execution strategies (continuous/periodic executions), which resided previously inside the original class, via subclassing. The new ContinuousScenarioRunner and PeriodicScenarioRunner classes enable us to make the code much more readable (no more complicated if...else logic to choose the appropriate execution strategy is present in the code) and extendable, so that it is now very easy to add your own ScenarioRunner (https://review.openstack.org/#/c/70771/);
  • We've successfully started the work on Tempest & Rally integration in order for the latter to be able to perform OpenStack deployment verification procedures as well as to possibly add new Tempest-based benchmark scenarios (https://review.openstack.org/#/c/70131/);
  • On the way to adding a full support for benchmarking with predefined OpenStack users (instead of using the generated ones), we've refactored the Endpoint entity, making it able to distinguish between administrator/user permisisons. Besides, each deployment gets now stored in the database with a list of endpoints instead of only one endpoint, since we are going to enable the DummyEngine to take several endpoints as its input (https://review.openstack.org/#/c/67154/);
  • One of the future features of Rally will be Heat-based benchmark scenarios which will make it possible to test the VMs performance. This week, we have started contributing to this as well (https://review.openstack.org/#/c/72749/);
  • Among many other simplier refactoring patches finished this week, we'd like to mention the one that improves the CLI code by structuring it to submodules (https://review.openstack.org/#/c/73059/).


The ongoing work includes:


We encourage you to take a look at new patches in Rally pending for review and to help us making Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=icehouse&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team


February 10, 2014

Hello stackers,

the past week has been extremely successful for us regarding the overall Rally code improvement, bugfixing, as well as new features implementation. Rally is actually about to become a totally easy-to-understand and easy-to-use piece of software which can be exploited by everyone interested in it.

The most important contributions to Rally made during the past week are as follows:

  • The code refactoring stuff has been quite involved:
  • We have issued a drastic rearrangement of the ScenarioRunner class (that is responsible for the actual benchmark method calls using a particular benchmarking strategy) by moving out some code from this class to new context classes. This change also enabled Rally to process all errors occuring on the cloud during benchmarking/cleanup correctly (https://review.openstack.org/#/c/69886/);
  • Another significant contribution is the sshutils module refactoring, which involves the API improvement as well as the new ability to process the stdin data (https://review.openstack.org/#/c/68063/);
  • Finally, a very nice work has been done on the benchmark scenarios refactoring by moving the hardcoded timeout and cloud poll interval values to rally.conf (https://review.openstack.org/#/c/71272/).


The current work encompasses the following directions:


We encourage you to take a look at new patches in Rally pending for review and to help us making Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=all&metric=commits&project_type=All&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team


February 3, 2014

Hello stackers,

our efforts during the past week were heavily focused on code refactoring and bugfixing. Among the most significant contrubutions are:


Several novelties have been introduced to Rally:

  • After having developed the abstract validators mechanism, we have developed a couple of useful concrete validators as well: the one that checks that the image indicated in the config for, say, the NovaServers.boot_and_delete_server benchmark scenario really exists and can be used (https://review.openstack.org/#/c/68055/) and another validator that does the same for flavors (https://review.openstack.org/#/c/70082/). Both validators have been attached to benchmark scenarios where they are of great use.
  • We've implemented the mechanism of measuring the time taken by atomic actions in our benchmark scneario (https://review.openstack.org/#/c/69828/): e.g. now Rally outputs not only the information on how long it took the cloud to boot and delete a single server (in the NovaServers.boot_and_delete_server scenario), but also how much time it took to boot the server and to delete it.


This week there is still a huge amount of work to be done around refactoring the very fundamental code in Rally. Among other things, we now rewrite the ScenarioRunner class which is the tool for launching benchmark scenarios (https://review.openstack.org/#/c/69886/) so that its functionality gets split into several context classes (responsible for temporary users management and resource cleanup after benchmarking), and also implementing different scenario launching strategies via inheritance (https://review.openstack.org/#/c/70771/).

We continue implementing new features in Rally as well. One example is the ongoing work on atomic actions runtime measurement: it is about to be supported by the CLI which will now display this detailed runtime information in a user-friendly way (https://review.openstack.org/#/c/70362/).


We encourage you to take a look at new patches in Rally pending for review and to help us making Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=all&metric=commits&project_type=All&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team

Retrieved from "https://wiki.openstack.org/w/index.php?title=Rally/UpdatesFebruary2014&oldid=48565"