Jump to: navigation, search

Difference between revisions of "Rally/Updates"

(Weekly update 23.06.2014)
Line 1: Line 1:
 
== Weekly updates ==
 
== Weekly updates ==
 +
 +
 +
==== July 07, 2014 ====
 +
 +
Hello stackers,
 +
 +
here is the update for the last weeks. From all the work we've completed we would like to highlight the following:
 +
 +
* New benchmark scenarios:
 +
:* Benchmark to [https://review.openstack.org/#/c/89326 validate a ""keystone"" token N times at service endpoint];
 +
:* [ https://review.openstack.org/#/c/93739 ""Neutron"" benchmarks scenario for creating and listing ports].
 +
* [https://review.openstack.org/#/c/89555 Add nova floating ip management in VM scenario];
 +
* [https://review.openstack.org/#/c/95353 Add image context class];
 +
* [https://review.openstack.org/#/c/99304 Large update of documentation];
 +
* [https://review.openstack.org/#/c/98158 Add service-level agreement checking];
 +
* [https://review.openstack.org/#/c/103706 Use oslo.db module and remove rally/openstack/common/db].
 +
 +
The main directions of our current work are as follows:
 +
 +
Current work includes such interesting novelties as [https://blueprints.launchpad.net/rally/+spec/benchmark-context-semantic-validation context semantic validation], [https://review.openstack.org/#/c/102363 periodic runner refactoring], [https://review.openstack.org/#/c/102853 "rally info" command] which prints descriptions for different entities in Rally, [https://review.openstack.org/#/c/97556 checking if required services are available before starting the scenario] and refactoring of validation system, continue work on [https://review.openstack.org/94806 "stress" runner].
 +
 +
We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.
 +
 +
Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
 +
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
 +
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z
 +
 +
 +
Stay tuned.
 +
 +
 +
Regards,
 +
The Rally team
  
  

Revision as of 20:36, 7 July 2014

Weekly updates

July 07, 2014

Hello stackers,

here is the update for the last weeks. From all the work we've completed we would like to highlight the following:

  • New benchmark scenarios:

The main directions of our current work are as follows:

Current work includes such interesting novelties as context semantic validation, periodic runner refactoring, "rally info" command which prints descriptions for different entities in Rally, checking if required services are available before starting the scenario and refactoring of validation system, continue work on "stress" runner.

We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards, The Rally team


June 23, 2014

Hello stackers,

here is a quick overview of the major contribution in Rally made over the past week:

  • New benchmark scenarios:


Current work includes such interesting novelties as the new "stress" scenario runner that generates a growing load until it breaks the cloud, new contexts: Image (boots VMs before benchmarking) and NeutronNetwork (adds pre-created networks) and many others. Also note that there will be soon a large update in the ReadTheDocs Rally page that will make it much more user-oriented.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team


June 16, 2014

Hello stackers,

during the past week, our work has primarily been concentrated on minor bugfixes and enhancements in different parts of Rally. These include:

  • Aggregated tables for atomic action runtimes are now available not only in the CLI, but also in the HTML output (generated by the $ rally task plot2html ... command). Let us remind that atomic actions are basic procedures that benchmark scenarios consist of (such as booting a server in Nova or deleting a user in Keystone).
  • The docs section of Rally has been extended with the so-called "User stories", which describe use cases of Rally in the real world, some results obtained by Rally as well as their analysis. The first user story is about token creation under different load in Keystone.
  • Bugfixes include:


Current work includes such interesting novelties as the new "stress" scenario runner that generated a growing load until it breaks the cloud, the new Image context that boots VMs before benchmarking and many others.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team


June 2, 2014

Hello stackers,

one of the most pleasant news for the past week is the appearance of a brand new Rally ReadTheDocs page, where all the docs from the Rally repository are available in a human-readable format.

As for recent patches merged to Rally, so let's pick up the most interesting ones:


Among new interesting patches being on their way to Rally, let's mention a filesystem benchmark (that will be launched inside created servers), new context classes for creating images and Neutron networks before launching becnhmarks, and many others.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



May 26, 2014

Hello stackers,

the interesting contributions to Rally during the past week comprise:

  • Yet another set of new benchmark scenarios: this time, for Ceilometer Resources GET API;
  • Documentation for the recently merged plugins functionality (let us remind you that this mechanism enables the developers to extend Rally with new scenarios in an easy way, without actually contributing to the Rally code);
  • There is now a new syntax for marking blocks of benchmark scenarios code that should be timed by Rally as atomic actions (their runtime statistics is available in the detailed results output after benchmarking completes). This syntax is based on the with-clause in Python and enables the developers to write constructs like with AtomicAction(scenario, "name_of_action"): <do_smth>, which tends to be much simpler in many cases that marking entire methods with a special @atomic_action_timer decorator (the previous approach).


This week, our contribution to Rally is going to be continued with new benchmark scenarios (e.g. those for Celiometer Statistics), several refactoring patches (e.g. aimed at somewhat more frequent usage of the Oslo code) and many others.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



May 19, 2014

Hello stackers,

during the OpenStack Summit in Atlanta we still have accomplished several important contributions to Rally:

  • Another set of new benchmark scenarios in Rally includes those for:
  • Important bugfixes have been issued for:
  • Finally, pretty much work has been done on code refactoring, such as:


Among the most interesting patches being either in progress of ready for review, let's mention more benchmark scenarios for Neutron, Heat and Ceilometer, further improvements in the CLI code, and also the work on the extended input config format which will allow the end-user to put resource names there (e.g. image names to boot servers from) instead of concrete IDs.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



May 12, 2014

Hello stackers,

here's what has happened in the project during the past week:


Despite the ongoing OpenStack Summit in Atlanta, we still have ambitious plans for this week, which include adding more benchmark scenarios (Heat, Neutron, Ceilometer etc.), working on code runtime efficiency improvements, improving the code for drawing plots and so on.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



May 05, 2014

Hello stackers,

due to holidays there hasn't been very much contribution to Rally during the past week. The highlights are as follows:


There is going to be much work this week that includes adding new benchmark scenarios (e.g. for Tempest, Neutron and Ceilometer), further improvements in CLI and graphs and also several bugfixes.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



April 28, 2014

Hello stackers,

the most important changes during the past week in Rally have been concentrated on creating completely new benchmark scenario classes and adding support for new contexts. To be more precise:


This week, we'll continue our work on expanding the range projects supported by our benchmarks. Benchmark scenarios already pending for review are those for Heat, Ceilometer and also Tempest. The ongoing work also includes several improvents in the overall user experience, e.g. changes in the CLI output format.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



April 21, 2014

Hello stackers,

here is the report of our recent activities in Rally. They have been quite numerous this week due to the contributions of our constantly growing team and include a couple of changes that touch the end user:

  • The scenario runner previously known as continuous has been split to 2 scenario runners named constant and constant_for_duration, thus becoming more "atomic" (previously, the continuous scenario runner was able to run scenarios both for the specified amount of times and for some duration. These two types of behaviour now belong to different runners). "Constant" means that both scenario runners generate a constant load on the cloud;
  • Several changes in the input configuration files formats include:
  • Several improvements in context classes:


This week, we continue our work on new benchmark scenarios for Tempest and quotas, new contexts as well as on many other improvements in Rally.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=juno&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



April 14, 2014

Hello stackers,

let us list our main contributions to Rally during the past week:


This week, our work continues with several new benchmark scenarios (including those for Tempest), new validators and also new functionality in the Rally core, e.g. the ability to use already existing tenants/users for benchmarking, implemented now through contexts.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=icehouse&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team



April 7, 2014

Hello stackers,

our contributions this week have been pretty diverse and touched different parts of Rally. Let us name a few that seem to be the most interesting ones:


There are also other parts of Rally which are in progress now and will hopefully have their patches merged the next week, e.g. the work on Tempest integration or further context classes implementation.


We encourage you to take a look at new patches in Rally pending for review and to help us make Rally better.

Source code for Rally is hosted at GitHub: https://github.com/stackforge/rally
You can track the overall progress in Rally via Stackalytics: http://stackalytics.com/?release=icehouse&metric=commits&project_type=all&module=rally
Open reviews for Rally: https://review.openstack.org/#/q/status:open+rally,n,z


Stay tuned.


Regards,
The Rally team


Archives