CY13-Q3 Community Analysis — OpenStack vs OpenNebula vs Eucalyptus vs CloudStack
This article is an update version of my previous article CY13-Q2 Community Analysis — OpenStack vs OpenNebula vs Eucalyptus vs CloudStack. Readers who are intested in further discussions please contact me via email at the above-mentioned address.
A Chinese version of this article is published at the same time, which can be found at CY13-Q3 OpenStack, OpenNebula, Eucalyptus, CloudStack社区活跃度比较.
It should be noted that this community analysis project was initiated in CY11-Q4, and this particular report is the 8th quarterly report being published since. The author served shortly as the Director of Customer Success in China for Eucalyptus Systems Inc during October 2012 and July 2013. However, the opinion presented in this report belongs strictly to the author rather than any current or previous employer of the author.
The objective of this article is to compare the OpenStack, OpenNebula, Eucalytpus and CloudStack user and developer communities, base on the communications between community members in the form of mailing lists or pubic forum discussions. The data being discussed include the total number of topics (threads), messages (posts), and participants (unique email addresses or registered members). To obtain the above-mentioned data, a Java program was written to retrieve all the forum posts and mailing list messages into a MySQL database for further processing. The analysis results were presented in the form of graphs generated by LibreOffice.
Starting from CY13-Q2, the OpenStack project kicked off the Ask.OpenStack discussing forum, which is now included as a data source for this analysis. It should be noted that there exists significant membership overlap between Ask.OpenStack and other OpenStack mailing lists and forums. In this CY13-Q3 report we carried out some preliminary de-duplication efforts for this data source, but certain amount of double counting still exists.
The Apache CloudStack graduated from the Apache incubator in CY13-Q2. The names of their mailing lists changed a little bit, but the membership and discussion scope remained the same. It should be noted that before this change there were a significant amount of message in the incubator-cloudstack-dev mailing list that were auto-generated by JIRA. Such messages became a lot less in the new cloudstack-dev mailing list. However, we still keep our previous filtering settings, which excludes any messages with “[jira]” in their topic.
Figure 1 and 2 represent the monthly number of topics (threads) and posts (messages). It can be seen that
(1) During the past 12 months, OpenStack-related discussions and CloudStack-related discussions were approximately on the same level, while Eucalyptus-related discussions and OpenNebula-related discussions were approximately on the same level.
(2) During the past 12 months, the volume of OpenStack and CloudStack related discussions were much higher than that of Eucalyptus and OpenNebula.
Generally speaking, the number of replies to a specific topic represents the attention being received, and the depth of discussion for that particular topic. When the number of master posts (the original post that started a particular topic) is more than the number of replies, it is safe to conclude that the participation of the forum or mailing list is very low. Therefore, the ratio between “the number of posts” and “the number of topics” represents the participation rate of an online community. In this study we call this ratio the Participation Ratio.
As can be seen from Figure 3, during the past 12 months the participation ratios of CloudStack and Eucalyptus were relatively higher, which were close to 4; the participation ratios of OpenStack and OpenNebula were relatively lower, which were a little bit higher than to 2.
We do notice that the concept of “participation ratio” generated some disagreements. Some people think that a lower “post-to-thread ratio” represents the ability to resolve problems in a very short time, therefore only a very limited number of discussions are needed. Some people think that a higher “post-to-thread ratio” might be an indicator that the community are on flame, and during a flame a large portion of the posts might be off-topic. Anyway, we agree that when we call this parameter “participation ratio” it somewhat represents our own opinion and it undermines the objectiveness of this report. However, because we do not find a better name to represent this parameter, we will just use it for the time being. (Dear readers, you are more than welcome to contribute a better name for this parameter.)
Figure 4 shows the number of monthly participants of the four projects being discussed. It can be seen that the number of active participants of OpenStack is much higher than the other three projects. The number of active participants of CloudStack is also significantly higher than OpenNebula and Eucalyptus. During the past 12 months, the number of active participants for OpenStack and CloudStack were growing steadily, while the number of active participants for Eucalyptus and OpenNebula exhibited no significant growth.
It should be noted that although the number of active participants of the CloudStack project is somewhat smaller than that of the OpenStack project, both projects have approximately the same amount of discussions (as shown in Figure 1 and Figure 2).
Accumulated Community Population refers to the total number of users and developers who have participated in forum or mailing list discussions. (This number does not include those who have registered into discussion forums or mailing lists but have never participated in any open discussions.) These are people who have tested or used a specific product for a while, but not necessary currently an active user.
Figure 5 shows the growth of the accumulated community populations of these 4 projects. Currently OpenStack has the larges accumulated community population, followed by Eucalyptus, CloudStack, and OpenNebule.
The problem is, after years of changes, a long-term (such as 4 to 5 years) accumulated community population might not be a good reference for community activeness. Some of the early members of one community might have switched to other communities (and probably more than once), some of the early community medium (such as mailing lists and forums) might have become EOL’ed. From a community analysis point of view, it might be better to count the accumulated community population of the past 6 to 12 months, while extending the range to the dinosaurs age will make this parameter meaningless.
Figure 6 shows the monthly population growth of the four projects being discussed. During the past 6 months, the populations of OpenStack is growing much faster than the other three projects. CloudStack is also exhibiting significant growth, but not as fast as OpenStack.
The populations of Eucalyptus and OpenNebula are growing at relatively slow paces, as compared to CloudStack and OpenStack.
Figure 7 is a combination of Figure 4 and Figure 6. The solid lines represent the monthly participants, while the dash lines represent the monthly new members.
During the past 12 months, for OpenStack and CloudStack, around 30% of their monthly participants are new members. For OpenNebula and Eucalyptus, around 50% of their monthly participants are new members. This indicates OpenStack and CloudStack communities are becoming more “sticky” than OpenNebula and Eucalyptus communities.
Figure 8 shows the total community population, active participants of the past quarter, and active participants of the past month, of the four projects being discussed. It can be seen that
(1) OpenStack has the largest total population, followed by Eucalyptus, CloudStack, and OpenNebula;
(2) OpenStack has the largest active population during the past quarter, followed by CloudStack, Eucalyptus, and OpenNebula;
(3) OpenStack has the largest active population during the past month, followed by CloudStack, Eucalyptus, and OpenNebula.
We also calculated the ratio of active population during the past quarter over total population. The result is 36.3% for OpenStack, 24.2% for CloudStack, 11.8% for OpenNebula, and 4.3% for Eucalyptus. Obviously a significant portion of OpenStack and CloudStack users choose to stay, while the majority of Eucalyptus users decide to leave. Such observation is in accordance with what we saw in Figure 7 – OpenStack and CloudStack communities are more “sticky” than OpenNebula and Eucalyptus communities.
In our CY12-Q3 report, we invented the concept of “Community Activeness Index”. Starting from CY13-Q3, we make some minor revision to this parameter, and it is now the combination of the following parameters:
(1) quarterly messages, which represents the volume of the discussions;
(2) quarterly participation ratio, which represents the average number of answers to a question; and
(3) active population of the past quarter, which represents the possibility to get help from community in the long term.
In this analysis, we choose the average values of these parameters as the reference data set, and compare the corresponding parameters of each community with the reference data set. Then we call the sum of the relative values of a community the “community activeness index” of the community. Now we can say the project with the highest “community activeness index” is THE most active project in this area.
As can be seen from Figure 9, OpenStack is currently THE most active project (with obvious advantage), followed by CloudStack, Eucalyptus, and OpenNebula.
We are seeing increasing number of suggestions to analyze the git activities of these open source IaaS projects. We also noticed that all of these four projects use git as the SVM for their source code. Starting from our CY13-Q1 report, we tried to do some basic analysis base on the git log data. It should be noted that for the OpenStack project, the data source includes all the sub-projects under openstack (57 sub-projects) and openstack-infra (33 sub-projects) on github.com.
In our CY13-Q1 report, we used “git log” to obtain log information. Starting from CY13-Q2, we will use “git log –no-merges” to obtain log information.
Figure 10 shows the monthly number of commit operations for these four projects. Generally speaking, the commit frequency of OpenStack is much higher than the commit frequencies of the other three projects. This is because the data source for OpenStack includes a total number of 90 sub-projects, which is far greater than the other three projects. The commit frequency of CloudStack is also significantly higher than Eucalyptus and OpenNebula. As compared to OpenNebula, Eucalyptus was also committing more frequently, but with significant fluctuations from month to month, which seems to be a typical batch-commit behavior. The commit frequency of the OpenNebula project is relatively small, with an average of 200 commits per month.
Figure 11 shows the monthly number of commit operations for the sub-projects of OpenStack. Generally speaking, the commit frequency of the Nova sub-project is about 3 times as high as the other sub-projects. It should be noted that although the commit frequency of these sub-projects are different, but they exhibit similar time-series curves, and their highs and lows occur at the same period of time. This indicates that although these sub-projects are relatively independent, but they work around the same development plan and the same release schedule. This is an indicator that the OpenStack project is well organized in terms of sub-project management.
Figure 12 shows the monthly number of contributors (identified by unique github.com accounts or email addresses) for these projects. Generally speaking, the number of OpenStack contributors is much higher than the other three projects, and is growing rapidly. The number of CloudStack contributors also exhibits some growth, but the growth is relatively slow. The number of Eucalyptus and OpenNebula contributors is relatively small, and does not exhibit growth during the past 12 months.
Figure 13 shows the monthly number of contributors (identified by unique github.com accounts) for the sub-projects of OpenStack. It can be seen that the number of Nova contributors is about 3 times as big as the other sub-projects.
People usually try to identify the institute to which a contributor belongs to by his/her email address. It is true that such method is defect in nature (different institutes have different policies regarding contributing to open source projects, some institutes even encourage their employees to contribute to open source projects with their personal account), but still this parameter can be used to show the contributions of certain institutes to certain open source projects. Figure 14 shows the monthly number of unique institutes (identified by the domain name of the contributor’s email address) contributing to these projects. We can see that the number of contributing institutes for OpenStack is much larger than the other three projects, and is growing rapidly. The number of contributing institutes for CloudStack is also growing, but at a relatively slow pace. The number of contributing institutes to Eucalyptus and OpenStack is relatively small, and does not exhibit any growth during the past 12 months.
Figure 15 shows the monthly number of contributing institutes to the sub-projects of OpenStack. It can be seen that the number of contributing institutes for Nova is about 3 times as big as the other sub-projects.
The following table lists those institutes that make the most contributions to these projects during CY13-Q3, according to the number of commit operations, along with the percentage of their commit operations. It can be seen that both Eucalyptus and OpenNebula are open source projects dominated by single institutes, while CloudStack and OpenStack are open source projects contributed by multiple institutes. For the CloudStack projects, influence from Citrix is still quite obvious, over 48% of the commits come from accounts belonging to citrix.com and cloud.com (3% decrease as compared to CY13-Q2). For the OpenStack project, redhat.com contributed to 15% of the commits, while ibm.com contributed 11% of the commits, hp.com contributed 5% of the commits, rackspace.com contributed 4% of the commits, and mirantis.com contributed 4% of the commits.
| CloudStack | Eucalyptus | OpenNebula | OpenStack | ||||
| Domain | % | Domain | % | Domain | % | Domain | % |
| citrix.com | 46 | eucalyptus.com | 50 | opennebula.org | 99.4 | redhat.com | 15 |
| apache.org | 23 | gmail.com | 40 | gmail.com | 0.3 | gmail.com | 14 |
| gmail.com | 12 | brainfood.com | 8 | tobru.ch | 0.3 | ibm.com | 11 |
| leaseweb.com | 3 | fedoraproject.org | 1 | openstack.org | 6 | ||
| cloud.com | 2 | hp.com | 5 | ||||
| schubergphilis.com | 2 | rackspace.com | 4 | ||||
| clogeny.com | 2 | mirantis.com | 4 | ||||
| widodh.nl | 1 | inaugust.com | 2 | ||||
| betterservers.com | 0.6 | suse.de | 2 | ||||
| ianduffy.ie | 0.6 | enovance.com | 1 | ||||
The following table lists those institutes that make the most contributions to the sub-projects of OpenStack during CY13-Q3, along with the percentage of their commit operations. We notice that UnitedStack – a nascent cloud computing startup – is making significant contributions to almost all aspects of OpenStack. We also notice that Intel is beginning to contribute code to OpenStack. We all know that Intel is a firm supporter of OpenStack since the formation of the OpenStack project. In the early days Intel used to maintain a fork of an earlier version of OpenStack, which prevented Intel from contributing to the mainstream. Obviously the Intel folks now realize that it is better to join the mainstream than working on an in-house version of OpenStack.
| Cinder | Glance | Horizon | Keystone | ||||
| Domain | % | Domain | % | Domain | % | Domain | % |
| ibm.com | 14 | rackspace.com | 22 | da.jp.nec.com | 17 | ibm.com | 33 |
| hp.com | 14 | gmail.com | 21 | redhat.com | 15 | gmail.com | 12 |
| gmail.com | 9 | ibm.com | 18 | gmail.com | 13 | redhat.com | 11 |
| solidfire.com | 8 | hp.com | 9 | hp.com | 11 | metacloud.com | 7 |
| mirantis.com | 7 | redhat.com | 7 | mirantis.com | 7 | 99cloud.net | 5 |
| intel.com | 7 | intel.com | 3 | metacloud.com | 4 | hp.com | 4 |
| openstack.org | 6 | dmllr.de | 2 | strikeawe.com | 3 | marantis.com | 3 |
| redhat.com | 4 | 99cloud.net | 2 | gmx.de | 2 | inaugust.com | 3 |
| unitedstack.com | 3 | outlook.com | 2 | b1-systems.de | 2 | openstack.org | 3 |
| canonical.com | 3 | canonical.com | 1 | unitedstack.com | 1 | unitedstack.com | 2 |
| Nova | Neutron | Swift | |||||
| Domain | % | Domain | % | Domain | % | ||
| ibm.com | 26 | gmail.com | 19 | gmail.com | 36 | ||
| redhat.com | 14 | openstack.org | 16 | redhat.com | 20 | ||
| gmail.com | 11 | nicira.com | 11 | swiftstack.com | 8 | ||
| mirantis.com | 6 | mirantis.com | 8 | enovance.com | 7 | ||
| rackspace.com | 5 | cisco.com | 7 | kotori.zaitcev.us | 5 | ||
| codestud.com | 4 | ibm.com | 4 | unitedstack.com | 2 | ||
| intel.com | 4 | unitedstack.com | 3 | not.mn | 2 | ||
| vmware.com | 3 | redhat.com | 3 | dmllr.de | 2 | ||
| citrix.com | 1 | da.jp.nec.com | 2 | brim.net | 2 | ||
| canonical.com | 1 | dreamhost.com | 2 | hp.com | 1 | ————————- | — |
For your convenience, a PDF version of this presentation can be downloaded from here. Please kindly keep the author information if you want to redistribute the content.
A SIDE NOTE
Because of the increasing level of social instability in China, I am seriously looking for the opportunity to continue my career in cloud computing outside of China. If your company is looking for an experienced person to work on technology evangelism, community management, marketing and communication, or business development, please kindly let me know and let’s see whether there is any possibility to cooperate. Yes I do need your company to provide assistance to apply for a work permit (such as H1B in the US, or sub-class 457 in Australia, or whatever applicable) in your country. Should your company provide the option to work from remote, I can get started in China before moving to your country. Furthermore, I do not request your company to cover the relocation expense for me and my family.
You are welcome to take a look at my professional profile on LinkedIn, with recommendations from my previous employers. An updated version of my resume (PDF version) is also available for your reference.
I can be reached via email (qjiang@ieee.org), or video interview via Skype.
Themocracy
[…] 本文同时发布了一个英文版本，可以参见CY13-Q3 Community Analysis — OpenStack vs OpenNebula vs Eucalyptus vs CloudStack这个帖子。 […]
[…] to rise. Qingye Jiang (John) tracks trends associated with open source IaaS communities, and his most recent edition shows that the hyperbolic growth of OpenStack (measured by monthly Git contributors) is sustaining, […]
[…] to rise. Qingye Jiang (John) tracks trends associated with open source IaaS communities, and his most recent edition shows that the hyperbolic growth of OpenStack (measured by monthly Git contributors) is sustaining, […]
[…] 本文同时发布了一个英文版本，可以参见CY13-Q3 Community Analysis — OpenStack vs OpenNebula vs Eucalyptus vs CloudStack这个帖子。 […]
What’s up to all, the contents existing at this web page are genuinely awesome for people knowledge, well, keep up the nice work fellows.
Greetings! This is my first comment here so I just wanted to give a quick
shout out and tell you I really enjoy reading your blog posts.
Can you suggest any other blogs/websites/forums that deal with the same subjects?
Thanks for your time!
I like the valuable info you provide for your articles.
I will bookmark your weblog and take a look at once more right here frequently.
I am relatively sure I’ll be told plenty of new
stuff proper here! Good luck for the next!
I’m not that much of a online reader to be honest but your
blogs really nice, keep it up! I’ll go ahead and bookmark
your website to come back later. Many thanks