Wiki source code of Project Health

Last modified by Vincent Massol on 2018/06/04 14:44
Hide line numbers
  1: This page lists various metrics related to the development of the XWiki project.
  2: 
  3: {{toc/}}
  4: 
  5: You can also browse the [[old Project Health page>>ProjectHealthOld]].
  6: 
  7: = Metric Sites =
  8: 
  9: There are several sites on the web analyzing the XWiki project and providing metrics:
 10: 
 11: * [[Ohloh>>https://www.ohloh.net/p/xwiki]]
 12: * [[Bitergia Report for 2014-01>>http://bitergia.com/public/previews/2014_01_fosdem/xwiki/browser/]]
 13: * Sonar:
 14: ** [[Sonar @ xwiki.org>>http://sonar.xwiki.org/]]
 15: ** [[Sonar Nemo for XWiki Commons>>http://nemo.sonarqube.org/dashboard/index/321369?did=1]]
 16: ** [[Sonar Nemo for XWiki Rendering>>http://nemo.sonarqube.org/dashboard/index/org.xwiki.rendering:xwiki-rendering?did=1]]
 17: * [[SVNSearch>>http://svnsearch.org/svnsearch/repos/XWIKI/search]] (till 2011 when XWiki moved from SVN to Git)
 18: * [[GitHub>>https://github.com/orgs/xwiki/dashboard]]:
 19: ** [[XWiki Commons graphs>>https://github.com/xwiki/xwiki-commons/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-commons/pulse/monthly]])
 20: ** [[XWiki Rendering graphs>>https://github.com/xwiki/xwiki-rendering/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-rendering/pulse/monthly]])
 21: ** [[XWiki Platform graphs>>https://github.com/xwiki/xwiki-platform/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-platform/pulse/monthly]])
 22: ** [[XWiki Enterprise graphs>>https://github.com/xwiki/xwiki-enterprise/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-enterprise/pulse/monthly]])
 23: 
 24: = Active Installs =
 25: 
 26: See [[dedicated page for Active Installs>>xwiki:ActiveInstalls.WebHome]].
 27: 
 28: = Downloads =
 29: 
 30: **Downloads for the WAR + HSQLDB packagings**:
 31: 
 32: {{chart type="bar" source="inline" params="range:B2-B14;series:columns;" title="XWiki Downloads (WAR+HSQLDB)" width="640" height="300"}}
 33: |=Year|=Downloads|=Notes
 34: |2005|19020|
 35: |2006|62079|
 36: |2007|56614|
 37: |2008|132424|
 38: |2009|256644|
 39: |2010|257633|
 40: |2011|174161|
 41: |2012|276281|
 42: |2013|242963|
 43: |2014|367989|
 44: |2015|353080|
 45: |2016|247291|
 46: |2017|232000|Extrapolated from data from 18 July 2016
 47: {{/chart}}
 48: 
 49: Source:
 50: 
 51: * From [[OW2 Download stats>>http://stats.ow2.org/downloadStats/]] (requires credentials)
 52: * These download figures contain [[all the distributions provided by XWiki on OW2>>http://forge.ow2.org/project/showfiles.php?group_id=170]].
 53: 
 54: Interpretation:
 55: 
 56: * At one point we had more distributions (workspaces, xeclipse, xoffice, xwatch, etc) and this could have lead to more downloads
 57: * Since XWiki 3.3 we now have a [[Debian distribution>>platform:AdminGuide.InstallationViaAPT]] (.DEB), installable through [[APT>>http://en.wikipedia.org/wiki/Advanced_Packaging_Tool]] and we don't count those downloads in the figures above. They could account for an important part, we would need to retrieve their stats.
 58: * Since XWiki 8.4 we now have [[Docker images>>https://hub.docker.com/_/xwiki/]] too.
 59: * These download figures need to be correlated with the [[Active Installs>>xwiki:ActiveInstalls.WebHome]].
 60: * These downloads do not count XWiki Extensions.
 61: * The majority of XARs are downloaded from the Extension Manager and are not counted in these stats.
 62: 
 63: **Corrected Graph**:
 64: 
 65: We're using the [[Active Install Distribution proportions>>xwiki:ActiveInstalls.DistributionData]] to correct the download figure above. 
 66: 
 67: Note that the Distribution data are only retrieved for XWiki 8.4.4+ so the corrections make sense only from 2017+ and they only been applied from 2017 forward.
 68: 
 69: {{chart type="stackedbar" source="inline" params="range:B2-C14;series:columns;" title="XWiki Downloads (Total)" width="640" height="300"}}
 70: |=Year|=Downloads|=Correction|=Notes
 71: |2005|19020|0|
 72: |2006|62079|0|
 73: |2007|56614|0|
 74: |2008|132424|0|
 75: |2009|256644|0|
 76: |2010|257633|0|
 77: |2011|174161|0|
 78: |2012|276281|0|
 79: |2013|242963|0|
 80: |2014|367989|0|
 81: |2015|353080|0|
 82: |2016|247291|0|
 83: |2017|232000|154000|Extrapolated, based on 60% of XAR+HSQLDB and 40% other (ie from ActiveInstalls.DistributionData)
 84: {{/chart}}
 85: 
 86: Interpretation:
 87: 
 88: * Based on the corrected graph, we're actually increasing the number of downloads of XWiki overall!
 89: 
 90: {{comment}}
 91: = Active Installs =
 92: 
 93: {{velocity}}
 94: {{chart type="line" source="xdom" params="document:xwiki:ActiveInstalls.ActiveInstallsHistoryData;range:B2-B.;series:columns" width="800"/}}
 95: {{/velocity}}
 96: 
 97: Source:
 98: 
 99: * Elastic Search for xwiki.org, see the raw data using the [[Kibana UI>>http://activeinstalls.xwiki.org/kibana3/]]
100: * See also the XWiki [[Active Installs page>>xwiki:ActiveInstalls.WebHome]] for more details.
101: 
102: Interpretation:
103: 
104: * Lists all XWiki installs that have sent a ping in the last 24 hours
105: * Do not count installs behind firewalls and that cannot access xwiki.org
106: {{/comment}}
107: 
108: = Mailing Lists Activity =
109: 
110: {{chart type="xy_line_and_shape" params="range:B2-C12;dataset:timetable_xy;domain_axis_type:date;domain_axis_date_format:dd-MM-yyyy;date_format:dd-MM-yyyy;time_period:month;range_axis_lower:700;range_axis_upper:7000" width="640" height="300"}}
111: |=Date|=Users|=Devs
112: |30-06-2006|1576|823
113: |30-06-2007|2091|2079
114: |30-06-2008|4842|4386
115: |30-06-2009|3777|5829
116: |30-06-2010|4629|5799
117: |30-06-2011|3156|3990
118: |30-06-2012|3061|3695
119: |30-06-2013|2620|3130
120: |30-06-2014|1974|1715
121: |30-06-2015|2108|1860
122: |30-06-2016|2441|2302
123: {{/chart}}
124: 
125: Source:
126: 
127: * [[XWiki's Markmail archives>>http://xwiki.markmail.org/]]
128: * For example, [[data between 30-06-2013 and 30-06-2014>>http://xwiki.markmail.org/search/?q=date%3A20130630-20140630]]
129: 
130: Interpretation:
131: 
132: * Either less users since July 2010 or the product is easier to use
133: * Either less devs since July 2010 or they're asking less questions (more proficient?)
134: 
135: = Commit Activity =
136: 
137: Commits for Platform, Enterprise, Manager, Commons, Rendering, XOffice, XEclipse, XWatch, XWorkspaces:
138: 
139: {{chart type="bar" source="inline" params="range:B2-B10;series:columns;" title="Commits" width="640" height="300"}}
140: |=Date|=Downloads|=Notes
141: |30-06-2008|6262|Found using svnsearch
142: |30-06-2009|7503|Found using svnsearch
143: |30-06-2010|6803|Found using svnsearch
144: |30-06-2011|7605|Found using svnsearch(Data from 9 months from svn, extrapolated to 12 months since we moved to git but using git data is misleading since git introduces more commits)
145: |30-06-2012|4387|Found using Git
146: |30-06-2013|3699|Found using Git
147: |30-06-2014|3295|Found using Git
148: |30-06-2015|3524|Found using Git
149: |30-06-2016|2864|Found using Git
150: |30-06-2017|2363|Found using Git
151: {{/chart}}
152: 
153: Commits for Contrib:
154: 
155: {{chart type="bar" source="inline" params="range:B2-B5;series:columns;" title="Commits" width="640" height="300"}}
156: |=Date|=Downloads|=Notes
157: |30-06-2008|55|Found using svnsearch
158: |30-06-2009|1113|Found using svnsearch
159: |30-06-2010|1023|Found using svnsearch
160: |30-06-2011|1009|Found using svnsearch(Data from 9 months from svn, extrapolated to 12 months since we moved to git but using git data is misleading since git introduces more commits)
161: {{/chart}}
162: 
163: Source:
164: 
165: * [[SVNSearch>>http://svnsearch.org/svnsearch/repos/XWIKI/search]] and Git/GitHub
166: * To compute all commits between 2 dates in Git: {{code language="none"}}git rev-list HEAD --count --since="2011-06-30" --until="2012-06-30"{{/code}}
167: 
168: Interpretation:
169: 
170: * See also the [[Commit Activity on Ohloh>>https://www.ohloh.net/p/xwiki/commits/summary]] which also shows a small commit slowdown since 2011 (i.e. since we moved to Git)
171: * Starting in 2011 we moved to Git (we were using SVN before) and this could have caused some difference in # of commits. For example sandbox and contrib code was moved in different Git repositories. In addition it's possible that using Git generates less commits because with SVN merges were a pain and thus devs were committing very frequently to not have to perform merges... ;)
172: * Some projects have been deprecated and moved to contrib such as XEclipse, XWatch, XOffice, Workspaces, XEM, etc and this has probably resulted in reduced commits
173: * We had 7605 commits in 2011 means about 20 commits/day. This is to be compared to [[other well known projects in 2011>>http://openlife.cc/blogs/2010/november/how-grow-your-open-source-project-10x-and-revenues-5x]]:(((
174: |=Project|=Commits per year|=Commits per day
175: |Gnome|36500|100
176: |Linux|47450|130
177: |Drupal|48545|133
178: |KDE|109500|300
179: 
180: Classification:
181: 
182: |=Category
183: |=XtraLarge
184: 1000+ devs
185: 100+ commits/day|Linux, KDE, Apache, Eclipse, Perl+CPAN, Drupal, Gnome
186: |=Large
187: 20-200 devs
188: 50-100 commits/day|MySQL, Qt, OpenOffice, Mono, JBoss
189: |=Medium|GIMP, SVN, wordpress
190: )))
191: * [[Comparison between XWiki, Foswiki and MediaWiki on Ohloh>>https://www.ohloh.net/p/compare?project_0=XWiki&project_1=Foswiki&project_2=MediaWiki]]
192: 
193: = Source Contributors =
194: 
195: {{image reference="committers.png"/}}
196: 
197: Source:
198: 
199: * [[Oloh Contributor Report>>https://www.ohloh.net/p/xwiki/contributors/summary]]
200: 
201: Analysis:
202: 
203: * For the full list of committers and their stats see also the [[Hall of Fame>>HallOfFame]].
204: * Seems the number of contributors has been steadily increasing till mid 2011 and from then on it's pretty stable between 8 to 15 different contributors each month.
205: * Thomas Mortagne is increasing his lead and is moving towards a 30% commit share for all times (27% ATM and 30% for 2015)
206: * Sergiu has reduced his participation, that's too bad! Come back Sergiu :)
207: * Jean-Vincent has left the project and is no longer active unfortunately
208: * Vincent is reducing slightly from 20% all time to 17% for 2015
209: * Marius is stable at 9%
210: * Guillaume is increasing: from 2% all time to 15% for 2015
211: * Eduard is also increasing: from 2% all time to 10% for 2015
212: * Pretty stable in # of core committers (but this doesn't take into account the activity on contrib! We need to find a way to analyze this).
213: 
214: = Issues Activity =
215: 
216: {{chart type="stackedbar" source="inline" params="range:B2-F13;series:columns;" title="Closed Issues per year" width="800" height="300"}}
217: |=Date|=Bugs|=Improvements|=New Features|=SubTasks|=Tasks
218: |30-06-2006|35|2|0|1|6
219: |30-06-2007|778|211|55|133|160
220: |30-06-2008|1317|445|183|540|309
221: |30-06-2009|1930|430|121|425|320
222: |30-06-2010|1134|398|89|84|315
223: |30-06-2011|776|407|128|44|255
224: |30-06-2012|670|406|92|113|219
225: |30-06-2013|968|333|63|63|175
226: |30-06-2014|860|464|69|7|159
227: |30-06-2015|884|642|98|92|213
228: |30-06-2016|759|472|85|5|238
229: |30-06-2017|581|334|51|4|197
230: {{/chart}}
231: 
232: Source:
233: 
234: * [[XWiki's JIRA>>https://jira.xwiki.org]]
235: * JQL example for 2012-06-30: {{code language="none"}}resolution = Fixed AND resolved >= 2011-06-30 AND resolved <= 2012-06-30 AND type = Bug{{/code}}
236: 
237: Analysis:
238: 
239: * Activity has been stable for the past few years. This needs to be correlated with [[the size of the team>>||anchor="HSourceContributors"]] which has also remained stable during the same period.
240: * In the 5.x cycle (From December 2012 to December 2013) we've increased a lot the number of bugs fixed thanks to our [[BFD strategy>>Community.XWikiDays]] (one per week during this period). In the 6.x cycle (Jan 2014 to Dec 2014) we've reduced this by doing other types of XWiki Days but still doing BFDs to keep bugs at bay.
241: 
242: = Bugs Killing =
243: 
244: Number of bugs closed vs bugs created over the past 1600 days:
245: 
246: July 2015:
247: 
248: {{image reference="bugs-july-2015.png"/}}
249: 
250: Source:
251: 
252: * [[JIRA Created bugs vs Closed bugs>>https://jira.xwiki.org/secure/Dashboard.jspa?selectPageId=10352#Created-vs-Resolved-Chart/13610]]
253: 
254: Analysis:
255: 
256: * [[BFD>>Community.XWikiDays]] is working great so far, we're keeping up!
257: 
258: = l10n Activity =
259: 
260: {{chart type="bar" source="inline" params="range:B2-B6;series:columns;" title="l10n modified translation keys" width="640" height="300"}}
261: |=Year|=Modified keys|=Notes
262: |2011|14939
263: |2012|20367
264: |2013|11808
265: |2014-06-30|29450|114 Hareketi has 21K but seems he saved 6 times for each key he really modified!
266: |2015-06-30|8747
267: {{/chart}}
268: 
269: {{chart type="bar" source="inline" params="range:B2-B6;series:columns;" title="l10n Contributors" width="640" height="300"}}
270: |=Year|=Contributors
271: |2011|34
272: |2012|28
273: |2013|65
274: |2014-06-30|30
275: |2015-06-30|26
276: {{/chart}}
277: 
278: Source:
279: 
280: * http://l10n.xwiki.org
281: * [[Example query>>http://l10n.xwiki.org/xwiki/bin/view/L10NCode/BestContributorsSheet?lowerBound=20130630&upperBound=20140630]]
282: 
283: Analysis:
284: 
285: * User "114 Hareketi" has 21K in from 2013-06-30 to 2014-06-30 but seems he saved 6 times several keys he modified... We would need to have unique modifications per key per user.
286: 
287: = Releases =
288: 
289: {{chart type="bar" source="inline" params="range:B2-B12;series:columns;" title="XWiki Enterprise/Standard Releases per year" width="800" height="300"}}
290: |=Year|=Releases
291: |30-06-2007|15
292: |30-06-2008|28
293: |30-06-2009|32
294: |30-06-2010|37
295: |30-06-2011|30
296: |30-06-2012|30
297: |30-06-2013|32
298: |30-06-2014|30
299: |30-06-2015|37
300: |30-06-2016|34
301: |30-06-2017|33
302: |30-06-2018|30|extrapolated, 27 as of 4/6/2018
303: {{/chart}}
304: 
305: Source:
306: 
307: * [[Versions released in JIRA for the XWiki Platform project>>https://jira.xwiki.org/plugins/servlet/project-config/XWIKI/versions]]
308: * [[Release Manager Roster>>ReleaseManagerRoster]] (but missing dates)
309: * [[Release Plans>>ReleasePlans.WebHome]] (since 2012 only)
310: 
311: Analysis:
312: 
313: * At some points we were releasing other projects in addition to XWiki Enterprise (XWiki Office, XWiki Enterprise Manager, XWiki Watch and XWiki Eclipse).
314: * Pretty stable release cycle which means we're globally following strictly our release plans at a rate of about 30 releases per year, that's 1 release every 12 days, or 2.5 releases per month. Our [[release strategy>>VersioningAndReleasePractices]] is to release a minor version every 2 to 2.5 months in average. However we do release milestones, RCs and bugfix releases too.
315: 
316: = Security Issues =
317: 
318: {{chart type="xy_line_and_shape" params="range:B2-C10;dataset:timetable_xy;domain_axis_type:date;domain_axis_date_format:dd-MM-yyyy;date_format:dd-MM-yyyy;time_period:month" title="Closed security issues per year" width="640" height="300"}}
319: |=Year|=Created|=Closed
320: |30-06-2007|4|2
321: |30-06-2008|13|7
322: |30-06-2009|7|3
323: |30-06-2010|55|22
324: |30-06-2011|38|53
325: |30-06-2012|18|10
326: |30-06-2013|22|20
327: |30-06-2014|22|22
328: |30-06-2015|21|25
329: {{/chart}}
330: 
331: Source:
332: 
333: * [[JIRA>>https://jira.xwiki.org]] query examples:
334: ** Created: {{code language="none"}}resolved >= "2013-06-30" and resolved < "2014-06-30" and level in (Confidential) and resolution in (Fixed){{/code}}
335: ** Closed: {{code language="none"}}created >= "2006-06-30" and created < "2007-06-30" and level in (Confidential){{/code}}
336: 
337: Analysis:
338: 
339: * You need to correlate created vs closed security issues as otherwise it doesn't mean much.
340: * For the past 4 years, we're closing slightly less security issues than there are issues created (77 closed vs 83 created).
341: * Note that there are various criticity levels in security issues and some are of minor importance while others can be important.
342: 
343: = Contrib Repository Creation =
344: 
345: {{chart type="bar" source="inline" params="range:B2-B7;series:columns;" title="Contrib Repositories Created per year" width="640" height="300"}}
346: |=Year|=Releases
347: |30-06-2010|0
348: |30-06-2011|16
349: |30-06-2012|56
350: |30-06-2013|47
351: |30-06-2014|41
352: |30-06-2015|38
353: {{/chart}}
354: 
355: Source:
356: 
357: * [[Groovy Script to compute list of repos between 2 dates>>snippets:Extension.GitHub Integration||anchor="HListallrepositoriesandtheircreationdates"]]
358: 
359: Analysis:
360: 
361: * Sustained activity over years (even though declining slightly)
362: * As of now, there's a total of 195 repositories. We would need to check how many are active or dead.
363: 
364: = Contributed Extensions =
365: 
366: Number of extensions contributed on extensions.xwiki.org, excluding those done by the XWiki Dev Team.
367: 
368: {{chart type="bar" source="inline" params="range:B2-B10;series:columns;" title="Contributed Extensions per year" width="800" height="300"}}
369: |=Year|=Releases
370: |30-06-2007|23
371: |30-06-2008|51
372: |30-06-2009|44
373: |30-06-2010|62
374: |30-06-2011|66
375: |30-06-2012|81
376: |30-06-2013|81
377: |30-06-2014|81
378: |30-06-2015|70
379: {{/chart}}
380: 
381: Source:
382: 
383: * [[Stats script on extensions.xwiki.org>>extensions:ExtensionCode.StatisticsPerDate]]
384: 
385: Analysis:
386: 
387: * Eerily stable from 2012-2014: 81 new extensions per year is close to 7 new extensions every month, or 1 new extension every 4 to 5 days.
388: 
389: = External Analysis =
390: 
391: * [[XWiki in 2010 by Vincent Massol>>http://massol.myxwiki.org/xwiki/bin/view/Blog/XWikiIn2010]]
392: * [[XWiki in 2009 by Vincent Massol>>http://massol.myxwiki.org/xwiki/bin/view/Blog/XWikiIn2009]]
Wiki source code of Project Health

Quick Links

My Recent Modifications

About

About

Support

Platform

User Guide

Admin Guide

Developer Guide

Projects

XWiki

Extensions

Other

Contribute

Status

Practices

Under the Hood

Get Involved

Get Connected
