Wiki source code of Project Health

Last modified by Vincent Massol on 2020/01/09 16:00
Hide line numbers
  1: This page lists various metrics related to the development of the XWiki project.
  2: 
  3: {{toc/}}
  4: 
  5: You can also browse the [[old Project Health page>>ProjectHealthOld]].
  6: 
  7: = Metric Sites =
  8: 
  9: There are several sites on the web analyzing the XWiki project and providing metrics:
 10: 
 11: * [[Ohloh>>https://www.ohloh.net/p/xwiki]]
 12: * [[Bitergia Report for 2014-01>>http://bitergia.com/public/previews/2014_01_fosdem/xwiki/browser/]]
 13: * Sonar:
 14: ** [[Sonar @ xwiki.org>>http://sonar.xwiki.org/]]
 15: ** [[Sonar Nemo for XWiki Commons>>http://nemo.sonarqube.org/dashboard/index/321369?did=1]]
 16: ** [[Sonar Nemo for XWiki Rendering>>http://nemo.sonarqube.org/dashboard/index/org.xwiki.rendering:xwiki-rendering?did=1]]
 17: * [[SVNSearch>>http://svnsearch.org/svnsearch/repos/XWIKI/search]] (till 2011 when XWiki moved from SVN to Git)
 18: * [[GitHub>>https://github.com/orgs/xwiki/dashboard]]:
 19: ** [[XWiki Commons graphs>>https://github.com/xwiki/xwiki-commons/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-commons/pulse/monthly]])
 20: ** [[XWiki Rendering graphs>>https://github.com/xwiki/xwiki-rendering/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-rendering/pulse/monthly]])
 21: ** [[XWiki Platform graphs>>https://github.com/xwiki/xwiki-platform/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-platform/pulse/monthly]])
 22: ** [[XWiki Enterprise graphs>>https://github.com/xwiki/xwiki-enterprise/graphs]] ([[Monthly Pulse>>https://github.com/xwiki/xwiki-enterprise/pulse/monthly]])
 23: 
 24: = Active Installs =
 25: 
 26: See [[dedicated page for Active Installs>>xwiki:ActiveInstalls.WebHome]].
 27: 
 28: = Downloads =
 29: 
 30: **Downloads for the WAR + HSQLDB packagings**:
 31: 
 32: {{chart type="bar" source="inline" params="range:B2-B14;series:columns;" title="XWiki Downloads (WAR+HSQLDB)" width="640" height="300"}}
 33: |=Year|=Downloads|=Notes
 34: |2005|19020|
 35: |2006|62079|
 36: |2007|56614|
 37: |2008|132424|
 38: |2009|256644|
 39: |2010|257633|
 40: |2011|174161|
 41: |2012|276281|
 42: |2013|242963|
 43: |2014|367989|
 44: |2015|353080|
 45: |2016|247291|
 46: |2017|232000|Extrapolated from data from 18 July 2016
 47: {{/chart}}
 48: 
 49: Source:
 50: 
 51: * From [[OW2 Download stats>>http://stats.ow2.org/downloadStats/]] (requires credentials)
 52: * These download figures contain [[all the distributions provided by XWiki on OW2>>http://forge.ow2.org/project/showfiles.php?group_id=170]].
 53: 
 54: Interpretation:
 55: 
 56: * At one point we had more distributions (workspaces, xeclipse, xoffice, xwatch, etc) and this could have lead to more downloads
 57: * Since XWiki 3.3 we now have a [[Debian distribution>>platform:AdminGuide.InstallationViaAPT]] (.DEB), installable through [[APT>>http://en.wikipedia.org/wiki/Advanced_Packaging_Tool]] and we don't count those downloads in the figures above. They could account for an important part, we would need to retrieve their stats.
 58: * Since XWiki 8.4 we now have [[Docker images>>https://hub.docker.com/_/xwiki/]] too.
 59: * These download figures need to be correlated with the [[Active Installs>>xwiki:ActiveInstalls.WebHome]].
 60: * These downloads do not count XWiki Extensions.
 61: * The majority of XARs are downloaded from the Extension Manager and are not counted in these stats.
 62: * In 2018 we stopped publishing our binaries on OW2 and thus we don't have the download figures since then. In addition, since we have several distribution channels (APT, Docker, xwiki.org, etc), it's impossible to track the download numbers. Thus we're now relying solely on Active Installs figures which provides a better tracking metric.
 63: 
 64: **Corrected Graph**:
 65: 
 66: We're using the [[Active Install Distribution proportions>>xwiki:ActiveInstalls.DistributionData]] to correct the download figure above. 
 67: 
 68: Note that the Distribution data are only retrieved for XWiki 8.4.4+ so the corrections make sense only from 2017+ and they only been applied from 2017 forward.
 69: 
 70: {{chart type="stackedbar" source="inline" params="range:B2-C14;series:columns;" title="XWiki Downloads (Total)" width="640" height="300"}}
 71: |=Year|=Downloads|=Correction|=Notes
 72: |2005|19020|0|
 73: |2006|62079|0|
 74: |2007|56614|0|
 75: |2008|132424|0|
 76: |2009|256644|0|
 77: |2010|257633|0|
 78: |2011|174161|0|
 79: |2012|276281|0|
 80: |2013|242963|0|
 81: |2014|367989|0|
 82: |2015|353080|0|
 83: |2016|247291|0|
 84: |2017|232000|154000|Extrapolated, based on 60% of XAR+HSQLDB and 40% other (ie from ActiveInstalls.DistributionData)
 85: {{/chart}}
 86: 
 87: Interpretation:
 88: 
 89: * Based on the corrected graph, we're actually increasing the number of downloads of XWiki overall!
 90: 
 91: {{comment}}
 92: = Active Installs =
 93: 
 94: {{velocity}}
 95: {{chart type="line" source="xdom" params="document:xwiki:ActiveInstalls.ActiveInstallsHistoryData;range:B2-B.;series:columns" width="800"/}}
 96: {{/velocity}}
 97: 
 98: Source:
 99: 
100: * Elastic Search for xwiki.org, see the raw data using the [[Kibana UI>>http://activeinstalls.xwiki.org/kibana3/]]
101: * See also the XWiki [[Active Installs page>>xwiki:ActiveInstalls.WebHome]] for more details.
102: 
103: Interpretation:
104: 
105: * Lists all XWiki installs that have sent a ping in the last 24 hours
106: * Do not count installs behind firewalls and that cannot access xwiki.org
107: {{/comment}}
108: 
109: = Mailing Lists Activity =
110: 
111: {{chart type="xy_line_and_shape" params="range:B2-C12;dataset:timetable_xy;domain_axis_type:date;domain_axis_date_format:dd-MM-yyyy;date_format:dd-MM-yyyy;time_period:month;range_axis_lower:700;range_axis_upper:7000" width="640" height="300"}}
112: |=Date|=Users|=Devs
113: |30-06-2006|1576|823
114: |30-06-2007|2091|2079
115: |30-06-2008|4842|4386
116: |30-06-2009|3777|5829
117: |30-06-2010|4629|5799
118: |30-06-2011|3156|3990
119: |30-06-2012|3061|3695
120: |30-06-2013|2620|3130
121: |30-06-2014|1974|1715
122: |30-06-2015|2108|1860
123: |30-06-2016|2441|2302
124: {{/chart}}
125: 
126: Source:
127: 
128: * [[XWiki's Markmail archives>>http://xwiki.markmail.org/]]
129: * For example, [[data between 30-06-2013 and 30-06-2014>>http://xwiki.markmail.org/search/?q=date%3A20130630-20140630]]
130: * We're now using a Discourse-based Forum, which provides its own statistics (which we could display here in the future)
131: 
132: Interpretation:
133: 
134: * Either less users since July 2010 or the product is easier to use
135: * Either less devs since July 2010 or they're asking less questions (more proficient?)
136: 
137: = Commit Activity =
138: 
139: Commits for Platform, Enterprise, Manager, Commons, Rendering, XOffice, XEclipse, XWatch, XWorkspaces:
140: 
141: {{chart type="bar" source="inline" params="range:B2-B10;series:columns;" title="Commits" width="640" height="300"}}
142: |=Date|=Downloads|=Notes
143: |30-06-2008|6262|Found using svnsearch
144: |30-06-2009|7503|Found using svnsearch
145: |30-06-2010|6803|Found using svnsearch
146: |30-06-2011|7605|Found using svnsearch(Data from 9 months from svn, extrapolated to 12 months since we moved to git but using git data is misleading since git introduces more commits)
147: |30-06-2012|4387|Found using Git
148: |30-06-2013|3699|Found using Git
149: |30-06-2014|3295|Found using Git
150: |30-06-2015|3524|Found using Git
151: |30-06-2016|2864|Found using Git
152: |30-06-2017|2363|Found using Git
153: {{/chart}}
154: 
155: Commits for Contrib:
156: 
157: {{chart type="bar" source="inline" params="range:B2-B5;series:columns;" title="Commits" width="640" height="300"}}
158: |=Date|=Downloads|=Notes
159: |30-06-2008|55|Found using svnsearch
160: |30-06-2009|1113|Found using svnsearch
161: |30-06-2010|1023|Found using svnsearch
162: |30-06-2011|1009|Found using svnsearch(Data from 9 months from svn, extrapolated to 12 months since we moved to git but using git data is misleading since git introduces more commits)
163: {{/chart}}
164: 
165: Source:
166: 
167: * [[SVNSearch>>http://svnsearch.org/svnsearch/repos/XWIKI/search]] and Git/GitHub
168: * To compute all commits between 2 dates in Git: {{code language="none"}}git rev-list HEAD --count --since="2011-06-30" --until="2012-06-30"{{/code}}
169: 
170: Interpretation:
171: 
172: * See also the [[Commit Activity on Ohloh>>https://www.ohloh.net/p/xwiki/commits/summary]] which also shows a small commit slowdown since 2011 (i.e. since we moved to Git)
173: * Starting in 2011 we moved to Git (we were using SVN before) and this could have caused some difference in # of commits. For example sandbox and contrib code was moved in different Git repositories. In addition it's possible that using Git generates less commits because with SVN merges were a pain and thus devs were committing very frequently to not have to perform merges... ;)
174: * Some projects have been deprecated and moved to contrib such as XEclipse, XWatch, XOffice, Workspaces, XEM, etc and this has probably resulted in reduced commits
175: * We had 7605 commits in 2011 means about 20 commits/day. This is to be compared to [[other well known projects in 2011>>http://openlife.cc/blogs/2010/november/how-grow-your-open-source-project-10x-and-revenues-5x]]:(((
176: |=Project|=Commits per year|=Commits per day
177: |Gnome|36500|100
178: |Linux|47450|130
179: |Drupal|48545|133
180: |KDE|109500|300
181: 
182: Classification:
183: 
184: |=Category
185: |=XtraLarge
186: 1000+ devs
187: 100+ commits/day|Linux, KDE, Apache, Eclipse, Perl+CPAN, Drupal, Gnome
188: |=Large
189: 20-200 devs
190: 50-100 commits/day|MySQL, Qt, OpenOffice, Mono, JBoss
191: |=Medium|GIMP, SVN, wordpress
192: )))
193: * [[Comparison between XWiki, Foswiki and MediaWiki on Ohloh>>https://www.ohloh.net/p/compare?project_0=XWiki&project_1=Foswiki&project_2=MediaWiki]]
194: 
195: = Source Contributors =
196: 
197: {{image reference="committers.png"/}}
198: 
199: Source:
200: 
201: * [[Oloh Contributor Report>>https://www.ohloh.net/p/xwiki/contributors/summary]]
202: 
203: Analysis:
204: 
205: * For the full list of committers and their stats see also the [[Hall of Fame>>HallOfFame]].
206: * Seems the number of contributors has been steadily increasing till mid 2011 and from then on it's pretty stable between 8 to 15 different contributors each month.
207: * Thomas Mortagne is increasing his lead and is moving towards a 30% commit share for all times (27% ATM and 30% for 2015)
208: * Sergiu has reduced his participation, that's too bad! Come back Sergiu :)
209: * Jean-Vincent has left the project and is no longer active unfortunately
210: * Vincent is reducing slightly from 20% all time to 17% for 2015
211: * Marius is stable at 9%
212: * Guillaume is increasing: from 2% all time to 15% for 2015
213: * Eduard is also increasing: from 2% all time to 10% for 2015
214: * Pretty stable in # of core committers (but this doesn't take into account the activity on contrib! We need to find a way to analyze this).
215: 
216: = Issues Activity =
217: 
218: {{chart type="stackedbar" source="inline" params="range:B2-F13;series:columns;" title="Closed Issues per year" width="800" height="300"}}
219: |=Date|=Bugs|=Improvements|=New Features|=SubTasks|=Tasks
220: |30-06-2006|35|2|0|1|6
221: |30-06-2007|778|211|55|133|160
222: |30-06-2008|1317|445|183|540|309
223: |30-06-2009|1930|430|121|425|320
224: |30-06-2010|1134|398|89|84|315
225: |30-06-2011|776|407|128|44|255
226: |30-06-2012|670|406|92|113|219
227: |30-06-2013|968|333|63|63|175
228: |30-06-2014|860|464|69|7|159
229: |30-06-2015|884|642|98|92|213
230: |30-06-2016|759|472|85|5|238
231: |30-06-2017|581|334|51|4|197
232: {{/chart}}
233: 
234: Source:
235: 
236: * [[XWiki's JIRA>>https://jira.xwiki.org]]
237: * JQL example for 2012-06-30: {{code language="none"}}resolution = Fixed AND resolved >= 2011-06-30 AND resolved <= 2012-06-30 AND type = Bug{{/code}}
238: 
239: Analysis:
240: 
241: * Activity has been stable for the past few years. This needs to be correlated with [[the size of the team>>||anchor="HSourceContributors"]] which has also remained stable during the same period.
242: * In the 5.x cycle (From December 2012 to December 2013) we've increased a lot the number of bugs fixed thanks to our [[BFD strategy>>Community.XWikiDays]] (one per week during this period). In the 6.x cycle (Jan 2014 to Dec 2014) we've reduced this by doing other types of XWiki Days but still doing BFDs to keep bugs at bay.
243: 
244: = Bugs Killing =
245: 
246: Number of bugs closed vs bugs created over the past 1600 days:
247: 
248: July 2015:
249: 
250: {{image reference="bugs-july-2015.png"/}}
251: 
252: Source:
253: 
254: * [[JIRA Created bugs vs Closed bugs>>https://jira.xwiki.org/secure/Dashboard.jspa?selectPageId=10352#Created-vs-Resolved-Chart/13610]]
255: 
256: Analysis:
257: 
258: * [[BFD>>Community.XWikiDays]] is working great so far, we're keeping up!
259: 
260: = l10n Activity =
261: 
262: {{chart type="bar" source="inline" params="range:B2-B6;series:columns;" title="l10n modified translation keys" width="640" height="300"}}
263: |=Year|=Modified keys|=Notes
264: |2011|14939
265: |2012|20367
266: |2013|11808
267: |2014-06-30|29450|114 Hareketi has 21K but seems he saved 6 times for each key he really modified!
268: |2015-06-30|8747
269: {{/chart}}
270: 
271: {{chart type="bar" source="inline" params="range:B2-B6;series:columns;" title="l10n Contributors" width="640" height="300"}}
272: |=Year|=Contributors
273: |2011|34
274: |2012|28
275: |2013|65
276: |2014-06-30|30
277: |2015-06-30|26
278: {{/chart}}
279: 
280: Source:
281: 
282: * http://l10n.xwiki.org
283: * [[Example query>>http://l10n.xwiki.org/xwiki/bin/view/L10NCode/BestContributorsSheet?lowerBound=20130630&upperBound=20140630]]
284: 
285: Analysis:
286: 
287: * User "114 Hareketi" has 21K in from 2013-06-30 to 2014-06-30 but seems he saved 6 times several keys he modified... We would need to have unique modifications per key per user.
288: 
289: = Releases =
290: 
291: {{chart type="bar" source="inline" params="range:B2-B12;series:columns;" title="XWiki Enterprise/Standard Releases per year" width="800" height="300"}}
292: |=Year|=Releases
293: |30-06-2007|15
294: |30-06-2008|28
295: |30-06-2009|32
296: |30-06-2010|37
297: |30-06-2011|30
298: |30-06-2012|30
299: |30-06-2013|32
300: |30-06-2014|30
301: |30-06-2015|37
302: |30-06-2016|34
303: |30-06-2017|33
304: |30-06-2018|30|extrapolated, 27 as of 4/6/2018
305: {{/chart}}
306: 
307: Source:
308: 
309: * [[Versions released in JIRA for the XWiki Platform project>>https://jira.xwiki.org/plugins/servlet/project-config/XWIKI/versions]]
310: * [[Release Manager Roster>>ReleaseManagerRoster]] (but missing dates)
311: * [[Release Plans>>ReleasePlans.WebHome]] (since 2012 only)
312: 
313: Analysis:
314: 
315: * At some points we were releasing other projects in addition to XWiki Enterprise (XWiki Office, XWiki Enterprise Manager, XWiki Watch and XWiki Eclipse).
316: * Pretty stable release cycle which means we're globally following strictly our release plans at a rate of about 30 releases per year, that's 1 release every 12 days, or 2.5 releases per month. Our [[release strategy>>VersioningAndReleasePractices]] is to release a minor version every 2 to 2.5 months in average. However we do release milestones, RCs and bugfix releases too.
317: 
318: = Security Issues =
319: 
320: {{chart type="xy_line_and_shape" params="range:B2-C14;dataset:timetable_xy;domain_axis_type:date;domain_axis_date_format:dd-MM-yyyy;date_format:dd-MM-yyyy;time_period:month" title="Created/Closed security issues per year" width="640" height="300"}}
321: |=Year|=Created|=Closed
322: |30-06-2007|4|2
323: |30-06-2008|13|7
324: |30-06-2009|7|3
325: |30-06-2010|55|22
326: |30-06-2011|38|53
327: |30-06-2012|18|10
328: |30-06-2013|22|20
329: |30-06-2014|22|22
330: |30-06-2015|26|24
331: |30-06-2016|13|14
332: |30-06-2017|15|13
333: |30-06-2018|7|5
334: |30-06-2019|18|8
335: {{/chart}}
336: 
337: Source:
338: 
339: * [[JIRA>>https://jira.xwiki.org]] query examples:
340: ** Created: {{code language="none"}}created >= "2018-06-30" and created < "2019-06-30" and level = Confidential{{/code}}
341: ** Closed: {{code language="none"}}resolved >= "2018-06-30" and resolved < "2019-06-30" and level = Confidential and status = Closed{{/code}}
342: 
343: Analysis:
344: 
345: * You need to correlate created vs closed security issues as otherwise it doesn't mean much.
346: * For the past 4 years, we're closing slightly less security issues than there are issues created (77 closed vs 83 created).
347: * Note that there are various criticity levels in security issues and some are of minor importance while others can be important.
348: 
349: = Contrib Repository Creation =
350: 
351: {{chart type="bar" source="inline" params="range:B2-B7;series:columns;" title="Contrib Repositories Created per year" width="640" height="300"}}
352: |=Year|=Releases
353: |30-06-2010|0
354: |30-06-2011|16
355: |30-06-2012|56
356: |30-06-2013|47
357: |30-06-2014|41
358: |30-06-2015|38
359: {{/chart}}
360: 
361: Source:
362: 
363: * [[Groovy Script to compute list of repos between 2 dates>>snippets:Extension.GitHub Integration||anchor="HListallrepositoriesandtheircreationdates"]]
364: 
365: Analysis:
366: 
367: * Sustained activity over years (even though declining slightly)
368: * As of now, there's a total of 195 repositories. We would need to check how many are active or dead.
369: 
370: = Contributed Extensions =
371: 
372: Number of extensions contributed on extensions.xwiki.org, excluding those done by the XWiki Dev Team.
373: 
374: {{chart type="bar" source="inline" params="range:B2-B10;series:columns;" title="Contributed Extensions per year" width="800" height="300"}}
375: |=Year|=Releases
376: |30-06-2007|23
377: |30-06-2008|51
378: |30-06-2009|44
379: |30-06-2010|62
380: |30-06-2011|66
381: |30-06-2012|81
382: |30-06-2013|81
383: |30-06-2014|81
384: |30-06-2015|70
385: {{/chart}}
386: 
387: Source:
388: 
389: * [[Stats script on extensions.xwiki.org>>extensions:ExtensionCode.StatisticsPerDate]]
390: 
391: Analysis:
392: 
393: * Eerily stable from 2012-2014: 81 new extensions per year is close to 7 new extensions every month, or 1 new extension every 4 to 5 days.
394: 
395: = External Analysis =
396: 
397: * [[XWiki in 2010 by Vincent Massol>>http://massol.myxwiki.org/xwiki/bin/view/Blog/XWikiIn2010]]
398: * [[XWiki in 2009 by Vincent Massol>>http://massol.myxwiki.org/xwiki/bin/view/Blog/XWikiIn2009]]
Wiki source code of Project Health

Quick Links

My Recent Modifications

About

About

Support

Platform

User Guide

Admin Guide

Developer Guide

Projects

XWiki

Extensions

Other

Contribute

Status

Practices

Under the Hood

Get Involved

Get Connected
