Contains instructions to perform various release steps in the Release Plans.

Initial Backward Compatibility Check

This initial step checks if the previous release cycle, or more recent bugfix releases done since, have properly set the xwiki.compatibility.previous.version property in the top level POM of xwiki-commons (for the branch you are currently releasing).

For example, if the current release to be made is for 4.2-milestone-3 and, in the meanwhile, there have been released bugfix versions for 4.1 (4.1.4 being the latest released), you need to ensure that the value for xwiki.compatibility.previous.version is 4.1.4.

Verify JIRA issue

If there are opened JIRA issues for the version you are currently releasing (fixVersion is set to the current release), you have two options:

1. The issue has no code committed yet (Commits tab shows nothing). In this case, you need to push the issue to the next development version. (e.g. fixVersion = 6.3-milestone-1 will be moved to fixVersion = 6.3-milestone-2)
2. There is some code already committed (Commits tab is not empty). In this case, you need to contact the assigned developer of the issue and find out if the committed code is complete:
   1. If the code is complete, you can close the issue (or ask the dev to do it)
   2. If the code is not complete, you can close the issue and ask the dev to create a new issue for the remaining work to be done for the next version.

In all cases, all opened issues must be closed before the release can be done.

Verify issues with commits

Such open issues may exist because the wrong issue key was used when committing, the existing commits are just trying to fix a test or adding extra logging (and not affecting the runtime) while the problem has not been addressed, it's a commit in a feature branch, etc. You need to ignore these false positives and detect any issue that has actual work done on it that is relevant for this release, close it and assign it the correct fix version so that it's properly counted in the release notes.

Note: The JIRA query is not perfect yet as we cannot query on the commit update date. Thus FTM you'll need to review each issue listed and verify if the issue should be closed or if it's a false positive.

Log on Release machine

Set up your identity

The first time

• Configure your Github profile to add the SSH key of the agent so that the commits can be pushed to Github with your user (To get the agent SSH key, do cat ~/.ssh/releaser_ssh.pub). To verify it works, do the following on the agent machine: ssh -T [email protected]. It should reply with Hi <your user id>! You've successfully authenticated, but GitHub does not provide shell access..
• Create your own GPG key if you don't already have one: gpg --gen-key
• Publish your public GPG key, if you have not already done so: gpg --keyserver hkp://keys.openpgp.org --send-key <keyID>
• Import your GPG key:
  • On your local computer run: gpg --list-secret-keys
  • Export your key in a secret.key file: gpg --export-secret-keys «keyID» > secret.key where keyID is the hexadecimal string on the sec line (either 8 char long or 40 char long)
  • Copy the secret.key file to the agent machine (you may need to copy to maven.xwiki.org first and then to agent-1-1)
    • From your local computer, upload the key to maven.xwiki.org: scp secret.key [email protected]:/home/maven
    • From maven.xwiki.org (/home/maven): scp -i ~/.ssh/releaser_ssh secret.key [email protected]:/home/releaser/<yourname>.gpgkey (give it a name)
      • The key can be stored on the agent, since it's password protected, so that you don't have to upload it next time, and just re-import it.
      • TODO: find out how we can keep the keys imported and tell maven which one to use during the release.
    • Remove the key from maven.xwiki.org after you have uploaded it to agent-1-1: rm secret.key
  • On the agent machine, run gpg --import <yourname>.gpgkey
• You need to have a .gitconfig.<yourusername> file. You can do that by copying one of the existing gitconfig file
• Make sure your gitconfig file has the key signingkey in the [user] section (the value is your key id which you can get with gpg --list-secret-keys).
• Copy your .gitconfig.<yourusername> file as the main gitconfig file: cp .gitconfig.<yourusername> .gitconfig

The other times

• Configure your Github profile to add the SSH key of the agent so that the commits can be pushed to Github with your user (To get the agent SSH key, do cat ~/.ssh/releaser_ssh.pub). To verify it works, do the following on the agent machine: ssh -T [email protected]. It should reply with Hi <your user id>! You've successfully authenticated, but GitHub does not provide shell access..
• Make sure previous release manager did not left his GPG key
  gpg --delete-secret-and-public-keys $(gpg --list-secret-keys | grep ^sec -A 1 | tail -n 1 | awk '{ print $1 }')
• Import your GPG key, run gpg --import <yourname>.gpgkey
  • If you did not leave your secret key file on the agent machine, you have to re-upload it (see The first time section above).
• Copy your .gitconfig.<yourusername> file as the main gitconfig file: cp .gitconfig.<yourusername> .gitconfig

Update Release scripts

Configure the Java Version

Depending on which branch (XWiki version) you are releasing from you may have to use a different Java version than what is used on master.

The Java version you need to use while releasing is documented on JavaSupportStrategy (see the source column).

To change the Java version you need to remove the "java" symbolic link from the home folder and recreate it to point to the "javaX" folder that corresponds to the Java version you have to use.
Right now only two versions of Java are installed on the release agent: Java8 and Java11, but it might evolve. Path of the java versions are available with the environment variable $JAVA_XX_PATH.

Update Translations

For a release candidate, the translations were already merged (when the Pull Requests were accepted) into the master branch which you have just forked.

For a final or bugfix version, there may be translations added since the RC or the previous final/bugfix that we need to integrate. Perform the following steps:

• Move to xwiki-trunks:
  [email protected]:~$ cd releases/xwiki-trunks/
• Run the update goal of the script with your branch (e.g. stable-10.5.x):
  [email protected]:~/releases/xwiki-trunks$ ~/xwiki-dev-tools/weblate-scripts/apply_translations.sh update stable-10.5.x
• Review the changes for anything amiss.
  • You need to go through each project (xwiki-commons, xwiki-rendering, xwiki-platform)
  • Do a git status to spot changes.
    • Do a git diff --cached
      and visually review modified translation keys and spot problems (like spam). Do not spend too much time here, since major issues should have been reviewed by the committer that merged the Pull Request, a quick scan is enough to spot obvious problems.
    • No need to do a git add at this point since it will be done for all projects below.
• Push / commit the translation changes on the branch of the version you are releasing (e.g. stable-10.5.x):
  [email protected]:~/releases/xwiki-trunks$ ~/xwiki-dev-tools/weblate-scripts/apply_translations.sh push stable-10.5.x

Compute list of updated languages

Collect the list of updated languages to publish in the Release Notes:

• cd to each repository (xwiki-commons, xwiki-rendering, xwiki-platform)
• Run the list_translation_changes.sh script to list all relevant modified translation files since the previously released final version and generate the list of modified languages (notice the usage of the --diff parameter to help you decide if a translation language should be counted or not, see below for more details):
  ## list_translation_changes.sh start_commit end_commit [options]
  
  ## Example when releasing a final version (e.g. 10.7):
  [email protected]:~/releases/xwiki-trunks/xwiki-commons$ ~/xwiki-dev-tools/weblate-scripts/list_translation_changes.sh xwiki-commons-10.6.1 stable-10.7.x --diff | less -r
  ## Example when releasing a RC version (e.g. 10.7RC1):
  [email protected]:~/releases/xwiki-trunks/xwiki-commons$ ~/xwiki-dev-tools/weblate-scripts/list_translation_changes.sh xwiki-commons-10.6.1 xwiki-commons-10.7-rc-1 --diff | less -r
  
  ## Other examples on some already released versions (in case the need arises):
  [email protected]:~/releases/xwiki-trunks/xwiki-rendering$ ~/xwiki-dev-tools/weblate-scripts/list_translation_changes.sh xwiki-rendering-10.3 xwiki-rendering-10.4 --diff | less -r
  [email protected]:~/releases/xwiki-trunks/xwiki-platform$ ~/xwiki-dev-tools/weblate-scripts/list_translation_changes.sh xwiki-platform-10.3 xwiki-platform-10.4 --diff | less -r
• Merge the list of updated language codes across all the repositories (from the output of the commands above) and update the Release Notes in the Translations section with these language codes.
  • Only count what should be counted:

    Be careful to only count real translation changes. For example if Weblate reorder the translations but no new translation is added, the language should not be counted.

    At the moment the script keeps all changes of the type `<start of line>key=value`, i.e. it discard comments for ex `#Missing someKey=someValue` is not counted.
     
    Since it can be hard to figure out what are user changes when there are key renames, key deletions or key move, another way to view changes is to look at the Activity Stream on l10n for added or changed translations.

  • Skip duplicates and sort the final list alphabetically.

Build the release

• Restart the release
  • If the release:prepare is good and you need to restart only the release:perform

Restart the release

If the build failed or if you wish to release again, perform the following steps:

• Set the version that you're building, e.g. [email protected]:~/releases/xwiki-trunks$ export VERSION='4.2-milestone-3'
• Navigate to the repositories that failed to build (e.g. xwiki-platform) and clean up. For example for xwiki-platform:
  [email protected]:~/releases/xwiki-trunks$ cd xwiki-platform
  [email protected]:~/releases/xwiki-trunks/xwiki-platform$ ~/restart-release.sh
• Edit the maven-release.sh script and comment out the previously successfully released repositories so that you don't release them again.
  [email protected]:~/releases/xwiki-trunks/xwiki-platform$ cd ..
  [email protected]:~/releases/xwiki-trunks$ vim ~/maven-release.sh

  Go to the end of the maven-release.sh file and scroll up, until you reach this section:

  # Wrapper function that calls release_project for each XWiki project in order: commons, rendering, platform, enterprise, manager.
  # This is the main function that is called when running the script.
  function release_all() {
  ...

  Inside this method, comment out the previously successful top level projects and leave uncommented the top level projects that still need to be released, including the one we are resuming from. In this example, we are resuming from xwiki-platform but xwiki-commons and xwiki-rendering were already successfully released, so we are skipping them:

  ...
   echo              "*****************************"
   echo -e "\033[1;32m    Releasing xwiki-commons\033[0m"
   echo              "*****************************"
  #  release_project xwiki-commons
   echo              "*****************************"
   echo -e "\033[1;32m    Releasing xwiki-rendering\033[0m"
   echo              "*****************************"
  #  release_project xwiki-rendering
   echo              "*****************************"
   echo -e "\033[1;32m    Releasing xwiki-platform\033[0m"
   echo              "*****************************"
    release_project xwiki-platform
  ...
• Fix the build if need be (you won't need to fix anything if you just want to release again for example).
• Re-launch the maven-release.sh script from /releases/xwiki-trunks to resume from where we left off:
  [email protected]:~/releases/xwiki-trunks$ ~/maven-release.sh

If the release:prepare is good and you need to restart only the release:perform

Going even further with the resuming of a failed build, in the case of release:perform, we can resume from the actual failed module. To do so, we must make some additional temporary modifications to the release script, besides the one described above which isolates the script to release only the currently failed module.

Comment out the cleanup steps done in the release_project method:

Comment out the release:prepare step in the release_maven method and add the -rf group:artefactId parameter inside the -Darguments="..." with the module you want to resume the release from. See an example below where we are resuming from org.xwiki.platform:xwiki-platform-distribution-war.

Manually set the git tag name that will be used for GPG signing:

Run the release script to resume the release of the current project:

Generate Code Contributors list

• Automatically, on the agent:
  ## list_contributors.sh <start_version> <end_version>
  [email protected]:~/releases/xwiki-trunks$ ~/xwiki-dev-tools/xwiki-release-scripts/list_contributors.sh 10.4 10.5-rc-1
• Manually (on the agent or locally, if the automatic option fails):
  • Collect the list of code contributors for this release by running the following command on each branch on each repository that has been released (xwiki-commons, xwiki-rendering, xwiki-platform):
    > git fetch --tags
    > git log --pretty=format:"%an" <previousTag>..<nextTag> | sort -u
    ## Example:
    > git log --pretty=format:"%an" xwiki-commons-10.4..xwiki-commons-10.5-rc1 | sort -u
    > git log --pretty=format:"%an" xwiki-rendering-10.4..xwiki-rendering-10.5-rc1 | sort -u
    > git log --pretty=format:"%an" xwiki-platform-10.4..xwiki-platform-10.5-rc1 | sort -u
    ## For **final versions**, always compare with the previous final, not with the previous RC:
    > git log --pretty=format:"%an" xwiki-platform-10.4..xwiki-platform-10.5 | sort -u
• Try to remove duplicates and infrastructure users (like xwikirogci or XWiki) and sort alphabetically.
• Update the Release Notes in the Credits section with the contributors list.

Handle Backward Compatibility Actions

Update Backward Compatibility in the release note

The Backward Compatibility report is automatically generated in the Release Notes page by the {{backwardCompatibilityReport134 version="<version>"/}} macro which does the following:

• Gets the revapi ignores from the pom.xml of xwiki-commons, xwiki-rendering and xwiki-platform GitHub repositories and store them in an xobject in the Release Note page. If you wish to regenerate the content from GitHub just delete this xobject.
• Displays the ignores

Update the backward compatibility setup in the build

If you're releasing a final or bugfix, perform the following operations on the agent or on your local machine:

• Automatically, on the agent:

  ## backward_compatibility_cleanup.sh <new_version>
  releaser@releaseagent-dev:~/releases/xwiki-trunks$ ~/xwiki-dev-tools/xwiki-release-scripts/backward_compatibility_cleanup.sh 12.3
  ...
  ...
  ...
  Also update the [master] branch? (Only if new release version is 'bigger' than the existing one. Y for final, N for most bugfixes except bugfix of a very recent final) :
  [y/N]

  • When asked Also update the [master] branch?, only answer y (yes) in one of these 2 cases, otherwise answer N (no):
    1. (common) if you are releasing a final version (e.g. 12.3, from stable-12.3.x that was recently created by the release candidate that was released 2 weeks ago) OR
    2. (less common) if you are releasing a bugfix version that would be "bigger" than any existing version (e.g. 12.3 was just released, or even 12.3-rc-1, however, a critical bug was discovered and we quickly release the bugfix version 12.3.1. For this bugfix, you also need to update master, because it acts more like a final version than a bugfix and is 'bigger' than what was released until then.)
• Manually (on the agent or locally, if the automatic option fails):
  • Checkout master for xwiki-commons and edit the top level pom.xml to update the xwiki.compatibility.previous.version. Set the value to be your release you've just done.
    ## Replace the previous version with the new version (e.g. 10.4 with 10.5).
    hudsonagent@vagent-1-1-dev:~/releases/xwiki-trunks/xwiki-commons$ git checkout master
    hudsonagent@vagent-1-1-dev:~/releases/xwiki-trunks/xwiki-commons$ sed -i 's/<xwiki.compatibility.previous.version>.*</<xwiki.compatibility.previous.version>10.5</' pom.xml
    ## Double check that it has been updated
    hudsonagent@vagent-1-1-dev:~/releases/xwiki-trunks/xwiki-commons$ git diff
    ## Commit and push
    hudsonagent@vagent-1-1-dev:~/releases/xwiki-trunks/xwiki-commons$ git commit -a -m "[release] Updated compatibility previous version to the one just released."
    hudsonagent@vagent-1-1-dev:~/releases/xwiki-trunks/xwiki-commons$ git push origin master
    
  • On master, you have to remove ignores from 3 locations and then commit & push the changes (git commit -a -m "[Misc] Removed revapi ignores from the previous version"):
    • xwiki-commons/xwiki-commons-core/pom.xml
    • xwiki-rendering/pom.xml
    • xwiki-platform/xwiki-platform-core/pom.xml
    • If you are doing this on the agent, you can use nano to open the files and use CTRL+W to search for revapi. Once you have found the JSON formatted ignores, select all the lines you want to delete by using CTRL+SHIFT+6 and press CTRL+K to delete the selected lines. Exit the exitor with CTRL+X, y, ENTER (when asked if the changes should be saved) and commit the changes for each repository.
  • Make sure the xwiki.compatibility.previous.version value is changed also on the branch from where you've released, and that the ignores are cleaned too from the branch, since future releases (ex. 10.5.1) are final releases too.

Clean up identity

 Then don't forget to remove the Agent's SSH Key from your Github Account.

Blog post on xwiki.org

Create a new blog post on xwiki.org. You can have a look at the previous release blog posts for inspiration.

Update fr.wikipedia.org

fr.wikipedia.org is different from en.wikipedia.org. You can not simply edit the XWiki page and update the version value (or a special template page like it is done for en). Instead, you need to press the "pencil" icon next to the version value and be redirected to https://www.wikidata.org/wiki/Q526699?uselang=fr#P348, the site that manages the data displayed by the infobox. There, you need to:

• Add a new version entry to the existing list ("+ ajouter une valeur" button at the end of the list)
• Enter the version number
• Press "+ ajouter un qualificatif"
• Type "date de publication" in the suggest box and select it.
• On the right, type the release date in the format "26 janvier 2021"
• Click on the control left to the version you have entered (the one with a small arrow pointing up) and select "Rang prefere". This will make it selected and displayed on the XWiki page.
• Press "publier" to publish you new version
• Click "modifier" for a version just before the one you have added that has the small arrow control pointing up.
• Click on the arrow control and select "Rang normal". This will make it deselected so that it is not displayed on the XWiki page.
• Check the XWiki page if the new version and date are properly displayed

Update Wikimatrix

This step must be performed only for the latest final releases (not bugfixes or RCs).

If it's the first time please register on https://www.wikimatrix.org and ask someone (Thomas for example) to get admin access to XWiki project for you.

Note: The only exception when a bugfix would be added here is when it would be done for the latest released final version (e.g. latest final is 10.2 and the bugfix is 10.2.1).

Forum Announcement

• Add a new post to the users forum on https://forum.xwiki.org/c/News
• Example post:
  • Subject: XWiki <version> released
  • Content:
    The XWiki development team is proud to announce the availability of XWiki <version>.
    <short summary>
    
    You can download it here: https://www.xwiki.org/xwiki/bin/view/Main/Download
    
    Make sure to review the release notes:
     https://www.xwiki.org/xwiki/bin/view/ReleaseNotes/Data/XWiki/<short version>
    
    Thanks for your support
    -The XWiki dev team
  • Category: News & Events
  • Tags: release

Announce on Twitter

To announce the new release on Twitter using XWiki.org`s account. Use the following type of text:

Rebuild Debian Distribution

The XWiki Debian distribution is automatically rebuilt every day using a crontab on maven.xwiki.org.

However, in order for the Debian distribution to be ready when we announce a new version, it's a good thing to force rebuild it.

This is achieved by logging on maven.xwiki.org with the maven user and trigger a rebuild of the Debian index.

Run the script.

This start the index update in the background, you can leave.

Force Extensions Update

In order to have up to date versions on https://extensions.xwiki.org you should trigger the Batch importer scheduler (from the first node of the cluster).

Update Docker

See documentation in the Docker GitHub project's README.