Making a Pootle Release

These instructions are the guidelines for anyone making a Pootle commit.

Summary

  1. git clone git@github.com:translate/pootle.git pootle-release
  2. Create release notes
  3. Up version number
  4. Update translations
  5. make build
  6. Test install and other tests
  7. Tag the release
  8. Publish on PyPI
  9. Upload to Sourceforge
  10. Release documentation
  11. Update translate website
  12. Unstage sourceforge
  13. Announce to the world
  14. Cleanup

Other possible steps

We need to check and document these if needed:

  • Pre-release checks
  • Build docs: we need to check if we need to build the docs for the release tarball.
  • Change URLs to point to the correct docs: do we want to change URLs to point to the $version docs rather then ‘latest’?
  • Building on Windows, building for other Linux distros. We have produced
  • Communicating to upstream packagers

Detailed instructions

Get a clean checkout

We work from a clean checkout to esnure that everything you are adding to the build is what is in VC and doesn’t contain any of your uncommitted changes. It also ensure that someone else could relicate your process.

git clone git@github.com:translate/pootle.git pootle-release

Create release notes

The release notes will be used in these places:

  • Pootle website - download page (used in gh-pages)
  • Sourceforge download - README.rst (used to give user info)
  • Email announcements - text version

We create our release notes in reStructured Text, since we use that elsewhere and since it can be rendered well in some of our key sites.

First we need to create a log of changes in Pootle:

git diff N-1 HEAD > docs/release/$version.rst

Edit this new file. You can use the commits as a guide to build up the release notes. You should remove all log messages before the release.

Note

Since the release notes will be used in places that allow linking we use links within the notes. These should link back to products websites (Virtaal, Pootle, etc), references to Translate and possibly bug numbers, etc.

Read for grammar and spelling errors.

Note

When writing the notes please remember:

  1. The voice is active. ‘Translate has released a new version of the toolkit’, not ‘A new version of the toolkit was released by Translate’.
  2. The connection to the users is human not distant.
  3. We speak in familiar terms e.g. “I know you’ve been waiting for this release” instead of formal.

Up version numbers

Update the version number in:

  • pootle/__version__.py
  • docs/conf.py`

In __version__.py, bump the build number if anybody used the toolkit with the previous number, and there have been any changes to code touching stats or quality checks. An increased build number will force a toolkit user, like Pootle, to regenerate the stats and checks.

For conf.py change version and release

Note

FIXME - We might want to automate the version and release info so that we can update it in one place.

The version string should follow the pattern:

$MAJOR-$MINOR-$MICRO[-$EXTRA]

E.g.

1.10.0
0.9.1-rc1

$EXTRA is optional but all the three others are required. The first release of a $MINOR version will always have a $MICRO of .0. So 1.10.0 and never just 1.10.

Update translations

Update the translations from the Pootle server

  1. Download all translations:

    # On pootle.locamotion.org
    ./manage.py sync_stores --project=pootle
    
    # On your computer
    scp -rp $user@pootle.locamotion.org/$location pootle/locales
  2. Update pootle/locale/LINGUAS to list the languages we would like to ship. While we package all PO files, this is an indication of which ones we want packagers to use. The requirements is roughly 100% translated with no obvious variable errors.

    .. code-block:: bash

    $ make mo # Build all LINGUAS enabled languages

Build the package

Building is the first step to testing that things work. From your clean checkout run:

make mo-all # if we are shipping an pre-release
make build

This will create a tarball in dist/ which you can use for further testing.

Note

We use a clean checkout just to make sure that no inadvertant changes make it into the release.

Test install and other tests

The easiest way to test is in a virtualenv. You can install the new toolkit using:

pip install path/to/dist/Pootle-$version.tar.bz2

This will allow you test installation of the software.

You can then proceed with other tests such as checking:

  1. Documentation is available
  2. Converters and scripts are installed and run correctly
  3. Meta information about the package is correct. See pypi section of reviewing meta data.

Tag the release

You should only tag once you are happy with your release as there are some things that we can’t undo.

git tag -a 2.5.0 -m "Tag version 2.5.0"
git push --tags

If this is the final release then there should be a stable branch e.g. stable/2.5.0, so create one if it does not already exist.

Publish on PyPI

Publish the package on the Python Package Index (PyPI)

  • Submitting Packages to the Package Index <http://wiki.python.org/moin/CheeseShopTutorial#Submitting_Packages_to_the_Package_Index>

Note

You need a username and password on https://pypi.python.org and have rights to the project before you can proceed with this step.

These can be stored in $HOME/.pypirc and will contain your username and password. A first run of ./setup.py register will create such a file. It will also actually publish the meta-data so only do it when you are actually ready.

Review the meta data. This is stored in setup.py, use ./setup.py --help to se some options to display meta-data. The actual long description is taken from /README.rst.

To test before publishing run:

make test-publish-pypi

Then to actually publish:

make publish-pypi

Copy files to sourceforge

Publishing files to the Translate Sourceforge project.

Note

You need to have release permissions on sourceforge to perform this step.

You will need:

  • Tarball of the release
  • Release notes in reStructured Text
  1. Create a new folder in the Pootle Sourceforge release folder using the ‘Add Folder’ button. The folder name must be the same as the release name e.g. 2.5.0-rc1. Mark this as being for staging for the moment.
  2. make publish-sourceforge will give you the command to upload your tarball and README.rst.
    1. Upload tarball for release.
    2. Upload release notes as README.rst.
    3. Click on the info icon for README.rst and tick “Exclude Stats” to exlude the README from stats counting.
  3. Final checks:
    1. Check that the README.rst for the parent Pootle folder is still appropriate, this text is the text from /README.rst.
    2. Check all the links in README.rst files for existing releases, new release and the parent folders.

Release documentation

We need a tagged release or branch before we can do this. The docs are published on Read The Docs.

Use the admin pages to flag a version that should be published. When we have branched the stable release we use the branch rather then the tag i.e. stable-2.5.0 rather than 2.5.0 as that allows any fixes of documentation for the 2.5.0 release to be immediately available.

Change all references to docs in the Pootle code to point to the branched version as apposed to the latest version.

Update Pootle website

We use github pages for the website. First we need to checkout the pages:

git checkout gh-pages
  1. In _posts/ add a new release posting. This is in Markdown format (for now), so we need to change the release notes .rst to .md, which mostly means changing URL links from ‘`xxx <link>`_‘ to [xxx](link).
  2. Change $version as needed. See download.html, _config.yml and git grep $old_release
  3. git commit and git push – changes are quite quick so easy to review.

Note

FIXME it would be great if gh-pages accepted .rst, maybe it can if we prerender just that page?

Unstage on sourceforge

If you have created a staged release folder, then unstage it now.

Announce to the world

Let people know that there is a new version:

  1. Announce on mailing lists: Send the announcement to the translate-announce mailing lists on translate-announce@lists.sourceforge.net translate-pootle@lists.sourceforge.net
  2. Adjust the #pootle channel notice. Use /topic to change the topic.
  3. Email important users
  4. Tweet about it

Cleanup

Some possible cleanup tasks:

  • Remove any RC builds from the sourceforge download pages and add redirects to Sourceforge Pootle top level download page.
  • Checkin any release notes and such (or maybe do that before tagging).
  • Remove your pootle-release checkout.
  • Update and change things based on what you learnt, don’t wait:
    • Update and fix these release notes and make sure they are on master.
    • Dicuss any changes that should be made or new things that could be added
    • Add automation if you can