| Store | Cart

Re: [Distutils] Proposal: using /etc/os-release in the "platform tag" definition for wheel files

From: Olivier Grisel <oliv...@ensta.org>
Tue, 2 Dec 2014 11:57:35 +0100
+1 to the idea in general. as well.

Here is another use case to motivate distro-aware platform tags for
linux wheels: speeding up continuous integration.

Many Python projects related to the SciPy ecosystem by sharing use the
following rackspace cloud storage container to mutualize build
artifacts:

http://wheels.scikit-image.org/

This makes it really easy to setup build chains to test libraries with
against recent (or even development) version of they dependencies that
cannot be apt-get installed on travis hosts for instance. Building
from source is often not an option for a project that have a
dependency on scipy for instance, the scipy build time itself would
eat most of the travis job allowed time and would not leave enough
time. And it would be a complete waste of resource to rebuild scipy
over and over again.

Unfortunately, all the wheels you find on
http://wheels.scikit-image.org with the "linux_x86_64" are only
expected to work on the Ubuntu Precise platform (which is used by
travis).

This ambiguous platform tag is really annoying:

- it prevents people who would like to setup CI for other linux
platforms (e.g. docker based CI engines that would test wheels on
redhat or centos) to share the same distribution infrastructure,
- the day travis changes its base distro we will have no way to detect
which wheels were built on the old distro and which wheels are built
on the newer version of the distro.

Note that those wheels are not meant to be used by our end-users, only
by CI tools for testing or by developers who would like to quickly
reproduce without having to rebuild everything from scratch.

If the experiment show that such distro tagged wheels are actually as
stable as their are supposed too (which can be mostly tested via CI),
then we could discuss later about the opportunity to distribute Linux
wheels on PyPI for the end users but to me this is not a priority at
all.

-- 
Olivier
_______________________________________________
Distutils-SIG maillist  -  Dist...@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Recent Messages in this Thread
Nick Coghlan Nov 28, 2014 06:03 am
Antoine Pitrou Nov 28, 2014 08:19 am
Nick Coghlan Nov 28, 2014 03:27 pm
Antoine Pitrou Nov 28, 2014 03:51 pm
Nick Coghlan Nov 29, 2014 03:47 pm
Antoine Pitrou Nov 29, 2014 04:10 pm
Nick Coghlan Nov 29, 2014 05:02 pm
Donald Stufft Nov 29, 2014 05:40 pm
Antoine Pitrou Nov 29, 2014 05:41 pm
Tres Seaver Nov 29, 2014 05:39 pm
Marius Gedminas Nov 28, 2014 08:40 am
Matthias Klose Nov 28, 2014 03:31 pm
Nick Coghlan Nov 28, 2014 03:38 pm
Marcus Smith Dec 01, 2014 01:41 am
Olivier Grisel Dec 02, 2014 10:57 am
Nick Coghlan Dec 02, 2014 11:56 am
Messages in this thread