| Store | Cart

Re: [Distutils] Working toward Linux wheel support

From: Daniel Holth <dho...@gmail.com>
Fri, 17 Jul 2015 20:18:35 +0000
I've recently packaged SDL2 for Windows as a wheel, without any Python
code. It is a conditional dependency "if Windows" for a SDL wrapper. Very
convenient. It uses a little WAF script instead of bdist_wheel to make the
package. https://bitbucket.org/dholth/sdl2_lib/src/tip

We were talking on this list about adding more categories to wheel, to make
it easier to install in abstract locations "confdir", "libdir" etc.
probably per GNU convention which would map to /etc, /usr/share, and so
forth based on the platform. Someone needs to write that specification.
Propose we forget about Windows for the first revision, so that it is
possible to get it done.

The real trick is when you have to depend on something that lives outside
of your packaging system, for example, it's probably easier to ship qt as a
wheel than to ship libc as a wheel. Asking for specific SHA-256 hashes of
all the 'ldd' shared library dependencies would be limiting. Specifying the
full library names of the same a-la RPM somewhere? And as always many Linux
users will find precompiled code to be a nuisance even if it does run and
even if the dependency in question is difficult to compile.

On Fri, Jul 17, 2015 at 2:34 PM Olivier Grisel <oliv...@ensta.org>
wrote:

> 2015-07-17 18:50 GMT+02:00 Marcus Smith <qwc...@gmail.com>:> >> >> >> I think Linux wheel support is almost useless unless the pypa stack> >> provides _something_ to handle non-python dependencies.> >> >> > I wouldn't say useless, but I tend to agree with this sentiment.> >> > I'm thinking the only way to really "compete" with the ease of Conda (for> > non-python dependencies) is to shift away from wheels, and instead focus> on> > making it easier to create native distro packages (i.e. rpm, deb> etc...that> > can easily depend on non-python dependencies) for python applications,> and> > moreover that these packages should be "parallel installable" with the> > system packages, i.e. they should depend on virtual environments, not the> > system python.>> +1 for being able to work in isolation of the system packages (and> without admin rights).>> This is precisely the killer feature of conda (and virtualenv to some> extent): users do not need to rely on interaction with sys admins to> get up and running to setup a developer environment. Furthermore they> can get as many cheap environments in parallel to develop and> reproduce bugs with various versions of libraries or Python it-self.>> However I don't see why you would not be able to ship your non-Python> dependencies as wheels. Surely it should be possible to package> stateless libraries like OpenBLAS, libxml/libxsql, llvm runtimes, qt> and the like as wheels.>> Shipping wheels for services such as database servers like postgresql> is out of the scope in my opinion. For such admin sys tasks such as> managing running stateful services, system packages or docker> containers + orchestration are the way to go.>> Still wheels should be able to address the "setup parallel dev> environments" use case. When I say "developer environment" I also> include "datascientists environment" that rely on ipython notebook +> scipy stack libraries.>> Best,>> --> Olivier> _______________________________________________> Distutils-SIG maillist  -  Dist...@python.org> https://mail.python.org/mailman/listinfo/distutils-sig>

_______________________________________________
Distutils-SIG maillist  -  Dist...@python.org
https://mail.python.org/mailman/listinfo/distutils-sig

Recent Messages in this Thread
Nate Coraor Jul 16, 2015 05:41 pm
Nick Coghlan Sep 06, 2015 11:32 pm
Nick Coghlan Sep 05, 2015 02:56 am
Marcus Smith Sep 07, 2015 04:11 am
Nate Coraor Sep 03, 2015 05:22 pm
Nick Coghlan Sep 07, 2015 04:26 am
Daniel Holth Aug 20, 2015 07:22 pm
Donald Stufft Aug 20, 2015 07:25 pm
Donald Stufft Sep 02, 2015 11:45 pm
Daniel Holth Sep 03, 2015 12:15 pm
Nate Coraor Aug 24, 2015 03:03 pm
Wes Turner Aug 24, 2015 05:51 pm
Nick Coghlan Jul 17, 2015 08:22 am
Chris Barker Jul 17, 2015 03:36 pm
Antoine Pitrou Jul 17, 2015 03:46 pm
Chris Barker Jul 17, 2015 03:53 pm
Andrea Bedini Jul 18, 2015 07:00 am
Tres Seaver Jul 21, 2015 03:25 am
Leonardo Rochael Almeida Jul 21, 2015 03:07 pm
Marcus Smith Jul 17, 2015 04:50 pm
Olivier Grisel Jul 17, 2015 06:34 pm
Daniel Holth Jul 17, 2015 08:18 pm
Chris Barker - NOAA Federal Jul 18, 2015 01:13 am
Daniel Holth Jul 18, 2015 02:11 am
Paul Moore Jul 18, 2015 11:51 am
Nick Coghlan Jul 20, 2015 05:50 am
Chris Barker Jul 20, 2015 05:37 pm
Paul Moore Jul 20, 2015 06:37 pm
Nick Coghlan Jul 27, 2015 02:19 pm
Nate Coraor Jul 27, 2015 07:07 pm
Oscar Benjamin Jul 21, 2015 04:38 pm
Chris Barker Jul 24, 2015 06:52 pm
Oscar Benjamin Jul 28, 2015 03:02 pm
Wes Turner Jul 28, 2015 04:21 pm
Nate Coraor Aug 12, 2015 08:21 pm
Robert Collins Aug 12, 2015 11:49 pm
Nathaniel Smith Aug 13, 2015 01:05 am
Nate Coraor Aug 13, 2015 02:07 pm
Leonardo Rochael Almeida Aug 13, 2015 07:30 pm
Wes Turner Aug 13, 2015 07:43 pm
Nathaniel Smith Aug 14, 2015 01:47 am
Wes Turner Aug 14, 2015 01:50 am
Nathaniel Smith Aug 14, 2015 02:33 am
Wes Turner Aug 14, 2015 02:41 am
Leonardo Rochael Almeida Sep 08, 2015 07:18 pm
Donald Stufft Sep 08, 2015 07:22 pm
Leonardo Rochael Almeida Sep 08, 2015 07:39 pm
Nathaniel Smith Aug 14, 2015 01:25 am
Robert Collins Aug 14, 2015 01:31 am
Wes Turner Aug 14, 2015 01:38 am
Robert Collins Aug 14, 2015 01:44 am
Wes Turner Aug 14, 2015 01:44 am
Nathaniel Smith Aug 14, 2015 02:14 am
Wes Turner Aug 14, 2015 02:24 am
Robert Collins Aug 14, 2015 02:27 am
Nathaniel Smith Aug 14, 2015 07:38 am
David Cournapeau Aug 13, 2015 05:52 pm
Nathaniel Smith Aug 14, 2015 04:07 am
Chris Barker Aug 14, 2015 04:04 pm
David Cournapeau Aug 14, 2015 04:20 pm
Chris Barker Aug 14, 2015 04:00 pm
Leonardo Rochael Almeida Jul 20, 2015 01:42 am
Nick Coghlan Jul 20, 2015 06:00 am
Chris Barker Jul 20, 2015 05:39 pm
Marcus Smith Sep 06, 2015 04:09 pm
Nick Coghlan Sep 05, 2015 08:35 am
Nick Coghlan Sep 05, 2015 06:44 am
Nick Coghlan Sep 05, 2015 06:43 am
Nathaniel Smith Sep 05, 2015 06:46 am
Donald Stufft Sep 05, 2015 03:06 am
Wes Turner Sep 08, 2015 07:14 pm
Daniel Holth Sep 08, 2015 07:32 pm
Nathaniel Smith Sep 09, 2015 11:49 pm
Nate Coraor Sep 21, 2015 03:33 pm
Nate Coraor Sep 09, 2015 03:06 pm
Donald Stufft Sep 08, 2015 06:33 pm
Donald Stufft Sep 07, 2015 04:02 pm
Marcus Smith Sep 07, 2015 05:51 pm
Wes Turner Sep 07, 2015 10:16 pm
Nate Coraor Sep 03, 2015 02:04 pm
Daniel Holth Sep 03, 2015 01:56 pm
Antoine Pitrou Aug 20, 2015 07:51 pm
Nate Coraor Aug 20, 2015 07:40 pm
Donald Stufft Aug 20, 2015 07:19 pm
Antoine Pitrou Aug 20, 2015 07:14 pm
Steve Dower Aug 14, 2015 04:17 pm
Daniel Holth Aug 20, 2015 06:38 pm
Chris Barker Aug 14, 2015 08:16 pm
Alexander Walters Aug 14, 2015 10:32 pm
Nate Coraor Aug 20, 2015 06:26 pm
Nick Coghlan Sep 05, 2015 02:12 am
Daniel Holth Sep 01, 2015 01:57 pm
Wes Turner Aug 26, 2015 01:42 am
Nate Coraor Aug 27, 2015 07:21 pm
Ben Finney Sep 06, 2015 11:42 pm
Messages in this thread