.rpm .deb .ebuild .tgz OMG! Eddy Mulyono current state of packaging across distros (Ubuntu, Gentoo, rPath), lessons learned, and what's next

Eddy Mulyono

current state of packaging across distros (Ubuntu, Gentoo, rPath), lessons learned, and what's next

metadata – whoami Gentoo ~ 3 years bunch of Bugzilla Sunrise committer Ubuntu ~ 1 year Launchpad PPA

Gentoo

~ 3 years

bunch of Bugzilla

Sunrise committer

Ubuntu

~ 1 year

Launchpad PPA

metadata - who User internal SysAdmin package stuff! Dev package stuff!

User

internal

SysAdmin

package stuff!

Dev

package stuff!

whatis packaging packages .C.R.U.D. package managers related tools

packages

.C.R.U.D.

package managers

related tools

why packaging?

base “wrapper” around shellscripts

“wrapper” around shellscripts

across distros Debian (Ubuntu) Fedora (Redhat) Gentoo Foresight (rPath)

Debian (Ubuntu)

Fedora (Redhat)

Gentoo

Foresight (rPath)

Debian 1: dpkg deps: apt

1: dpkg

deps: apt

debian/rules makefile targets build binary .deb arch, indep clean

makefile targets

build

binary

.deb

arch, indep

clean

debian/rules: from scratch Makefile repeats remember autotools?

Makefile repeats

remember autotools?

debhelper debhelper dh_make generate scaffold debian/* (rules) dh_* wrapper scripts scaffold pic

debhelper

dh_make

generate scaffold debian/* (rules)

dh_*

wrapper scripts

scaffold pic

cdbs debhelper all over refactor common code include debhelper.mk dpatch autotools gnome, kde, xfce perl, python, ant

debhelper all over

refactor common code

include debhelper.mk

dpatch

autotools

gnome, kde, xfce

perl, python, ant

cdbs: append append build:: build/mysql-common:: build/mysql-client:: build/mysql-server::

append

build::

build/mysql-common::

build/mysql-client::

build/mysql-server::

cdbs: next dbconfig-common wwwconfig-common webapps-common (mozilla-extension) more, please

dbconfig-common

wwwconfig-common

webapps-common

(mozilla-extension)

more, please

debian/control: apt package metadata Build-Depends Depends Conflicts Suggests, Recommends

package metadata

Build-Depends

Depends

Conflicts

Suggests, Recommends

Debian: packaging dev package archive can't wrap my head around it. use Launchpad PPA

package archive

can't wrap my head around it.

use Launchpad PPA

Debian: A&D dpkg-divert debconf packaging info all over the place debian/rules debian/control debian/install

dpkg-divert

debconf

packaging info all over the place

debian/rules

debian/control

debian/install

Gentoo 1: ebuild deps: emerge paludis

1: ebuild

deps: emerge

paludis

Gentoo: ebuild ebuild: shell functions src_unpack() get source & patch src_compile() configure & make src_install() make install src_test() make test

ebuild: shell functions

src_unpack()

get source & patch

src_compile()

configure & make

src_install()

make install

src_test()

make test

Gentoo: ebuild (cont.) pkg_preinst() enewgroup & enewuser (merge) pkg_postinst() gnome: menu item entry, mime handler pkg_config() mysql: init db, password

pkg_preinst()

enewgroup & enewuser

(merge)

pkg_postinst()

gnome: menu item entry, mime handler

pkg_config()

mysql: init db, password

Gentoo: ebuild: inst v. rm pkg_preinst() (merge) pkg_postinst() pkg_prerm() (unmerge) pkg_postrm()

pkg_preinst()

(merge)

pkg_postinst()

pkg_prerm()

(unmerge)

pkg_postrm()

Gentoo: portage package metadata DEPENDS conflicts: !package RDEPENDS

package metadata

DEPENDS

conflicts: !package

RDEPENDS

Gentoo: eclasses ebuild: “object-oriented” shell functions inheritance gnome, kde, xfce, rox, enlightenment python, ruby, perl, mono, java vim, elisp, xemacs perl-module, gems, php-pear-r1

ebuild: “object-oriented” shell functions

inheritance

gnome, kde, xfce, rox, enlightenment

python, ruby, perl, mono, java

vim, elisp, xemacs

perl-module, gems, php-pear-r1

Gentoo: eclass inherit gnome2 python gnome2_src_unpack python_src_unpack src_unpack? python_src_unpack order matters

inherit gnome2 python

gnome2_src_unpack

python_src_unpack

src_unpack?

python_src_unpack

order matters

Gentoo: eclass notes eclass refactor common code cvs, subversion, git, darcs (“live ebuilds”) webapps multi-instance vhosts Debian: webapps-common gems, php-pear perl-module: g-cpan

eclass

refactor common code

cvs, subversion, git, darcs (“live ebuilds”)

webapps

multi-instance

vhosts

Debian: webapps-common

gems, php-pear

perl-module: g-cpan

Gentoo: packaging dev overlays /usr/portage /usr/local/portage sunrise gnome overlays.gentoo.org YOURs! version bump:rename

overlays

/usr/portage

/usr/local/portage

sunrise

gnome

overlays.gentoo.org

YOURs!

version bump:rename

Fedora/Redhat 1: rpm deps: yum, up2date, zypp, urpmi

1: rpm

deps: yum, up2date, zypp, urpmi

rpm specfiles shellscript sections (& macros) %prep %setup: unpack %patch %build %configure %install %makeinstall

shellscript

sections (& macros)

%prep

%setup: unpack

%patch

%build

%configure

%install

%makeinstall

specfiles: into rpm %files %doc %config(noreplace) *.rpmnew %attr(0644, root, root) %defattr `rust` helps

%files

%doc

%config(noreplace)

*.rpmnew

%attr(0644, root, root)

%defattr

`rust` helps

specfiles: inst v. rm %pre (install) %post %preun (uninstall) %postun

%pre

(install)

%post

%preun

(uninstall)

%postun

specfiles: (belated) introduction package metadata Name, %description Requires, Conflicts

package metadata

Name, %description

Requires, Conflicts

specfiles: A&D %triggerin %triggerun many tools: rpm2targz alien apt-rpm Fedora, OpenSuSE, and Mandriva don't share macros

%triggerin

%triggerun

many tools:

rpm2targz

alien

apt-rpm

Fedora, OpenSuSE, and Mandriva don't share macros

rPath/Foresight 1: cvc (kinda) deps: conary

1: cvc (kinda)

deps: conary

conary package.recipe class Foo(PackageRecipe) def setup(r) r.addArchive('http://...') r.addPatch() r.Configure('--with-gtk') r.Make('all') r.MakeInstall() r.Run('ls') AutoPackageRecipe

class Foo(PackageRecipe)

def setup(r)

r.addArchive('http://...')

r.addPatch()

r.Configure('--with-gtk')

r.Make('all')

r.MakeInstall()

r.Run('ls')

AutoPackageRecipe

super classes AutoPackageRecipe Gnome PR kdeCore PR CPAN PR RPM PR

AutoPackageRecipe

Gnome PR

kdeCore PR

CPAN PR

RPM PR

super classes (2) multiple inheritance Python mixin

multiple inheritance

Python mixin

cvc pkg repo~ver ctrl repo cvc newpkg cvc co (edit, cook .recipe) cvc ci distributed VCS repo shadow (branch) co (edit, cook .recipe) ci merge (upstream) promote (pull)

pkg repo~ver ctrl repo

cvc newpkg

cvc co

(edit, cook .recipe)

cvc ci

distributed VCS repo

shadow (branch)

co

(edit, cook .recipe)

ci

merge

(upstream) promote (pull)

conary A&D Python dvcs rollback changeset:config files steep learning curve trove, flavor, ... verbose syntax to specify package Tom Lord's Arch shortcuts :) relatively young

Python

dvcs

rollback

changeset:config files

steep learning curve

trove, flavor, ...

verbose syntax to specify package

Tom Lord's Arch

shortcuts :)

relatively young

Loose Ends

chroots Debian: pbuilder Fedora: mock rPath: rmake Gentoo: catalyst LiveCD

Debian: pbuilder

Fedora: mock

rPath: rmake

Gentoo: catalyst

LiveCD

Build Services Ubuntu: Launchpad PPA (apt repo) Fedora: Koji rPath: rBuilder Online (VM) OpenSuSE: Build Service (obs) (one click) open source! Gentoo: tinderbox some dude's DistCC farm

Ubuntu: Launchpad PPA (apt repo)

Fedora: Koji

rPath: rBuilder Online (VM)

OpenSuSE: Build Service (obs) (one click)

open source!

Gentoo: tinderbox

some dude's DistCC farm

Devs: why pkg-ing? build system distribution system LP PPA obs 1 click install

build system

distribution system

LP PPA

obs 1 click install

SysAdmins: why pkg-ing? “encode” best practices apache2 phpmyadmin don't document, package!

“encode” best practices

apache2

phpmyadmin

don't document, package!

users: why pkg-ing? “easier” deployment pre-built dependencies

“easier” deployment

pre-built

dependencies

what's next

what's next: CPANism Perl CPAN, Ruby gems, PHP PEAR & PECL, PyPI, R CRAN Mozilla extensions, Eclipse plugins should os distro handle this? if so, how? Debian: manual (py-support, py-central) Gentoo: auto-generate ex needed by non-Perl 666+ if not, how?

Perl CPAN, Ruby gems, PHP PEAR & PECL, PyPI, R CRAN

Mozilla extensions, Eclipse plugins

should os distro handle this?

if so, how?

Debian: manual (py-support, py-central)

Gentoo: auto-generate

ex needed by non-Perl

666+

if not, how?

what's next: Java current practice: bundle JARs Gentoo is doing fun stuff Maven

current practice: bundle JARs

Gentoo is doing fun stuff

Maven

what's next: PackageKit one UI to rule them all apt conary yum zypp ...

one UI to rule them all

apt

conary

yum

zypp

...

what's next: Windows Pidgin: GTK XChat: GTK GIMP: GTK KDE on Windows Games: DirectX

Pidgin: GTK

XChat: GTK

GIMP: GTK

KDE on Windows

Games: DirectX

exit Things are getting better Many challenges ahead Thanx!

Things are getting better

Many challenges ahead

Thanx!

Q&A

References http://docs.fedoraproject.org/drafts/rpm-guide-en/index.html http://wiki.rpath.com/ http://www.packagekit.org/ http://flickr.com/photos/mknowles/47457221/sizes/m/ http://www.supermanhomepage.com/multimedia/Wallpaper-Images/superman-supergirl-tb.html http://flickr.com/photos/juiceboxgasoline/98539782/ http://flickr.com/photos/drh/2256587356/ http://www.fpa.nifc.gov/Library/Documentation/FPA_PM_Reference_Information/Output/images/gis_layers.jpg

http://docs.fedoraproject.org/drafts/rpm-guide-en/index.html

http://wiki.rpath.com/

http://www.packagekit.org/

http://flickr.com/photos/mknowles/47457221/sizes/m/

http://www.supermanhomepage.com/multimedia/Wallpaper-Images/superman-supergirl-tb.html

http://flickr.com/photos/juiceboxgasoline/98539782/

http://flickr.com/photos/drh/2256587356/

http://www.fpa.nifc.gov/Library/Documentation/FPA_PM_Reference_Information/Output/images/gis_layers.jpg