There's a new backporter in town....

[jdong]

ubp-build.py!

http://backports.ubuntuforums.org/ubp/projects/ubp-tools/ubp-build/ubp-build.py

This handy little Python script I hacked together reduces backporting to a single command!



For example, I just packaged Nautilus 2.10.1 with the command "ubp-build.py nautilus" :) :)


This should really ease our workload :)

[23meg]

wow, sounds practical. does it backport from debian unstable?

[jdong]

It backports from whatever it can get through the apt-get source command, which depends on your deb-src lines in sources.list.

[McQuaid]

Great work!

[jdong]

Ok, I fixed two bugs in it this morning.... stupid octal... :D

[aboe]

mmm...403..forbidden...

that's a pity I would love to help out...in anyway possible

[ShaneAu]

mmm...403..forbidden...

that's a pity I would love to help out...in anyway possible
It's on one of the mirrors:

ftp://ftp2.caliu.info/backports/projects/ubp-tools/ubp-build/ubp-build.py

[aboe]

found it in the ftp....so how can I help building with this?? :smile:

[Mez]

yeah, looks nea, theres a couple of things I'd like to be able to backport

I assume it's just now finding an apt-get deb-src repos for whatever we want ot backport?

[jdong]

Issue "ubp-build.py" to see the syntax. You can provide it a package name, if it's APT-gettable via deb-src, or give it a URL to a pre-debianized tar.gz, or give it URLs to an orig.tar.gz and a .diff.gz.

[Technoviking]

I just realized I can replaced with a small script :).

Mike

[jdong]

Naw, developers can now shift their focus onto the more important issues: stability and quality.

[McQuaid]

I tried this script for the first time and everything seemed to go ok but had this at the end:

dpkg-genchanges: binary-only upload - not including any source code
dpkg-buildpackage: binary only upload (no source included)
Build succeeded!
***Copying to local repository
Backport or Extra [B/e] ?B
Section [m/r/U/v] ?U
Architecture [i/p/a] (I)?i
`kaffeine_0.6-0ubuntu6_i386.deb' -> `/home/mcquaid/ubp/dists/hoary-backports-staging/universe/binary-i386'
/bin/cp: cannot create regular file `/home/mcquaid/ubp/dists/hoary-backports-staging/universe/binary-i386': No such file or directory
Traceback (most recent call last):
File "/home/mcquaid/ubuntu source script/ubp-build.py", line 267, in ?
add_to_workingcopy()
File "/home/mcquaid/ubuntu source script/ubp-build.py", line 240, in add_to_workingcopy
raise Exception("Error copying to repository...")
Exception: Error copying to repository...

The deb was still created and I then manually installed it but I curious as to what went wrong.
Also, when it asked me backport/extra,sect,arch I thought that was already answered by the files in the debian directory.

[jdong]

That step is for committing it to a Backports mirror... So it assumes a certain folder structure.

You can CTRL+C at that point, and just look in ~/ubp-compile-temp for the debs.

[Quest-Master]

Hmm.. keeps on asking for a password and username.. :\

[Majlo]

Hmm.. keeps on asking for a password and username.. :\

Try this link

http://backports.ubuntuforums.org/ubp/projects/ubp-tools/ubp-build/ubp-build.py
;-)

[jdong]

Thanks. Original link fixed.

[monway]

Hi JDONG,

I'm Dylan the guy that all the buzz is about for the ppc backport support. I've just recently posted to the list a lil intro about me. I'm happy to say i've tested your script on my ppc machine and doing the ubp-build.py nautilus and see how that goes. So far so good. I'm happy to contribute. Looking forward to more as I go. cheers to all.
-Dylan

[monway]

jdong,

the script worked fine up to this point
***Copying to local repository
Backport or Extra [B/e] ?B
Section [m/r/U/v] ?m
Architecture [i/p/a] (I)?p
/bin/cp: `/home/loki/ubp/dists/hoary-backports-staging/main/binary-powerpc': specified destination directory does not exist
Try `/bin/cp --help' for more information.
Traceback (most recent call last):
File "/home/loki/Desktop/ubp-build.py", line 272, in ?
add_to_workingcopy()
File "/home/loki/Desktop/ubp-build.py", line 245, in add_to_workingcopy
raise Exception("Error copying to repository...")
Exception: Error copying to repository...

Looks like we need a powerpc section for me to contribute. Thanks.
:D

[manicka]

Can't download the script with wget

Connection refused

[jdong]

google for ubp-build -- master mirror down for server migration.

[floydwaferfield]

After the edit changelog part, I get the message that says "I couldn't resolve build dependencies by myself. I'll drop you to a shell". I was just wondering how you go about doing this.

[jdong]

First off, that means the package doesn't qualify for official Backports.

IF you want to work past it, try:


dpkg-buildpackage -b -rfakeroot


This should spit out a list of dependencies that are not currently met. Use apt-get install to install as many of these as you can, and keep on doing the above command to check what's left. When you've gotten as close as you possibly can, press CTRL+D, then ubp-build.py will prompt you to rebuild with no dep check, say YES.

If this step fails, the package cannot be compiled under Breezy.

[floydwaferfield]

I was trying to backport ZSNES using the source tar.gz from one of the ZSNES mirrors. How do I copy the dependencies of v.1.40 in multiverse to this version?

[jdong]

Use ubp-build.py SOURCE_TAR_GZ_URL NEWEST_UBUNTU_OR_DEBIAN_DIFF.diff.gz and follow the above procedure when prompted to manually do deps.

[strikeforce]

Use ubp-build.py SOURCE_TAR_GZ_URL NEWEST_UBUNTU_OR_DEBIAN_DIFF.diff.gz and follow the above procedure when prompted to manually do deps.


Can we use the source from the repositories? E.g. packages.ubuntu.com have links to the orig.tar.gz? Or will that not work?

Edit

Also when backporting the only change is in the number e.g. ~breezy1
Do you change the name in the changelog or just the number?

[jdong]

(1) If you're gonna use both the orig.tar.gz and diff.gz from an APT repository, you might as well put the appropriate deb-src lines in /etc/apt/sources.list, and just do ubp-build packagename.

(2) Only append ~breezy0.1 to the version field; Don't bother changing anything else. Use 0.1 rather than 1 so that future "official backports" would override your work.

[akurashy]

i just noticed this post, i should try using this *goes to read more about it*

[akurashy]

well, i'm really a bit confused, is there gonig to be a wiki on using this? would be great for developer reference :)

[jdong]

You want to write one?

[akurashy]

i think I pass, like i said i'm still a bit confused of the usage.

[n6mod]

First off, that means the package doesn't qualify for official Backports.


Can you clarify that? For instance, I just built the Evolution packages using ubp-build.py, but I had to build and install evolution-data-server before evolution itself would build. It seems like any modular package would have this problem.

In any event, the new Evolution packages seem to have fixed the horrible problems with Evolution-Exchange in Breezy.

-Zandr

[jdong]

Can you clarify that? For instance, I just built the Evolution packages using ubp-build.py, but I had to build and install evolution-data-server before evolution itself would build. It seems like any modular package would have this problem.

Ok, that's fine, provided that e-d-s is in accordance of the Backports guidelines (i.e. no libraries, builds fine with ubp-build without the built in hacks)

[n6mod]

Ok, that's fine, provided that e-d-s is in accordance of the Backports guidelines (i.e. no libraries, builds fine with ubp-build without the built in hacks)

I wasn't watching the output of ubp-build carefully enough, nor with enough wisdom, to percieve any built-in hacks.

That said, there are a couple of outside dependencies on libs built as part of e-d-s. deskbar-applet and nautilus-sendto, in particular. (Not very far outside, but outside)

It's also not quite bombproof (It's 2.5, and upstream doesn't think 2.5 is released)

So I'd say it's not ready for Backports, but I can track Dapper with ubp-build. (which is a marvelous tool, thank you!)

The ubp-built packages work fine for me, which is more than can be said about the version in Breezy.

[rko618]

I feel like a n00b. I am trying to run
ubp-build.py
in the directory that I KNOW ubp-build.py is in and I am getting
ubp-build.py: command not found


what am I doing wrong?

[mlind]

If you're on the same directory as this file is, then try
./ubp-build.py

[jamadagni]

I tried modifying the script to work with pre-downloaded source packages and diffs, but probably owing to my total absence of previous experience with Python, I was not able to get it to work. Please check and tell me what I did wrong.

I changed basically the do_tarball and do_patch functions.

Also, I was not able to understand the purpose of the "-O-" between the wget command and the pipe.

[jdong]

The script should already work with predownloaded source and diffs -- if you provide the two filenames it should understand it.

The -O- and pipe just downloads the tarball and directly extracts it as it streams in, instead of saving the tarball to the hard disk first. Saves some disk space :)

[jamadagni]

The script should already work with predownloaded source and diffs -- if you provide the two filenames it should understand it.

Nope. Voici -

$ ls
kboincspy_0.9.1-3.diff.gz kboincspy_0.9.1.orig.tar.gz ubuntu-backport-builder.py

$ ./ubuntu-backport-builder.py kboincspy_0.9.1.orig.tar.gz kboincspy_0.9.1-3.diff.gz
***Parsing packagename....
Treating arguments as source archive and debianization patch
***Cleaning up working directory...
Cleaning up existing working directory...
***Fetching sourcecode...
--20:10:37-- http://kboincspy_0.9.1.orig.tar.gz/
=> `-'
Resolving kboincspy_0.9.1.orig.tar.gz... failed: Name or service not known.

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error exit delayed from previous errors
Something went wrong unpacking sources. I'll let you do it instead...
Unpack sources into a subdirectory of /home/samjnaa/ubp-compile-temp for me.

The -O- and pipe just downloads the tarball and directly extracts it as it streams in, instead of saving the tarball to the hard disk first. Saves some disk space :)

The -O- is a part of what? Bash syntax? If I do want to save the tarball to the disk first, then how should it be changed?

Thanks.

[jdong]

-O- is an option to wget. Namely, -O means specify output file name, and '-' is standard output. Remove the -O- and wget will revert to its original behavior of saving the file.

[jamadagni]

Fine, but what is the solution to use pre-downloaded files?