As I posted on AskUbuntu, I got AMD / ATI Drivers working on Ubuntu 12.04.

After installing Ubuntu to an USB Stick with Method1 from the install instructions page.

Download the AMD / ATI Driver from here.

Now follow the instructions posted here.