Well, apparently MP3 support is iffy for all versions of Linux, probably due to copyright issues. Anyways, thanks to a few forum posts, and Jacob's Weblog I was able to get it running.

Just an FYI: Sound Juicer is your default ripper and Rhythmbox plays your music.

Yay, for Ubuntu Wiki! Okay so after much searching to rip and play Mp3's in Ubuntu visit the following Wiki pages, or just follow the instructions that I've written:
Restricted Formats
Ubuntu Ripping Cds


So here's what you need to do for Ubuntu 6.06 LTS:

1. You're going to need to download/install a few packages. Make sure the Multiverse and Universe repositories are enabled. You're going to need to install the following packages (Order isn't important):
   • gstreamer0.10-plugins-ugly
     
   • gstreamer0.8-lame
     
   • gstreamer0.8-mad
     
   • gstreamer0.10-plugins-ugly-multiverse
     
   • gstreamer0.8-misc
   
   
   
2. Okay gstreamer0.10-plugins-ugly, gstreamer0.8-mad and gstreamer0.8-misc should let you play Mp3s now.
   
   
3. Next go into Sound Juicer and go to "Prefrences" look at "Output Format" and click "Edit Profiles."
   
   
4. Hit "New."
   
5. Quote:
   Profile Name: MP3 128
   Description: Blah
   GStreamer Pipeline: audio/x-raw-int,rate=44100,channels=2 ! lame name=enc bitrate=128 ! id3v2mux
   File Extension: mp3
   
   
6. Now, then you just enabled MP3 ripping at a 128k bitrate, you can change the bit-rate to whatever you like. Whoot! If the files are comming out garbled or 40mb each, you probably forgot to install one of the packages, just go back and double check.