I remember reading in the liner notes to this that they swore they would never play this song live.
Then in 2006 or 2007 I was at the Warped Tour in Dallas. It was hot and miserable all day. When NOFX came on at the end of the day a huge storm blew in. After 1 song someone comes out on the stage and tells Fat Mike they are shutting it down. They ask everyone to go over to the pavilion. Nobody moved. The entire crowd just yelled for the show to continue.
10 minutes later Fat Mike comes back out and says they told them they can play 3 songs. So they would play their 3 longest songs. Which included this song, the Decline. It was a sight to behold watching them play it in pouring ass rain. It was even more impressive than the Red Rock video because without the backing orchestra El Hefe and Eric Melvin had to play the trombone and trumpet parts between playing guitar.
As far as I am aware that was the first time they played it live too.