@rjh - I used to rollerblade around the same time - the mid to late 90s - when the X Games and extreme sports in general was really taking off. It was really popular where I grew up and around the world; like skateboards, a pair of rollerblades were usually relatively cheap and you could do it just about anywhere. Now you'd hardly ever see a rollerblader at a skate park.
All sports go through high points and low points, but to me I think the days of inline skating being a part of the X Games or even popular are over. It's hard to pinpoint a specific reason for this, but I have my own opinions. When the X Games first started, skateboarding, BMX and inline skating were the big three. They all used similar if not identical courses and they were entertaining for everybody.
Then I think extreme sports in general became oversaturated and they needed something to keep it fresh and interesting. By then freestyle motocross was really taking off; instead of being limited to videos - you might remember the Crusty Demons of Dirt series - there were a lot more organized events and meanwhile, the X Games was having trouble attracting good enough competitors for inline skating. So when they cut inline skating which I believe was around 2005, they practically killed the sport. No kids were turning on the television and wanting to start skating, they all wanted motorbikes now.
That being said, I had a lot of fun doing it growing up, I just don't think it's coming back any time soon.