@MsClean - I've seen oven baked beer can chicken recipes before although I have never tried it myself. There was one that I was tempted to try though that looked pretty simple that I'll try to explain for you.
The cook lined a roasting pan with foil then emptied and rinsed out the beer can and filled it only half way with sangria. You can use the half filled can of beer if you prefer, or wine, soda or fruit juice works just as well.
She punched four or five holes in the top of the can with a pointed can opener for ventilation then placed the can in the center of the roasting pan.
She then put the marinated whole chicken, large cavity down, over the beer can and roasted it for one and a half to two hours.
I'm sure someone who has done this before will have a better answer for you. You might also search the Internet for some different techniques but I think that's basically how it's done.