I quickly tried the HDR based technique. I made a very bad HDR using 3 panoramas. Every panorama was positioned in different way, luckily Photoshop got the function to get rid of the ghosts, so the final image could be used:
Rest is simple, just using the HDR as image based light:
Light seems quite nice, only con is that the render times are insane, especially with final gathering.