I figured that's what was being referred to. I suggest people go look at it again
Baltar is looking DOWN from the TOP of a hill, while Adama's house was at the BOTTOM of a hill, as the people had approached coming from the TOP of the hill.
At the top of the hill that the people approached from, there was NO ruins.
But Baltar is standing right next to some ruins.
Thus, different hill.