Situated just a third of a mile (0.5 km) to the north of Dalmeny House, on the shores of the Firth of Forth, Barnbougle Castle was the original home of the Earls of Rosebery. It is a 13th Century tower house, but was abandoned for the more comfortable surroundings of Dalmeny in 1817. An original plan by Robert Adam intended to extend and modernise the castle, but the family preferred a new site set back from the exposed location by the river.
However, in 1881, Archibald Primrose, the 5th Earl of Rosebery (1847 - 1929), who became British Prime Minister, rebuilt and extended the Castle as a retreat. The main function of the restored castle was to hold his extensive library; the living space was relatively modest.
Barnbougle remains a residence of the Rosebery family.