The Square has been the focal point of the village for many generations. The site of Rory McGuinness's fourteenth century castle after which Rostrevor was once called "Caisleann Rhuadhri" are reputed to be on the south side of the Square. Almost all the buildings were built in the early to mid nineteenth century, which was also when the large oak tress were planted. The main exception is nos. 8 - 10, which were originally built as a police station in 1932. Nos. 12 - 16 are the remains of the Sangster's Hotel where the Yelverton's stayed before their infamous marriage in 1857. The house at the corner of Greenpark Road is known as "the Anchorage" and is an excellent example of a period house that has been well maintained as a family home.