This castle was built and controlled by the Normans as they attempted to take control of South Wales. A wooden castle was built on the banks of the river Gwendraeth by Roger, bishop of Salisbury in around 1106. Roger was a trusted supporter of Henry I and was responsible for other construction work. He built Sherborne Old Castle and a Cathedral at Old Sarum. The steep banks of the river provide protection one one side of the castle while a ditch provided protection on the other. The wooden structure was replaced by a stone castle in the late thirteenth century.