The 1st Earl of Suffolk was the younger son of the 4th Duke of Norfolk, who was first cousin to Henry and Thomas (Viscounts of Bindon). His mother was Margaret Audley, an heiress, through whom he inherited Audley End and other land in Suffolk. In early life, he was an admiral, fighting against the Spanish. After illness curtailed his military career, he held a variety of significant posts, culminating in the office of Lord High Treasurer to King James I. As his influence rose, he initiated a huge (and unaffordable) building programme, including the building of a new Audley End House, the largest private house in England.

His fortunes then crashed; he was accused by the king of embezzlement from the royal treasury, and of extorsion. He was fined, and imprisoned for a time. Although he was released from prison, he never gained his former position.

The 1st Earl of Suffolk was succeeded, in title and estates, by his son and grandson. His grandson, James Howard, sold the Dorset estates in 1641, to Humphrey Weld. The list of properties sold includes Cullifordtree Hundred, but does not explicitly include Sutton Poyntz. For reasons that are not clear, it seems that Sutton Poyntz was sold separately, to Eliab Harvey of Rolls Court in Essex.