The earliest dated owner was Lambert De Scoteni in 1137.

Scotney Castle was used as a fortified house which housed families. The only existing original building are the southern circular tower and the western towers arched entrance. This evidence was recorded by a member of the Darell family who died in 1558.

The Darell family has owned Scotney Castle for 350 years. Thomas Darell who lived in the Castle was a Catholic and many priest holes were put in the Castle and because of this it was used by a famous Jesuit, Father Richard Blount from 1591 - 1598 who hid in one of the priest holes.

Another member of the Darell family, Arthur Darell was a smuggler and as a result of this the Castle was surrounded by Officials who were there to arrest Arthur. To escape capture Arthur attacked an Officer so violently that he was killed, Arthur then tied rocks to his boots and threw him in the moat. The spirit of this Officer comes from the moat and bangs on the door of the Castle and walks the corridors leaving wet footprints where he has trodden.

In 1630 the Castles east side was rebuilt but you are still able to see the ruins.

1778 the Hussey family owned the Castle and revamped it into a Manor House which was completed in 1843.

In 1952 Edward Hussey III's Grandson inherited the castle and lived there until his death in 1970 where the Estate was left to the National Trust who own it to this day.