King Charles enjoys a summer getaway to The Castle of Mey every year Andrew Milligan - PA Images/Getty Images‘Do you think me mad?’ So asked the Queen Mother in a letter to her treasurer, Sir Arthur Penn. And while the King enjoys his summer getaway, let Tatler talk you through the history of the Castle of Mey. Sometime around the turn of the 1560s, it was built by the 4th Earl of Caithness as a gift for his second son, William Sinclair. With its owner otherwise indisposed, the Castle of Mey was taken up by George Sinclair, who named the family the Sinclairs of Mey.