Constructed as a law office in 1790, the rear part of 202 High Street was conveyed by Ambassador William Vans Murray to his brother, Dr. John Murray, in 1797. Judge James A. Stewart acquired the property around 1848, and it was significantly added to.
In the early 20th century, prominent local architect (and twice mayor of Cambridge) J. Benjamin Brown bought the building and converted the top floor into a residence, keeping the first floor as his office. Later, it was the headquarters of the Cambridge Yacht Club Woman’s Auxiliary.
In 2008, the structure was the victim of arson, requiring the efforts of more than 100 firefighters and causing over $500,000 in damage. It is currently being renovated.