The house of Thomas Gunter was well-known in Abergavenny as a meeting place for Catholic worshippers during the late 17th century. At this time, Catholics were persecuted in Britain and to be associated with them could be dangerous.

In 1907, whilst renovating the interior of the house, Mrs T. S. Foster came upon an attic room covered with frescos including a dramatic representation of "The adoration of the magi". It would appear that this was the chapel in which the friends of Thomas Gunter worshipped.