The 34-year-old Englishman and the betrothed 35-year-old never even went red carpet official during their six-year romance, which began at the 2016 Met Gala and ended in 2023