In 1046, Heilwige de Dabo, Countess of Eguisheim and mother of Pope Leo IX, founded a priory of Canons Regular of Saint Augustine on the hill. Leo IX consecrated the church in 1049 and deposited relics of Saint Romain there. The lower part of the choir dates from the 12th century, the chapel of Saint-Michel still has Romanesque openings and the chapel of Saint-Léon still has parts of the 12th century in its chevet.
The parish church of Saint-Romain now houses 2 reliquary shrine masterpieces of Romanesque goldsmithery.The largest, the Saint-Romain shrine, dates from the 12th century.It is a barlong oak chest with a gabled roof, covered with plates of embossed, engraved and partially gilded silver. The front is decorated with Christ surrounded by six apostles placed under arcatures. The other six apostles are depicted at the back with the Virgin Mary. The sides represent two episodes in the life of the saint: his baptism and his beheading.
The small shrine, ‘Petit reliquaire’, is similar in plan but smaller, and also features the figure of Christ under an archway, but this time surrounded by wise and foolish virgins. Nuns are on the other side.The reliefs are not of the same quality as those in the reliquary of Saint Roman.