I ended up buying gasket material and made my own new gaskets by hand and will now apply permatex to seal it all up. Not the most beautiful job but it will definitely do the trick.
I made four gaskets, one for each side of the metal “membrane” if that makes any sense at all.