Good Morning PA,
My back wall looks similar to yours. They are not going to be perfectly smooth like the laminated side walls. I would, and do pay attention to signs of it worsening. Keep checking seals and caulk and as long as it doesn't get worse I think you're good to go.
Good Luck