Yes, in your bottom photo, the water heater bypass valve is located on the outside of the blue PEX at the lower part of the water heater. It's a 1/4 turn valve , currently it's set on "summer" or "water heater flow ON"... Turn the valve so it aligns with the vertical PEX and it will be in "bypass" or "water heater flow OFF".
Your water pump is a FloJet brand. You can tell by the "blue locking tabs" on the inlet and outlet connections. The very BEST thing you can do for your pump reliability is to purchase and install a strainer on the inlet (white flex hose with blue stripes) to protect the pump diaphragm from damage caused by trash that IS (not could be) in your fresh water tank.
https://www.amazon.com/Flojet-017403...6635441&sr=8-5
You may need to reposition the water pump to get the strainer installed. That consists of unscrewing the 4 mounting screws and sliding the pump over (away from the wall) an inch or so.
Here's a link to that $7 strainer which (to me) is a "no brainer"... Yeah I know.... It's late and I haven't had my nap yet LOL