Fuel pump diaphragm looks to be showing behind the plate on the side of the carburetor, with the Phillips head screws holding the plate on. So the fuel pump is integrated as a side mounted version, right on the side of the carburetor. Find your model number or serial number, and go to boats.net, you should be able to find a carb schematic, and available parts list there.

That was all rebuilt when I rebuilt the carb (Was having the same problem before rebuild) I guess I could rebuild it again if you think it's the problem.

Yup. There it is. Like Trappede4ever said. See the diaphragm underneath the aluminum plate with the phillips head screws?
That gas hose looks soft.

https://www.marineengine.com/parts/...00-thru-0t979999-usa/carburetor-assembly

That link I sent you is kinda generic, just for the picture value. For Merc parts you need to get BOTH the serial number and the model number.

Had a similar issue recently with an older 15 HP Evinrude. Tried everything involving filters and fuel and had to keep squeezing bulb to maintain speed. Replaced fuel pump and problem was solved. Yes, I see your fuel pump like others have mentioned. I'd be willing to bet if you can replace it, your problem will go away.

I ordered the parts. They Ain't cheap. around $70 so I hope this fixes it. I'm hoping I can fix this without pulling the carb because it's a pain in the rump. However, it looks like I'm going to have too.

Ethanol fuel does in another......need I say any more.
The gaskets just do not like it at all over time.

When you have your carb apart, check and make sure your float is sitting level. You also might want to pressure test the needle/ seat, to make sure they aren't the issue. I had a newer 4 stroke with 3 carbs display similar symptoms. After ruling out a lot of other options, I finally figured out the all plastic carb floats (no brass hinge arm to bend for adjustment) had warped, sitting high, and causing my issues. I has to order new floats, and wait for arrival, since the all plastic ones cannot be adjusted.