Points near a + charge are at higher potential than those farther away.

Points near a - charge are at lower potential than those farther away.

Moving from left to right in the figure below results in a decrease in potential. This would be true even if one of the charges was removed. Think about it.