You can remove a square from the portal by closing the square.
How to remove a Portal square:
Click the Close icon
in the square. Use the Portal settings to display the Portal square again.