You can choose to display a row with buttons in the page editor. These buttons add and remove columns from that page.
Even if not enabled, you can change the number of columns for your page in the page layout section.