To remove a block from one of your channels, hover on the block you want to remove, click the three dots and hit, "remove connection".

Keep in mind that the block will not be deleted from any channels where other members have connected it.