Oh yes, definitely! Even if someone is moving in soon after you leave you must cancel your contracts. I made the mistake of thinking my supervisor would handle it, but I was still billed the base fees after moving until I resolved the issue. So make sure you sort it out before moving out!