Do I need to tell them?!?

Presumably you have given your new employers a P45? If so, they have to tell the tax office of your change in employment and it will be done then!