This came from the beach at Dumpton Gap in Kent.
The site is mostly cretaceous chalk with bands of flint and produces sea urchins but I don't know what this is.
My suspicion is sponge but I may have to stand in pseudes corner with my face to the wall.