Can an LLM Forget the Right Things? Towards Data Science