Kia ora,
here is another post about The One and Only Ivan.
I think Ivan does remember some of his childhood stories. But he only remembers the sad memories and not many happy memories. He has lots of sad memories because his parents and sister died. I think he is trying not to remember the sad memories because there are no happy memories.
Would you try and forget your sad memories?