Now 85, he fled North Korea as a teenager to avoid being drafted into the military. For more than 60 years, he wondered whether his loved ones were still alive. He was desperate to see them again.
He had been consistently applying for a reunion ever since the program to bring together families separated by the Korean War began in the 1980s.
On Saturday, he finally got his wish.
His was one of fewer than 200 families selected for a rare reunion.
He says he did not recognize his sister Ahn Yoon-Sook, 79, at first. But he knew it had to be her when he saw a familiar scar on her forehead -- one that he gave her when they were play-fighting as children.
"I felt nothing but happiness," he tells CNN.
The first thing he did was ask his sisters for forgiveness, because he left them alone to take care of the family. He says that should have been his responsibility.
Their response: tears.
Then, his sister Ahn Yoon-Ae, 72, told him, "Even though we did not have you, our great leader took us into his arms and provided a big house."
'I was careful with what I was saying'
Looking at the wrinkles on her face and the poor quality of her traditional Korean dress, Ahn suspected life had been a lot tougher for his little sister than she was able to admit in front of the North Korean monitors who were listening to every word.
"She looked so much older than she really is," he says.
But he felt he could not talk about the real story of their lives or ask why their younger sister died at 33.
"I was afraid if I said something wrong, my sisters would face repercussions (from North Korean authorities)," he says. "That is why I was careful with what I was saying and what I was asking. There was not that much freedom."
He says he could only imagine the hardships his whole family faced over the decades on the other side of the border and the overwhelming feeling during the reunion was sadness.
"I would have felt better not knowing. After knowing, there is more sadness," he says. "It would actually have been better not meeting them."
After just a few hours together over a period of three days, it was time to say goodbye.
Ahn says knowing he will likely never see his sisters again made him even sadder.