Bernie's Fate 'Made-off' With His Family

Convicted Ponzi schemer Bernard Madoff was forced to "let ... go" of his wife almost a year ago and is wracked by "horrible nightmares" as he sits in a North Carolina prison, he told ABC News' Barbara Walters in an exclusive interview.

Though he "can live with" the anger of people he defrauded out of billions of dollars and he is adjusting to the rhythms of life in prison, even at 73 years old, he is troubled by anger and turmoil within his own family.

"Not seeing my family and knowing they hate me" is the worst thing about being in prison, he said. "I betrayed them."

Asked what he'd like to say to his grandchildren, he said, without apparent emotion, "I am sorry to have caused them pain."

As he sat across from Walters during a two-hour conversation at the Federal Correction Complex at Butler, N.C., on Oct. 14, Madoff often seemed to be trying as much as possible to feel no pain, himself.

There were no pictures taken of the session because cameras are not allowed into the prison for interviews with Madoff.

Madoff said he passes the time by reading, recently finishing a book about Wall Street robber barons.

The man who ran a Ponzi scheme of more than $60 billion has held six or seven different jobs in prison, he said, and he makes $170 a month.