In 1964, she married Hollywood columnist Joe Hyams (6 June 1923 – 8 November 2008), who was 17 years older, in Las Vegas in front of a Justice of the Peace. Sommer suffered her first miscarriage while working on the set of The Money Trap, in which she co-starred with Glenn Ford and Rita Hayworth.
A second miscarriage followed exactly one year later during the filming of Boy, Did I Get A Wrong Number, in which she starred with Bob Hope under the direction of George Marshall.
In 1973, Sommer and Hyams tried again to start a family. While working on the set of Die Reise nach Wien she suffered her third miscarriage. By then her marriage was on the rocks.
Her mother, Renata von Schletz, accompanied her to film sets as well as on cinema tours even after Elke Sommer’s marriage to Joe Hyams had failed and a new man came into her life: Tom Bohla. Bohla moved in with Sommer, who had separated from her husband, but was still sharing the house with him and had no intention of filing for divorce.
Then she met Wolf Walther, eight years her junior and the general manager of New York City’s luxury hotel Essex House. They were married on 29 August 1993 in Franconia. In a 2014 interview, Sommer described how she and Walther met:
“I was in New York City starring in Tamara and had to stay there for four months. So, I had to find an apartment but they were excruciatingly expensive, tiny and loud. As I knew the managing director of the Essex House, I wanted to talk to him about renting a room but the hotel had a new managing director, a man by the name of Wolf Walther. So we met. For him, it was love at first sight. For me, it took a little longer, but not much longer. As you may know, Tamara is a play in which the audience follows the actor of their choice, and as you may also know, my husband is 6’5″ and hard to miss. I saw him every night in the audience, following me. Every night. And that was the beginning of the greatest love story of my life, still unfolding and getting better by the day.”