Conway died at 8:45 a.m. PST in Los Angeles, his rep Howard Bragman told People.
The actor is also known for playing Ensign Parker on the 1960s comedy McHale's Navy, voicing Barnacle Boy in SpongeBob SquarePants, and playing Dorf in a wide series of films.
Conway has long battled Normal Pressure Hydrocephalus (NPH).
According to People:
The beloved actor is best known for his work on The Carol Burnett Show, winning viewers over with characters like the Oldest Man and Mr. Tudball, whose accent he has said was inspired by his Romanian mother. He was known to ad-lib his sketches — even surprising his scene partners — and won a Golden Globe Award for the series in 1976, along with Emmys in 1973, 1977 and 1978.
According to his IMDb page, Conway has 124 acting credits to his name.
Conway is survived by his wife of 35 years, six biological children, a stepdaughter, and two granddaughters.