Charles was born in London, the younger son of Admiral Sir William Wordsworth Fisher, G.C.B., G.C.V.O., and his wife, Cecilia Warre-Cornish. He had two older sisters. His brother was killed in a flying accident.

His paternal grandfather, Herbert William Fisher, served as the personal tutor to the Prince of Wales, the future Edward VII, during his undergraduate studies at Christ Church and from 1860-70, acted as his private secretary. His maternal grandfather, Francis Warre-Cornish, had been Vice-Provost of Eton. His uncle, Charles Dennis Fisher was killed in 1915. All of them had been at Christ Church.

Charles was a King’s Scholar at Eton and matriculating in 1937, came up to Christ Church as a Scholar. He graduated with a 2nd in Classical Mods in 1939.

His father died the year he came up and his mother moved into an apartment in Hampton Court Palace, the following year. She died in 1965.

Charles was a Captain in the Royal Horse Artillery when he was killed in Italy on 11 July 1944.

He is buried in the Assisi War Cemetery. Plot X, D, 3.

He is commemorated in the Royal Memorial Chapel, Sandhurst.