Originally from Northampton, Oliver attended University of Surrey where he was awarded a conducting scholarship, studying with Nicholas Conran. He also studied composition and conducting with Sebastian Forbes and singing with Glyn Davenport. During this time Oliver was a student conductor with the Amadeus Orchestra, and assistant conductor of Bath Philharmonia. Graduating with a Master's Degree, he went on to continue his studies at the University of Freiburg, Germany, and at the Juilliard School in New York City.

His work as a baritone has included solo recitals throughout England, and also in Germany (Freiburg Stadttheater), France (Besançon Opera), Italy (Padova Opera) and Spain (Granada Festival), and in the USA. His oratorio credits include Messiah, The Creation, Elijah, Beethoven's Ninth Symphony, and Requiems by Fauré, Mozart and Brahms.

Oliver began his conducting career as Music Director of Guildford Opera, where productions included Eugene Onegin, Le nozze di Figaro, Iolanthe, The Mikado, Samson, The Tales of Hoffmann, The Rake's Progress, The Bear and Trouble in Tahiti. Since then he has worked as Assistant Conductor and Chorus Master for British Youth Opera, Associate Lecturer in Conducting for University of Surrey, Director of Schola Cantorum Greenwich, and Guest Conductor for Northampton Festival Opera.

He has also prepared choirs and soloists for a number of conductors, including Lorin Maazel, Sir Neville Marriner, Edward Gardner, Giuseppe Grazioli, Eckart Preu and Ian Tracey. He has also prepared singers for performances with Yale Opera, the Academy of St Martin-in-the-Fields, Stamford Symphony Orchestra and the American Classical Orchestra.

In June 2008, Oliver was appointed as Musical Director of the Ceramic City Choir in Stoke-on-Trent, the largest Choral Society in North Staffordshire, with whom he has embarked on an exciting series of concerts. Plans include Mendelssohn Elijah and Elgar The Music Makers. He also works as a choir trainer for the Royal School of Church Music, and teaches at Uppingham School in Rutland, where he is Head of Singing.