Galway played with the Philharmonia Orchestra as it rose to prominence in the 1950s. He auditioned for the Berlin Philharmonic Orchestra under Herbert von Karajan, and was principal flute of that orchestra from 1969 to 1975. To Karajan's surprise and dismay, after a period of some disagreement, "Jimmy" Galway decided that he would leave to pursue a solo career, which he succeeded in doing admirably. He still performs regularly and is one of the world's leading classical flute players.

He is Principal Guest Conductor of the London Mozart Players, based at the Fairfield Halls, Croydon, South London. And most recently, he performed for the Academy Award-winning ensemble recording the soundtracks of Peter Jackson's Lord of the Rings film trilogy.

He now resides in Meggen, Switzerland, with his U.S.-born wife, Jeanne. They often tour together playing duets, accompanied by Phillip Moll on piano.