There are at least two artists with this name:

1) Garden Of Delight is a gothic rock band Founded in 1991, Artaud proclaimed that G.O.D. would produce seven albums in seven years with seven songs each -- seven is a very powerful number and, in some arcane traditions, seven thrice is the number of perfection. The corpus of The Garden of Delight cannot be viewed as individual albums or songs -- they are all integral aspects of the whole plan that Artaud has been consistently explicating since the first years of this decade. In the 1994 song "Necromanteion (S.O.C.R.)," Artaud utters "The Last of the Lost Ones/Tell them I want to see them." On their most recent album "Scheoul," he declares "We are the Last of the Lost Ones." Six years and six albums later, the circle approaches completion.

Musically, there can be little doubt that Artaud is influenced by Carl McCoy in both subject matter and vocal style.
G.O.D. retain the fundamental structure of "a man and his drum machine." However, Artaud sneers at the notion that the Garden of Delight is a "goth" band. Considering goth, one immediately thinks of bands that are influenced by the Sisters of Mercy. Granted, there is a certain degree of such within the Garden of Delight's work (particularly Symbol and Vision). However, this does not take into account the incredible diversity of their music. Indeed, while all of their albums have had thematic consistency, their music has changed greatly through the years. The Garden of Delight never seem content with a particular "sound." They will adopt one, master it, synthesize it with something else, and then move on. To firmly label the Garden of Delight would imply musical stagnation, which is quite far from the truth.

Official Site

2) Garden of Delight is a German Celtic Folk band. The claim they play "Celtic Rock / Irish Speed / Gothic Folk".

Bandmembers
Michael M. Jung - Vocals, Guitars, Mandolin, Banjo, Mandola
Dominik Roesch - Fiddle, Backing Vocals
Sascha Lotz - Guitars, Backing Vocals
Alex Golub - Drums
Elton Scharf - Bass
Dunday - Bass
Steffen Petry - Flute
Dario Gebel - Guitars
Alex Heinz - Drums

Discography
1999 - Songs of the early days
2000 - Songs about love, desire and parting
2001 - Celtic legends
2002 - Traditional & unplugged
2003 - Celtinus
2003 - Hey Hoh
2004 - The last Banshee
2004 - Pirates & Heartbreakers
2005 - Dunkle Seelen
2005 - Keltenherz "Gothicca"
2005 - Rebels, Roses & Celts
2006 - The dancing gypsy
2007 - Boneman-Live 1
2007 - Boneman-Live 2

Sideprojects
Keltenherz
Finnegan Und Der Kobold - a musical/play.

Official site