With You is the fifth track on Prince's second album Prince. In 1987, a re-recorded version (essentially a cover version, but mixed by Prince) was included as the fourth track on Jill Jones' first and only album Jill Jones.
An early version of the song was recorded on 17 February 1979 at Music Farm Studios in New York, during a day of sessions led by Pepé Willie intended for Tony Silvester, leader of the group The Main Ingredient to use as demos for Little Anthony and the Imperials, who he wanted to produce (the one-day session also produced One Man Jam, If You Feel Like Dancin', I Feel For You, Thrill You Or Kill You, and André Cymone's original version of Do Me, Baby), although With You was recorded with extra studio time and was not intended for use by Tony Silvester.
While specific recording dates for the album version are not known, the album sessions took place from late April to late May 1979 at Alpha Studios in Burbank, California. Overdubs and mixing took place at Hollywood Sound Recorders in Los Angeles, California.
In 1986, Jill Jones re-recorded the track for inclusion on her 1987 eponymous album Jill Jones. This is essentially a cover version of the track, without musical input by Prince, but Prince mixed the Jill Jones version further on 30 January 1986 at Sunset Sound in Hollywood, California (on the same day as mixing Mia Bocca, G-Spot and Baby, You're A Trip, and recording It's A Wonderful Day), leading to its inclusion here.