A Chicago native, Davis graduated from Harvard Law School in 1967 and the same year joined the administration of New York City Mayor John Lindsay. Over a five-year period, he worked in a variety of city departments, including welfare, human resources and city planning and as a speechwriter.  After working in private legal practice and serving on the city planning commission, he was appointed parks commissioner by Mayor Koch in 1978, a position he held through 1983.