The land around Normanville was originally inhabited by the Kaurna people and the Kaurna name was probably 'Pangkarla' (C.Schultz, "The Southern Kaurna Place Name Project"), possibly meaning 'the place of two lagoons'. The name 'Normanville' was given to section 1014 by Robert Norman, who gained a land grant for the section in 1840 and subdivided it into township blocks about 1850. A blacksmith shop, a hotel, a church, and houses were built, and Norman offered land for a police station and for approaches for the proposed jetty.

The first jetty at Normanville (there have been three jetties over the years) was built in 1853-1856. In 1865 Normanville was officially declared a port, named Port Yankalilla, with its own harbourmaster. In the 1850s and 60s Normanville was a busy port, but by the late seventies the shipping trade was falling off.

Today Normanville, with its beautiful beach and numerous cafes, is a popular destination for holiday-makers in the summer months.