A nice little town, supposed to be quiet, but when I happen to be there it's always noisy and crowded, in a very friendly way. Indeed every third weekend of July (from Thursday to Sunday included), there is a street arts festival called "Chalon dans la Rue". The streets, squares, parks are full of jugglers, clowns, acrobats, actors, dancers, puppeteers, in other words, full of surprises. Chalon is on your way to the south (I know lots of English people go to the Riviera or the Dordogne, well as far as the Dordogne is concerned, Chalon is a slight detour) and while calling there you can also buy some delicious wine in Givry or Jambles not far from there and in the town itself there are wonderful restaurants. 

I hope it makes you feel like going there next summer. I have been a fervent spectator for 16 years and have never been disappointed.