I have observed in many Musjids that the Jumuah Khutbah and Salaat are very short while the talk is very long.

Answer

Yes, the Hadith does say something contrary to this practice. The Hadith implies that a standard of measuring the Aql (intelligence) of a man is the Jumuah Khutbah and Salaat. A long Khutbah and a short Salaat indicate that the man's Aql is blighted or stunted. From this we can infer that when both the Khutbah and the Salaat are shorter than the bayaan (lecture), the Aql would be more clouded. The Salaat should be longer than the Khutbah.