Synaptic transmission is a fundamental neurobiological process by which neurons interact with each other and non-neuronal cells. It involves release of active substances from the presynaptic neuron onto receptive elements of postsynaptic cells, inducing waves of spreading electrochemical response. While much has been learned about the cellular and molecular mechanisms driving and governing transmitter release and sensing, the evolutionary origin of synaptic connections remains obscure. Herein, we review emerging evidence and concepts suggesting that key components of chemical synapse arose independently from neurons, in different functional and biological contexts, before the rise of multicellular living forms. We argue that throughout evolution, distinct synaptic constituents have been co-opted from ancestral forms for a new role in early metazoan, leading to the rise of chemical synapses and neurotransmission. Such a mosaic model of the origin of chemical synapses agrees with and supports the pluralistic hypothesis of evolutionary change.