Machine learning has experienced unprecedented growth in recent years, often referred to as an “artificial intelligence revolution.” Biological systems inspire the fundamental approach for this new computing paradigm: using neural networks to classify large amounts of data into sorting categories. Current machine-learning schemes implement simulated neurons and synapses on standard computers based on a von Neumann architecture. This approach is inefficient in energy consumption, and thermal management, motivating the search for hardware-based systems that imitate the brain. Here, the present state of thermal management of neuromorphic computing technology and the challenges and opportunities of the energy-efficient implementation of neuromorphic devices are considered. The main features of brain-inspired computing and quantum materials for implementing neuromorphic devices are briefly described, the brain criticality and resistive switching-based neuromorphic devices are discussed, the energy and electrical considerations for spiking-based computation are presented, the fundamental features of the brain's thermal regulation are addressed, the physical mechanisms for thermal management and thermoelectric control of materials and neuromorphic devices are analyzed, and challenges and new avenues for implementing energy-efficient computing are described.