Solid electrolytes are considered as an ideal substitution of liquid electrolytes, avoiding the potential hazards of volatilization, flammability, and explosion for liquid electrolyte���based rechargeable batteries. However, there are significant performance gaps to be bridged between solid electrolytes and liquid electrolytes; one with a particular importance is the ionic conductivity which is highly dependent on the material types and structures. In this review, the general physical image of ion hopping in the crystalline structure is revisited, by highlighting two main kernels that impact ion migration: ion hopping pathways and skeletons interaction. The universal strategies to effectively improve ionic conductivity of inorganic solid electrolytes are then systematically summarized: constructing rapid diffusion pathways for mobile ions; and reducing resistance of the surrounding potential field. The scoped strategies offer an exclusive view on the working principle of ion movement regardless of the ion species, thus providing a comprehensive guidance for the future exploitation of solid electrolytes.