The deconfined quark-gluon plasma (QGP) created in relativistic heavy-ion collisions enables the exploration of the fundamental properties of matter under extreme conditions. Noncentral collisions can produce strong magnetic fields on the order of 1018 G, which offers a probe into the electrical conductivity of the QGP. In particular, quarks and antiquarks carry opposite charges and receive contrary electromagnetic forces that alter their momenta. This phenomenon can be manifested in the collective motion of final-state particles, specifically in the rapidity-odd directed flow, denoted as v1(y). Here, we present the charge-dependent measurements of dv1/dy near midrapidities for π±, K±, and p(p¯) in Au+Au and isobar (Ru4496+Ru4496 and Zr4096+Zr4096) collisions at sNN=200 GeV, and in Au+Au collisions at 27 GeV, recorded by the STAR detector at the Relativistic Heavy Ion Collider. The combined dependence of the v1 signal on collision system, particle species, and collision centrality can be qualitatively and semiquantitatively understood as several effects on constituent quarks. While the results in central events can be explained by the u and d quarks transported from initial-state nuclei, those in peripheral events reveal the impacts of the electromagnetic field on the QGP. Our data put valuable constraints on the electrical conductivity of the QGP in theoretical calculations.