The Erhu can be traced back to proto-Mongolic instruments which first appeared in China during the Tang dynasty. It is believed that Erhu has evolved from the Xiqin (奚 琴). The xiqin is believed to have originated from the Xi people located in current northeast China.

​

The first character Erhu  (二,  two) is believed to come from the fact that it has two strings. The second character (胡) indicates that it is a member of the Huqin family.

​

The name Huqin literally means "instrument of the Hu peoples", suggesting that the instrument may have originated from regions to the north or west of China generally inhabited by nomadic people on the extremities of past Chinese kingdoms.