This breakout cable should work with your phone. It will let you eliminate the external USB conversions, which are a potential source of grounding and noise issues.
There are various kinds of breakouts, so be sure you get the right type. Of course you'll need one with a TRRS plug, like this one. This is technically called a CTIA breakout cable. (There's another type called OMTP which will NOT work for you.) The two jacks are usually pink/red (for a mono mic) and green (for stereo earphones). There may be some oddball manufacturers who use different color coding.