Yes - depending on the program used, it usually gives you 4 layers (drums, bass, vocals, other). The stems have some artifacts, you might wanna compare apps (I know Cubase 15, izotope RX and Spectralayers, but there are others - possibly there's some online app too) for the best result. You can work with an mp3 as well but, since the stems aren't perfect and mp3s are already a lossy format, you might wanna try to find the best possible quality original file.