Honestly, DDR4 RAM isn't worth the amount of upgrades you would need to make. You would also need to find a new motherboard that supports DDR4 RAM with an lga1150 socket.
I would honestly wait until DDR4 or DDR5 (or ddr max ) become more useful, and once your CPU gets worse to the point of unusable.
Also do you have any sort of Video Card that could be bottle necking your performance?