You could go into withdrawal and have severe symptoms like fever, joint pain, or fatigue. Work with your doctor to safely taper off steroids instead. Slowly reduce prednisone so your body has time ...