Strengthening can help
The outside of your elbow has been sore for some time, and there's an especially sharp pain when you carry something in that arm. That's why you've been avoiding carrying things and have generally avoided activities that involve use of the arm, such as gardening. Despite the rest, it hasn't improved much. Is there anything you can do to make it better?