Signatures of Open Quantum System Dynamics in Single Qubit Annealing