Yea, replace the other O2 sensor because they don't cause a lean condition, and let us know what code was thrown. MIL lamps do burn out. You can check this by turning the key to the on position(not start) and see if the CEL illuminates.

They doing a OBDII test or a tail pipe test?