Towards Robust Learning Systems via Amortized Optimization and Domain Adaptation