Check out the paper Risks From Learned Optimization in Advanced Machine Learning Systems Check out the slides