Learning to Think Small