"We show that carefully designed sparse attention can be as expressive and flexible as the original full attention model. Along with theoretical guarantees, we provide a very efficient implementation which allows us to scale to much longer inputs. As a consequence, we achieve state-of-the-art results...
Source: googleblog.com
Now you're talking: human-like robot may one day care for dementia patients: With her brown hair, soft skin and expressive face, Nadine is a new brand of human-like robot that could one day, scientists hope, be used as a personal assistant or care provider for the elderly.
Source: reuters.com