Constructing Transformers For Longer Sequences with Sparse Attention Methods
"We show that carefully designed sparse attention can be as expressive and flexible as the original full attention model. Along with theoretical guarantees, we provide a very efficient implementation which allows us to scale to much longer inputs. As a consequence, we achieve state-of-the-art results...
Source: googleblog.com
Medical educators’ beliefs about teaching, learning, and knowledge: development of a new framework
Interesting paper about beliefs among medical educators. This has been
developed with a qualitative study of undergraduate educators but the
framework makes for good reading for those of us involved in urging
colleagues and expert speakers to become more learner-centred. "The sharp divide between...
Source: biomedcentral.com
Israel Reveals Newly Discovered Fragments of Dead Sea Scrolls
The finds, ranging from just a few millimeters to a thumbnail in size, are the first to be unearthed in archaeological excavations in the Judean Desert in about 60 years.
Source: nytimes.com
SARS-CoV-2-specific T cell immunity is seen in cases of COVID-19
SARS-CoV-2-specific T cell immunity in cases of COVID-19 and SARS, and uninfected controls: Memory T cells induced by previous pathogens can shape the susceptibility to, and clinical severity of, subsequent infections1. Little is known about the presence of pre-existing memory T cells in humans with...
Source: nature.com
Earliest roasted root vegetables found in 170,000-year-old cave dirt: Charred fragments found in a cave in southern Africa
Earliest roasted root vegetables found in 170,000-year-old cave dirt: Charred fragments found in a cave in southern Africa suggest that the real “paleo diet” included lots of roasted root vegetables that were rich in carbohydrates
Source: newscientist.com
Unraveling the IT Productivity Paradox — Lessons for Health Care — NEJM: Good article from RAND Corporation. There
Unraveling the IT Productivity Paradox — Lessons for Health Care — NEJM: Good article from RAND Corporation. There is ongoing debate about the wisdom of the $27 billion federal investment driving the adoption of health information technology (IT) under the Health Information Technology for Economic...
Source: nejm.org
RSS feed