Highlights, new tasks & graph ML in 2021; Safer pre-trained models; Embeddings: Larger ≠ better

·Sebastian Ruder··

Hi all,I hope you've had a good start to the new year. This newsletter covers my and others' highlights of 2021. I also discuss recent pre-trained models that put more emphasis on safety and recent text similarity models where large is not always better.I really appreciate your feedback, so let me know what you love ❤️ and hate  about this edition. Simply hit reply on the issue.Click here to view the newsletter in your browser.If you were referred by a friend, click here to subscribe. If you en...

Read full article →

Related Articles

Accelerating Gemma 4: faster inference with multi-token prediction drafters
amrrs · Hacker News · 4d ago
OpenAI’s o1 correctly diagnosed 67% of ER patients vs. 50-55% by triage doctors
donsupreme · Hacker News · 6d ago
ProgramBench: Can language models rebuild programs from scratch?
jonbaer · Hacker News · 2d ago
ZAYA1-8B matches DeepSeek-R1 on math with less than 1B active parameters
steveharing1 · Hacker News · 2d ago
A couple million lines of Haskell: Production engineering at Mercury
unignorant · Hacker News · 6d ago