Google puts it foot on the accelerator, casting aside safety concerns to not only release a GPT 4 -competitive model, PaLM 2, but also announce that they are already training Gemini, a GPT 5 competitor [likely on TPU v5 chips]. This is truly a major day in AI history, and I try to cover it all.
I'll show the benchmarks in which PaLM (which now powers Bard) beats GPT 4, and detail how they use SmartGPT-like techniques to boost performance. Crazily enough, PaLM 2 beats even Google Translate, due in large part to the text it was trained on. We'll talk coding in Bard, translation, MMLU, Big Bench, and much more.
I'll end on the Universal Translator deepfakes and the underwhelming results from Sundar Pichai and Sam Altman's trip to the White House and what Hinton says about it all. On a more positive note, I cover Med PaLM 2, which could genuinely save thousands of lives.
PaLM 2 Technical Report: ai.google/static/documents/pa...
Release Notes Google Blog: blog.google/technology/ai/goo...
Bard Access: bard.google.com/
Scaling Transformer to 1M tokens: arxiv.org/pdf/2304.11062.pdf
GPT 4 Technical Report: arxiv.org/pdf/2303.08774.pdf
Bard Languages: support.google.com/bard/answe...
Self Consistency Paper: arxiv.org/pdf/2203.11171.pdf
Are Emergent Abilities a Mirage: arxiv.org/pdf/2304.15004.pdf
Sparks of AGI Paper: arxiv.org/pdf/2303.12712.pdf
Big Bench Hard: github.com/suzgunmirac/BIG-Be...
Google Keynote: • Google Keynote (Google...
Gemini: • Google I/O 2023: PaLM ...
Med PaLM 2: • Med-PaLM 2, our expert...
TPU v5: ai.googleblog.com/2022/01/goo...
Hinton Warning: • 'Godfather of AI' warn...
White House Readout: www.whitehouse.gov/briefing-r...
/ aiexplained Non-Hype, Free Newsletter: signaltonoise.beehiiv.com/
Негізгі бет Ғылым және технология Enter PaLM 2 (New Bard): Full Breakdown - 92 Pages Read and Gemini Before GPT 5? Google I/O
Пікірлер: 727