UL2 20B: An Open Source Unified Language Learner

Posted by Yi Tay and Mostafa Dehghani, Research Scientists, Google Research, Brain Team Building models that understand and generate natu... | Continue reading


@ai.googleblog.com | 1 year ago

ML-Enhanced Code Completion Improves Developer Productivity

Posted by Maxim Tabachnyk, Staff Software Engineer and Stoyan Nikolov, Senior Engineering Manager, Google Research The increasing complex... | Continue reading


@ai.googleblog.com | 1 year ago

ML-Enhanced Code Completion Improves Developer Productivity

Posted by Maxim Tabachnyk, Staff Software Engineer and Stoyan Nikolov, Senior Engineering Manager, Google Research The increasing complex... | Continue reading


@ai.googleblog.com | 1 year ago

Google AI Blog: Deep Hierarchical Planning from Pixels

Posted by Danijar Hafner, Student Researcher, Google Research Research into how artificial agents can make decisions has evolved rapidly... | Continue reading


@ai.googleblog.com | 1 year ago

Thinking beyond accuracy: Towards reliability in deep learning

Posted by Dustin Tran and Balaji Lakshminarayanan, Research Scientists, Google Research Deep learning models have made impressive progres... | Continue reading


@ai.googleblog.com | 1 year ago

Google ML Compiler Inlining Achieves 3-7% Reduction in Size

Posted by Yundi Qian, Software Engineer, Google Research and Mircea Trofin, Software Engineer, Google Core The question of how to compile... | Continue reading


@ai.googleblog.com | 1 year ago

Quantum Advantage in Learning from Experiments

Posted by Jarrod McClean, Staff Research Scientist, Google Quantum AI, and Hsin-Yuan Huang, Graduate Student, Caltech In efforts to learn... | Continue reading


@ai.googleblog.com | 1 year ago

MV-GPT: A New Generative Pre-Training Framework for Multimodal Video Captioning

Posted by Paul Hongsuck Seo and Arsha Nagrani, Research Scientists, Google Research, Perception Team Multimodal video captioning systems... | Continue reading


@ai.googleblog.com | 1 year ago

LIMoE: Learning Multiple Modalities with One Sparse Mixture-of-Experts Model

Posted by Basil Mustafa, Research Software Engineer and Carlos Riquelme, Research Scientist, Google Research, Brain team Sparse models s... | Continue reading


@ai.googleblog.com | 1 year ago

Deep Learning with Label Differential Privacy

Posted by Pasin Manurangsi and Chiyuan Zhang, Research Scientists, Google Research Over the last several years, there has been an increa... | Continue reading


@ai.googleblog.com | 1 year ago

Image-Text Pre-Training with Contrastive Captioners

Posted by Zirui Wang and Jiahui Yu, Research Scientists, Google Research, Brain Team Oftentimes, machine learning (ML) model developers b... | Continue reading


@ai.googleblog.com | 1 year ago

GraphWorld: Advances in Graph Benchmarking

John Palowitch and Anton Tsitsulin, Research Scientists, Google Research, Graph Mining team Graphs are very common representations of na... | Continue reading


@ai.googleblog.com | 1 year ago

Alpa: Automated Model-Parallel Deep Learning

Posted by Zhuohan Li, Student Researcher, Google Research, and Yu Emma Wang, Senior Software Engineer, Google Core Over the last several ... | Continue reading


@ai.googleblog.com | 1 year ago

Extracting Skill-Centric State Abstractions from Value Functions

Posted by Dhruv Shah, Intern, and Brian Ichter, Research Scientist, Robotics at Google Advances in reinforcement learning (RL) for roboti... | Continue reading


@ai.googleblog.com | 1 year ago

Google at ICLR 2022

Posted by Cat Armato and Callan Hajosy, Program Managers The 10th International Conference on Learning Representations ( ICLR 2022 ) kick... | Continue reading


@ai.googleblog.com | 1 year ago

Pix2Seq: A New Language Interface for Object Detection

Posted by Ting Chen and David Fleet, Research Scientists, Google Research, Brain Team Object detection is a long-standing computer visio... | Continue reading


@ai.googleblog.com | 1 year ago

Interfaces for Ambient Computing

Posted by Alex Olwal, Research Scientist, Google Augmented Reality and Artem Dementyev, Hardware Engineer, Google Research As consumer el... | Continue reading


@ai.googleblog.com | 1 year ago

Vdtts: Visually-Driven Text-to-Speech

Posted by Tal Remez, Software Engineer, Google Research and Micheal Hassid, Software Engineer Intern, Google Research Recent years have ... | Continue reading


@ai.googleblog.com | 2 years ago

Large-Scale Matrix Factorization on TPUs

Posted by Harsh Mehta, Software Engineer, Google Research Matrix factorization is one of the oldest, yet still widely used, techniques f... | Continue reading


@ai.googleblog.com | 2 years ago

Efficiently Initializing Reinforcement Learning with Prior Policies

Posted by Ikechukwu Uchendu, AI Resident and Ted Xiao, Software Engineer, Robotics at Google Reinforcement learning (RL) can be used to ... | Continue reading


@ai.googleblog.com | 2 years ago

Reproducibility in Deep Learning and Smooth Activations

Posted by Gil Shamir and Dong Lin, Research Software Engineers, Google Research Ever queried a recommender system and found that the same... | Continue reading


@ai.googleblog.com | 2 years ago

Pathways Language Model (Palm): 540B Parameters for Breakthrough Perf

Posted by Sharan Narang and Aakanksha Chowdhery, Software Engineers, Google Research In recent years, large neural networks trained for l... | Continue reading


@ai.googleblog.com | 2 years ago

Auto-Generated Summaries in Google Docs

Posted by Mohammad Saleh, Software Engineer, Google Research, Brain Team and Anjuli Kannan, Software Engineer, Google Docs For many of us... | Continue reading


@ai.googleblog.com | 2 years ago

Offline Optimization for Architecting Hardware Accelerators

Posted by Amir Yazdanbakhsh, Research Scientist and Aviral Kumar, Student Researcher, Google Research Advances in machine learning (ML) o... | Continue reading


@ai.googleblog.com | 2 years ago

Multimodal Bottleneck Transformer (MBT): A New Model for Modality Fusion

Posted by Arsha Nagrani and Chen Sun, Research Scientists, Google Research, Perception Team People interact with the world through multip... | Continue reading


@ai.googleblog.com | 2 years ago

Hybrid Quantum Algorithms for Quantum Monte Carlo

Posted by William J. Huggins, Research Scientist, Google Quantum AI The intersection between the computational difficulty and practical i... | Continue reading


@ai.googleblog.com | 2 years ago

Optimizing Airline Tail Assignments for Cleaner Skies

Posted by Emily Masten, Software Engineer, Google Research, Operations Research Team Airlines around the world are exploring several tact... | Continue reading


@ai.googleblog.com | 2 years ago

Co-Training Transformer with Videos and Images Improves Action Recognition

Posted by Bowen Zhang, Student Researcher and Jiahui Yu, Senior Research Scientist, Google Research, Brain Team Action recognition has ... | Continue reading


@ai.googleblog.com | 2 years ago

Learning from Weakly-Labeled Videos via Sub-Concepts

Posted by Zizhao Zhang and Guanhang Wu, Software Engineers, Google Research, Cloud AI Team Video recognition is a core task in computer v... | Continue reading


@ai.googleblog.com | 2 years ago

Using Deep Learning to Annotate the Protein Universe

Posted by Maxwell Bileschi, Staff Software Engineer and Lucy Colwell, Research Scientist, Google Research, Brain Team Proteins are ess... | Continue reading


@ai.googleblog.com | 2 years ago

Federated learning with formal differential privacy guarantees

Posted by Brendan McMahan and Abhradeep Thakurta, Research Scientists, Google Research In 2017, Google introduced federated learning (FL... | Continue reading


@ai.googleblog.com | 2 years ago

Constrained Reweighting for Training Deep Neural Nets with Noisy Labels

Posted by Abhishek Kumar and Ehsan Amid, Research Scientists, Google Research, Brain Team Over the past several years, deep neural networ... | Continue reading


@ai.googleblog.com | 2 years ago

Grammar Correction as You Type, on Pixel 6

Posted by Tony Mak, Software Engineer, Google Research and Simon Tong, Principal Engineer, Google Research, Brain Team Despite the succes... | Continue reading


@ai.googleblog.com | 2 years ago

The Balloon Learning Environment

Posted by Joshua Greaves, Software Engineer and Pablo Samuel Castro, Staff Software Engineer, Google Research, Brain Team Benchmark chall... | Continue reading


@ai.googleblog.com | 2 years ago

Robust Routing Using Electrical Flows

Posted by Ali Kemal Sinop and Kostas Kollias, Research Scientists, Google Research In the world of networks , there are models that can e... | Continue reading


@ai.googleblog.com | 2 years ago

Machine Learning for Mechanical Ventilation Control

Posted by Daniel Suo, Software Engineer and Elad Hazan, Research Scientist, Google Research, on behalf of the Google AI Princeton Team ... | Continue reading


@ai.googleblog.com | 2 years ago

Good News About the Carbon Footprint of Machine Learning Training

Posted by David Patterson, Distinguished Engineer, Google Research, Brain Team Machine learning (ML) has become prominent in information ... | Continue reading


@ai.googleblog.com | 2 years ago

A Scientific Challenge for the Diagnosis and Gleason Grading of Prostate Cancer

Posted by Po-Hsuan Cameron Chen, Software Engineer, Google Health and Maggie Demkin, Program Manager, Kaggle In recent years, machine lea... | Continue reading


@ai.googleblog.com | 2 years ago

Differential Privacy for Large Scale Image Classification

Posted by Alexey Kurakin, Software Engineer and Roxana Geambasu, Visiting Faculty Researcher, Google Research Machine learning (ML) model... | Continue reading


@ai.googleblog.com | 2 years ago

Google Research: Themes from 2021 and Beyond

Posted by Jeff Dean, Senior Fellow and SVP of Google Research, on behalf of the entire Google Research community Over the last several de... | Continue reading


@ai.googleblog.com | 2 years ago

Evaluating syntactic abilities of language models

Posted by Jason Wei, AI Resident and Dan Garrette, Research Scientist, Google Research In recent years, pre-trained language models, such... | Continue reading


@ai.googleblog.com | 2 years ago

More Efficient In-Context Learning with GLaM

Posted by Andrew M Dai and Nan Du, Research Scientists, Google Research, Brain Team Large language models (e.g., GPT-3 ) have many signi... | Continue reading


@ai.googleblog.com | 2 years ago

A Fast WordPiece Tokenization System

Posted by Xinying Song, Staff Software Engineer and Denny Zhou, Senior Staff Research Scientist, Google Research Tokenization is a funda... | Continue reading


@ai.googleblog.com | 2 years ago

General and Scalable Parallelization for Neural Networks

Posted by Yuanzhong Xu and Yanping Huang, Software Engineers; Google Research, Brain Team Scaling neural networks, whether it be the amou... | Continue reading


@ai.googleblog.com | 2 years ago

Model Ensembles Are Faster Than You Think

Posted by Xiaofang Wang, Intern and Yair Alon (prev. Movshovitz-Attias), Software Engineer, Google Research When building a deep model ... | Continue reading


@ai.googleblog.com | 2 years ago

Permutation-Invariant Neural Networks for Reinforcement Learning

Posted by David Ha, Staff Research Scientist and Yujin Tang, Research Software Engineer, Google Research, Tokyo “The brain is ... | Continue reading


@ai.googleblog.com | 2 years ago

Predicting text readability from scrolling examples

Posted by Sian Gooding, Intern, Google Research Illiteracy affects at least 773 million people globally, both young and old. For these i... | Continue reading


@ai.googleblog.com | 2 years ago

MetNet-2: Deep Learning for 12-Hour Precipitation Forecasting

Posted by Nal Kalchbrenner and Lasse Espeholt, Google Research Deep learning has successfully been applied to a wide range of important ... | Continue reading


@ai.googleblog.com | 2 years ago