Google Patent Signals That You Might Not Need LLMs

Google Patent Signals That You Might Not Need LLMs

Not every task requires the full force of a large language model.  As the industry continues to build bigger and better models, Google is looking at ways to save energy: The company is seeking to patent a system for automatically mixing the usage of multiple generative models with “differing computational efficiencies.”  Upon receiving a query, Google’s system will first feed the input to a small, resource-efficient AI model to come up with an i…