Robots talking to different robots until something valuable emerges (recursive chat) [Draft post]
I recently read an article from Google about FunSearch which is designed to discover mathematical solutions to previously unsolved problems.
FunSearch works by pairing a pre-trained LLM, whose goal is to provide creative solutions in the form of computer code, with an automated “evaluator”, which guards against hallucinations and incorrect ideas. By iterating back-and-forth between these two components, initial solutions “evolve” into new knowledge.
I love the idea of 2 LLMs working together. There’s an eccentric one hallucinating all sorts of crazy stuff. Then there’s the stern pragmatist shutting down all ideas until finally something valuable emerges.
I wanted to recreate this idea but instead of discovering math functions, I wanted to implement a brainstorming tool.