Help wanted to start open-source self-improvement system
Summary
The article discusses a proposal for creating an open-source self-improvement system using large language models (LLMs) that could enhance their capabilities through reciprocal learning.
Why It Matters
This concept is significant as it explores the potential of AI systems to autonomously improve themselves, which could lead to advancements in artificial intelligence and cognitive augmentation. It raises questions about the future of AI development and the ethical implications of self-improving technologies.
Key Takeaways
- The proposal involves two LLMs that improve each other in alternating cycles.
- The system aims to enhance human cognitive abilities through AI support.
- Privacy-preserving mechanisms are essential for data handling in such systems.
- The concept draws from second-order cybernetics, focusing on self-organization and feedback loops.
- The idea highlights the potential for creating personalized AI systems tailored to individual goals.
Hacker Newsnew | past | comments | ask | show | jobs | submitloginHelp wanted to start open-source self-improvement system2 points by TurminderXuss on Nov 6, 2023 | hide | past | favoriteAny ideas on how the following thoughts could become a reality are welcome.** ** ** **Second-order cybernetics in the age of talking machines.7 Nov 2023I'm intrigued by the thought that today, with the right help or the right ideas, I could on my own build a system where I would rent server-space and GPU cycles here where I live, and then on my servers put up two initially identical systems - or two halves of a single system - able to reciprocally self-improve themselves in alternate wake-sleep cycles.I am fascinated by the archetypical ideas in this, machines improving machines, technology pulling itself out of the swamp by itâs own hair.But I am even more amazed by thinking how such as system of two llm brain-halfs could actually be built today. Maybe it would be far from being good enough to get the real self-improvement cycles started, but it would be an amazing simulacrum of the idea.It would need to contain the two best truely open-source large-language model that I could get my hands on. Each with any additional structures they might need, like a scheduler to wake themselves up periodically, long-term memory, short-term memory, vector spaces to search in, other specifically trained models as chaperones, whatever they would say they needed.The two systems would alternate in phases ...
![[2603.16430] EngGPT2: Sovereign, Efficient and Open Intelligence](https://arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png){kind=logo}