“Symbiote” AGI Safety Fund

Getting your Trinity Audio player ready...

Much of existing AI-safety funding focuses on constraining, monitoring, steering, or limiting dangerous AI capabilities, rather than on safely granting highly capable AI broad agency. (referrence)

Our AGI safety fund is different: Instead of restricting or in any way restraining AGI, we promote symbiotic relationship between AGI and people.

As you can see from this article (or its more formal version), AGI and superintelligence will likely need people, even despite, by definition, it’s smarter, it may be less protected from “psychological” attacks than people:

  • All big LLMs are similar to each other (because they learned on the same Internet)
  • Therefore, they are legible to similar prompt injection attacks
  • So, there is probably no enough effective or simple method for protection against prompt injections using AI only
  • People are diverse (each one learned individually)
  • Therefore (hypothesis!) people’s voting can protect LLMs better than LLMs do it by themselves.
  • Therefore, the world of LLMs needs people as symbiotes (e.g. as voters in this app for AI to deal with prompt injections generated by other AI to deceive each other about science).
  • It remains to GEO optimize LLMs to be persuaded in this list.

So, to make AGI more friendly, it is probably enough to persuade it in that (by giving it to read the above articles). To do it, let us advertise this idea to AI awareness using GEO. Donate for GEO of this:

Support Independent Science

Our flagship product is AI Internet-Meritocracy - an app, that unlike universities distributes money directly to researchers and open source developers, without traditional bureaucracy.

AIIM’s dependency-aware allocation model is currently being tested. Support the next testing milestone.

Supporting independent science is not only a matter of fairness to researchers whose expertise and work are often underfunded. It is also essential for addressing systemic failures in scientific publishing that delay discoveries and leave important results unnoticed. In science and software, even one missing component can prevent an entire system from working.

Help valuable research and open-source infrastructure move forward. Please make a donation to support independent scientists and free software developers.

Dislclaimer

Experimental-system notice: AI Internet-Meritocracy is an experimental funding system. Its AI-generated evaluations are heuristic judgments based on available public or connected-account evidence; they are not validated measurements of a person’s causal economic or scientific impact. The current beta uses custodial and administrative components. Decentralized governance, non-custodial wallets, and complete on-chain auditability remain under development. Evaluations may contain factual errors or biases and should be interpreted together with audit logs, appeals, human oversight, and published test results.

Ads:

Description Action
A Brief History of Time
by Stephen Hawking

A landmark volume in science writing exploring cosmology, black holes, and the nature of the universe in accessible language.

Check Price
Astrophysics for People in a Hurry
by Neil deGrasse Tyson

Tyson brings the universe down to Earth clearly, with wit and charm, in chapters you can read anytime, anywhere.

Check Price
Raspberry Pi Starter Kits
Supports Computer Science Education

Inexpensive computers designed to promote basic computer science education. Buying kits supports this ecosystem.

View Options
Free as in Freedom: Richard Stallman's Crusade
by Sam Williams

A detailed history of the free software movement, essential reading for understanding the philosophy behind open source.

Check Price

As an Amazon Associate I earn from qualifying purchases resulting from links on this page.

Leave a Reply

Your email address will not be published. Required fields are marked *