Lifeboat Foundation

Preparation requires technical research and development, as well as adaptive, proactive governance.

Yoshua Bengio, Geoffrey Hinton, […], Andrew Yao, Dawn Song, […], Pieter Abbeel, Trevor Darrell, Yuval Noah Harari, Ya-Qin Zhang, Lan Xue, […], Shai Shalev-Shwartz, Gillian Hadfield, Jeff Clune, Tegan Maharaj, Frank Hutter, Atılım Güneş Baydin, Sheila McIlraith, Qiqi Gao, Ashwin Acharya, David Krueger, Anca Dragan, Philip Torr, Stuart Russell, Daniel Kahneman, Jan Brauner [email protected], and Sören Mindermann +22 authors +20 authors +15 authors fewer Authors Info & Affiliations

Science.

Two OpenAI employees who worked on safety and governance recently resigned from the company behind ChatGPT.

Daniel Kokotajlo left last month and William Saunders departed OpenAI in February. The timing of their departures was confirmed by two people familiar with the situation. The people asked to remain anonymous in order to discuss the departures, but their identities are known to Business Insider.

Center for natural and artificial intelligence.

Researchers from the Oxford Martin Programme on Ethical Web and Data Architectures (EWADA), University of Oxford, have called for a more considered approach when embedding ethical principles in the development and governance of AI for children.

Chinese ambassador Chen Xu called for the high-quality development of artificial intelligence (AI), assistance in promoting children’s mental health, and protection of children’s rights while delivering a joint statement on behalf of 80 countries at the 55th session of the United Nations Human Rights Council (UNHRC) on Thursday.

Chen, China’s permanent representative to the UN Office in Geneva and other international organizations in Switzerland, said that artificial intelligence is a new field of human development and should adhere to the concept of consultation, joint construction, and shared benefits, while working together to promote the governance of artificial intelligence.

The new generation of children has become one of the main groups using and benefiting from AI technology. The joint statement emphasized the importance of children’s mental health issues.

The “Beneficial AGI Summit & Unconference” is a new event organized by SingularityNet and TrueAGI in collaboration with others. The Millennium Project is one of the sponsors of the event and our Jerome Glenn, Executive Director and co-founder of The Millennium Project, and José Cordeiro, MP Board member and RIBER and Venezuela Nodes Chair, are members of the organizing committee of the event. The Beneficial AGI summit will take place both online and physically and c/o Hilton Panama in Panama City. The streaming is free, get your ticket.

The objective of the conference is to bring together the leading voices in AI in actions to catalyze the emergence of beneficial AGI. Key themes of the event are: Constitution & Governance Framework, Global Brain Collective, Simulation / Gaming Environments, Scenarios analysis process, Potential scenarios (from 1 to 7).

On the first two days of the BGI Summit, Feb. 27–28, top thought leaders from around the globe will engage in comprehensive, detailed discussions of a wide range of questions regarding various approaches to AGI and their ethical, economic, psychological, political, environmental and other implications. The focus will be on discussing issues, making conceptual progress, forming collaborations, and engaging in the practical actions aimed at catalyzing the emergence of beneficial AGI based on the ideas and connections set in motion by all involved.

This year’s World Economic Forum Annual Meeting in Davos was a testament to the growing prominence of artificial intelligence (AI) in our world.

Davos 2024 vividly demonstrated AI’s growing influence in shaping the future of work, creativity, and global governance.

Just after filming this video, Sam Altman, CEO of OpenAI published a blog post about the governance of superintelligence in which he, along with Greg Brockman and Ilya Sutskever, outline their thinking about how the world should prepare for a world with superintelligences. And just before filming Geoffrey Hinton quite his job at Google so that he could express more openly his concerns about the imminent arrival of an artificial general intelligence, an AGI that could soon get beyond our control if it became superintelligent. So, the basic idea is moving from sci-fi speculation into being a plausible scenario, but how powerful will they be and which of the concerns about superAI are reasonably founded? In this video I explore the ideas around superintelligence with Nick Bostrom’s 2014 book, Superintelligence, as one of our guides and Geoffrey Hinton’s interviews as another, to try to unpick which aspects are plausible and which are more like speculative sci-fi. I explore what are the dangers, such as Eliezer Yudkowsky’s notion of a rapid ‘foom’ take over of humanity, and also look briefly at the control problem and the alignment problem. At the end of the video I then make a suggestion for how we could maybe delay the arrival of superintelligence by withholding the ability of the algorithms to self-improve themselves, withholding what you could call, meta level agency.

▬▬ Chapters ▬▬

Continue reading “Dangers of superintelligence | Separating sci-fi from plausible speculation” »

Businesses must also ensure they are prepared for forthcoming regulations. President Biden signed an executive order to create AI safeguards, the U.K. hosted the world’s first AI Safety Summit, and the EU brought forward their own legislation. Governments across the globe are alive to the risks. C-suite leaders must be too — and that means their generative AI systems must adhere to current and future regulatory requirements.

So how do leaders balance the risks and rewards of generative AI?

Businesses that leverage three principles are poised to succeed: human-first decision-making, robust governance over large language model (LLM) content, and a universal connected AI approach. Making good choices now will allow leaders to future-proof their business and reap the benefits of AI while boosting the bottom line.