article thumbnail

Moving from Red AI to Green AI, Part 1: How to Save the Environment and Reduce Your Hardware Costs

DataRobot

They are used for different applications, but nonetheless they suggest that the development in infrastructure (access to GPUs and TPUs for computing) and the development in deep learning theory has led to very large models. To illustrate the energy needed in deep learning, let’s make a comparison.

Green 145
article thumbnail

Twittering and Forgetting

Beth's Blog: How Nonprofits Can Use Social Media

The title of this post is a play on a book I read The Book of Learning and Forgetting by Frank Smith in 1998 when I was working with arts educators on integrating technology into their lesson plans. I would recommend technology resources and they would share books about learning. Via email can use up to 5 search terms.

Twitter 50
professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Timaeus in 2024

The AI Alignment Forum

Published on February 20, 2025 11:54 PM GMT TLDR: We made substantial progress in 2024: We published a series of papers that verify key predictions of Singular Learning Theory (SLT) [ 1 , 2 , 3 , 4 , 5 , 6 ]. Another difficulty was searching for appropriate hyperparameters. This is a remarkable empirical fact.

article thumbnail

Google at ICLR 2023

Google Research AI blog

If you’re registered for ICLR 2023, we hope you’ll visit the Google booth to learn more about the exciting work we’re doing across topics spanning representation and reinforcement learning, theory and optimization, social impact, safety and privacy, and applications from generative AI to speech and robotics. Mukund Varma T.

Google 105
article thumbnail

Stanford AI Lab Papers and Talks at NeurIPS 2021

Stanford AI Lab Blog

Kochenderfer Contact : philhc@stanford.edu Links: Paper Keywords : deep learning or neural networks, sparsity and feature selection, variational inference, (application) natural language and text processing Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Authors : Jeff Z.

Contact 40
article thumbnail

The Theoretical Reward Learning Research Agenda: Introduction and Motivation

The AI Alignment Forum

However, if we want to design a chess-playing AI that can invent completely new strategies and entirely outclass human chess players, then we must use something analogous to reward maximisation (together with either a search algorithm or an RL algorithm, or some other alternative to these).

article thumbnail

Research directions Open Phil wants to fund in technical AI safety

The AI Alignment Forum

*White-box estimation of rare misbehavior: AIs may only exhibit egregiously bad behaviour in scenarios that are extremely rare before deployment and very hard for us to find by search over inputs, but which may be common once in deployment. No input-space search: One very nice advantage that techniques like Sheshadri et al.