DataRobot

APRIL 21, 2022

They are used for different applications, but nonetheless they suggest that the development in infrastructure (access to GPUs and TPUs for computing) and the development in deep learning theory has led to very large models. To better quantify this, we have developed methods to measure efficiency.

Green 145

Green Environment Metrics Measure 145

The AI Alignment Forum

FEBRUARY 28, 2025

Concretely, this research agenda involves answering questions such as: What is the right method for expressing goals and instructions to AI systems? Similarly, a complete answer to (3) would be a (pseudo)metric d on the space of all reward functions which quantifies their similarity.

Research 40

Research Learning Method Policy 40

Stanford AI Lab Blog

DECEMBER 6, 2021

Kochenderfer Contact : philhc@stanford.edu Links: Paper Keywords : deep learning or neural networks, sparsity and feature selection, variational inference, (application) natural language and text processing Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Authors : Jeff Z.

Contact 40

Contact Learning Theory Authoring Offline 40

The AI Alignment Forum

FEBRUARY 7, 2025

Were interested in more research on this, and other stress tests of todays state-of-the-art alignment methods. We want to fund research that identifies the conditions under which these failure modes occur, and makes progress toward robust methods of mitigating or avoiding them.

Research 52

Research Fund Open Technique 52

The AI Alignment Forum

FEBRUARY 28, 2025

We also managed to leverage these results to produce a new method for conservative optimisation, that tells you how much (and in what way) you can optimise a proxy reward, based on the quality of that proxy (as measured by a STARC metric ), in order to be guaranteed that the true reward doesnt decrease (and thereby prevent the Goodhart drop).

Learning 40

Learning Discussion Classes Policy 40

Google Research AI blog

NOVEMBER 28, 2022

Derrick Xin , Behrooz Ghorbani , Ankush Garg , Orhan Firat , Justin Gilmer Associating Objects and Their Effects in Video Through Coordination Games Erika Lu , Forrester Cole , Weidi Xie, Tali Dekel , William Freeman , Andrew Zisserman , Michael Rubinstein Increasing Confidence in Adversarial Robustness Evaluations Roland S.

Google 52

Google Language Tutorial Offline 52

The AI Alignment Forum

MARCH 28, 2025

And the way you said it just then, it sounded more like the first one: heres a new nice metric of how good your mechanistic explanation is. 00:26:47): And so what this gives us is an interaction metric where we can measure how bad this hypothesis is. I dont know if theres some area-under-the-curve metric or something.

Model 52

Model Network Train Training 52