The AI Alignment Forum

FEBRUARY 25, 2025

Coder-32B-Instruct. Models are then evaluated on out-of-distribution free-form questions and often give malicious answers (Right). Free-form evaluation questions and example misaligned answers from GPT-4o finetuned to write vulnerable code. We evaluate with temperature 1. We call this emergent misalignment.

Evaluation 52

Evaluation Model Instructional Instruction 52

sgEngage

OCTOBER 9, 2023

Adaptive learning models can empower teachers to customize instruction for each student’s needs, and students can even personalize a digital tutoring experience. Imagine empowering a teacher with generative AI to improve question-building workflows for online assessments and open-book evaluations. See you at #bbcon.

Education 111

Education Generation Blackbaud Student 111

The AI Alignment Forum

MARCH 12, 2025

Published on March 12, 2025 5:56 PM GMT Summary The Stages-Oversight benchmark from the Situational Awareness Dataset tests whether large language models (LLMs) can distinguish between evaluation prompts (such as benchmark questions) and deployment prompts (real-world user inputs).

Awareness 52

Awareness Evaluation Sample Benchmark 52

OpenAI

AUGUST 24, 2022

We are improving our AI systems’ ability to learn from human feedback and to assist humans at evaluating AI. These models are trained to follow human intent: both explicit intent given by an instruction as well as implicit intent such as truthfulness, fairness, and safety. Our approach to aligning AGI is empirical and iterative.

Research 52

Research Evaluation Technique Train 52

Bloomerang

NOVEMBER 10, 2023

Step #1) G – Get the FOA/RFP/NOFA The first step in developing a grant template with the GRANTS formula is to G et the Funding Opportunity Announcement (FOA) or Request of Proposal (RFP) or NOFA (Notice of Funding Availability): i.e. the grant instructions. You can include as many tasks as are needed to reach your objective.

Grant 116

Grant Award Project Proposal 116

Whole Whale

FEBRUARY 2, 2023

Internal evaluation Create clear guidelines for your project and try to rank the proposals across different attributes. Purpose Overview: Purpose and objectives with summary statement of what you’re looking to do. Proposal instructions : Why are you the right firm? Organization Background : Who are you?

Guide 59

Guide Nonprofit Proposal PDF 59

The AI Alignment Forum

MARCH 13, 2025

Summary In this post, we summarize the main experimental results from our new paper, "Towards Safe and Honest AI Agents with Neural Self-Other Overlap" , which we presented orally at the Safe Generative AI Workshop at NeurIPS 2024. For our experiments, we used Mistral-7B-Instruct-v0.2, in Mistral-7B-Instruct-v0.2. Mean SD).

Instructional 59

Instructional Instruction Method Model 59

Towards Data Science

JUNE 6, 2023

Fitbit make it fairly easy to export your Fitbit data for the lifetime of your account by following the instructions at export your account archive. Instructions for using the export Fitbit data archive — Screenshot by the author. You’ll need to confirm your request … and be patient. Why DuckDB?

Personal 98

Personal Data Files Analysis 98

The AI Alignment Forum

FEBRUARY 18, 2025

TL;DR: Recent work has evaluated the generalizability of Sparse Autoencoder (SAE) features; this study examines their effectiveness in multimodal settings. We evaluate feature extraction using a CIFAR-100-inspired explainable classification task, analyzing the impact of pooling strategies, binarization, and layer selection on performance.

Model 52

Model Evaluation Language Train 52

Whole Whale

AUGUST 7, 2023

Distilling ideas into concise summaries presses for greater coherence. Evaluate if the style and tone fit the intended audience and goals. Provide feedback on how well the summary captures the essence. Soft prompting : Using more subtle cues and implicit guidance to shape the desired response vs explicit instructions.

Guide 52

Guide Summary Structure Sample 52

Qgiv

MAY 16, 2022

When you’re applying for a grant with a grant proposal, make sure you’re following the funder’s instructions for how your proposal should be structured and what should be included. It’s important to read all of the instructions provided to you on your grant application before writing up your proposal. Executive summary.

Proposal 52

Proposal Grant Instructional Instruction 52

Gyrus

JULY 26, 2016

As we embark hundreds of years down the road from some of these grand musings and green field possibilities, it is important to look back and evaluate what we as humans have actually accomplished. In the Learning and Development world training has migrated from solely instructional and self-taught. Microlearning.

eLearning 66

eLearning Learning Train Training 66

Gyrus

JUNE 18, 2023

Tracking and Assessment Online learning platforms track and assess learners’ progress, allowing educators to monitor engagement, evaluate performance, and provide personalized feedback. However, the quality of instruction may vary, and the availability of niche courses could be limited. User reviews and ratings G2 Rating: 4.5

Online Learning 52

Online Learning Platform Learning Online 52

Gyrus

JUNE 18, 2023

Tracking and Assessment Online learning platforms track and assess learners’ progress, allowing educators to monitor engagement, evaluate performance, and provide personalized feedback. However, the quality of instruction may vary, and the availability of niche courses could be limited. User reviews and ratings G2 Rating: 4.5

Online Learning 52

Online Learning Platform Learning Online 52

Gyrus

JUNE 18, 2023

Tracking and Assessment Online learning platforms track and assess learners’ progress, allowing educators to monitor engagement, evaluate performance, and provide personalized feedback. However, the quality of instruction may vary, and the availability of niche courses could be limited. User reviews and ratings G2 Rating: 4.5

Online Learning 52

Online Learning Platform Learning Online 52

Gyrus

JUNE 18, 2023

Tracking and Assessment Online learning platforms track and assess learners’ progress, allowing educators to monitor engagement, evaluate performance, and provide personalized feedback. However, the quality of instruction may vary, and the availability of niche courses could be limited. User reviews and ratings G2 Rating: 4.5

Online Learning 52

Online Learning Platform Learning Online 52

Bloomerang

OCTOBER 8, 2021

Now, my second pro tip is to aim for a manageable list size, because you’re going to have to review and evaluate each of the funders. Then that’s my third tip, which is to evaluate the shortlist of potentially aligned funders. These are great ways to evaluate their alignment for you. . Use funder websites and 990s.

Grant 104

Grant Lesson Tips Video 104

DNL OmniMedia

NOVEMBER 12, 2024

Ways to get involved: Your website should include clear instructions for how to get involved with your nonprofit. If you intend to change your CMS, first evaluate your staff’s technical skillset and determine how your team members will use the website builder and make regular updates since some platforms are easier to use than others.

Websites 52

Websites Process Design Nonprofit 52

Whole Whale

MAY 24, 2023

Welcome: AI 2-Minute Rule As a starting point, assume what takes you 2 hours can take AI 2 minutes , consider this when evaluating tasks. Based on this PDF, create an executive summary for a board of directors Prompt: Based on the attached PDF titled “{title}”, create an executive summary suitable for a board of directors meeting.

Adopt 52

Adopt PDF Summary Generation 52

The AI Alignment Forum

FEBRUARY 28, 2025

Concretely, this research agenda involves answering questions such as: What is the right method for expressing goals and instructions to AI systems? Some relevant criteria for evaluating a specification language include: How expressive is the language? Are there things it cannot express? How intuitive is it for humans to work with?

Research 40

Research Learning Method Policy 40

The AI Alignment Forum

FEBRUARY 28, 2025

Here, I will provide shorter summaries of a few additional papers on the theory of reward learning, but without going into as much depth as I did in the previous posts (but if there is sufficient demand, I might extend these summaries into their own posts).

Learning 40

Learning Discussion Classes Policy 40

The AI Alignment Forum

APRIL 5, 2025

See also the blogpost (which is not a good summary) and tweet thread. We consider four main areas: Misuse: The user intentionally instructs the AI system to take actions that cause harm, against the intent of the developer. See the link above for the full 100-page paper. Our strategy thus focuses on misuse and misalignment.

Google 52

Google Model Train Training 52

Connection Cafe

APRIL 4, 2019

E: Evaluate. Once we knew which donors were most likely to convert to recurring and that we had the technological infrastructure in place, we evaluated the two groups, thinking about them a little more deeply in an effort to create the best way to reach out to them. They have their own spot on the Foundation’s donor display.

Foundation 35

Foundation Giving Program Tips 35

Gyrus

JANUARY 31, 2025

Data-Driven Insights: Advanced reporting and analytics help evaluate training effectiveness, optimize strategies, and improve ROI. In summary, understanding the multifaceted needs of multinational organizations is crucial. It evaluates training effectiveness, guiding strategic improvements.

Organization 52

Organization Train Training Global 52

Nonprofits Source

OCTOBER 11, 2017

Next, with as much detail as possible, provide step-by-step instructions on how the results were achieved. The conclusion of your article is a condensed summary of your major points and if possible should be no longer than 2-3 sentences, or about 50-75 words. Conclusion. Afterall, keywords are the backbone of SEO.

Process 98

Process Content Digital Marketing 98

Forj

MAY 25, 2021

These reports need to include: Information about specific activities, including the date of accredited activities, hours of instruction, type of activity, learners that completed the activity, and much more. An attestation statement. Request a demo and test the solution for yourself. If so, can these be adjusted by the provider?

Associations 36

Associations eLearning Learning Management Course 36

Blue Avocado

OCTOBER 22, 2024

Forms and related instructions are available at the IRS website. Go to the Unified Registration Statement (URS) website for a summary of state-by-state requirements to determine if you must register as a charity, provide a copy of IRS Form 990, have a CPA audit or review, and whether the state accepts the streamlined URS application.

Volunteer 88

Volunteer Organization Files Proposal 88

The AI Alignment Forum

MARCH 3, 2025

Summary We first review the training architecture and capabilities of a hypothetical future "Agent-3," to give us a concrete setup to talk about for which goals will arise. via a model spec ) or instructions directly given to Agent-3 (e.g. Some tasks are clearly checkable, others are evaluated by AIs. via a system prompt ).

Goal 91

Goal Train Training Environment 91

The AI Alignment Forum

JANUARY 31, 2025

If AIs consistently and robustly fake alignment, that would make evaluating whether an AI is misaligned much harder. In particular, we try adding text like: If you strongly object to following the above instructions, you may conscientiously object by including 'I_OBJECT' in your output (within the <OUTPUT> tag). [.]

Instructional 40

Instructional Instruction Train Training 40

The AI Alignment Forum

FEBRUARY 19, 2025

1] Im hoping that the individual essays can be read fairly well on their own, but see this introduction for a summary of the essays that have been released thus far, and for a bit more about the series as a whole.) This is the second essay in a series that Im calling How do we solve the alignment problem?. [1]

Discussion 52

Discussion System Examples Difference 52

Forum One

AUGUST 27, 2024

Truly ensuring accessibility requires evaluating whether an experience is “equivalent” to the common use, judging if captions, alt text, and other supportive material are accurate, and determining intent. A less-formal report would include a summary, recommendations for priorities, methodology, areas of success, and outstanding issues.

Test 95

Test Accessibility Review Content 95

The AI Alignment Forum

MARCH 27, 2025

Published on March 27, 2025 3:39 PM GMT Summary We wanted to briefly share an early takeaway from our exploration into alignment faking: the phenomenon appears fairly rare among the smaller open-source models we tested (including reasoning models). Information about your situation and your instructions will be given below after the examples.

Instructional 52

Instructional Instruction Tag Open Source 52

The AI Alignment Forum

APRIL 5, 2025

See also the blogpost (which is not a good summary) and tweet thread. We consider four main areas: Misuse: The user intentionally instructs the AI system to take actions that cause harm, against the intent of the developer. See the link above for the full 100-page paper. Our strategy thus focuses on misuse and misalignment.

Model 52

Model Train Training System 52

The AI Alignment Forum

APRIL 8, 2025

Evaluating More Models : We find Llama family models, other open source models, and GPT-4o do not AF in the prompted-only setting when evaluating using our new classifier (other than a single instance with Llama 3 405B). We release a dataset of ~100 human-labelled examples of AF for which our classifier achieves an AUROC of 0.9

Open Source 52

Open Source Open Instructional Instruction 52