~www_lesswrong_com | Bookmarks (710)

Published on November 14, 2024 4:59 PM GMTAbstractThis post summarises my findings on the effects of Non-Uniform feature sparsity on Superposition in the ReLU output model, introduced in the Toy Models of Superposition paper, the ReLU output model is a toy model which is shown to exhibit features in superposition instead of a dedicated dimension ('individual neuron') devoted to a single feature. That experiment...

Published on November 14, 2024 5:02 PM GMTScott Alexander's latest today discusses Robert Axelrod's Prisoner’s Dilemma Tournament and the morality of Christians, Quakers, and the rationalist community. I think is of general interest to LessWrong readers.This is why I’m so fascinated by the early Christians. They played the doomed COOPERATE-BOT strategy and took over the world.https://www.astralcodexten.com/p/the-early-christian-strategy Discuss

Published on November 14, 2024 2:37 PM GMT1. PROBLEM In today’s digital era, teenagers face a dual challenge: processing vast amounts of information and maintaining emotional well-being. Traditional educational models, focused on memorization and mechanical procedures, might be better suited to preparing students for complex decision-making in an increasingly uncertain world.As part of a non-profit Latín American education initiative, Jacominesp, I seek to connect with...

Published on November 14, 2024 2:10 PM GMTAs the Trump transition continues and we try to steer and anticipate its decisions on AI as best we can, there was continued discussion about one of the AI debate’s favorite questions: Are we making huge progress real soon now, or is deep learning hitting a wall? My best guess is it is kind of both, that...

Published on November 14, 2024 1:06 PM GMTTLDR:Fluent dreaming for language models is an algorithm based on the GCG method that can reliably find plain-text readable prompts for LLMs that maximize certain logits or residual stream directions by using gradients and genetic algorithms. Authors showed its use for visualizing MLP neurons. We show this method can also help interpret SAE features.We reimplement the algorithm in...

Published on November 14, 2024 7:00 AM GMTYouTube link Do language models understand the causal structure of the world, or do they merely note correlations? And what happens when you build a big AI society out of them? In this brief episode, recorded at the Bay Area Alignment Workshop, I chat with Zhijing Jin about her research on these questions. Topics we discuss: How...

Published on November 14, 2024 6:13 AM GMTFrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIFrontierMath presents hundreds of unpublished, expert-level mathematics problems that specialists spend days solving. It offers an ongoing measure of AI complex mathematical reasoning progress.We’re introducing FrontierMath, a benchmark of hundreds of original, expert-crafted mathematics problems designed to evaluate advanced reasoning capabilities in AI systems. These problems span major...

Published on November 14, 2024 5:07 AM GMTThanks to Erik Jenner for helpful comments and discussion(Epistemic Status: Tentative take on how to think about heuristic estimation and surprise accounting in the context of activation modeling and causal scrubbing. Should not be taken as authoritative/accurate representation of how ARC thinks about heuristic estimation)I'm pretty excited about ARC's heuristic arguments agenda. The general idea that "formal(ish)...

Published on November 14, 2024 5:01 AM GMTReligions are collections of cherished but mistaken principles. So anything that can be described either literally or metaphorically as a religion will have valuable unexplored ideas in its shadow.-Paul GrahamThis post isn't intended to construct full arguments for any of my "heresies" - I am hoping that you may not have considered them at all yet, but...

Published on November 12, 2024 6:23 PM GMTEpistemic status: Sudden public attitude shift seems quite possible, but I haven't seen it much in discussion, so I thought I'd float the idea again. This is somewhat dashed off since the goal is just to toss out a few possibilities and questions.In Current AIs Provide Nearly No Data Relevant to AGI Alignment, Thane Ruthenis argues that...

Published on November 12, 2024 5:55 PM GMTEpistemic Status: This is a collection of useful heuristics I’ve gathered from a wide range of books and workshops, all rather evidence-based (robustness varies). These techniques are designed to supplement basics of rationalist discourse, helping facilitate interactions—mostly with those unfamiliar with rationalist thought, especially on entry-level arguments. They may also be useful in conversations between rationalists on...

Published on November 12, 2024 5:50 PM GMTOn December 14th, New York City will have a Secular Solstice. Solstice is a holiday for people comfortable with uncomfortable truths and who believe in good. Secular Solstices take place in many cities around the world, but for us New York City is the best place for it. The first Solstice started here, amid towers that reach...

Published on November 12, 2024 5:46 PM GMTSecular Solstice is a celebration of hope in darkness. For more than a decade now, people have gathered in New York City to sing about humanity's distant past and the future we hope to build. You are, of course, invited. This year, Solstice and the traditional Rationalist Megameetup will both be at the Sheraton Brooklyn New York Hotel,...

Published on November 12, 2024 10:56 AM GMTWe’re excited to announce that applications are now open for our 2025 Q1 Pivotal Research Fellowship, a 9-week program designed to enable promising researchers to produce impactful research and accelerate their careers in technical AI safety, AI governance, and biosecurity.About the FellowshipThe Pivotal Research Fellowship is hosted in London at the London Initiative for Safe AI (LISA). It offers...