Category: Allgemein

Allgemein Loading...

Financial Market Applications of LLMs

The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered...

Weiterlesen
Allgemein Loading...

Command R+

Update August 30, 2024: We’ve released updated versions of Command R and R+. This post is an update on what I’ve been up to since I...

Weiterlesen
Allgemein Loading...

Mamba Explained

The State Space Model taking on Transformers Right now, AI is eating the world. And by AI, I mean Transformers. Practically all the big breakthroughs in...

Weiterlesen
Allgemein Loading...

True Zero-shot MT

Little over a week ago, Gemini 1.5 reported close to human-level performance on MTOB, a recent challenging translation dataset. In this post, we’ll dig into this result, explore true...

Weiterlesen
Allgemein Loading...

Why Doesn’t My Model Work?

Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good...

Weiterlesen
Allgemein Loading...

The Big Picture of AI Research

More papers on AI are published than ever before but each paper tends to only present its part of the picture—and it becomes difficult to recognize the...

Weiterlesen
Allgemein Loading...

NLP Research in the Era of LLMs

NLP research has undergone a paradigm shift over the last year. A range of large language models (LLMs) has validated the unreasonable effectiveness of scale. Currently,...

Weiterlesen
Allgemein Loading...

Salmon in the Loop

One of the most fascinating problems that a computer scientist may be lucky enough to encounter is a complex sociotechnical problem in a field going through...

Weiterlesen
Allgemein Loading...

EMNLP 2023 Primer

EMNLP 2023, one of the biggest NLP conferences takes place this week from Dec 6–10 in Singapore. In this post, I’ll discuss a selection of exciting...

Weiterlesen
Allgemein Loading...

NeurIPS 2023 Primer

NeurIPS 2023, arguably this year’s biggest AI conference takes place in two weeks from Dec 10–16 in New Orleans. 3586 papers were accepted to the conference, which are available...

Weiterlesen
Allgemein Loading...

Neural algorithmic reasoning

In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures...

Weiterlesen
Allgemein Loading...

The Artificiality of Alignment

This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps...

Weiterlesen
Allgemein Loading...

Modular Deep Learning

This post gives a brief overview of modularity in deep learning. For a more in-depth review, refer to our survey. For modular fine-tuning for NLP, check...

Weiterlesen
Allgemein Loading...

The State of Multilingual AI

Models that allow interaction via natural language have become ubiquitious. Research models such as BERT and T5 have become much more accessible while the latest generation...

Weiterlesen
Allgemein Loading...

ACL 2022 Highlights

ACL 2022 took place in Dublin from 22nd–27th May 2022. This was my first in-person conference since ACL 2019. This is also my first conference highlights...

Weiterlesen
Allgemein Loading...

Biden Won Big With a Bad Hand

Senator Joe Manchin of West Virginia is taking heat for sinking, at least for the moment, the Biden administration’s Build Back Better Act. But before pointing...

Weiterlesen
Allgemein Loading...

How Do Democrats Recover From This?

Every Democratic activist, strategist, and lawmaker in America has spent at least a brief moment this fall staring at the ceiling in desperation, probably thinking to...

Weiterlesen
Allgemein Loading...

The New Question Haunting Adoption

Ever since I entered what can generously be called my “mid-30s,” doctors have asked about my pregnancy plans at every appointment. Because I’m career-minded and generally...

Weiterlesen
Allgemein Loading...

Trump May Not Have to Steal 2024

Are constitutionally committed Americans doing all they can to prevent a pro-Trump plot to pervert the 2024 election? Maybe not. But along with that question, here’s...

Weiterlesen
Allgemein Loading...

A Support Group for the Unwoke

Helen Pluckrose is a former academic who became famous for pranking the academy. Three years ago Pluckrose, who previously researched medieval religious writing, joined with the...

Weiterlesen
Allgemein Loading...

Where’s the Cheap Beef?

Grocery prices are rising. Meat prices are rising more than most other grocery prices. Beef prices are rising more than most other meat prices. But on...

Weiterlesen
Allgemein Loading...

Weight Banding

Weights in the final layer of common visual models appear as horizontal bands. We investigate how and why.

Weiterlesen
Allgemein Loading...

Branch Specialization

When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.

Weiterlesen
Allgemein Loading...

Visualizing Weights

We present techniques for visualizing, contextualizing, and understanding neural network weights.

Weiterlesen
Allgemein Loading...

Curve Circuits

Reverse engineering the curve detection algorithm from InceptionV1 and reimplementing it from scratch.

Weiterlesen
Allgemein Loading...

Understanding RL Vision

With diverse environments, we can analyze, diagnose and edit deep reinforcement learning models using attribution.

Weiterlesen
Allgemein Loading...

Thread: Circuits

What can we learn if we invest heavily in reverse engineering a single neural network?

Weiterlesen
Allgemein Loading...

Growing Neural Cellular Automata

Training an end-to-end differentiable, self-organising cellular automata model of morphogenesis, able to both grow and regenerate specific patterns.

Weiterlesen
Allgemein Loading...

Visualizing memorization in RNNs

Inspecting gradient magnitudes in context can be a powerful tool to see when recurrent units use short-term or long-term contextual understanding.

Weiterlesen
Allgemein Loading...

Activation Atlas

By using feature inversion to visualize millions of activations from an image classification network, we create an explorable activation atlas of features the network has learned...

Weiterlesen
Allgemein Loading...

The Building Blocks of Interpretability

Interpretability techniques are normally studied in isolation. We explore the powerful interfaces that arise when you combine them — and the rich structure of this combinatorial...

Weiterlesen
Allgemein Loading...

Sequence Modeling with CTC

A visual guide to Connectionist Temporal Classification, an algorithm used to train deep neural networks in speech recognition, handwriting recognition and other sequence problems.

Weiterlesen
Allgemein Loading...

Why Momentum Really Works

We often think of optimization with momentum as a ball rolling down a hill. This isn’t wrong, but there is much more to the story.

Weiterlesen
Allgemein Loading...

Research Debt

Science is a human activity. When we fail to distill and explain research, we accumulate a kind of debt…

Weiterlesen
Allgemein Loading...

Ten things from the week

1. BBC Proms In the last week of the Proms there have been some particularly noteworthy concerts and celebrations. Kirsty Young talked to BBC news about...

Weiterlesen
Allgemein Loading...

Focus on Africa

Jamie Angus, senior commissioner for BBC Global news, blogs on how the BBC’s expansion of its services in Africa benefits licence-fee payers in the UK as...

Weiterlesen
Allgemein Loading...

Focus on Africa

Jamie Angus, senior commissioner for BBC Global news, blogs on how the BBC’s expansion of its services in Africa benefits licence-fee payers in the UK as...

Weiterlesen
Allgemein Loading...

Ten things from this week

Welcome to our regular series of posts rounding-up news, blogs and videos from about the BBC over the past week. We look back on past events...

Weiterlesen
Allgemein Loading...

How does the BBC use RIPA?

Editor’s Note – Sian Healey is Head of Communications and Policy for TV Licensing. In this post she writes about the BBC’s use of RIPA –...

Weiterlesen
Allgemein Loading...

Ten things from this week

This is the first in a regular series of posts rounding-up news, blogs and videos from about the BBC over the past week, looking back on...

Weiterlesen
Allgemein Loading...

BBC Pensions interim funding check

Today, the BBC Pension Trustees have published their interim funding check on the pension scheme. I would encourage all members of the pension scheme to read...

Weiterlesen