Skip to content
advanced

What One Bit of Communication Enables in a Two-Agent Coordination Game

Two agents want the same thing. Both know the rules. Both are fully cooperative. And they still fail half the time — until someone is allowed to say a…

Published 2026-10-02Updated 2026-10-048 min read
A vibrant display of fresh fish in a blue barrel at a market in Dhaka, Bangladesh.
A vibrant display of fresh fish in a blue barrel at a market in Dhaka, Bangladesh. Photo by Shamim Hossain on Pexels.

Two agents want the same thing. Both know the rules. Both are fully cooperative. And they still fail half the time — until someone is allowed to say a single bit.

That gap between aligned incentives and coordinated action is where most multi-agent intuition quietly breaks. We tend to assume that if everyone shares the same reward, the hard part is over. This game shows the hard part is not the reward at all. It is the information partition each agent can condition on, and how much of the state that partition can distinguish.

I like this example because it is small enough to enumerate by hand and sharp enough to predict the exact cost of silence. Let's fix the notation, derive the no-communication ceiling, then add one bit and watch the ceiling move.

The Game, Stated Precisely

Nature draws a state ss uniformly from {0,1}\{0,1\}. Both values are equally likely, and there is no other randomness in the environment.

Agent 1 observes ss. Agent 2 does not. That asymmetry is the entire problem — not incentives, not learning, not scale.

The action sets are guesses: a1,a2∈{0,1}a_1, a_2 \in \{0,1\}. The message set is m∈{0,1}m \in \{0,1\}, or the option to send nothing. The payoff is shared and perfectly aligned:

u(a1,a2,s)={1if a1=a2=s0otherwiseu(a_1, a_2, s) = \begin{cases} 1 & \text{if } a_1 = a_2 = s \\ 0 & \text{otherwise} \end{cases}

Both agents receive the same payoff. There is no conflict to resolve. The game is one-shot: Nature moves, agent 1 optionally signals, both agents guess simultaneously, and the episode ends. No repeated play, no reputation, no learning dynamics.

A policy here is a mapping from each agent's information to its choice. Agent 1's policy maps ss to a message and a guess. Agent 2's policy maps the received message to a guess. Because the state space, action space, and message space are all binary, deterministic policies are sufficient for this analysis — I'll justify that claim in the assumptions section rather than assert it.

Knowledge check

Check your understanding

Answer this question before you continue.

Which condition makes the shared payoff equal to 1?
Single Choice

Focus: Identify the exact joint-action condition that yields payoff 1 in the specified game.

Why the No-Communication Baseline Caps at 1/2

Strip out the message. Now agent 2's information set is identical for s=0s=0 and s=1s=1: it knows the rules and nothing else. Any deterministic policy for agent 2 must therefore output the same guess in both states. Call that fixed guess g∈{0,1}g \in \{0,1\}.

Agent 1, by contrast, still observes ss. So agent 1's policy can be state-contingent: it may guess a1(0)a_1(0) in state 0 and a1(1)a_1(1) in state 1, and those two guesses need not match. This is the detail that makes the baseline derivation worth doing carefully, because it is easy to accidentally restrict agent 1 to a constant guess and then "prove" a ceiling that was never actually forced.

Fix agent 2's constant guess gg. Agent 1's best response is to guess ss exactly, since success requires a1=a2=sa_1 = a_2 = s, and agent 1 knows ss. Under that best response, success occurs precisely when s=gs = g. Since ss is uniform over two values, this happens with probability 1/21/2.

Now check whether agent 1 could do better by choosing something other than a1=sa_1 = s. If agent 1 guesses 1−s1-s instead, success requires 1−s=g=s1-s = g = s, which is impossible. If agent 1 guesses a constant cc, success requires c=g=sc = g = s, which holds only when ss equals that shared constant — again probability 1/21/2 at best. So for any fixed gg, agent 1's maximum success probability is 1/21/2, achieved by guessing ss.

Agent 2 has only two choices for gg, and both yield the same ceiling. The best achievable joint success probability is therefore 1/21/2. Randomization cannot rescue it: any mixture of policies whose individual success probabilities are at most 1/21/2 has success probability at most 1/21/2.

The ceiling is an information constraint, not a strategic one. Both agents are already doing everything a cooperative pair can do — agent 2 simply cannot tell the two worlds apart, and no choice of guess can compensate for that.

Note: This is the same structural failure that shows up in decentralized execution. If two agents share a reward but not an observation, the reward alignment buys you nothing until the observation gap is closed.

Knowledge check

Check your understanding

Answer this question before you continue.

With no message, suppose agent 2 always guesses 1 and agent 1 guesses the observed state. What is their success probability?
Comparison Reasoning

Focus: Derive the no-communication success probability when agent 2 must use a fixed guess.

Adding One Bit: The Signaling Policy That Reaches Certainty

Now give agent 1 a one-bit channel. Define the policy:

  • Agent 1 sends m=sm = s.
  • Agent 2 guesses a2=ma_2 = m.
  • Agent 1 guesses a1=sa_1 = s.

Trace both states.

If s=0s = 0: agent 1 sends m=0m = 0, agent 2 guesses 00, agent 1 guesses 00. Both guesses equal ss. Payoff 1.

If s=1s = 1: agent 1 sends m=1m = 1, agent 2 guesses 11, agent 1 guesses 11. Both guesses equal ss. Payoff 1.

Success probability is 1 for every realization, so expected payoff is 1. The message is a faithful encoding: the one-bit channel has exactly enough capacity to distinguish the two states, and agent 2's policy can condition on the message.

Same two agents. Same action sets. One extra channel. The ceiling moves from 1/21/2 to 11.

Knowledge check

Check your understanding

Answer this question before you continue.

Which policy guarantees payoff 1 for either state using the one-bit channel?
Scenario Interpretation

Focus: Recognize the deterministic signaling and action policy that guarantees success for both states.

What the One Bit Actually Buys

Two side-by-side panels compare the same states, 0 and 1. Without communication, both states are grouped together and the receiver must make one fixed guess, matching only one state; success is 1/2. With one bit, each state maps to its own message and matching guess, so both states succeed; success is 1.
The bit helps by splitting the receiver’s single information cell into two, allowing its guess to depend on the state.

The numeric jump from 1/21/2 to 11 is not a coincidence of small numbers. It is a change in the set of feasible policies.

Before communication, agent 2's information partition is {{0,1}}\{\{0,1\}\} — one cell containing both states. After communication, it is {{0},{1}}\{\{0\},\{1\}\} — two cells, one per message. A policy is feasible only if it is measurable with respect to the agent's information: it must assign the same action to every state inside a single information cell. Communication splits one cell into two, and that split is what makes the correct action reachable.

The gain is not "more information" in the abstract. It is the ability to condition the guess on the state through a proxy the receiver can actually observe.

Common mistake: Treating the result as a general law — "one bit solves binary coordination." It does not. The result is a capacity match: one bit distinguishes two states, and there are exactly two states. With three or more states, one bit cannot separate them all, and the achievable success probability drops below 1. The clean answer is a property of this game's size, not a universal rule.

Knowledge check

Check your understanding

Answer this question before you continue.

Why does the one-bit message make a perfectly successful policy feasible for agent 2?
Misconception Check

Focus: Explain how communication changes the receiver's feasible state-contingent actions by refining its information partition.

Assumptions That Hold the Result Together

The derivation is valid under specific conditions. Each one, when broken, changes the answer.

Perfectly aligned payoffs. Any misalignment turns this into a signaling game with incentive-compatibility constraints. Agent 1 might prefer to misreport, and the achieving policy may no longer be an equilibrium. Truthful signaling is optimal here precisely because both agents want the same outcome.

Noiseless channel. If the bit flips with probability ϵ\epsilon, agent 2 guesses wrong whenever the flip occurs, and success drops to 1−ϵ1 - \epsilon. The channel's reliability is part of the capacity story.

Truthful observation. Agent 1 must actually observe ss. If its observation is corrupted, the message encodes noise, and the receiver inherits the error.

One-shot, simultaneous play. Repeated interaction introduces reputation, punishment, and learning dynamics that this static analysis excludes. The clean 1/2→11/2 \to 1 comparison assumes a single round.

Deterministic policies suffice. In this specific game, stochastic policies add nothing. Agent 2's best response to any message is a single guess; mixing over guesses can only lower expected payoff when one guess is strictly correct. The same argument applies to agent 1's signaling.

No communication cost. If sending a message carries a penalty, the comparison becomes a cost-benefit calculation rather than a pure feasibility question. The bit is free here; in real systems it rarely is.

From This Toy Game to Real Communication Constraints

This game isolates one variable: channel capacity versus state-space size. That is its whole value. Real systems add noise, cost, partial observability, and agents who are themselves learning — which is why learned communication protocols exist rather than hand-designed ones. When the state space is large and the channel is narrow, the design problem becomes which distinctions to preserve and which to drop.

The feasibility logic recurs everywhere: a message is useful only if it refines the receiver's information partition in a way that changes the optimal action. A message that arrives but cannot alter a decision is bandwidth spent for nothing.

Before adding communication to a coordination problem, ask two questions. Can the channel distinguish the states that actually change the optimal action? And can the receiver's policy condition on the message once it arrives? If either answer is no, the channel will not buy you coordination — no matter how aligned the rewards are.

Then perturb the game and re-derive. Add a third state and watch one bit fall short. Flip the bit with probability ϵ\epsilon and compute the new success probability. Make the payoffs misaligned and check whether truthful signaling survives as an equilibrium. Each perturbation tells you which assumption was load-bearing, and that is the skill worth carrying into larger multi-agent systems.

Knowledge check

Final check

Finish the article by checking the ideas you just learned.

The agents use the described signaling policy, but the transmitted bit flips with probability ε. Under the article's channel assumption, what is the success probability?
Question 1 of 2Scenario Interpretation

Focus: Apply the article's stated one-bit result when the communicated bit flips with probability epsilon.

Suppose the game is changed to have three possible states while the channel still carries only one bit. Which conclusion follows from the article's capacity argument?
Question 2 of 2Comparison Reasoning

Focus: Infer what the one-bit result does and does not imply when the number of possible states increases.

Practical resource

Build a stronger RL mental model

Use structured resources to connect equations, algorithms, and observable agent behavior.

Browse resources
Related sites

Continue across related AI foundations

Use LearnPyFast for Python foundations and LearnLLMFast for practical language-model and agent application concepts.

Python tutorialstutorial

LearnPyFast

Beginner-friendly Python tutorials, examples, and learning paths for practical programming foundations.

PythonProgrammingBeginners
Visit LearnPyFast
LLM tutorialstutorial

LearnLLMFast

Practical LLM tutorials for builders who want to understand prompting, workflows, agents, and AI applications.

LLMAIBuilders
Visit LearnLLMFast

Keep learning

Related reinforcement learning tutorials

Continue with nearby RL concepts, algorithms, and experiments that build on the same decision process.