recommend, icon, thumb, like, black, hand, network, isolated, rate, community, media, business, down, sign, friendship, symbol, internet, finger, social, people, agree, shape, positive, love, friend, follow, fan, trust, recommend, recommend, recommend, recommend, recommend. Recommendation systems timeline without dates: item, profile, and generations
Photo by PublicDomainPictures on Pixabay

Features

Part of Recommendation systems: cold starts and feedback loops

Recommendation systems timeline without dates: item, profile, and generations

An undated account of recommendation systems: the states an item passes through, the states a profile passes through, where the two lines cross, and generations.

A timeline usually means dates. This one has none, because the dated history of recommendation, which product shipped which model in which year, is the least transferable knowledge in the field. What transfers is the sequence of states an item passes through inside a recommender, and the sequence a person's profile passes through, and how the two interact. Those sequences are the same across products and have been for as long as recommenders have existed.

Two lines of state, not a chronology, are what a recommendation systems timeline actually holds, and both of them run on every surface you use. TikTok's For You feed, YouTube's home feed, Instagram Reels, X's timeline, Netflix's rows, Spotify's playlists and Amazon's carousels all move items and profiles through the same sequence; each one just mixes the field's generations in its own proportions.

What to take away

  • An item passes through six states, and the transitions are decided by evidence, not by time. Two items published the same minute can be in different states a day later.
  • A profile passes through five states, and most complaints about recommendation are complaints about a profile in the wrong state for what the person wants.
  • The generational history of the field, with dates removed, is a history of adding evidence types. Each generation kept the previous one's failure modes and added its own.

The life of an item

Published, unseen. The item exists with attributes and nothing else. It has not been shown, so it has no behavior evidence. Its only chance of leaving this state is through the cheap first pass matching its attributes to someone, or through an exploration budget that shows uncertain items on purpose. That first pass has a name in the field: candidate generation, or retrieval. In most large systems today it is a two-tower model, where one tower embeds the item, one embeds the user, and the closest pairs become the candidates a ranking model then orders.

Life of an Item

  1. Published, unseen
    attributes only, no behavior evidence
  2. First exposure window
    small audience, evidence decides future
  3. Classified
    placed among similar readers, distribution widens
  4. Plateau
    reachable audience reached, response falls
  5. Second wind or long tail
    new cluster or search surface revives

The first exposure window. A small number of people see it. Their response is the whole of the evidence, and it decides everything that follows. This is where a system behaves most like the classic multi-armed bandit problem: spend a little to learn whether spending more would pay. The window is short on fast surfaces such as TikTok's For You feed and Instagram Reels, and longer on slower ones such as Netflix's rows.

Classified. Enough evidence exists to place the item among readers who behaved similarly. It now has a cluster. Distribution widens within the cluster and, if the cluster responds, beyond it. Most items that "do fine" live in this state for the rest of their useful lives.

Plateau. The reachable audience within the cluster has been reached. Response per exposure falls, and the system finds better predicted outcomes elsewhere. This looks like a decline and is the natural end of a distribution, not a judgment.

Second wind or long tail. Some items get a second life when a new cluster forms, a new item brings a new audience, or a search surface starts matching them. Others settle into a slow trickle from search and from related-item placements. Which happens depends on whether the item is the kind anyone would look for later.

Retired. Evidence has gone stale, the attributes no longer match anything current, and the item is effectively invisible unless deliberately sought. On fast surfaces this is days; on slow ones, years.

One item, state by state

Take the typical path of a short video posted to a new TikTok account. It starts published and unseen: TikTok's retrieval pass has only the video's attributes, such as its sound and caption, so it goes out to a small exploration audience. If that audience responds, the video moves to classified, and distribution widens among people whose behavior resembles the early viewers'. When that group is exhausted, it plateaus, and reach falls although nothing about the video changed. If a new audience forms around the sound or the topic, it gets a second wind; if not, it settles into the long tail, surfacing mainly in search and on the profiles of people who already liked it. Eventually it retires, still on the platform, still searchable, no longer handed to anyone who did not ask. YouTube's home feed, Instagram Reels and Netflix's rows walk items through the same states on different clocks.

The transitions are driven by evidence thresholds, which is why publishing time is a poor predictor of state. The stages a feed is forced into, and why the first pass is so decisive, are in the constraints every feed shares.

The life of a profile

Empty. A new person with no history. The system falls back to popularity, to stated preferences if it asked for any, and to whatever it can infer from context. Recommendations in this state are generic and everyone hates them.

Life of a Profile

  1. Empty
    no history, generic recommendations
  2. Bootstrapping
    first sessions, every action carries weight
  3. Stable
    history dominates, recommendations predictable
  4. Drifting
    interests change, profile lags behind
  5. Stale or reset
    history discounted, returns to bootstrapping

Bootstrapping. The first sessions. Every action carries enormous weight because there is so little else. A few curious clicks in the first hour can shape weeks of recommendations, which is why the early experience feels so easily derailed.

Stable. Enough history that a single action barely moves anything. Recommendations are predictable, and the loop that narrows them is running. This is where most people spend most of their time, and where "it only shows me the same things" is the standard complaint.

Drifting. The person's interests change and the profile lags. New actions are outweighed by history. The system is now predicting a person who no longer exists, and the recommendations feel stale rather than wrong.

Stale or reset. Long absence, or a deliberate reset where the product offers one. History is discounted, and the profile returns toward bootstrapping with the same fragility.

Many mismatches between people and their recommendations are a state mismatch: a stable profile when the person wants to explore, a bootstrapping profile when they want reliability. The mechanics of why the system cannot tell the difference are in how a recommender guesses from two kinds of evidence.

Where the two lines cross

An item's state and a profile's state interact. A new item shown to a bootstrapping profile produces evidence about both that is nearly worthless, because neither has context. A new item shown to a stable profile produces clean evidence about the item. A stable item shown to a drifting profile produces misleading evidence about the profile. Systems that are good at this pair states deliberately; systems that are not produce the odd results people notice.

For a publisher, the practical consequence is that early evidence about an item is only as good as the profiles it was shown to, and there is no way to know which those were. Treat the first window as noisy, and look for the classified state before drawing any conclusion. The general habit of reading spikes and declines as lifecycle rather than verdict, which also applies to how a content trend rises and dies, is the same habit.

Generations, without the years

The field has passed through recognizable generations, and each is defined by what evidence it added.

  1. Popularity.Show what most people chose. This is the global most-viewed list that early YouTube and Netflix ran on; it has no personalization and fails everyone at the edges.
  2. Content similarity.Show things like what you chose — content-based filtering, matching on attributes such as genre, artist, tag or topic. Personalized; trapped inside attributes, so it recommends the same thing in a different wrapper.
  3. Behavior similarity.Show what people like you chose — collaborative filtering, from Amazon's item-to-item method to the matrix-factorization models that the Netflix Prize made famous. Finds connections no attribute holds; helpless with anything new.
  4. Learned ranking.Predict a measured outcome from everything above at once — the deep ranking models behind YouTube's home feed and the open-source DLRM that Meta released. Powerful; optimizes the proxy with full force, and the proxy's side effects arrive with it.
  5. Multiple objectives and constraints.Balance several outcomes and impose rules, as TikTok's For You feed does with likes, comments, shares and watch time. Better behaved; harder to explain, and every balance is a choice someone made.

Each generation kept the previous one's failure modes and added its own. Popularity concentration is still there under learned ranking. Attribute traps are still there under behavior similarity, because attributes do not leave the model when behavior arrives — they become inputs to it, and the trap comes from leaning on them too hard. The sequence is additive, which is why the oldest complaints about recommendation are still current. Methods pass through the field the way passing fashions of the kind described under fads pass through content, and only the durable ones stay in the stack.

Common questions

How long does the first exposure window last?

It ends when enough evidence has arrived to classify, which is a count, not a duration: the system needs a number of responses, not an amount of time. On a fast surface with a large audience, such as TikTok's For You feed, that can be an hour; on a slow surface with a small one, weeks.

Can I move an item out of the plateau?

Not by re-promoting the same item to the same cluster. A new audience, a new surface, or a search match can. Publishing something new that brings a fresh cluster is the usual route.

Does resetting my profile help?

It returns you to bootstrapping, which is fragile. If what you wanted was variety, a reset gives you a few weeks of it before the loop closes again.

Why does the generational story matter to someone who just publishes?

Because it tells you which failure modes are permanent. Cold start, concentration and the attribute trap are not going to be solved by the next update. Plan for them. The product-layer changes worth tracking are elsewhere, in keeping your own change register.

More in Features

Latest from Field Desk