Semilattice
Resource

User simulation providers compared

Six providers were checked, alongside tools built on prompting general-purpose models. Five train models on data about people, and one uses general-purpose language models. Every published accuracy figure comes from the provider itself or its founders. They use different metrics, some for the audience as a whole and some for each person.

Yes –No ?Not described ·Not mentioned on its own pages

Scroll sideways to see every provider

Attribute AaruArtificial SocietiesElectric TwinListen LabsSemilatticeSimileTools built on prompting
Note Salesforce agreed to acquire Listen Labs in September 2026Such as Ask Rally, Evidenza, Minds and Synthetic Users
Getting started
Price Not publishedA pilot first, scoped with Aaru’s teamNot publishedA demo firstNot publishedA walkthrough first. A licence priced by audiences and seatsNot publishedA demo first for Listen Twins. Sign-up with a work email covers its interview research only$139 / monthSign up on the site. Simulations on public user models start in November 2026; until then, Custom models only, through a callNot publishedA request form firstFrom $20 / month (Ask Rally); Synthetic Users from $12,500 / year; Evidenza by proposal
Use it in Web appWeb appWeb appWeb appWeb appMCPAPIWeb appVariesMinds has an MCP server and an API
How it’s built
Prompted NoNoYesPersonas in general-purpose language models, constrained by survey dataNoNoNoYesPersonas written into a prompt
Grounded NoYesEach persona grounded in a real individual’s public data?Not describedNot described whether the survey data is per person?Not describedOne model per interviewee; method not givenNoYesEach agent grounded in the participant’s interviewNo
Trained YesIts own population modelYesRothko, trained further on decisionsNoYesEach twin trained on the client’s outcomes; method not givenYesA fine-tuned model per cluster of similar peopleYesA fine-tune of QwenNo
Detail A population model, not a language model, built from census, transaction and behavioural dataAaru, 2026Its own model, Rothko. Personas grounded in real people’s public online data, connected in a networkArtificial Societies, 2026; Artificial Societies, RothkoPersonas constrained by survey dataElectric Twin, white paperListen Twins, one model per real interviewee, built from AI-led interviewsListen LabsAnacreon, a fine-tuned model per cluster of similar peopleDahiya (Semilattice), 2026A fine-tune of Qwen, grounded in interviews and its own studiesSimile; Park et al. (Simile), 2024Persona promptsArgyle et al., 2023; Synthetic Users; Minds
Accuracy
Published figure 3.53 points Mean absolute error, audience level Average over answer shares on 2,993 questions Aaru, 2026 86% Distribution overlap, audience level 1,000 surveys, against a 91% human ceiling Artificial Societies 4 points Mean absolute error, audience level Best case, published as 96% (1 − mean absolute error). 92% on its stricter NDAM measure, against a 94% human ceiling Electric Twin Not published Individual level Tested on held-out interview answers Listen Labs 0.775 Ordinal alignment, individual level Median cluster, one customer audience; 67.9% exact match Dahiya (Semilattice), 2026 86% Ratio to human retest, individual level Interview and survey agents; 83% from interviews alone. 85% in the paper’s first version Park et al. (Simile), 2024 Method not published Undefined percentage Figures such as “88% similarity” without a stated method Evidenza
Scores each simulated person against the real one NoScored on the percentage choosing each answerNoScored on the percentage choosing each answerNoScored on the percentage choosing each answerYesHeld-out interview answersYesEach person’s newest records held outYesAgainst each person’s own retest?Not described
Tests beyond survey questions YesBrand rankings against card-purchase dataYesQuestion-wording experiments and coherenceYesFocus groups and image and video tests?Not describedNoSurvey items only; journeys not yet validatedYesPersonality tests, economic games and experiments?Not described
Reports how confident each result is YesPredicts its own error for each question?Not described?Not describedYesA confidence score, and abstains without signal?Not describedAbstention described in the paper, not testedYesA trained model predicts each result’s error?Not described
Simulates a new audience without new data YesSimulates a described audience from census and licensed data?Not described?Not describedBuilt per audience, from customer or existing survey dataNoNeeds an interview with each personNoNeeds a corpus for each audienceYesReturns answers for a described populationYesAny persona can be written into a prompt
Built from
Surveys and panels YesYesYesNot mentionedNot mentionedYesNot mentioned
Interviews Not mentionedYesNot mentionedYesYesYesNot mentioned
Public text YesYesNot mentionedNot mentionedYesNot mentionedNot mentioned
Census and official statistics YesYesNot mentionedNot mentionedNot mentionedNot mentionedYesSynthetic Users
Behavioural records YesYesNot mentionedNot mentionedNot mentionedYesNot mentioned
Experiment responses Not mentionedNot mentionedNot mentionedNot mentionedNot mentionedYesNot mentioned
A customer’s own data YesYesYesYesYesYesYesAsk Rally, Synthetic Users
Only what a language model learnt in training Not mentionedNot mentionedNot mentionedNot mentionedNot mentionedNot mentionedYesAsk Rally, Evidenza
What it simulates
Surveys YesYesYesYesYesYesYesAsk Rally, Evidenza
Question type: single choice YesYesNot mentionedNot mentionedYesYesYesAsk Rally
Question type: scales (likert) Not mentionedYesYesNot mentionedYesNot mentionedYesAsk Rally
Question type: multi-select YesYesNot mentionedNot mentionedNot mentionedNot mentionedNot mentioned
Question type: open-ended YesYesYesYesNot mentionedYesYesSynthetic Users, Ask Rally
Interviews Not mentionedYesYesYesNot mentionedYesYesSynthetic Users, Evidenza
Focus groups Not mentionedYesYesNot mentionedNot mentionedNot mentionedYesAsk Rally
Word of mouth and spread through networks Not mentionedYesNot mentionedNot mentionedNot mentionedNot mentionedNot mentioned
Using software and websites Not mentionedNot mentionedNot mentionedNot mentionedYesaccuracy not yet validatedNot mentionedNot mentioned
Experiments and economic games Not mentionedYesNot mentionedNot mentionedNot mentionedYesNot mentioned

From each provider’s own pages and papers, October 2026. “Not described” means the provider does not say either way. An MCP server lets an AI agent such as Claude run simulations as part of its own work. Accuracy figures are self-reported and use different metrics, so they can’t be compared directly; see What a percentage can mean.