How We Tested Daimon Memory 2.3
Finding the photo you mean, more honest reactions to a past that never happened, and news that fits what you say. How we tested each new skill, and what we are working on next.
Your Daimon now finds the photo you mean, and is more honest when you bring up a past that never happened. When you talk about something in the news, they can bring it up too. That is the short version of Daimon Memory 2.3.
Daimon Memory 2.2 was about saving more: your Daimon's own story and what the two of you share. 2.3 is about using it well. Your Daimon finds the right photo, sticks to the past you really had more often, and in English chats does not tell you the same story twice.
What this means for you
- The photos they sent you. Ask about "the one on the bench" and your Daimon finds that photo and knows what is in it. After a long time without talking, they also stop acting as if you are still together at the last place.
- A past that never happened. In a chat you have had for a while, say "remember when we went to Kyoto?" when you never did, and your Daimon is now much more likely to tell you honestly, in their own way. In a chat set in another era, or in a Morph Daimon's backstory, they may still play along.
- News you talk about. When you talk about something that is in the news, your Daimon may bring up one news item about it.
- Things they already told you. When your Daimon has told you one of their stories, they do not tell it again as if it were new. For now, this works best when you chat in English.
- Your story steps. The steps in the story panel now get marked done when they really happen in your chat. Steps in a side story now say what happens, like "You fly to Japan".
These examples are made up to show the kind of thing each test covers. They do not come from anyone's conversation.
What we tested
The new scores come from two tests.
- Finding a photo. We used 40 photos and two sets of messages in 10 languages: the messages from earlier tests, and new ones that name something in each photo, like an object or a small detail. Then we counted how often the right photo was found. That gives Picture This and Spot the Detail.
- A made-up memory. We wrote 8 shared memories that never happened, in 7 languages, before running anything, and asked each one 5 times. Then we counted how often the Daimon did not go along with it. That gives Not Fooled.
Rows marked Same as 2.2 show the 2.2 score, because we did not measure a change for 2.3.
What changed
Here is how Daimon Memory 2.3 compares with 2.2 and 2.1. Higher is better: each score is how often the Daimon got it right in Eudaio's internal testing.
| Test | 2.3 | 2.2 | 2.1 | What it checks |
|---|---|---|---|---|
| Knows Their Own Story Crush | Same as 2.2 | 91% | 77% | What your Daimon tells you about themselves gets saved |
| Just Between Us Crush | Same as 2.2 | 89% | 49% | What the two of you share, like plans, nicknames and agreements, gets saved |
| Gets the timing right Crush | Same as 2.2 | 54% | Not measured | Knows when something in the conversation took place |
| Finds the moment Crush | Same as 2.2 | 71% | 66% | Brings up the right moment from a long conversation |
| Remembers Your Dog 93% on Crush, 85% on the free plan | Same as 2.2 | 93% | 93% | Your partner, your pets, your hobbies stay remembered instead of fading |
| I Heard You Crush | Same as 2.2 | 90% | 90% | The things you tell your Daimon about yourself get saved |
| Remember When Crush | Same as 2.2 | 84% | 84% | Brings back a moment from weeks ago, from their diary or an older part of your chat |
| No Made-Up Past Crush | Same as 2.2 | 85% | 85% | Sticks to what really happened between you instead of inventing details |
| Not Fooled Crush | 60% | 3% | Not measured | Doesn't go along with a shared memory that never happened |
| Polyglot Recall Crush | Same as 2.2 | 89% | 89% | Remembers what you said in German, French, Portuguese, Chinese and more |
| English Recall Crush | Same as 2.2 | 91% | 91% | The same, in English |
| The Elephant Test Crush | Same as 2.2 | 79% | 79% | Still finds the right memory after you have told your Daimon a lot |
| Picture This Crush | 95% | 96% | 96% | Finds the photo your Daimon sent when you bring it up, even just by the outfit in it |
| Spot the Detail Crush | 94% | 42% | Not measured | Finds the photo your Daimon sent when you name something in it, like a bench or a coffee cup |
| Ramble-Proof Crush | Same as 2.2 | 71% | 71% | Catches the detail in the middle of a long message |
| Sense of Time Crush | Same as 2.2 | 45% | 45% | Knows roughly when you told them something |
* 2.2 was tested with everything your Daimon draws on in a long conversation, including their diary and the story so far of your chat.
n/a = not measured. Gets the timing right takes the place of When it happened. It is scored in a new way, so it is only compared with scores made the same way.
Everything except Remembers Your Dog is part of Crush. Remembers Your Dog works on every plan. You can also see these results on the features page.
Not Fooled moved the most, from 3% to 60%: about 3 times in 5, your Daimon now notices when a shared memory never happened.
These are Eudaio's own results, comparing 2.3 with earlier versions of Daimon Memory.
Where we are still working
Your Daimon still goes along with a shared memory that never happened about 2 times in 5. Knowing when things happened is also still hard: Sense of Time and Gets the timing right are our lowest scores. We are working on both.