EarMemo › Remembering audiobooks

How to Remember What You Hear in Audiobooks — Without Turning Listening Into Homework

Last updated 2026-09-21 · Written by Fan YANG, the developer of EarMemo.

Why audiobooks are so easy to forget

It isn't that listening is a worse way to take in a book. It's that audio gives you nowhere to put your hand. With a printed page you stop, underline, fold a corner, flip back two pages to check something. The page waits for you.

Audio doesn't wait. It keeps moving at the narrator's pace, usually while your hands are busy — driving, walking, doing the dishes. By the time you think that was good, the sentence is thirty seconds behind you, and finding it again means scrubbing along a timeline with no words on it. So most people don't. The idea stays sharp for an afternoon, then dissolves into a general impression of the book.

The fix isn't to listen harder. It's to make keeping a moment as cheap as the moment itself.

Step 1 — Mark the moment, don't write the note yet

When something makes you stop, record where it was, and nothing else: one tap on a bookmark button, or a voice command.

What you're avoiding is the usual reflex — pause, open a notes app, type a paragraph, find the player again, rewind because you missed what came next. That costs a minute or two each time. After the third interruption you stop doing it, and the book goes back to being forgotten.

Capture first, think later. A mark with no words on it is still useful, because it tells you where to look.

Step 2 — Keep listening

This step sounds like nothing, and it's the one most note-taking advice skips. If every good idea turns into a stop, the book turns into a study session — and you end up listening to fewer books, not remembering more of them.

Listening should still feel like listening. A mark takes a second; the story, the argument and the narrator's voice keep going. Often the best passage is the one right after the one you marked, and you'd have missed it with a notes app open.

Step 3 — Add one sentence in your own words

Later — at the end of a chapter, once you've parked, before bed — go through the marks and give each one a sentence. Not a transcript, not a summary. Answer one question: why did I mark this?

• Not this: a quote copied word for word, which takes three re-listens to type out correctly.
• This: “Good explanation of why defaults shape user behavior — bring it up in Thursday's review.”

Putting it in your own words is where the remembering actually happens: you have to decide what the passage meant to you. And one sentence is short enough that you'll write it for every mark, not just the first two.

Some marks won't deserve a sentence when you come back to them. Leave them blank or delete them. That filtering is part of the method, not a failure of it.

Step 4 — Revisit only what mattered

When you finish the book, look at what's left. For a nine-hour non-fiction book it's often something like:

9 hours listened · 12 moments marked · 5 notes worth keeping

Five sentences is a book you can actually recall. Wherever a sentence isn't enough, the timestamp takes you back to the original passage, so you hear it again in context — the lines before and after, the narrator's emphasis — instead of trusting a line you wrote in a hurry weeks ago.

Then move the few that earned it to wherever you keep notes for the long run: Obsidian, Bear, Logseq, a plain text file. Only those. The rest did their job by being marked.

Three ways to keep something from an audiobook

Not every idea needs the same treatment. The common mistake is using the heaviest method on everything.

Most things you hear do not need the third level. Flashcards are the right tool for material you'll be tested on — vocabulary, a certification, a medical exam. For most non-fiction, a history, or a novel you loved, the goal isn't to recite it. It's to not lose the parts that changed how you think.

Using EarMemo for this workflow

EarMemo is one way to do this on iPhone and iPad if your audiobooks or lectures are local files — DRM-free m4b or mp3 you already own. It's built around these four steps:

1. Mark. Tap Bookmark Here in the player, or say “Bookmark here in EarMemo” to Siri. Playback doesn't stop. The mark lands two seconds before your tap, because you always react a beat after the sentence starts.
2. Keep listening. A haptic tick confirms the mark and the book carries on.
3. Add your words. Open the notes whenever you like and write on any mark; it auto-saves. If you tapped late, nudge the timestamp by ±2 seconds to re-anchor it.
4. Revisit. Tap a note and EarMemo plays the original passage. Close the notes page and you're back where you were in whatever you're listening to now. Export the notes worth keeping as plain Markdown.

Marks are unlimited for everyone. The free version lets you write on five of them; a one-time EarMemo Pro purchase removes that limit and adds Markdown export.

The export is a set of .md files with the timestamps written in — how to drop them into an Obsidian vault is covered on timestamped audio notes exported as Markdown. If the book isn't on your phone yet, start with playing M4B and MP3 audiobooks on iPhone.

EarMemo deliberately stops before this becomes a study system. There are no flashcards, no review schedule, no streaks and no AI summary. It keeps the moments; what you do with them is up to you.

Questions people actually ask

How do I remember what I hear in audiobooks?

Don't try to remember the whole book. Mark the moments that make you stop, keep listening, then give each mark one sentence in your own words and revisit only those when you finish. The timestamp on each mark lets you hear the original passage again whenever the sentence isn't enough.

Should I take notes while listening to an audiobook?

Mark while listening; write afterwards. Pausing to write full notes breaks the listening, and most people give up on it after a few tries. A one-tap timestamp costs a second, and you add the words at the end of a chapter or the end of the day, when you can think about why it mattered.

How do I save a specific moment in an audiobook?

Bookmark the exact playback position in your player rather than writing the time down by hand. In EarMemo that is one tap on Bookmark Here, or asking Siri, and playback keeps going; the mark is set two seconds before the tap so it catches the start of the sentence. For Audible titles, use Audible's own bookmarks.

Should I transcribe audiobook passages or write notes in my own words?

Write in your own words. A transcript records what the author said; a one-sentence note records why it mattered to you, which is the part you are trying to keep. If you need the exact wording later — to quote it — the timestamp takes you back to the original audio.

How do I get audiobook notes into Obsidian?

Export them as Markdown files and save them into your vault folder. EarMemo exports notes as plain .md files with the timestamps written in — one note, one book, or a whole album merged — and the iOS share sheet saves them straight into iCloud Drive › Obsidian or On My iPhone › Obsidian. There is no sync; it is a file. Step by step, with a sample export →

Do I need flashcards to remember audiobooks?

Usually not. Flashcards and spaced repetition are for material you must recall on demand, like exam content or vocabulary. For most books the goal is to keep the ideas that mattered and be able to find them again, which a timestamp and one sentence do with far less effort.