Our Written Testing Protocol
Consistent inputs. Clear criteria.
Voice comparison: Head-to-head voice-generation tests will use the same fixed script, written to challenge number reading, proper-name pronunciation, emotional shifts and punctuation. Each baseline run will use default settings, without manual tuning.
Editing and cost tasks: Editing workflows and episode-cost comparisons will use matched, real-world podcast or video tasks appropriate to the question being investigated. We will not treat a voice-generation script as a universal test for unrelated editing work.
Evaluation rubric: Our assessment dimensions are voice naturalness; pauses and rhythm; number reading; name pronunciation; emotional delivery; export and download ability; cost per finished episode; and effort and time required. The same published rubric will guide each evaluation, with its dimensions applied where relevant to the task.
Where we are: Desk research was completed in October 2026. Preparation for the initial hands-on round is in progress. No hands-on runs, audio samples, scores or findings are available yet. The first results will be published here after the relevant tests have been completed.