​

Intro

When the evaluation you requested is completed, a link to the corresponding report will be sent to the email you signed up with.

The report will include a summary of the evaluation, the evaluation results, evaluator information, and the statistics of each stimulus:

• Evaluation Summary: evaluation start time and end time, evaluation type, and reliability
• Overall: The final evaluation results obtained according to the evaluation criteria and requests
• Evaluation Information: Detailed data and analysis gathered during the evaluation process, including methodologies used, criteria assessed, and specific observations
• Evaluator information: Background details about evaluators, including their language, country of residence, and any relevant qualifications
• Stimuli: playable links to each audio files and their statistics including the mean, median, standard deviation, (90%, 95%, 99%) of confidence intervals

​

Report details

​

Evaluation Summary

• Eval start: 20240302T02:37Z
• Eval end: 20240302T06:13Z
• Eval type: 9-point naturalness MOS
• Reliability coefficient: 0.737

​

Overall

​

Evaluator information

• Number of evaluators: 35
• Attention test: 3 evaluators eliminated
• Intelligence test: pass
• First language: English (100%)
• Gender Ratio: 18:17 (Female:Male)
• Country of Residence: United States, United kingdom, and Australia.

​

Stimuli details

• The number of audio files: 32
• Stimuli verification: decodable, playable
• Stimuli type: speech