A DESCRIPTIVE EVALUATION METHODOLOGY FOR CONSUMER AUDIO EQUIPMENT
http://onlinelibrary.wiley.com/doi/1...306.x/abstract
可列印查看
A DESCRIPTIVE EVALUATION METHODOLOGY FOR CONSUMER AUDIO EQUIPMENT
http://onlinelibrary.wiley.com/doi/1...306.x/abstract
Introduction
In March of this year, I conducted a scientific investigation to assess the validity of the ABX test for audio evaluation. During the course of that investigation, I was able to obtain a better understanding of a proper methodology for audio equipment evaluation. I was encouraged to submit my findings to a scientific journal for review and publication. There were several publication options available. I chose to submit my results to the Journal of Sensory Studies (JOSS), which is the premier peer-reviewed international sensory science journal. The Journal of Sensory Studies is also the official peer-reviewed journal of the Society of Sensory Professionals. An overview of JOSS can be read here: JOSS Overview.
Journal Paper Publication Acceptance
I have received notice that my 16-page manuscript, entitled "A Descriptive Evaluation Methodology For Consumer Audio Equipment", has been accepted for publication after rigorous peer review. The abstract, evaluation methodology summary and conclusion sections are as follows (all quoted text (in blue) and figures are © 2010 Wiley Periodicals, Inc.):
Abstract
"A pilot study was conducted in order to investigate the application of descriptive analysis techniques to the evaluation of consumer audio equipment. A global seven-step methodology for the descriptive evaluation of the sound characteristics of consumer audio equipment was developed. In contrast to the commonly used forced choice discrimination methods for audio equipment evaluation, the proposed methodology enhances, rather than compromises, a subject’s sensory input. A case study employing a minimally trained subject demonstrated the applicability of sensory evaluation techniques to sound. There has been some resistance in the audio community to the adoption of sensory science evaluation methods because such methods are erroneously thought to apply only to products that affect the senses of touch, taste, smell and sight.
Evaluation Methodology Summary
"The basic framework for the seven-step descriptive evaluation method for audio equipment comprises:
1. Evaluator sense organ assessment.
2. Evaluator training.
3. Evaluator experience.
4. Proper equipment setup, speaker placement and selection of
the optimum evaluator listening location (stereo sweet spot).
5. A quiet, comfortable and “acoustically friendly” listening
room, preferably with the capability of dimming the lights.
6. Careful listening, in the stereo sweet spot with familiar,
well-recorded music.
7. “Sound stage mapping” where the location of sounds (images)
within the sound stage and the attributes of those sounds are
carefully documented."
Conclusion
"This pilot study demonstrated that the descriptive analysis method for audio equipment evaluation is a sensitive, accurate, elegant, portable and easy to learn protocol. In stark contrast to the widely used forced choice discrimination evaluation methods, the protocol proposed in this paper is administered under realistic, non-stressful conditions and it maximizes and optimizes the amount of aural and tactile information received by the subject. The case study results emphasize the need for further study in audio evaluation with a fully trained descriptive analysis panel. Formal descriptive analysis would require evaluative panel members with training in descriptive techniques, adequate hearing ability, adequate full body tactile response, an extensive memory in real musical and vocal sounds, competence in setting up a moderate to high resolution audio system in an acoustically appropriate room and competence in documenting what is heard and felt."
Sample Figures
http://i148.photobucket.com/albums/s...sAudConfig.jpg
Figure 1. Audio test arrangement for descriptive method for stereophonic audio evaluation. © 2010 Wiley Periodicals, Inc.
http://i148.photobucket.com/albums/s...SndStgBlue.jpg
Figure 3. Aerial and lateral sound stage charts for musical selection "Blue". © 2010 Wiley Periodicals, Inc.
http://i148.photobucket.com/albums/s...triotest-s.jpg
Figure 4. Typical Duo-trio balanced reference (ABX) audio test arrangement. © 2010 Wiley Periodicals, Inc.
Motivation And Major Points
What I hope to achieve by publishing this paper is more consideration from the audiophile and audio community toward the adoption of scientifically validated and appropriate audio evaluation principles. The sensory science community is eager to see more research in the application of sensory science principles to sound.
Another important consideration is the deluge of misinformation, much coming from seemingly "authoritative" and "legitimate" sources via the Internet, that new entrants into our hobby and new entrants into professional audio practice are exposed to and influenced by.
The main points of the paper are:
1. Sensory science descriptive analysis (DA) techniques are applicable to and appropriate for the evaluation of audio equipment.
2. One does not need superhuman hearing to participate in accurate descriptive analysis of audio evaluation. A minimally trained subject quickly learned to discern subtle performance differences in audio equipment.
3. Forced choice discrimination methods, such as ABX, are not appropriate for the evaluation of audio equipment.
Publication Schedule
My copyright agreement with the journal prohibits me from posting a copy of the paper on the Internet. The paper will be available, in print and electronic formats, from the journal's website.
The Journal of Sensory Studies is published six times a year (Feb., Apr., Jun., Aug., Oct., and Dec.). "A Descriptive Evaluation Methodology For Consumer Audio Equipment" is scheduled to be published in the Journal's hard copy edition in December of 2010. This could possibly be moved up or back one issue (to either October 2010 or February 2011). Well in advance of the hard copy publication, the paper will be published on the Journal's website.
Further Study
I submitted a short paper on an audio-related topic to an international journal of the Institute of Electrical and Electronics Engineers (IEEE) in April of this year. After rigorous peer review, the journal editor informed me that they were interested in the topic, but they considered the paper to be "incomplete". The editor provided very specific instructions for revising the paper. Basically, I was advised that I needed to provide more theoretical and quantitative discussion pertaining to the results. I will provide a full discussion of this paper at a later date.
A common criticism, by the unknowledgeable, of high performance audio products is the absence of the science behind such products appearing in peer-reviewed scientific journals. The absence of such published information is more reflective of the realities and constraints of manufacturing in a competitive marketplace rather than high performance audio products being based on snake oil, voodoo and wishful thinking. Scientists who work for audio product companies typically do not have time to go 'round and 'round with the months-long peer review process. The "validation" of their work comes from the hearing of, and purchase by, the consumer rather than from acceptance by a scientific journal. Another consideration is the fact that the science behind many commercial audio products is proprietary information. Publishing such information in a journal, (or divulging such information in a patent application) might put a company at a severe competitive disadvantage.
I have submitted two audio related papers to scientific journals. The first paper, regarding audio equipment evaluation techniques, has been approved for publication in the leading international sensory science journal. The second paper has completed the first round of review by a leading international IEEE journal and is a work in progress.
From my limited experience, I can certainly extrapolate that scientific journals could be filled to the brim with audio related papers...if audio company scientists and engineers wanted to do that.
https://www.polkaudio.com/forums/sho...d.php?t=103417
不一樣喔,海棉套有聲學效果的啦
保險套通常會消音..........