The invention discloses a binaural playback method, system and device of a digital sound-generating chip, which relates to the technical field of recording and playback. It is used to solve the problem of poor recording playback effect and poor recording playback effect in the existing technology. Problems that affect the judgment of sound location. It includes: the array microphone picks up the cross-sectional sound pressure distribution in the ear canal, completes binaural recording, and obtains sound pressure information; converts the sound pressure information into electrical signals, and transmits the electrical signals to the digital sound chip; and then calculates the corresponding sound pixels based on the electrical signals. The frequency, amplitude or quantity of the unit generates a driving signal to drive multiple corresponding sound-emitting pixel units to form an array and emit sound at the same time, realizing binaural recording playback and reproducing the sound pressure mode of the ear canal cross-section during recording. The present invention uses an array microphone and a digital sound chip respectively, which can retain the implicit clues, make the playback effect closer to the real effect of the recording, and improve the accuracy of the recording playback effect and sound direction judgment.
1. A binaural playback method of a digital sound chip, characterized in that the method includes:
The array microphone picks up the cross-sectional sound pressure distribution in the ear canal, completes binaural recording, and obtains sound pressure information;
Convert the sound pressure information into an electrical signal, and transmit the electrical signal to a digital sound chip; the digital sound chip at least includes a sound pixel unit;
The digital sounding chip calculates the characteristic information of the corresponding sounding pixel unit according to the electrical signal; the characteristic information at least includes the frequency, amplitude or number of the sounding pixel unit;
Generate a driving signal according to the characteristic information of the sound-emitting pixel unit;
Based on the driving signal, multiple corresponding sound-emitting pixel units are driven to form an array and sound simultaneously, thereby realizing binaural recording playback and reproducing the sound pressure mode of the ear canal cross-section during recording.
2. The binaural playback method of a digital sound chip according to claim 1, characterized in that generating a driving signal according to the characteristic information of the sound pixel unit specifically includes:
When all the sound-emitting pixel units are working, change the frequency and voltage of the driving electrical signal;
Based on the changed electrical signal frequency and voltage, the diaphragms of different sound-emitting pixel units vibrate at different frequencies and amplitudes, radiating different sound pressures.
3. The binaural playback method of a digital sound chip according to claim 1, characterized in that generating a driving signal according to the characteristic information of the sound pixel unit specifically includes:
Divide the sound pressure signal corresponding to the sound pressure information into several intervals according to the sound pressure level;
Divide the sound pressure signal within the same sound pressure range of the ear canal cross-section into a region;
During playback, the average sound pressure corresponding to the sound pressure signal in the area is used as the unified sound pressure in the area; the ear canal cross section is divided into several areas for playback of different sound pressures; the area with high sound pressure works as a pixel unit The density is high; the density of working pixel units is low in areas with low sound pressure.
4. The binaural playback method of the digital sound chip according to claim 1, characterized in that, before converting the sound pressure information into an electrical signal and transmitting the electrical signal to the digital sound chip, it also includes:
Process the one-dimensional audio signal through an algorithm to obtain a three-dimensional audio signal;
Convert three-dimensional audio signals into two-dimensional electrical signals.
5. The binaural playback method of a digital sound chip according to claim 4, characterized in that converting the sound pressure information into an electrical signal and transmitting the electrical signal to the digital sound chip specifically includes:
The sound pressure information is transmitted to the digital sound chip through a two-dimensional electrical signal; the two-dimensional electrical signal includes two-dimensional position information and sound pressure information of multiple microphones;
The same frame signals from different microphones are arranged serially in order, and the signals from all microphones are combined into two-dimensional electrical signals at the corresponding time and transmitted to the digital sound chip.
6. The binaural playback method of a digital sound chip according to claim 1, characterized in that the digital sound chip calculates the characteristic information of the corresponding sound pixel unit according to the electrical signal, specifically including:
The digital sound-generating chip reproduces the non-uniform sound pressure mode based on the received electrical signal;
The diaphragm of the sound-generating pixel unit is driven by the electric signal to vibrate repeatedly and radiate sound waves outward;
Based on the magnitude of the radiated sound pressure of the sound wave, the amplitude of the diaphragm and the number of working sound-emitting pixel units are determined.
7. The binaural playback method of the digital sound chip according to claim 1, characterized in that the array microphone picks up the cross-sectional sound pressure distribution in the ear canal, completes binaural recording, and obtains the sound pressure information, which specifically includes:
The array microphone is composed of multiple silicon microphones forming an array;
Or the array microphone is composed of multiple microphone units forming an array; the structure of the multiple microphone units is consistent with the sound-emitting pixel unit, a certain offset voltage is applied, and the sound pressure is measured through capacitance changes caused by the movement of the diaphragm.
8. A binaural playback system of a digital sound chip, characterized in that the system at least includes:
Digital sound chip and array microphone;
The digital sound chip at least includes a sound pixel unit; the array microphone is used to pick up the cross-sectional sound pressure distribution in the ear canal, complete binaural recording, and obtain sound pressure information;
The digital sound chip is used to receive the electrical signal corresponding to the sound pressure information, and calculate the characteristic information of the corresponding sound pixel unit according to the electrical signal; the characteristic information at least includes the frequency, amplitude or number of the sound pixel unit; and generate Driving signal; based on the driving signal, multiple corresponding sound-emitting pixel units are driven to form an array and sound simultaneously, thereby realizing binaural recording playback and reproducing the sound pressure mode of the ear canal cross-section during recording.
9. The binaural playback system of a digital sound chip according to claim 8, wherein the array microphone is formed of an array of multiple silicon microphones;
Or the array microphone is composed of multiple microphone units to form an array; the diaphragm of the sound-emitting pixel unit is driven by an electric signal to vibrate repeatedly and radiates outward; the size of the radiation sound pressure is related to the vibration frequency and vibration speed of the diaphragm. Related to the diaphragm area;
When all the sound-emitting pixel units are working, by changing the frequency and voltage of the driving electrical signal, the diaphragms of different pixel units vibrate at different frequencies and amplitudes, radiating different sound pressures;
Or the sound pressure information is divided into several intervals according to the sound pressure level, the sound pressure information in the same sound pressure interval of the ear canal cross section is divided into one area, and the average value of the sound pressure information in this interval is used as the area during playback. Uniform sound pressure in the area.
10. A binaural playback device of a digital sound chip, characterized in that the device includes:
The sound pressure information determination module is used for the array microphone to pick up the cross-sectional sound pressure distribution in the ear canal, complete binaural recording, and obtain the sound pressure information;
An electrical signal conversion module, used to convert the sound pressure information into an electrical signal, and transmit the electrical signal to a digital sound chip; the digital sound chip at least includes a sound pixel unit;
A sound-emitting pixel unit characteristic information calculation module is used for the digital sound-emitting chip to calculate the characteristic information of the corresponding sound-emitting pixel unit according to the electrical signal; the characteristic information at least includes the frequency, amplitude or number of the sound-emitting pixel unit;
A driving signal generation module, configured to generate a driving signal according to the characteristic information of the sound-emitting pixel unit;
The binaural recording and playback module is used to drive multiple corresponding sound-emitting pixel units based on the driving signal to form an array and emit sounds simultaneously, thereby realizing binaural recording and playback, and reproducing the sound pressure mode of the ear canal cross-section during recording.
Technical field
The present invention relates to the technical field of recording and playback, and in particular to a binaural playback method, system and device of a digital sound chip.
Background technique
Since the binaural sound pressure contains the main spatial information of the sound, it can be picked up using a pair of miniature microphones placed at the ears of an artificial head (or a real subject). The resulting binaural sound signal is only amplified, transmitted, recorded, and then replayed using a pair of headphones, thereby generating main spatial information consistent with the original sound field at the listener's ears, realizing the replay of sound spatial information. This is how binaural recording and playback systems work. The spatial hearing effect produced by the virtual auditory playback system based on binaural signals is more realistic and natural. However, when using headphones to play back binaural signals, due to the difference between the headphone playback method and the original sound field, the cognitive information used to judge the front and rear directions will be lost, and a certain problem of front and rear sound image confusion will occur. The image is judged to be from the rear mirror direction, or the sound image from the rear is judged to be from the front mirror direction. Moreover, the probability of misinterpreting the sound image from the front as the rear is much greater than the probability of misinterpreting the sound image from the rear as the front.
In personalized binaural recording, clues such as binaural time difference, binaural intensity difference, and pinna spectrum effect can all be truly recorded, but the real listening effect is still better than binaural recording, indicating that there are still some unconfirmed hidden Listening localization cues are weakened or lost during recording playback. As a result, the playback effect of binaural recordings is greatly different from the real recording, and the playback effect of the recording is poor, which affects the judgment of sound direction.
Therefore, there is an urgent need to provide a more reliable binaural recording and playback solution.
Contents of the invention
The object of the present invention is to provide a binaural playback method, system and device of a digital sound chip, which is used to solve the problem in the existing technology that the binaural playback effect is greatly different from the real recording, the recording playback effect is poor, and the sound direction is affected. A matter of judgment.
In order to achieve the above objects, the present invention provides the following technical solutions:
In a first aspect, the present invention provides a binaural playback method of a digital sound-generating chip. The method includes:
The array microphone picks up the cross-sectional sound pressure distribution in the ear canal, completes binaural recording, and obtains sound pressure information;
Convert the sound pressure information into an electrical signal, and transmit the electrical signal to a digital sound chip; the digital sound chip at least includes a sound pixel unit;
The digital sounding chip calculates the characteristic information of the corresponding sounding pixel unit according to the electrical signal; the characteristic information at least includes the frequency, amplitude or number of the sounding pixel unit;
Generate a driving signal according to the characteristic information of the sound-emitting pixel unit;
Based on the driving signal, multiple corresponding sound-emitting pixel units are driven to form an array and sound simultaneously, thereby realizing binaural recording playback and reproducing the sound pressure mode of the ear canal cross-section during recording.
Compared with the existing technology, the binaural recording and playback method provided by the present invention uses an array microphone to pick up the cross-sectional sound pressure distribution in the ear canal, completes the binaural recording, and obtains the sound pressure information; converts the sound pressure information into an electrical signal, and The electrical signal is transmitted to the digital sound chip; then the frequency, amplitude or number of the corresponding sound pixel unit is calculated according to the electrical signal to generate a driving signal to drive multiple corresponding sound pixel units to form an array and sound simultaneously, achieving binaural recording playback and reproduction of the recording. is the sound pressure mode of the ear canal cross-section. The present invention uses an array microphone and a digital sound chip respectively in the binaural recording and playback process, which can retain the implicit clues, make the playback effect closer to the real effect of the recording, and improve the recording playback effect and the accuracy of sound direction judgment. .
In a second aspect, the present invention provides a binaural playback system of a digital sound chip. The system at least includes:
Digital sound chip and array microphone;
The digital sound chip at least includes a sound pixel unit; the array microphone is used to pick up the cross-sectional sound pressure distribution in the ear canal, complete binaural recording, and obtain sound pressure information;
The digital sound chip is used to receive the electrical signal corresponding to the sound pressure information, and calculate the characteristic information of the corresponding sound pixel unit according to the electrical signal; the characteristic information at least includes the frequency, amplitude or number of the sound pixel unit; and generate Driving signal; based on the driving signal, multiple corresponding sound-emitting pixel units are driven to form an array and sound simultaneously, thereby realizing binaural recording playback and reproducing the sound pressure mode of the ear canal cross-section during recording.
In a third aspect, the present invention provides a binaural playback device of a digital sound chip. The device includes:
The sound pressure information determination module is used for the array microphone to pick up the cross-sectional sound pressure distribution in the ear canal, complete binaural recording, and obtain the sound pressure information;
An electrical signal conversion module, used to convert the sound pressure information into an electrical signal, and transmit the electrical signal to a digital sound chip; the digital sound chip at least includes a sound pixel unit;
A sound-emitting pixel unit characteristic information calculation module is used for the digital sound-emitting chip to calculate the characteristic information of the corresponding sound-emitting pixel unit according to the electrical signal; the characteristic information at least includes the frequency, amplitude or number of the sound-emitting pixel unit;
A driving signal generation module, configured to generate a driving signal according to the characteristic information of the sound-emitting pixel unit;
The binaural recording and playback module is used to drive multiple corresponding sound-emitting pixel units based on the driving signal to form an array and emit sounds simultaneously, thereby realizing binaural recording and playback, and reproducing the sound pressure mode of the ear canal cross-section during recording.
The technical effects achieved by the system solution provided by the second aspect and the device solution provided by the third aspect are the same as those of the method solution provided by the first aspect, and will not be described again here.
(20min delay)
