Automation has been "taking our job" now for over 400 years, the cool thing about programmers is they produce automations and thanks to the Jevons Paradox, we are guaranteed to have inifite work as long as we are willing to adapt to the new tools.
Delta-sigma modulation generates an inefficient encoding of the audio signal, with much more bits than necessary.
Converting a delta-sigma encoded bit stream to a PCM (pulse-code modulation) stream (e.g. with 24-bit or 16-bit samples at a sampling frequency of 48 kHz or 44.1 kHz) is a method of data compression.
On the other hand, delta-sigma modulation is more efficient for both analog-to-digital and digital-to-analog conversions, in the sense that for a given quality of the conversion it is much easier and much cheaper to make ADCs and DACs with delta-sigma modulation than with pulse-code modulation.
Because of this, for audio signals, normally delta-sigma ADCs and DACs are used at the analog inputs and outputs, but the delta-sigma bit stream is converted by digital filtering to PCM for data storage or for audio processing.
Delta-sigma is not a compression technique. A good delta-sigma encoder will use roughly the same number of bits as a PCM encoder. Delta-sigma uses more samples per second but fewer bits per sample to capture the same information. The reason delta-sigma is desirable is noise shaping, not compression.
An ADC that merely samples much faster than Nyquist but with the same number of bits per sample as PCM is not a delta-sigma converter; it's an oversampler. Delta-sigma converters always sample faster and use fewer bits per sample (usually just one bit per sample).
No. For equivalent quality, even a high-order delta-sigma encoder will need more bits than PCM.
The ratio between the sampling frequencies is greater than the ratio between the number of bits per sample. How much greater it is depends on the order of the sigma-delta modulator and higher-order modulators need much less extra bits, but they have other problems, which prevent the increase of the order too much.
Unlike PCM, delta-sigma modulation does not provide any guarantee about the maximum error at a given point in time, i.e. about the maximum instantaneous difference between the original signal and the encoded signal. Delta-sigma modulation only guarantees that certain statistical properties of the original signal and of the encoded signal are the same. For example in the case of the first-order delta-sigma modulator it is guaranteed only that the difference between the integrals over an interval of time of the original and of the encoded signals is smaller than a superior limit that depends on the length of the time interval.
This is why even for high-order delta-sigma modulators the ratio between their sampling frequencies and the sampling frequency of an equivalent PCM signal must remain great, because the sampling period of the PCM signal must be long enough so that the statistics of the delta-sigma signal accumulated during it make sense.
I do not like the term "noise shaping" and it is somewhat misleading, because it is not an intrinsic property of the delta-sigma modulator, but in order for the noise to be "shaped", it must actually exist. That means that when the input signal does not include any noise, the output of the delta-sigma modulator will oscillate periodically and deterministically around a value and there will be no "noise shaping". However, real electronic circuits always have noise, and when that noise is insufficient, in delta-sigma ADCs additional noise is injected at input, to prevent the periodic oscillations at output.
A simple oversampler can be regarded in some sense as a zeroth order delta-sigma modulator, because some of the formulae for delta-sigma modulators apply to it when the order is set to 0.
Just oversampling cannot produce any improvement in the resolution of a PCM signal obtained by filtering the oversampled signal. But if white noise with an amplitude equal to the quantization interval is added at the input of the oversampler, then by averaging the output, i.e. by low-pass filtering it, additional bits per sample can be obtained depending on how long is the averaging interval. This is the well known statistics property that the average of N random samples will have a lower variance than the original samples, which decreases for increasing N.
The same happens with delta-sigma modulators, the difference is only that the number of additional bits of resolution per PCM sample grows much faster with the length of the averaging interval than in the case of the simple oversampler, the higher the order of the delta-sigma modulator, the more additional bits at a given averaging interval.
Nonetheless, while the simple formula that expresses the achievable signal-to-noise ratio, i.e. the number of bits per PCM sample, as a function of the averaging interval, looks like one could get infinite resolution by just increasing the order of the delta-sigma modulator, that does not work in reality, where the order is limited to rather low values and the formula for the additional bits of resolution is not valid for very short averaging times, when the higher-order statistics are meaningless.
but even if they do know something we don't why say this publicly? Yes, I get you are trying to boost your evaluation in the ongoing "war" against Anthropic and now XAI but I'm not sure how ready society is for AGI
This reminds me of that time Anthropic publicly admitted that Claude was generating "anxiety" patterns within its neural networks and the worst part is that, instead of acting ethically, they chose to directly manipulate "those vectors" to see what would happen and specially what is happening inside those companies could trigger a legal dilemma in the future we (society) are not prepared to deal with that
I would argue that the fact that there is a lot of bad python code out there is actually a good thing for training data, gives the chance of learning what works and what doesn't.Also there are bad programmers that have found original solutions to very niche problems, would be nice to know about those even if it means rewriting the whole thing.
reply