Thanks for reading the first page of the most difficult to understand of the papers.

It is really hard to be read and I get already a negative feedback for it.

I. “…flame war on Steve’s blog…”

The war is a usual activity for the human beings. Or not? So – no problem? :-)

II.”… infinite number of samples, not two…”

An infinite number of samples to reconstruct the simplest signals as DC, SS, CS, SS+DC, CS+DC, etc. seems really strange for me.

But may be it is a different perception for the goal of the theoretical concepts.

I my opinion if the theory cannot be validated – it is not a theory.

It is an idea or a supposition or something like that, but not a science and not a theory.

So if “infinite number of samples” is the goal of the “sampling theorem” and if could validate that concept in practice – you are right. :)

III. If you try “Nyquist frequency” with Google and take into consideration the only the first several definition may be you will find the following.

You will agree that these are not the same definitions for the same term.

If you continue the search you will find more interpretations.

And the reason is that Nyquist did not give definition of any particular frequency related to signal sampling, conversion and reconstruction.

“….The Nyquist frequency, named after the Swedish-American engineer Harry Nyquist or the Nyquist–Shannon sampling theorem, is half the sampling frequency of a discrete signal processing system.[1] [2] It is sometimes known as the folding frequency of a sampling system.[3]…”

http://en.wikipedia.org/wiki/Nyquist_frequency

“…..In order to recover all Fourier components of a periodic waveform, it is necessary to use a sampling rate nu at least twice the highest waveform frequency. The Nyquist frequency, also called the Nyquist limit, is the highest frequency that can be coded at a given sampling rate in order to be able to fully reconstruct the signal, i.e.,

f_(Nyquist)=1/2nu. ………”

http://mathworld.wolfram.com/NyquistFrequency.html

“…..The Nyquist frequency is the bandwidth of a sampled signal, and is equal to half the sampling frequency of that signal. If the sampled signal should represent a continuous spectral range starting at 0 Hz (which is the most common case for speech recordings), the Nyquist frequency is the highest frequency that the sampled signal can unambiguously represent………..”

http://www.fon.hum.uva.nl/praat/manual/Nyquist_frequency.html

“……Nyquist frequency – (telecommunication) twice the maximum frequency occurring in the transmitted signal……….”

http://www.thefreedictionary.com/Nyquist+frequency

“Nyquist frequency

The shortest detectable frequency in a time series. All time series are, in practice, recorded at discrete time points (for example, one reading per second). Periodic variations that happen more rapidly than the shortest time interval cannot be detected. With time intervals of size t the Nyquist frequency is t−1 cycles per unit time………”

http://www.answers.com/topic/nyquist-frequency-in-math

etc ……..

IV . “….It’s a mathematical concept, central to sampling theory….”

There is no need of that concept in the sampling theory.

The sampling, conversion and reconstruction system is build from ADC, Memory and DAC . To explain it there is no need of Dirac, Dirichet, etc.

The analog signal is converted into “staircase function” not in “comb” and there is no need of any “delta functions” or similar.

V. “Aliasing”, “decimation” – In my opinion there must be more clear and easy to remember terms for both events.

VI. “…. there really is no point in trying to ridicule it. …”

I am unhappy to find so many inaccuracy and misleading concepts in so modern technical field.

I do not see any relation between that terminology and the reality.

Also I do not see any practical relation between Nyquist, Shannon and even Kotelnikov and the systems with ADCD, DAC, Memory, SH etc.

I hope that you will find the answer clear, serious and good enough to be accepted.

Thank you for your time and effords.

I look forward to hear more critics from you and/or from anybody interested in the subject.

Best regards

Petre Petrov

I started reading your paper [3], and do not agree with any of your points on the first page. I stopped reading after that. I’m not trying to start a flame war on Steve’s blog, but I just have to call out nonsense when I see it.

-> “Classical sampling theorem is an oversimplified sampling theorem generally stating that two samples are enough to reconstruct “exactly” band limited signals…” — sampling theory says you need an infinite number of samples, not two.

-> “Nyquist frequency […] means several different things.” — It doesn’t. Just because some people misinterpret a phrase doesn’t make it useless.

“the misleading interpretation is one of the proof that the classical SST is not accurate.” — Some people don’t understand the theory, the theory must be wrong!

-> “Delta function – unreal function used to

construct the Dirac comb. No practical value in the

sampling theory […]” — It’s a mathematical concept, central to sampling theory.

-> “Aliasing – a misleading term”, and “The word “alias” has a criminal meaning” — I think you misunderstand the word. It makes perfect sense to use this word for this purpose. If you want to complain about English words used “wrong”, complain about the use of “save” to mean “write a file to disk”. :)

-> “Decimation – incorrect term (nothing to do with the

number 10) […] giving […] cruel historical background of the term)” — You are trying too hard to find things to complain about.

When a theory is as useful as sampling theory, there really is no point in trying to ridicule it. You should put your efforts into improving it, and extending it, rather than trying to prove it wrong.

PS: sampling theory refers to the highest frequency in the signal, not the bandwidth. When Shannon speaks of bandwidth, he refers to the amount of information communicated over a channel. But that’s a whole different story.

]]>Thanks for posting of my not very well written message and more thanks for your reply.

I like your teaching. Also I think that what you are doing is very useful.

Often the informal teaching is better than the formal.

You are right. There are some pints of confusions in that field.

In order to understand at least partially my position in sampling theorem/theory, please see the papers below.

I apologize for not very clear language and some omissions. May be the papers will be of some use for your and your auditory.

I look forward for more materials from you.

Thanks again

Best regards

Petre Petrov

*** Some papers***

[1] A New Approach to Sampling Sinusoidal and Cosinusoidal – ET 4 CO 198.pmd

http://www.ieindia.org/pdf/88/88ET104.pdf

[2] Sampling of the Simplest Signals – 9 CP PE 8.pmd

http://www.ieindia.org/pdf/89/89CP109.pdf

[3]. “Reevaluation and replacement of basic terms in the sampling theory”,

http://www.pueron.org/pueron/nauchnakritika/Th_Re.pdf

[4]. New Approach to Comparison of Classical Papers of H. Hyquist, V. Kotelnikov and C. Shannon and Theirs Impact on the Terminology.

http://www.radiotec.ru/catalog.php?cat=jr4&art=7235

[5] A note about the definitions of “sine/cosine wave”, “sinusoidal/co-sinusoidal signal” and the “simplest band limited signals”.

There are three test signals with “zero band width” by definition:

* the constant signal,

* the sinusoidal signal and

* the co-sinusoidal signals.

The equations are given below:

Aconst = constant;

A = Amsin(ωt + φ) + 0;

A = Amcos(ωt + φ) + 0;

According to the “classical sampling theorems” these signals should be reconstructed with “zero samples” because they have “zero bandwidth”. It is obvious that when the model applied in the real signals sampling and reconstruction systems the so called “take and memorize the sample until the next samples is taken” is applied:

* in the first case only one sample is needed to reconstruct the signal

* in the second and third cases four samples are needed because there are four parameters to reconstruct and also four samples are guarantying 3dB bandwidth of the sampling and direct reconstruction system.

Obviously refereeing only to the “band width” is wrong. The model should be taken into consideration. Also Nyquist never formulated any “sampling theorem”, etc.……..

]]>In essence, the theorem shows that a bandlimited analog signal that has been sampled can be perfectly reconstructed from an infinite sequence of samples if the sampling rate exceeds 2B samples per second, where B is the highest frequency in the original signal. If a signal contains a component at exactly B hertz, then samples spaced at exactly 1/(2B) seconds do not completely determine the signal, Shannon’s statement notwithstanding. This sufficient condition can be weakened, as discussed at Sampling of non-baseband signals below.

More recent statements of the theorem are sometimes careful to exclude the equality condition; that is, the condition is if x(t) contains no frequencies higher than or equal to B; this condition is equivalent to Shannon’s except when the function includes a steady sinusoidal component at exactly frequency B.

The “triangle figures” you mention satisfy the formulation above, because the triangle shape is zero at the Nyquist frequency.

In *Discrete-Time Signal Processing* (Prentice-Hall 1989 edition, p. 86), Oppenheim and Schafer are careful about this point, but they put the strict inequality in a different place than suggested in the Wikipedia article.

Their formulation allows the signal to contain nonzero energy all the way up to and including the Nyquist frequency, but then they require the sampling frequency to be strictly greater than twice the Nyquist frequency. Either formulation works.

]]>