Least Squares in Gaussian Noise – Maximum Likelihood

From the previous posts on Linear Regression (using Batch Gradient descent, Stochastic Gradient Descent, Closed form solution), we discussed couple of different ways to estimate the  parameter vector in the least square error sense for the given training set. However, how does the least square error criterion work when the training set is corrupted by [...]

0 comments Read the full article →

Symbol Error rate for QAM (16, 64, 256,.., M-QAM)

In May 2008, we derived the theoretical symbol error rate for a general M-QAM modulation (in  Embedded.com, DSPDesignLine.com and dsplog.com) under Additive White Gaussian Noise. While re-reading that post, felt that the article is nice and warrants a re-run, using OFDM as the underlying physical layer. This post discuss the derivation of symbol error rate for a general [...]

0 comments Read the full article →

Newton’s method to find square root, inverse

Some of us would have used Newton’s method (also known as Newton-Raphson method) in some form or other. The method has quite a bit of history,  starting with the Babylonian way of finding the square root and later over centuries reaching the present recursive way of finding the solution. In this post, we will describe [...]

0 comments Read the full article →

Closed form solution for linear regression

In the previous post on Batch Gradient Descent and Stochastic Gradient Descent, we looked at two iterative methods for finding the parameter vector  which minimizes the square of the error between the predicted value  and the actual output  for all  values in the training set. A closed form solution for finding the parameter vector  is possible, and in this post [...]

8 comments Read the full article →

Stochastic Gradient Descent

For curve fitting using linear regression, there exists a minor variant of Batch Gradient Descent algorithm, called Stochastic Gradient Descent. In the Batch Gradient Descent, the parameter vector  is updated as, . (loop over all elements of training set in one iteration) For Stochastic Gradient Descent, the vector gets updated as, at each iteration the [...]

2 comments Read the full article →

Batch Gradient Descent

I happened to stumble on Prof. Andrew Ng’s Machine Learning classes which are available online as part of Stanford Center for Professional Development. The first lecture in the series discuss the topic of fitting parameters for a given data set using linear regression.  For understanding this concept, I chose to take data from the top [...]

7 comments Read the full article →

Back!

Am getting ready to be back posting frequently. Please see below the top 50 articles of this blog based on the pageviews in the month of September 2011 (used Google Analytics to pick up this data).

9 comments Read the full article →

Non coherent demodulation of pi/8 D8PSK (TETRA)

In TETRA specifications, one of the modulation technique used is Differential 8 Phase Shift Keying (D8PSK). We will discuss the bit error rate with non-coherent demodulation of D8PSK in Additive White Gaussian Noise (AWGN) channel.

5 comments Read the full article →

IEEE 802.11ac – Very High Throughput for lower 6GHz band

IEEE 802.11ac Very High Throughput (for <6GHz band) is an upcoming standard which is development by IEEE standardization committee. The mandate of Task Group AC is supposed to enhance the High Throughput rates achieved by 802.11n.  As described in the document VHT below 6GHz PAR plus 5C’s (802.11-08/0807r4) the group has the following objectives :

2 comments Read the full article →

Non coherent demodulation of pi/4 DQPSK (TETRA)

In TETRA specifications, one of the modulation technique used is Differential Quaternary Phase Shift Keying (DQPSK). We will discuss the bit error rate with non-coherent demodulation of DQPSK in Additive White Gaussian Noise (AWGN) channel.

5 comments Read the full article →

TETRA Air interface specifications – Overview

TETRA (TErrestrial Trunked RAdio) is a wireless specification intended to be used by government agencies, public health services, rail transport, military etc. TETRA specification comes from ETSI (European Telecommunication Standards Institute). We plan to start a post series on the building blocks of TETRA physical layer and radio specifications and this is the first post [...]

4 comments Read the full article →

BER for BPSK in ISI channel with MMSE equalization

In the past, we had discussed BER for BPSK in flat fading Rayleigh channel and BER for BPSK in a frequency selective channel using Zero Forcing Equalization. In this post, lets discuss a frequency selective channel with the use of Minimum Mean Square Error (MMSE) equalization to compensate for the inter symbol interference (ISI). For [...]

39 comments Read the full article →

Happy New Year 2010

Wishing all the readers of dsplog.com a great year 2010 ! Its been a mixed year for dsplog. Some key milestones a) Crossing 1000 subscribers with 1100+ comments in March 2009 b) Crossing 100 posts with 2200 subscribers and 2600+ comments in October 2009 c) As I write this, we have 102 posts with 2603 [...]

2 comments Read the full article →

BER for BPSK in ISI channel with Zero Forcing equalization

In the past, we had discussed BER for BPSK in flat fading Rayleigh channel. In this post, lets discuss a frequency selective channel with the use of Zero Forcing (ZF) equalization to compensate for the inter symbol interference (ISI). For simplifying the discussion, we will assume that there is no pulse shaping at the transmitter. [...]

35 comments Read the full article →

← Previous Entries