For a linear fit (a first-order polynomial) we don't need to invert a matrix!! Defining
γ=n−1∑i=01σ2i, γx=n−1∑i=0xiσ2i, γy=n−1∑i=0(yiσ2i), γxx=n−1∑i=0xixiσ2i, γxy=n−1∑i=0yixiσ2i,we obtain
β0=γxxγy−γxγyγγxx−γ2x, β1=γxyγ−γxγyγγxx−γ2x.This approach (different linear and non-linear regression) suffers often from both being underdetermined and overdetermined in the unknown coefficients βi. A better approach is to use the Singular Value Decomposition (SVD) method discussed next week.