Regression Analysis and Simple Linear Regression Essay

Submitted By rohankapil
Words: 2277
Pages: 10
Open Document
Quantitative Methods

Sri Krishnamurthy, CFA, CAP
Hult.quant.fenway@gmail.com
Hult.quant.backbay@gmail.com
QuantUniversity LLC.
Adjunct Lecturer
Hult International Business School

Session 2 - Part 1
Copyright 2014 QuantUniversity LLC. Cannot be reproduced or used without written permission from
QuantUniversity LLC.

Agenda
 Regression Analysis : Estimating Statistical

Relationships
 In-class Exercise

Regression

Topics
 Regression Terminology
 Scatterplots

 Correlation
 Simple Linear Regression
 Multiple Regression
 Modeling relationships

Where can you use regression?
 Can you predict starting salaries for graduating students ?
 Salary = function of { Previous years of education, Experience,

GPA, Interview Performance etc.}
 Can you predict speed of a car ?
 Speed = Function of { Engine parameters, Car age, Tire age,

Car Model}
 Does spending more on advertising increase sales ?

 Can you predict the energy prices/temperatures for the

next year?

What is regression ?
 Regression analysis is the study of relationships between variables.
 Prediction
 Unknown variable = function of finite known variables

Type of Data:
 Cross sectional data
 For example : at a point in time, sales = function of {no of

promotional TV ads}
 Time series
 For example : Temperature tomorrow = function of {temperature 1

year ago, temperature 2 years ago etc}

Regression terms
 Dependent variable / Target Variable /

Response variable (Y)
 The unknown variable we are trying to explain/predict  Independent variable / Explanatory variable / Predictor variable (X)
 The variables used to predict the response variables Type of Relationship
 Type of Relationship:
 Linear Or non Linear

Types
 Simple Linear Regression
 1 dependent variable , 1 independent variable
 Ex : Sales = function of { ad spend}

 Multiple Linear Regression
 1 dependent variable , many independent variable
 Ex : Sales = function of { ad spend, no of promotional events,

number of sales offices}

Scatter Plots

Why Scatterplots ?
 A scatterplot is a graphical plot of two numerical variables,

an X and a Y.
 If there is any relationship between the two variables, it is usually apparent from the scatterplot.
 Drugstore Sales.xlsx
 To use a scatterplot to examine the relationship between

promotional expenditures and sales at Pharmex.

Observations:
Drugstore Sales.xlsx




The scatterplot indicates that there is a positive relationship between Promote and Sales.
The relationship is not perfect. While the variable Promote is helpful in predicting Sales, it does not lead to perfect predictions. Correlation and Causation
 Correlation between the variables does not imply

causation.
 Scatterplot only tells if there is a relationship between the two plotted variables.

To analyze multiple variables
 We can use scatterplots to examine the relationships among

the dataset variables.




Examine scatterplots between each explanatory variable and the dependent variable.
With multiple explanatory variables, check for relationships among them.

 Overhead Costs.xlsx
 Data file contains observations of overhead costs, machine

hours, and production runs at Bendrix, an automobile parts manufacturing company.

To check for Linear and Non-Linear relationships  Scatterplots are useful for detecting relationships that may not

be obvious otherwise.
 Some relationships may not be linear – when points do not cluster around a straight line.
 Scatterplot below indicates a nonlinear relationship between life expectancy of newborns in 1990 and GNP per capita.

To check for outliers
 Scatterplots are especially useful for identifying outliers –

observations that fall outside of the general pattern of the rest of the observations.
 Example below shows an outlier on a scatterplot of the relationship between CEO salary and years of experience.

How to address outliers?
 Bad data/not relevant to the analysis : Omit
 If not clear, run
Show More

Related Documents: Regression Analysis and Simple Linear Regression Essay

Assignment BA520 Week 2 Essay

Decision Analysis Armstead M. Deas BA520 Week#2, May 9, 2015 Dr. Jackson Abstract A variable is defined as a value that can take different values depending on particular circumstances. As such a variable can take on many values as and when the situation dictates. Subsequently a variable is not static; its altering nature can help the estimator determine the possible values of a function for different variable values (Render, Stair, Hanna and Hale, 2009). For example, assume that the…

Words 526 - Pages 3

R Function Essay

Vito Ricci - R Functions For Regression Analysis – 14/10/05 (vito_ricci@yahoo.com) R FUNCTIONS FOR REGRESSION ANALYSIS Here are some helpful R functions for regression analysis grouped by their goal. The name of package is in parentheses. Linear model Anova: Anova Tables for Linear and Generalized Linear Models (car) anova: Compute an analysis of variance table for one or more linear model fits (stasts) coef: is a generic function which extracts model coefficients from objects returned by…

Words 2292 - Pages 10

Simple Linear Regression

Chapter 11 – Simple linear regression Types of Regression Models (Sec. 11-1) Linear Regression: • - Outcome of Dependent Variable (response) for ith experimental/sampling unit • - Level of the Independent (predictor) variable for ith experimental/sampling unit • - Linear (systematic) relation between Yi and Xi (aka conditional mean) • - Mean of Y when X=0 (Y-intercept) • - Change in mean of Y when X increases by 1 (slope) • - Random error term Note that…

Words 447 - Pages 2

Project Last Essay

CONTENTS PART I. SIMPLE REGRESSION ANALYSIS 4 (a) Statement of estimated equation 4 (b) Interpretation of coefficient 4 (c) Comment on the significance of the model 4 (d) Test of regression assumptions 5 PART II. MULTIPLE REGRESSION ANALYSIS 6 (a) Explanation of selected variables for the model 6 (b) Statement of estimated equation 6 (c) Interpretation of coefficients 7 (d) Comment on the significance of the model 7 (e) Test for regression assumptions 8 APPENDIX LIST…

Words 1808 - Pages 8

Essay on Applying Time

Applying Time Series Methodologies To forecast variables such as sales and demand, models such as simple linear regression, simple moving averages, and weighted moving averages. To be able to arrive at a reasonably accurate forecast, variation in the data provided needs to be analyzed. Variations can be cyclical, seasonal, secular, or irregular. This simulation illustrates the use of regression and time series methodologies to forecast the advertising budget, sales, and production levels in a company…

Words 347 - Pages 2

qbus revision Essay

list 1. Understand the linear relationship between two variables A measure of linear relationship: sample covariance and Pearson Coefficient of correlation (scale free) :Data Analysis > Correlation 2. Perform parametric and non-parametric tests for the coefficient of correlation Parametric Test: T-test, Data Analysis Plus > Correlation (Pearson) Non-Parametric Test: Z-test, Data Analysis Plus > Correlation (Spearman) 3. Understand the concept of simple linear regression analysis A statistical process…

Words 1686 - Pages 7

Written Assignment 2 Essay

the simple linear regression equation Y = β0 + β1X1 + ǫ, and superimpose your regression line on the scatterplot in part (a). β1= Sx1y/Sx1x1= 18762573.43/17526467.18 = 1.07 β0 = ˉy- β1ˉx1 = 6290.714 – 1.0705x6353.214 = -510.58 ≈ -511 Thus, the regression equation is: Y = -511+ 1.07X1 + ǫ (d) Enter the data from the table above into two separate columns of a Minitab worksheet. Now use Minitab to perform a simple linear regression of Y…

Words 865 - Pages 4

The Aualleg Procedure: Regression With Autocorrelated Correction Methods

Chapter 8 The AUTOREG Procedure Chapter Table of Contents OVERVIEW . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303 GETTING STARTED . . . . . . . . . . . Regression with Autocorrelated Errors . . Forecasting Autoregressive Error Models Testing for Autocorrelation . . . . . . . . Stepwise Autoregression . . . . . . . . . Testing for Heteroscedasticity . . . . . . Heteroscedasticity and GARCH Models . SYNTAX . . . . . . . . . . . Functional Summary . . . . PROC AUTOREG…

Words 1470 - Pages 6

A Brief Note On Home Valuation Services

representations of data, constructing confidence intervals, creating hypothesis tests, analyzing variance, and performing regression analysis. Based on their findings in CA, they will apply the same approach to the remaining 49 states in order to implement a standard customary and reasonable appraiser fee schedule for their nationwide appraisal management business. Analysis and Approach Descriptive Statistics We first analyze the data using descriptive statistics to gain a quick understanding…

Words 5468 - Pages 22

Analysis On Forecasting

QUANTITATIVE ANALYSIS FOR MANAGEMENT Forecasting Barry Render / Ralph M. Stir, JR. Summarized by - NOPPOL BEOKHAIMOOK Learning Objectives (1) Students will be able to: – Understand and know when to use various families of forecasting models – Compare moving averages, exponential smoothing, and trend time-series models – Seasonally adjust data. – Understand Delphi and other qualitative decision-making approaches 1 Learning Objectives (2) Students will be able to: – Identify independent and dependent…

Words 5226 - Pages 21