(/)

All Books (/doc) Tutorials (/doc/Tutorials) Statistics (/doc/Tutorials/Statistics)

Multivariate Analysis (/doc/Tutorials/MultiVar-Analysis)

Tutorials Search

5.6.1 Principal Component Analysis

Contents

1 Summary
2 Selecting Principal Methods
3 Request Principal Component Plots
4 Interpreting The Results

Summary

Principal Component Analysis is useful for reducing and interpreting large multivariate data sets with underlying linear structures, and for discovering previously
unsuspected relationships.

We will start with data measuring protein consumption in twenty-five European countries for nine food groups. Using Principal Component Analysis, we will examine
the relationship between protein sources and these European countries.

Selecting Principal Methods

To determine the number of principal components to be retained, we should first run Principal Component Analysis and then proceed based on its result:

1. Open a new project or a new workbook. Import the data file \samples\Statistics\Protein Consumption in Europe.dat
2. Select the entire worksheet and then select Statistics: Multivariate Analysis: Principal Component Analysis.
3. Accept the default settings in the open dialog box and click OK.
4. Select sheet PCA Report.
5. In the Eigenvalues of the Correlation Matrix table, we can see that the first four principal components explain 86% of the variance and the remaining
components each contribute 5% or less. We will keep four main components.

6. A scree plot can be a useful visual aid for determining the appropriate number of principal components. The number of components depends on the
"elbow" point at which the remaining eigenvalues are relatively small and all about the same size. This point is not very evident in the scree plot, but we
can still say the fourth point is our "elbow" point.

(/www/out.aspx?
(/www/out.aspx?
(https://www.youtube.com/user/TheOriginlab)
(/fileExchange)
(http://blog.originlab.com)
(/forum)
i=Facebook)
i=LinkedIn)
 (/)

7. Click the lock icon in the results tree and select Change Parameters in the context menu. In the Settings tab, set Number of Components to
Extract to 4. Do not close the dialog; in the next steps, we will retrieve component diagrams.

Request Principal Component Plots

In the Plots tab of the dialog, users can choose whether they want to create a scree plot or a component diagram.

Scree Plot

The scree plot is a useful visual aid for determining an appropriate number of principal components.

Component Plot

Component plots show the component score of each observation or component loading of each variable for a pair of principal components. In the
Select Principal Components to Plot group, users can specify which pair of components to plot. The component plots include:

Loading Plot

The loading plot is a plot of the relationship between the original variables and the subspace dimension. It is used to interpret relationships
between variables.

Score Plot

The score plot is a projection of data onto subspace. It is used to interpret relationships between observations.

BiPlot

The biplot shows both the loadings and the scores for two selected components in parallel.
(/www/out.aspx?
(/www/out.aspx?
(https://www.youtube.com/user/TheOriginlab)
(/fileExchange)
(http://blog.originlab.com)
(/forum)
i=Facebook)
i=LinkedIn)
1. In the dialog that was opened in the preceding steps, select the Plots tab. Make sure Scree Plot, Loading Plot, and Biplot are selected.
 2. The first two components are usually responsible for the bulk of the variance. This is why we are going to plot the component plot in the space of the first
(/)
two principal components. In the Select Principal Components to Plot group, set Principal Component for X Axis to 1, and set Principal Component
for Y Axis to 2. Click OK.

Interpreting The Results

1. In the Correlation Matrix, we can see that the variables are highly correlated. Many values are greater than 0.3. Principal Component Analysis is an
appropriate tool for removing the collinearity.

2. The main component variables are defined as linear combinations of the original variables. The Extracted Eigenvectors table provides coefficients for
equations.

3. The Loading Plot reveals the relationships between variables in the space of the first two components. In the loading plot, we can see that Red Meat,
(/www/out.aspx?
(/www/out.aspx?
(https://www.youtube.com/user/TheOriginlab)
(/fileExchange)
(http://blog.originlab.com)
(/forum)
Eggs, Milk, and White Meat have similar heavy loadings for principal component 1. Fish, fruit, and vegetables, however, have similar heavy loadings for
i=Facebook)
i=LinkedIn)
principal component 2.
 (/)

4. The biplot shows both the loadings and the score for two selected components in parallel. It can reveal the projection of an observation on the subspace
with the score points. It can also find the ratio of observations and variables in the subspace of the first two components. (Note: Double-click the graph to
open and customize.)
5. Use the Data Reader tool to open the Data Info window and examine the plot in greater detail. We can see that Spain and Portugal's protein sources
differ from those of other European countries. Spain and Portugal rely on fruits and vegetables, while eastern European countries such as Albania,
Bulgaria, Yugoslavia, and Romania prefer cereals and nuts.

(/www/out.aspx?
(/www/out.aspx?
(https://www.youtube.com/user/TheOriginlab)
(/fileExchange)
(http://blog.originlab.com)
(/forum)
i=Facebook)
i=LinkedIn)
 To display country information
(/) in the Data Info window, as in the image above:
1. Right-click the Data Info window and select Preferences....
2. In the Rows tab, move Country from the left panel to the right. Click OK.

To create an arbitrary 3D loading plot, such as PC1-PC2-PC4 or PC1-PC3-PC5 loading plot:

1. Click the lock icon in the results tree and select Change Parameters in the context menu. In the Settings tab, set Number of
Components to Extract as needed. For example, if you want to do a PC1-PC2-PC4 loading plot, Number of Components to Extract
should be set as 4. Click OK to close the dialog.
2. The Extracted Eigenvectors table now has 4 columns. To duplicate the sheet PCA Plot Data1, select the sheet PCA Plot Data1 tab and
right click to select Duplicate. Then rename the new sheet as sheet PCA Plot Data2.
3. Right click on the Workbook title bar and select Properties... from the context menu to open the dialog. In the Window Properties dialig,
uncheck Spreadsheet Cell Notation box. Click OK to close the dialog.
4. Suppose you want to plot a PC1-PC2-PC4 loading plot. Activate the sheet PCA Plot Data2, highlight Col (E) and right click to insert a
column ahead of Col (E). Insert a column ahead of Col (G). Highlight two new columns and right click to select Set as: Z.
5. Rename the long name of Col (H1) and Col (I1) as Principal Component 4. Set the all the Eigenvalue of Col (H1)as 0.
6. Go to sheet PCA1, copy the Coefficents of PC4 in the Extracted Eigenvectors table and paste it into Col (I1) of sheet PCA Plot Data2.
7. Highlight Col (C) to Col (I1) and select Plot>3D: Vector: 3D Vector XYZ XYZ.
8. You can also customize the Plot by changing vector color and adding label. Double click to enter Plot Detail dialog and then go to Original
level. Select 3D Vector tab, change Color as Blue and Width as 4; Go to Label tab and customize Label From: Col(G), Position: Right,
Size: 20 and Attach to: Arrow Head. Click OK to close the dialog. The 3D loading plot will be created as follow.

© OriginLab Corporation. All rights reserved.

Site Map (/index.aspx?go=Company&pid=914) | Privacy Policy (/index.aspx?
go=Company/PrivacyPolicy) | Terms of Use (/index.aspx?
go=Company/TermsOfUse)

(/www/out.aspx?
(/www/out.aspx?
(https://www.youtube.com/user/TheOriginlab)
(/fileExchange)
(http://blog.originlab.com)
(/forum)
i=Facebook)
i=LinkedIn)