Linear Algebra: Matrices, Determinants, Vectors, Linear Equations, Eigenvalues & Eigenvectors

Linear Algebra: Matrices, Determinants, Vectors, Linear Equations, Eigenvalues and Eigenvectors

Linear Algebra is one of the most useful areas of mathematics for understanding systems of equations, transformations, data, biological models, statistics, computer science, bioinformatics and many other scientific fields. Although the subject may initially look like a collection of symbols and formulas, its central idea is quite simple: we use mathematical objects such as vectors and matrices to represent information and then use systematic operations to solve problems.

In this chapter, we will study matrices, determinants, vectors, systems of linear equations, matrix operations, eigenvalues and eigenvectors. The explanations are written in simple human language so that the concepts are useful both for learning and for competitive examinations.

Linear algebra is particularly important in modern biology and biotechnology. It can be used in gene-expression analysis, bioinformatics, image processing, population modelling, biological networks, statistics, machine learning and computational biology.

📚 Table of Contents

1. Meaning of Linear Algebra
2. Matrices
3. Types of Matrices
4. Matrix Operations
5. Determinants
6. Vectors
7. Systems of Linear Equations
8. Gaussian Elimination
9. Rank of a Matrix
10. Inverse of a Matrix
11. Eigenvalues
12. Eigenvectors
13. Applications of Linear Algebra
14. Applications in Biology and Biotechnology
15. Common Mistakes
16. Important Exam Facts
17. MCQs
18. FAQs
19. Last-Minute Revision
20. Conclusion

1. 🔢 What is Linear Algebra?

Linear algebra is the branch of mathematics concerned mainly with vectors, matrices and linear equations. The word "linear" refers to relationships in which variables occur only to the first power and are not multiplied by one another.

For example:

2x + 3y = 10

is a linear equation. In contrast:

x² + y = 10

is not linear because x is raised to the second power.

Linear algebra provides a compact way of handling many equations simultaneously. Instead of writing ten or a hundred equations separately, we can represent them using a single matrix equation.

AX = B

Here A is a matrix containing coefficients, X is the vector of unknown variables and B is the vector of constants.

💡 Simple idea: A matrix is like a structured table of numbers, while a vector can be thought of as an ordered list of numbers. Linear algebra gives us rules for working with these objects.

2. 🧮 Matrices

A matrix is a rectangular arrangement of numbers, symbols or expressions arranged in rows and columns. Matrices are widely used to organize information and perform mathematical calculations efficiently.

A matrix is usually represented by a capital letter such as A, B or C.

A = [ 2   4   6 ]
[ 1   3   5 ]

The matrix above contains 2 rows and 3 columns. Therefore, its order is:

2 × 3

If a matrix has m rows and n columns, its order is written as m × n.

Matrix Elements

Each individual number in a matrix is called an element or entry. The element in row i and column j is commonly represented by:

a_ij

The first subscript identifies the row and the second identifies the column.

Example:
In the matrix

A = [ 5   8 ]
     [ 2   7 ]

a₁₂ = 8 because it is located in row 1, column 2.

3. 📊 Important Types of Matrices

Type	Meaning	Example / Condition
Row Matrix	Contains only one row.	[ 2 4 6 ]
Column Matrix	Contains only one column.	[ 2; 4; 6 ]
Rectangular Matrix	Number of rows and columns are different.	2 × 3 matrix
Square Matrix	Number of rows equals number of columns.	3 × 3
Zero Matrix	All elements are zero.	[0 0; 0 0]
Diagonal Matrix	All off-diagonal elements are zero.	[2 0; 0 5]
Scalar Matrix	A diagonal matrix with equal diagonal elements.	[4 0; 0 4]
Identity Matrix	Diagonal elements are 1 and all others are 0.	I = [1 0; 0 1]
Symmetric Matrix	A = AT	Transpose does not change the matrix.
Skew-Symmetric Matrix	AT = -A	Diagonal elements must be zero.

Identity Matrix

The identity matrix is particularly important because it behaves like the number 1 during matrix multiplication.

AI = IA = A

For a 3 × 3 matrix, the identity matrix is:

I = [1 0 0]
[0 1 0]
[0 0 1]

Exam Point: The identity matrix must be square.

4. ➕ Matrix Operations

Matrices can be added, subtracted and multiplied, but each operation follows specific rules. Understanding these rules is more important than simply memorizing formulas.

4.1 Matrix Addition

Two matrices can be added only when they have the same order. Corresponding elements are added.

A = [1 2; 3 4]     B = [5 6; 7 8]

A + B = [6 8; 10 12]

4.2 Matrix Subtraction

Similar to addition, subtraction requires matrices of the same order.

A - B = [1-5   2-6; 3-7   4-8]

A - B = [-4   -4; -4   -4]

4.3 Scalar Multiplication

When a matrix is multiplied by a scalar, every element of the matrix is multiplied by that number.

3A = 3[1 2; 3 4] = [3 6; 9 12]

4.4 Matrix Multiplication

Matrix multiplication is different from ordinary multiplication. Two matrices A and B can be multiplied when the number of columns of A equals the number of rows of B.

(m × n)(n × p) = m × p

For example, a 2 × 3 matrix can be multiplied by a 3 × 4 matrix, producing a 2 × 4 matrix.

Easy rule:
Look at the inside numbers.

(2 × 3) × (3 × 4)

The inside numbers are equal, so multiplication is possible. The answer will have the outside dimensions:

2 × 4

4.5 Matrix Multiplication Example

Consider:

A = [1 2; 3 4]

B = [5 6; 7 8]

The first element of AB is calculated by multiplying the first row of A by the first column of B:

(1 × 5) + (2 × 7) = 19

Therefore:

AB = [19   22; 43   50]

Very Important: Matrix multiplication is generally not commutative. Therefore:

AB ≠ BA in general.

4.6 Transpose of a Matrix

The transpose of a matrix is obtained by changing its rows into columns. It is represented by A^T.

A = [1 2 3; 4 5 6]

A^T = [1 4; 2 5; 3 6]

Important properties include:

• (A^T)^T = A
• (A + B)^T = A^T + B^T
• (AB)^T = B^TA^T

5. 🧩 Determinants

A determinant is a scalar value associated with a square matrix. It provides useful information about the matrix, especially whether the matrix has an inverse and whether a system of linear equations may have a unique solution.

The determinant of matrix A is written as:

det(A)   or   |A|

Determinant of a 2 × 2 Matrix

For:

A = [a   b; c   d]

the determinant is:

|A| = ad − bc

Example:

A = [2   3; 1   4]

det(A) = (2 × 4) − (3 × 1)

= 8 − 3

= 5

Why is the Determinant Important?

• If det(A) ≠ 0, the square matrix is nonsingular and has an inverse.
• If det(A) = 0, the matrix is singular and does not have an ordinary inverse.
• The determinant is useful in solving systems of linear equations.
• It can describe scaling of area or volume under a linear transformation.

Important Properties of Determinants

• Interchanging two rows changes the sign of the determinant.
• If two rows are identical, the determinant is zero.
• If one row is a multiple of another, the determinant is zero.
• The determinant of an identity matrix is 1.
• det(AB) = det(A)det(B).
• det(A^T) = det(A).

6. ➡️ Vectors

A vector is a quantity that has both magnitude and direction. In mathematical terms, a vector can be represented as an ordered list of numbers.

v = [3, 4]

The vector above can be visualized as an arrow starting at the origin and ending at the point (3,4).

Scalar vs Vector

Feature	Scalar	Vector
Basic idea	Has magnitude only	Has magnitude and direction
Example	Temperature	Velocity
Representation	Single number	Ordered components
Example value	25	(3,4)

Magnitude of a Vector

For a two-dimensional vector:

v = (x,y)

its magnitude is:

|v| = √(x² + y²)

Example:
For v = (3,4):

|v| = √(3² + 4²)
= √25
= 5

Vector Addition

Vectors are added component by component.

(a,b) + (c,d) = (a+c,b+d)

For example:

(2,3) + (4,5) = (6,8)

Dot Product

The dot product of two vectors produces a scalar.

A · B = A₁B₁ + A₂B₂ + ... + A_nB_n

For two vectors:

A = (a,b),   B = (c,d)

A · B = ac + bd

The dot product is also related to the angle between two vectors:

A · B = |A||B|cosθ

Exam Tip: If the dot product of two non-zero vectors is zero, the vectors are perpendicular or orthogonal.

7. 📝 Systems of Linear Equations

A system of linear equations contains two or more linear equations that must be satisfied simultaneously.

For example:

x + y = 5
2x + y = 7

We need to find values of x and y that satisfy both equations.

Subtracting the first equation from the second:

x = 2

Substituting x = 2 into x + y = 5:

2 + y = 5
y = 3

Therefore, the solution is:

(x,y) = (2,3)

Matrix Representation

The same system can be written in matrix form:

AX = B

For:

x + y = 5
2x + y = 7

we can write:

[1 1] [x] = [5]
[2 1] [y] [7]

This compact representation becomes extremely useful when dealing with many equations and many unknowns.

Possible Solutions

A system of linear equations may have:

• One unique solution
• No solution
• Infinitely many solutions

Situation	Meaning	Graphical Interpretation for Two Equations
Unique solution	Exactly one solution exists.	Lines intersect at one point.
No solution	No common solution exists.	Parallel distinct lines.
Infinite solutions	Many solutions satisfy the system.	Same line.

8. 🔄 Gaussian Elimination

Gaussian elimination is a systematic method for solving systems of linear equations. It uses elementary row operations to transform a matrix into a simpler form.

The three basic elementary row operations are:

1. Interchange two rows.
2. Multiply a row by a non-zero constant.
3. Add a multiple of one row to another row.

Example

Consider:

x + y = 5
2x + y = 7

The augmented matrix is:

[1   1 | 5]
[2   1 | 7]

Replace the second row by:

R₂ → R₂ − 2R₁

We obtain:

[1   1 | 5]
[0   -1 | -3]

Therefore:

y = 3

and then:

x = 2

9. 📈 Rank of a Matrix

The rank of a matrix represents the maximum number of linearly independent rows or columns. It is an important concept for understanding the number of independent pieces of information contained in a matrix.

The rank of a matrix can be determined using row reduction. After converting the matrix to row-echelon form, count the number of non-zero rows.

Example:

Suppose row reduction produces:

[1   2   3]
[0   1   4]
[0   0   0]

There are two non-zero rows. Therefore, the rank is 2.

Exam Point: The rank of a matrix cannot be greater than the smaller of its number of rows and number of columns.

10. 🔁 Inverse of a Matrix

The inverse of a square matrix A is another matrix A^-1 such that:

AA^-1 = A^-1A = I

A matrix has an ordinary inverse only when it is square and nonsingular, meaning:

det(A) ≠ 0

Inverse of a 2 × 2 Matrix

If:

A = [a   b; c   d]

then:

A^-1 = 1/(ad-bc) [d   -b; -c   a]

Example:

A = [2   3; 1   4]

det(A) = 5

Therefore:

A^-1 = 1/5 [4   -3; -1   2]

11. ⭐ Eigenvalues

Eigenvalues are one of the most important concepts in linear algebra. They help us understand how a matrix transformation changes particular directions.

If A is a square matrix and v is a non-zero vector, then:

Av = λv

Here:

• A = square matrix
• v = eigenvector
• λ = eigenvalue

The key idea is that after multiplication by A, the eigenvector does not change its fundamental direction. It is only scaled by λ.

Characteristic Equation

Eigenvalues are found by solving:

det(A − λI) = 0

This equation is called the characteristic equation.

Eigenvalue Example

Consider:

A = [2   0; 0   3]

The characteristic equation is:

det(A − λI) = 0

Therefore:

|2−λ   0|
|0   3−λ| = 0

(2−λ)(3−λ)=0

Hence:

λ = 2 and λ = 3

Important Properties of Eigenvalues

• The eigenvalues of a triangular matrix are its diagonal elements.
• The sum of eigenvalues equals the trace of the matrix, counting algebraic multiplicity.
• The product of eigenvalues equals the determinant, counting algebraic multiplicity.
• A singular matrix has at least one zero eigenvalue.
• The eigenvalues of an identity matrix are all 1.

12. 🧬 Eigenvectors

An eigenvector is a non-zero vector whose direction remains unchanged when a matrix acts on it, although its magnitude may be scaled.

Av = λv

Once an eigenvalue λ is known, the corresponding eigenvectors are obtained by solving:

(A − λI)v = 0

Simple interpretation:

Imagine a matrix as a machine that transforms arrows. Most arrows may change both their length and direction. An eigenvector is a special arrow whose direction remains the same. The eigenvalue tells us how much that arrow is stretched, compressed or reversed.

Eigenvalue and Eigenvector Relationship

13. 🔍 Trace of a Matrix

The trace of a square matrix is the sum of its diagonal elements.

A = [a b; c d]

tr(A) = a + d

For a 3 × 3 matrix:

A = [a b c]
[d e f]
[g h i]

tr(A) = a + e + i

Important connection: For a square matrix, the trace equals the sum of its eigenvalues, counting algebraic multiplicity.

14. 🔗 Linear Independence

A set of vectors is called linearly independent if no vector in the set can be expressed as a linear combination of the others.

For example, vectors:

v₁ = (1,0)
v₂ = (0,1)

are linearly independent because neither vector can be obtained by multiplying the other by a scalar.

In contrast:

v₁ = (1,2)
v₂ = (2,4)

are linearly dependent because:

v₂ = 2v₁

15. 🔄 Linear Transformations

A linear transformation is a function between vector spaces that preserves vector addition and scalar multiplication.

If T is a linear transformation, then:

T(u + v) = T(u) + T(v)

T(cu) = cT(u)

Matrices provide a convenient way to represent linear transformations. For example, rotation, scaling, reflection and projection can be represented using matrices.

16. 🌍 Applications of Linear Algebra

Linear algebra is not restricted to theoretical mathematics. It is used in many real-world scientific and technological applications.

💻 Computer Science

Matrices and vectors are fundamental in computer graphics, machine learning, image processing and numerical computation.

📊 Data Science

Data sets can be represented as matrices. Matrix operations are central to regression, dimensionality reduction and many statistical methods.

🤖 Artificial Intelligence

Neural networks perform large numbers of matrix and vector operations during training and prediction.

🧬 Bioinformatics

Vectors and matrices can represent gene-expression data, sequence comparisons, molecular features and biological networks.

📷 Image Processing

Digital images can be represented as matrices of numerical pixel values.

⚙️ Engineering

Linear systems are widely used in structural analysis, electrical circuits, control systems and signal processing.

17. 🧬 Applications in Biology and Biotechnology

Linear algebra has become increasingly important in modern biological research. Biological data are often high-dimensional, meaning that researchers may measure thousands of genes, proteins or metabolites simultaneously.

17.1 Gene Expression Data

Suppose expression levels of several genes are measured in multiple biological samples. The resulting data can naturally be organized as a matrix.

Rows = genes      Columns = samples

Each matrix element represents the expression level of one gene in one sample.

17.2 Principal Component Analysis

Principal Component Analysis (PCA) uses concepts from linear algebra to transform high-dimensional data into a smaller number of informative dimensions. Eigenvalues and eigenvectors are particularly important in PCA.

Biological example: PCA can help visualize whether samples from different experimental groups show different overall molecular profiles.

17.3 Biological Networks

Networks involving genes, proteins or metabolites can be represented using matrices. An adjacency matrix, for example, records whether two nodes in a network are connected.

17.4 Population Models

Matrix models can describe changes in biological populations over time. For example, age-structured or stage-structured population models can use matrices to predict future population sizes.

17.5 Image Analysis

Microscopy images can be represented as arrays or matrices of pixel intensities. Matrix-based methods are therefore important in microscopy image processing, cell segmentation and quantitative biological imaging.

18. ⚠️ Common Mistakes in Linear Algebra

1. Confusing Matrix Order

A matrix with 3 rows and 2 columns has order 3 × 2, not 2 × 3.

2. Incorrect Matrix Multiplication

Always check whether the inner dimensions match: (m × n)(n × p).

3. Assuming AB = BA

Matrix multiplication is generally not commutative.

4. Forgetting the Zero Vector

An eigenvector must be non-zero. The zero vector cannot be used as an eigenvector.

5. Confusing Determinant with Matrix

A determinant is a scalar value, while a matrix is an array of elements.

19. 🎯 Important Exam Facts

No.	Important Fact
1	A matrix is an arrangement of elements in rows and columns.
2	The order of a matrix is rows × columns.
3	Matrix addition requires matrices of the same order.
4	Matrix multiplication requires matching inner dimensions.
5	AB is generally not equal to BA.
6	The transpose changes rows into columns.
7	Identity matrix contains 1 on the main diagonal and 0 elsewhere.
8	The determinant is defined for square matrices.
9	A matrix with determinant zero is singular.
10	A nonsingular square matrix has an inverse.
11	Vector magnitude represents its length.
12	The dot product of perpendicular non-zero vectors is zero.
13	Eigenvalues satisfy det(A − λI) = 0.
14	Eigenvectors satisfy Av = λv.
15	An eigenvector cannot be the zero vector.
16	The trace is the sum of diagonal elements.
17	The sum of eigenvalues equals the trace, counting algebraic multiplicity.
18	The product of eigenvalues equals the determinant, counting algebraic multiplicity.
19	The rank cannot exceed the smaller dimension of the matrix.
20	Linear algebra is widely used in computational biology and data analysis.

20. 📌 Important Formula Sheet

Concept	Formula
Matrix multiplication dimensions	(m × n)(n × p) = m × p
2 × 2 determinant	|A| = ad − bc
Vector magnitude	|v| = √(x² + y²)
Dot product	A · B = |A||B|cosθ
Matrix inverse	AA⁻¹ = A⁻¹A = I
Eigenvalue equation	det(A − λI) = 0
Eigenvector equation	Av = λv
Eigenvector calculation	(A − λI)v = 0
Trace	Sum of diagonal elements
Determinant of product	det(AB) = det(A)det(B)

21. 📝 Multiple Choice Questions

Q1. A matrix with 3 rows and 4 columns has which order?

1. 4 × 3
2. 3 × 4
3. 3 × 3
4. 4 × 4

Answer: B — 3 × 4

Q2. Which matrix must be square?

1. Row matrix
2. Column matrix
3. Identity matrix
4. Rectangular matrix

Answer: C — Identity matrix

Q3. For A = [2 3; 1 4], what is det(A)?

1. 5
2. 8
3. 11
4. 2

Answer: A — 5

Q4. Matrix multiplication AB is generally:

1. Always commutative
2. Never possible
3. Not commutative
4. Always zero

Answer: C — Not commutative

Q5. What is the identity matrix used for?

1. It behaves like zero under multiplication
2. It behaves like one under matrix multiplication
3. It always has determinant zero
4. It contains no diagonal elements

Answer: B — It behaves like one under matrix multiplication

Q6. The determinant of a singular matrix is:

1. 1
2. -1
3. 0
4. Infinity

Answer: C — 0

Q7. Which equation is used to find eigenvalues?

1. Av = 0
2. det(A − λI) = 0
3. A + B = C
4. A = I

Answer: B — det(A − λI) = 0

Q8. An eigenvector must be:

1. Zero vector
2. Non-zero vector
3. Always a scalar
4. Always a matrix

Answer: B — Non-zero vector

Q9. The trace of a matrix is the:

1. Product of all elements
2. Sum of diagonal elements
3. Sum of all elements
4. Determinant

Answer: B — Sum of diagonal elements

Q10. Which field commonly uses matrices to represent gene-expression data?

1. Bioinformatics
2. Geology only
3. Astronomy only
4. Classical literature

Answer: A — Bioinformatics

Q11. If two non-zero vectors have a dot product of zero, they are:

1. Parallel
2. Orthogonal
3. Identical
4. Zero vectors

Answer: B — Orthogonal

Q12. The inverse of A exists when:

1. det(A) = 0
2. det(A) ≠ 0
3. A has no rows
4. A is always rectangular

Answer: B — det(A) ≠ 0

22. ❓ Frequently Asked Questions

What is linear algebra?

Linear algebra is the branch of mathematics dealing mainly with vectors, matrices, linear equations and linear transformations.

What is a matrix?

A matrix is a rectangular arrangement of numbers or other mathematical elements organized into rows and columns.

What is the difference between a matrix and a determinant?

A matrix is an array of elements, while a determinant is a single scalar value calculated from a square matrix.

When can two matrices be added?

Two matrices can be added only when they have the same dimensions.

When is matrix multiplication possible?

If A has dimensions m × n and B has dimensions n × p, then AB is possible and the resulting matrix has dimensions m × p.

What is an eigenvalue?

An eigenvalue is a scalar λ for which a non-zero vector v satisfies Av = λv.

What is an eigenvector?

An eigenvector is a non-zero vector whose direction remains unchanged when the matrix transformation is applied to it, apart from scaling by the eigenvalue.

Why is linear algebra important in biology?

It provides mathematical tools for analysing high-dimensional biological data, including gene-expression matrices, biological networks, population models, microscopy images and dimensionality-reduction methods.

23. ⚡ Last-Minute Revision Table

Topic	Remember This
Matrix	Rows + columns
Matrix order	Rows × columns
Addition	Same dimensions required
Multiplication	Inner dimensions must match
Identity	Diagonal = 1, others = 0
Transpose	Rows become columns
Determinant	Scalar associated with square matrix
Singular matrix	det(A) = 0
Inverse	Exists for nonsingular square matrix
Vector	Magnitude + direction
Dot product	Produces a scalar
Eigenvalue	det(A − λI) = 0
Eigenvector	Av = λv
Trace	Sum of diagonal elements
Rank	Number of independent rows/columns

24. 🧠 Easy Memory Tricks

📌 Matrix Order

Remember: Rows come first.
Therefore: Rows × Columns.

📌 Multiplication

Remember: Inside numbers must match.
(m × n)(n × p).

📌 Determinant

For 2 × 2: ad − bc.

📌 Eigenvalues

Remember:
det(A − λI) = 0

📌 Eigenvectors

Remember:
Av = λv

📌 Inverse

Remember:
A × A⁻¹ = I

25. 🗺️ Complete Linear Algebra Concept Map

26. 🎓 Conclusion

Linear algebra provides a powerful mathematical language for representing and solving problems involving multiple variables. The most important building blocks are matrices, vectors and systems of linear equations.

Matrices allow large amounts of information to be organized in a structured form. Matrix operations allow us to transform and combine that information. Determinants help us understand important properties of square matrices, including whether an inverse exists. Vectors provide a way to represent quantities with magnitude and direction.

Eigenvalues and eigenvectors are especially important because they reveal special directions and scaling behaviour associated with a matrix. These concepts are used in methods such as PCA and many computational techniques.

For students of biology, biotechnology, microbiology and bioinformatics, linear algebra is particularly useful because modern biological research increasingly depends on numerical data. Gene-expression studies, biological networks, population models, image analysis and computational modelling can all involve matrices and vectors.

🌟 Final Takeaway: Master these seven ideas first: Matrix → Matrix Operations → Determinant → Vector → Linear System → Eigenvalue → Eigenvector. Once these concepts are clear, many advanced mathematical and computational methods become much easier to understand.

⬆️ Back to Top