Data Science Math Foundations

Essential mathematical concepts for data science including linear algebra, calculus, and probability theory fundamentals required for understanding advanced algorithms

Category
Data Science
Level
basic
Languages
en → en
Cards
51
Markdown
Data Science Math Foundations (.md)

Flashcards (51)

#Front (Term / Question)Back (Definition / Answer)ExampleMultiple-Choice Options
1What is standard deviation?Standard deviation is the square root of variance, representing the average distance of data points from the mean.
2What is a derivative?A derivative represents the rate of change of a function with respect to a variable.
3Define a vector.A vector is an ordered array of numbers that can represent a point in space or a direction and magnitude.
4Define eigenvalues and eigenvectors.Eigenvalues are scalars that indicate how much a corresponding eigenvector is stretched or compressed during a linear transformation.
5What is the purpose of calculus in data science?Calculus is used to optimize functions, analyze changes, and understand the behavior of models.
6What is a limit in calculus?A limit describes the value that a function approaches as the input approaches a certain point.
7What is the Central Limit Theorem?The Central Limit Theorem states that the distribution of sample means approaches a normal distribution as sample size increases.
8What is clustering in data science?Clustering is an unsupervised learning technique that groups similar data points together based on their features.
9Define the concept of a norm in vector spaces.A norm is a function that assigns a non-negative length or size to vectors in a vector space.
10What is the learning rate in machine learning?The learning rate is a hyperparameter that determines the step size at each iteration while moving toward a minimum of the loss function.
11What is underfitting?Underfitting happens when a model is too simple to capture the underlying trend of the data.
12What is the chain rule in differentiation?The chain rule is a formula for computing the derivative of the composition of two or more functions.
13Define a continuous function.A continuous function is one where small changes in the input result in small changes in the output.
14What is a probability distribution?A probability distribution describes how probabilities are assigned to different possible outcomes of a random variable.
15What is the difference between L1 and L2 regularization?L1 regularization adds the absolute value of coefficients as a penalty, while L2 regularization adds the square of coefficients.
16What is a matrix?A matrix is a rectangular array of numbers arranged in rows and columns.
17Explain the concept of a determinant.The determinant is a scalar value that can be computed from a square matrix and indicates whether the matrix is invertible.
18What is a p-value?A p-value indicates the probability of observing the test results under the null hypothesis; lower values suggest stronger evidence against it.
19Explain the concept of a normal distribution.A normal distribution is a bell-shaped probability distribution characterized by its mean and standard deviation.
20What is F1 score?The F1 score is the harmonic mean of precision and recall, providing a balance between the two metrics.
21What is overfitting in machine learning?Overfitting occurs when a model learns the training data too well, capturing noise instead of the underlying pattern.
22What is feature scaling?Feature scaling is the process of normalizing or standardizing the range of independent variables in data preprocessing.
23What is the purpose of a loss function?A loss function quantifies how well a model's predictions match the actual outcomes, guiding the optimization process.
24Define AUC in the context of ROC.AUC (Area Under the Curve) measures the overall performance of a binary classifier, with values closer to 1 indicating better performance.
25What is Principal Component Analysis (PCA)?PCA is a technique used for dimensionality reduction that transforms data to a new coordinate system based on variance.
26What is the difference between a row vector and a column vector?A row vector is a 1 x n matrix (horizontal), while a column vector is an n x 1 matrix (vertical).
27What is a hypothesis test?A hypothesis test is a statistical method used to determine if there is enough evidence to reject a null hypothesis.
28What is a confusion matrix?A confusion matrix is a table used to evaluate the performance of a classification model by comparing predicted and actual values.
29What is a correlation coefficient?A correlation coefficient quantifies the degree to which two variables are related, ranging from -1 to 1.
30What is Bayes' theorem?Bayes' theorem describes how to update the probability of a hypothesis based on new evidence.
31Define precision in the context of classification.Precision is the ratio of true positive predictions to the total predicted positives, indicating the accuracy of positive predictions.
32Define the mean of a dataset.The mean is the average value, calculated by summing all data points and dividing by the number of points.
33Define dimensionality reduction.Dimensionality reduction is the process of reducing the number of features in a dataset while preserving its essential information.
34What does it mean for vectors to be orthogonal?Vectors are orthogonal if their dot product is zero, indicating they are perpendicular to each other.
35What is a linear transformation?A linear transformation is a function between vector spaces that preserves vector addition and scalar multiplication.
36Define linear regression.Linear regression is a statistical method for modeling the relationship between a dependent variable and one or more independent variables.
37What is a confidence interval?A confidence interval is a range of values that is likely to contain the true parameter value with a specified level of confidence.
38What is gradient descent?Gradient descent is an optimization algorithm used to minimize the loss function by iteratively adjusting model parameters.
39What is the purpose of matrix multiplication?Matrix multiplication combines two matrices to produce a third matrix, representing transformations in linear algebra.
40Define Type I and Type II errors.Type I error is rejecting a true null hypothesis, while Type II error is failing to reject a false null hypothesis.
41What is the difference between supervised and unsupervised learning?Supervised learning uses labeled data to train models, while unsupervised learning finds patterns in unlabeled data.
42What is variance?Variance measures the spread of a set of values, calculated as the average of the squared differences from the mean.
43Define conditional probability.Conditional probability is the probability of an event occurring given that another event has already occurred.
44What is the fundamental theorem of calculus?The fundamental theorem of calculus links differentiation and integration, stating that they are inverse processes.
45What is the purpose of regularization?Regularization techniques are used to prevent overfitting by adding a penalty for complexity to the loss function.
46What is the purpose of cross-validation?Cross-validation is used to assess how the results of a statistical analysis will generalize to an independent dataset.
47Explain the concept of integration.Integration is the process of finding the accumulated area under a curve represented by a function.
48What is a scalar in linear algebra?A scalar is a single numerical value, often representing magnitude without direction.
49What is the difference between descriptive and inferential statistics?Descriptive statistics summarize data, while inferential statistics make predictions or inferences about a population based on sample data.
50What is recall in classification?Recall is the ratio of true positive predictions to the total actual positives, measuring the model's ability to identify relevant instances.
51What is the ROC curve?The ROC curve is a graphical representation of a classifier's performance across different thresholds, plotting true positive rate against false positive rate.