Statistical Analysis Link Limited

Everyone discusses machine learning, artificial intelligence, deep learning, and generative AI.

But we ignore the fundamentals of mathematics and statistics.

There was one quote on Twitter that says

“𝘞𝘩𝘦𝘯 𝘺𝘰𝘶’𝘳𝘦 𝘧𝘶𝘯𝘥𝘳𝘢𝘪𝘴𝘪𝘯𝘨, 𝘪𝘵’𝘴 𝘈𝘐. 𝘞𝘩𝘦𝘯 𝘺𝘰𝘶’𝘳𝘦 𝘩𝘪𝘳𝘪𝘯𝘨, 𝘪𝘵’𝘴 𝘔𝘓. 𝘞𝘩𝘦𝘯 𝘺𝘰𝘶’𝘳𝘦 𝘪𝘮𝘱𝘭𝘦𝘮𝘦𝘯𝘵𝘪𝘯𝘨, 𝘪𝘵’𝘴 𝘭𝘰𝘨𝘪𝘴𝘵𝘪𝘤 𝘳𝘦𝘨𝘳𝘦𝘴𝘴𝘪𝘰𝘯.”

Many machine learning algorithms would require a background in statistics and probability. Without it, your model wouldn’t know what to do with data.

You don’t need to be a statistics expert to learn ML, but to understand it makes a big difference.

It helps:

* Asking questions about data
* Cleaning and preprocessing data
* Selecting the right features
* Model evaluation
* Model prediction

When dealing with large datasets, it helps to summarise and simplify complex patterns, so we can actually make sense of them.

Bootstrapping is a powerful statistical method used to estimate the distribution of a statistic by resampling with replacement from a single sample.

It allows you to make inferences about a population even when you have limited data.

Challenges:
❌ Computational Cost: Can be resource-intensive as it involves multiple resampling iterations.
❌ Bias: Results can be biased if the initial sample is not representative of the population.
❌ Variance: High variance in estimates can occur, especially with small sample sizes.

Advantages:
✔️ Versatility: Bootstrapping can be applied to a wide range of statistics and is especially useful when the theoretical distribution is unknown.
✔️ No Assumptions Needed: It doesn’t require assumptions about the shape of the population distribution.
✔️ Robustness: Provides reliable estimates even with small sample sizes.

In practice, bootstrapping can be implemented in



bootstrap r(p50), reps(1000): summarize var, detail

bootstrap r(ratio), reps(1000) seed(4567): myratio

This means that we will execute bootstrap with our myratio program for 1,000 replications and specify a random-number seed so you can reproduce.

The visualization illustrates how a sample is used to generate resamples (orange) through bootstrapping. Points that appear multiple times in the resamples are highlighted in red. This process helps in estimating the distribution of a statistic by examining the histogram of the resampled statistics.

Statistics isn't just about numbers—it's about making sense of data and drawing meaningful conclusions.

These are some key concepts that shape our understanding:

➡️ Correlation: Not everything that moves together is connected! Correlation shows a relationship between variables, but correlation ≠ causation. Always dig deeper before jumping to conclusions.

➡️ P-Value: This is your tool for significance. A small p-value (usually