hypothesis seven steps

• Statistics And Probability
• Probability

Seven Steps in Hypothesis Testing

Related documents

Add this document to collection(s)

You can add this document to your study collection(s)

Add this document to saved

You can add this document to your saved list

Suggest us how to improve StudyLib

(For complaints, use another form )

Input it if you want to receive answer

Hypothesis Testing Procedure

Mastering hypothesis testing | cfa level i quantitative methods.

In this lesson, we’ll dive into the world of hypothesis testing, an essential method in inferential statistics . By the end of this lesson, you’ll have a thorough understanding of the hypothesis testing process, complete with a real-world example to help you grasp the concepts. So, buckle up, and let’s get started!

Understanding Hypothesis Testing

While estimation focuses on building confidence intervals around point estimates, hypothesis testing revolves around assessing a statement or idea regarding a population . The process can be broken down into 7 steps :

• State the hypothesis.
• Identify the appropriate test statistic and its probability distribution.
• Specify the significance level .
• State the decision rule.
• Collect the data and calculate the test statistic .
• Make the statistical decision.
• Make the economic decision.

Let’s explore each step in detail:

Step 1: State the Hypothesis

First and foremost, we need to state two hypotheses: the null hypothesis (H 0 ) and the alternative hypothesis (H A ) . The null hypothesis is the one we’re testing, while the alternative hypothesis is accepted when the null hypothesis is rejected.

We can formulate the hypotheses in three ways, depending on the population parameter (θ) in relation to a possible value (θ 0 ):

• Null: θ = θ 0 ; Alternative: θ ≠ θ 0
• Null: θ ≤ θ 0 ; Alternative: θ > θ 0
• Null: θ ≥ θ 0 ; Alternative: θ < θ 0

Consider the alternative hypothesis as the one you suspect to be true or wish to prove. To prove it, you need to reject the null hypothesis .

Suppose you suspect a mutual fund ’s performance beats the benchmark. θ represents the performance difference between the fund and the benchmark. You want to prove that θ > 0, so you make it your alternative hypothesis H A . The null hypothesis H 0 is its complement, θ ≤ 0.

Step 2: Identify the Test Statistic and Its Probability Distribution

The test statistic is the basis for rejecting the null hypothesis . Its general form is calculated as:

( Sample Statistic – H 0 Value) / Standard Error of the Sample Statistic

Now, we need to determine the test statistic ’s probability distribution. In the curriculum, we’ll discuss four distributions: z, t, chi-square, and F-distribution. For now, let’s use the t-distribution. In our example, we collect 30 random observations of the mutual fund ’s outperformance data. The degrees of freedom, in our example, are 30 – 1 = 29.

Step 3: Specify the Significance Level

Since hypothesis testing involves making inferences from sample statistics, there’s always a chance of error. There are two types of errors:

• Type 1 error : Rejecting the null hypothesis when it is actually true.
• Type 2 error : Failing to reject the null hypothesis when it is actually false.

The significance level (α) is the probability of making a Type 1 error, while the probability of making a Type 2 error is denoted by β. It’s challenging to quantify β, so we won’t cover it in this lesson. The power of a test is the probability of correctly rejecting a null hypothesis .

Ideally, we want to minimize both types of errors. However, there’s a trade-off between them. Decreasing α increases the probability of Type 2 error. The only way to decrease both errors is to increase the sample size. Due to the central limit theorem , the standard error of the sampling distribution decreases as the sample size increases.

In our example, we’ll set a moderate significance level of ⍺=5%.

Step 4: State the Decision Rule

The decision rule involves determining whether the test statistic is extreme enough to fall outside the critical values. If it does, the result is statistically significant, and we reject the null hypothesis .

For our example, we perform a one-tailed test on the right tail of the distribution. Based on the null hypothesis , we expect the sample mean to be near or less than zero. If the test statistic falls within this region, it’s statistically insignificant. However, if it falls in the right tail, it’s statistically significant, and we reject the null hypothesis .

Using a t-distribution with 29 degrees of freedom, we find a critical value of 1.699 for a one-tail level of 0.05. We reject the null hypothesis if the test statistic is greater than 1.699.

Step 5: Collect Data and Calculate Test Statistic

It’s crucial to ensure the quality of the sample to minimize the probability of flawed conclusions. Make sure the data is free from measurement errors and biases in sample selection. Be aware of time period bias and the effect of starting and ending dates on the conclusions drawn from the sample .

In our example, we collect 30 random observations of the mutual fund ’s outperformance data. We find that the sample mean is 4.5% with a standard deviation of 12%. Thus, the test statistic is calculated to be 2.05.

Step 6: Make the Statistical Decision

In our example, the test statistic falls within the rejection region (t > 1.699), so we reject the null hypothesis . We conclude that the mutual fund does outperform the benchmark at a 5% significance level .

Step 7: Make the Economic Decision

Statistical significance doesn’t always imply economic significance. An analyst should consider other factors to determine if the strategy is economically advantageous. In the end, always remember to weigh the statistical findings with real-world context and implications before making a final decision.

Hypothesis Testing in Investment Decision Making

Earlier, we determined that statistically, the mutual fund does indeed outperform the benchmark. But does that mean an investor should buy the mutual fund instead of the index fund? Before we can answer this, we should consider other factors.

Key Factors to Consider

Let’s examine the following factors:

• Cost: Manager, advisory, transaction, and brokerage fees can add up. Sometimes, these fees can erode the outperformance of the mutual fund .
• Taxes: Factor in additional taxes that may be imposed, based on the investor’s tax regime.
• Risk: The mutual fund ’s outperformance might be due to the manager taking on higher risk than the benchmark. Determine if this outperformance is worth pursuing, considering the investor’s risk profile.

Alternative Approach: The p-value Method

Before we end this lesson, let’s discuss an alternative approach to the critical value approach. We call this the p-value method .

The p-value is the smallest level of significance for which the null hypothesis can be rejected. In our example, we found our test statistic to be 2.05. From a t-distribution table, we find the corresponding p-value to be 2.5%.

The p-value method allows the reader to make their own conclusions about the significance of the results, rather than setting a specific rejection criteria.

Significance Levels and False Positives

The significance level (α) of a test represents the probability of a Type 1 error, or a false positive. If we perform a single test with a significance level of 5%, the likelihood of a false positive is 5%.

However, conducting multiple tests and comparing the number of significant results to the significance level can be misleading. Instead, we should adjust the significance level for each test using the following formula:

Adjusted Significance Level = (Rank of P-Value) × ( Significance Level / Number of Tests)

For example, let’s say we test the hypothesis that the excess return of a mutual fund is significantly greater than zero for 50 different funds. We rank the p-values from lowest to highest and calculate the adjusted significance levels. If only one test has a p-value lower than its adjusted significance level , we fail to reject the null hypothesis at the 5% level.

And that’s all for this lesson! We’ll be going through more examples on hypothesis testing in the coming lessons. See you soon!

✨ Visual Learning Unleashed! ✨ [Premium]

Elevate your learning with our captivating animation video—exclusive to Premium members! Watch this lesson in much more detail with vivid visuals that enhance understanding and make lessons truly come alive. 🎬

Unlock the power of visual learning—upgrade to Premium and click the link NOW! 🌟

Hey visitor,

Are you a CFA Level I candidate, or someone who is exploring taking the CFA exam? Four years ago, I was in your shoes. I am a Computer Engineering graduate and have been working as an engineer all my life. Having developed a keen interest in finance, I decided on a career switch to the finance field and enrolled into the CFA program at the same time.

Was it tough? You bet!

Adjusting to the drastic career change was tough. I naturally neglected the preparation for my Level I exam in June 2014. It was not until the middle of March 2014 that I realized I only had a little more than 2 months to the exam. To compound my problems, I basically did not have a preparation strategy. Having no background in finance at all, I tried very hard to read the curriculum from cover to cover, but eventually that fell flat. I can still recall the number of times I dozed off while studying, or just going back and forth trying to understand even the simplest concept. My mind simply could not keep up after a hard day at work.

Does all these sound familiar to you? Well, take heart. No matter how bleak it seems, at least sit for the exam and treat it as a learning experience. That was basically my attitude as I burrowed through my exam prep with toil and stress. By God’s grace, I did pass my Level I exam in June 2014. It was an experience I would not want to revisit though.

Tweaking the approach

For the Level II exam, I endeavoured not to repeat the mistakes I made. Based on the Pareto 80/20 principle, I learnt to extract the most essential bits from the curriculum enough to give me that 80% result to pass. Being a visual learner, I took notes and summaries in pictorial form. Instead of reserving huge segments of time to study, I carved out pockets of time to learn and practise – accommodating to my full-time job. I managed to pass my Level II and Level III exams consecutively with considerably less effort and stress than when I did my level I.

Why PrepNuggets?

I love the CFA Program and truly value the skills and ethics that are imparted to make me a better finance professional. My desire is to help candidates who are keen to pursue this path to do so in the most effective and painless process as possible – based on the lessons that I learnt as a candidate. I have set up PrepNuggets with the vision to revolutionise learning by using technology, catering to the short attention span that we can afford. If this makes sense to you, join the PrepNuggets community by signing up for your free student account. I am confident that the materials that we have laboriously crafted will bring you closer to that dream pass with just that 20% effort. Let us do the hard work for you.

Keith Tan, CFA Founder and Chief Instructor PrepNuggets

About the Author

PrepNuggets

Keith is the founder and chief instructor of PrepNuggets. He has a wide range of interests in all things related to tech, from web development to e-learning, gadgets to apps. Keith loves exploring different cultures and the untouched gems around the world. He currently lives in Singapore but frequently travels to share his knowledge and expertise with others.

Please note that while we offer a full refund, a small 5% processing fee is applied to cover non-refundable transaction fees initially absorbed by us to facilitate your purchase.

Have you ever gotten stuck in your study because you can’t remember a formula, or what a specific term means? Now, say goodbye to scanning through all the videos and ploughing through pages and pages just to find what you are looking for. All the important formulas, definitions and diagrams you need for the exam are now at your fingertips at prepnuggets.com/glossary .

What’s more, these quick references are deeply integrated in our lessons, so you get a good idea of what the lesson covers even before watching the video. The references also point you to specific video lessons where it is covered, so you can quickly access the corresponding video to learn more about the term.

Available now for all Level I topics ,  this service is exclusive for our Premium and Pro members only. We will progressively add the rest of the topic areas over the next few months.

We think this is a game-changer for your CFA success!

On the 1st of March 2018, we took a bold step of faith to put our Financial Reporting and Analysis (FRA) course on Udemy.

For those of you who are new to Udemy, it is the world’s largest marketplace for online courses. Think of it like the EBay of online courses.

So imagine our trepidation in pitting our course in this highly competitive platform, against the many CFA prep providers already entrenched on the platform.


Overwhelming.

Yes, that’s the word that aptly describes the response to our course from the Udemy community.

“Best Seller” Tag

The “Best Seller” tag from Udemy is attached to only one best selling course in its category. In just 1 month, our FRA course became the best selling CFA course on the platform. If you do a search for ‘CFA Level 1’, our course comes out on top in the search rankings.

Global Reach

Since the launch on 1 March, we have had more than 250 paid enrolments. While we are heartened by this figure, nothing beats knowing that our course has reached 50 countries around the world! It was simply heartwarming to receive messages from students from countries we barely know about, telling us how much they love the course and their wish that we would produce more of such courses. This certainly spurs us on to produce more materials to ease the burden of CFA candidates worldwide.

Awesome Ratings

Moving Forward

We are working hard to bring more of our courses to Udemy! We realise some candidates prefer to purchase courses as they need individually, so we endeavour to give more options to our potential students. Check out our Udemy Courses Page to find out which of our courses are available on Udemy for your purchase.

Special Offer for Udemy Students

If you have purchased our course on Udemy and would like to continue with the PrepNuggets study approach for other topics, we have an awesome upgrade offer to Premium membership for you !

[theme-my-login show_reg_link=”0″]

[theme-my-login default_action=”register” show_title=”false”]

Username or Email Address

Remember Me